2023-07-21T07:15:16.906 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T07:15:16.907 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-07-21_06:30:09-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7346414 --owner scheduled_vshankar@teuthology --name vshankar-2023-07-21_06:30:09-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --verbose -- /home/teuthworker/archive/vshankar-2023-07-21_06:30:09-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7346414/orig.config.yaml 2023-07-21T07:15:16.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T07:15:22.056 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-07-21_06:30:09-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7346414 branch: wip-vshankar-testing-20230720.042515 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: vshankar@redhat.com first_in_suite: false job_id: '7346414' kernel: client: sha1: distro flavor: default kdb: true sha1: c685da6f56cc77f2cfb9c4221be3960522616caf ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-07-21_06:30:09-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing-20230720.042515 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230720.042515 sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 632 sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 sleep_before_teardown: 0 subset: 14/1024 suite: fs suite_branch: wip-vshankar-testing-20230720.042515 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e2c50893bf78471cc8ee960317cc10390300dfd5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi086.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 79491cb69dd37a1eafb93b3471998174bdfa2fd9 timestamp: 2023-07-21_06:30:09 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-21T07:15:22.057 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e2c50893bf78471cc8ee960317cc10390300dfd5/qa; will attempt to use it 2023-07-21T07:15:22.058 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e2c50893bf78471cc8ee960317cc10390300dfd5/qa/tasks 2023-07-21T07:15:22.058 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-21T07:15:22.060 INFO:teuthology.task.internal:Checking packages... 2023-07-21T07:15:22.088 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'e2c50893bf78471cc8ee960317cc10390300dfd5' 2023-07-21T07:15:22.088 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-21T07:15:22.089 INFO:teuthology.packaging:ref: None 2023-07-21T07:15:22.089 INFO:teuthology.packaging:tag: None 2023-07-21T07:15:22.089 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230720.042515 2023-07-21T07:15:22.089 INFO:teuthology.packaging:sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-21T07:15:22.090 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230720.042515 2023-07-21T07:15:22.793 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5042.ge2c50893 2023-07-21T07:15:22.794 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-21T07:15:22.801 INFO:teuthology.task.internal:no buildpackages task found 2023-07-21T07:15:22.801 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-21T07:15:22.823 INFO:teuthology.task.internal:Saving configuration 2023-07-21T07:15:22.845 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-21T07:15:22.853 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T07:15:27.887 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-21_06:30:09-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7346414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 07:08:26.273139', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-21T07:15:30.232 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-21_06:30:09-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7346414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 07:08:26.271395', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-21T07:15:30.232 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-21T07:15:30.241 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-07-21T07:15:30.242 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-07-21T07:15:30.242 INFO:teuthology.run_tasks:Running task console_log... 2023-07-21T07:15:30.330 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f39bdbc03a0>, signals=[15]) 2023-07-21T07:15:30.349 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-21T07:15:30.363 INFO:teuthology.task.internal:Opening connections... 2023-07-21T07:15:30.363 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T07:15:30.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T07:15:30.437 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2023-07-21T07:15:30.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T07:15:30.506 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-21T07:15:30.518 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-07-21T07:15:30.537 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-07-21T07:15:30.537 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-07-21T07:15:30.597 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T07:15:30.598 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T07:15:30.598 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-07-21T07:15:30.598 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-07-21T07:15:30.598 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6" 2023-07-21T07:15:30.598 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-07-21T07:15:30.598 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T07:15:30.598 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-07-21T07:15:30.599 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T07:15:30.599 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T07:15:30.599 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T07:15:30.599 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T07:15:30.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:15:30.599 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T07:15:30.599 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T07:15:30.599 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T07:15:30.600 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T07:15:30.600 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-07-21T07:15:45.637 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2023-07-21T07:15:45.671 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-07-21T07:15:45.692 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-07-21T07:15:45.730 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T07:15:45.730 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T07:15:45.730 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-07-21T07:15:45.730 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-07-21T07:15:45.730 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2023-07-21T07:15:45.731 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-07-21T07:15:45.731 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T07:15:45.731 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-07-21T07:15:45.731 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T07:15:45.731 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T07:15:45.731 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T07:15:45.731 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T07:15:45.732 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:15:45.732 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T07:15:45.732 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T07:15:45.732 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T07:15:45.732 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T07:15:45.732 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-07-21T07:15:46.053 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-21T07:15:46.070 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-21T07:15:46.081 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-21T07:15:46.081 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2023-07-21T07:15:46.084 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2023-07-21T07:15:46.103 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-21T07:15:46.111 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-21T07:15:46.111 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2023-07-21T07:15:46.144 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2023-07-21T07:15:46.191 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-21T07:15:46.251 INFO:teuthology.run_tasks:Running task kernel... 2023-07-21T07:15:46.273 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'} 2023-07-21T07:15:46.274 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}} 2023-07-21T07:15:46.274 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-07-21T07:15:46.274 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-21T07:15:46.275 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-21T07:15:46.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T07:15:46.294 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2023-07-21T07:15:46.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T07:15:46.295 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-07-21T07:15:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-21T07:15:46.353 INFO:teuthology.task.kernel:Running kernel on smithi086: 4.18.0-372.9.1.el8.x86_64 2023-07-21T07:15:46.354 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum install -y kernel 2023-07-21T07:15:46.354 INFO:teuthology.orchestra.run.smithi006.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-21T07:15:46.355 INFO:teuthology.task.kernel:Running kernel on smithi006: 4.18.0-372.9.1.el8.x86_64 2023-07-21T07:15:46.355 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2023-07-21T07:15:47.554 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-07-21T07:15:47.554 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-07-21T07:15:47.613 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-07-21T07:15:47.614 INFO:teuthology.orchestra.run.smithi086.stdout:Unable to read consumer identity 2023-07-21T07:15:49.479 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 5.3 kB/s | 3.5 kB 00:00 2023-07-21T07:15:49.549 INFO:teuthology.orchestra.run.smithi086.stdout:Copr repo for python3-asyncssh owned by ceph 5.6 kB/s | 3.5 kB 00:00 2023-07-21T07:15:52.055 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 16 MB 00:02 2023-07-21T07:15:55.647 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 542 kB/s | 24 kB 00:00 2023-07-21T07:15:56.308 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-21T07:15:56.360 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-07-21T07:15:56.362 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2023-07-21T07:15:56.362 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-07-21T07:15:56.496 DEBUG:teuthology.orchestra.run.smithi006:> echo no | sudo yum reinstall kernel || true 2023-07-21T07:15:56.845 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-07-21T07:15:56.846 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-07-21T07:15:57.116 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:02 ago on Fri 21 Jul 2023 07:15:55 AM UTC. 2023-07-21T07:15:57.158 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-21T07:15:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2023-07-21T07:15:57.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum reinstall -y kernel || true 2023-07-21T07:15:57.582 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-07-21T07:15:57.582 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-07-21T07:15:57.850 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:02 ago on Fri 21 Jul 2023 07:15:55 AM UTC. 2023-07-21T07:15:57.891 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-21T07:15:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2023-07-21T07:15:57.957 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2023-07-21T07:15:58.039 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-21T07:15:58.040 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-21T07:15:58.041 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-21T07:15:58.041 DEBUG:teuthology.parallel:result is None 2023-07-21T07:16:13.682 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 663 kB/s | 16 MB 00:24 2023-07-21T07:16:17.116 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 440 kB/s | 24 kB 00:00 2023-07-21T07:16:17.811 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-21T07:16:17.860 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2023-07-21T07:16:17.861 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2023-07-21T07:16:17.861 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2023-07-21T07:16:17.979 DEBUG:teuthology.orchestra.run.smithi086:> echo no | sudo yum reinstall kernel || true 2023-07-21T07:16:18.311 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-07-21T07:16:18.312 INFO:teuthology.orchestra.run.smithi086.stdout:Unable to read consumer identity 2023-07-21T07:16:18.567 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:01 ago on Fri 21 Jul 2023 07:16:17 AM UTC. 2023-07-21T07:16:18.608 INFO:teuthology.orchestra.run.smithi086.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-21T07:16:18.643 INFO:teuthology.orchestra.run.smithi086.stderr:Error: No packages marked for reinstall. 2023-07-21T07:16:18.689 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum reinstall -y kernel || true 2023-07-21T07:16:19.018 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-07-21T07:16:19.018 INFO:teuthology.orchestra.run.smithi086.stdout:Unable to read consumer identity 2023-07-21T07:16:19.271 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:02 ago on Fri 21 Jul 2023 07:16:17 AM UTC. 2023-07-21T07:16:19.310 INFO:teuthology.orchestra.run.smithi086.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-21T07:16:19.352 INFO:teuthology.orchestra.run.smithi086.stderr:Error: No packages marked for reinstall. 2023-07-21T07:16:19.397 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q kernel | sort -rV | head -n 1 2023-07-21T07:16:19.477 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-21T07:16:19.477 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-21T07:16:19.477 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-21T07:16:19.478 DEBUG:teuthology.parallel:result is None 2023-07-21T07:16:19.478 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-21T07:16:19.485 INFO:teuthology.task.internal:Creating test directory... 2023-07-21T07:16:19.486 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-21T07:16:19.488 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-21T07:16:19.506 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-21T07:16:19.513 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-21T07:16:19.533 INFO:teuthology.task.internal:Creating archive directory... 2023-07-21T07:16:19.533 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-21T07:16:19.549 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-21T07:16:19.579 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-21T07:16:19.591 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-21T07:16:19.591 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-21T07:16:19.616 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-21T07:16:19.646 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T07:16:19.653 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T07:16:19.665 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T07:16:19.672 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T07:16:19.674 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-21T07:16:19.682 INFO:teuthology.task.internal:Configuring sudo... 2023-07-21T07:16:19.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-21T07:16:19.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-21T07:16:19.745 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-21T07:16:19.756 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-21T07:16:19.756 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-21T07:16:19.789 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-21T07:16:19.805 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T07:16:24.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T07:16:24.931 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T07:16:27.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T07:16:27.851 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:16:27.852 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-21T07:16:27.923 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T07:16:32.973 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T07:16:33.016 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T07:16:38.112 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T07:16:38.144 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:16:38.144 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-21T07:16:38.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2023-07-21T07:16:38.217 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2023-07-21T07:16:38.283 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-21T07:16:38.316 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-21T07:16:38.628 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-21T07:16:38.636 INFO:teuthology.task.internal:Starting timer... 2023-07-21T07:16:38.636 INFO:teuthology.run_tasks:Running task pcp... 2023-07-21T07:16:38.662 INFO:teuthology.run_tasks:Running task selinux... 2023-07-21T07:16:38.674 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-21T07:16:38.675 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2023-07-21T07:16:38.740 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2023-07-21T07:16:38.742 DEBUG:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2023-07-21T07:16:38.796 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: 2023-07-21T07:16:38.798 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-21T07:16:38.798 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2023-07-21T07:16:38.822 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2023-07-21T07:16:38.822 DEBUG:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2023-07-21T07:16:38.845 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2023-07-21T07:16:38.845 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi086.front.sepia.ceph.com': 'permissive'} 2023-07-21T07:16:38.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-21T07:16:38.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T07:16:38.890 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-21T07:16:38.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T07:16:38.917 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-21T07:16:38.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2023-07-21T07:16:38.957 DEBUG:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2023-07-21T07:16:38.985 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-21T07:16:38.994 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-21T07:16:38.995 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-21T07:16:39.015 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-21T07:16:39.017 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi086.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-21T07:28:49.733 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi086.front.sepia.ceph.com')] 2023-07-21T07:28:49.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-21T07:28:49.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T07:28:49.805 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-07-21T07:28:49.830 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-21T07:28:49.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-07-21T07:28:49.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T07:28:49.897 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-07-21T07:28:49.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-07-21T07:28:49.967 INFO:teuthology.run_tasks:Running task clock... 2023-07-21T07:28:49.980 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-21T07:28:49.981 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-21T07:28:49.981 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T07:28:49.984 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-21T07:28:49.985 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T07:28:50.015 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-21T07:28:50.031 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-21T07:28:50.039 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-21T07:28:50.054 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-21T07:28:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2023-07-21T07:28:50.121 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2023-07-21T07:28:50.131 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2023-07-21T07:28:50.135 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-21T07:28:50.143 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2023-07-21T07:28:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-21T07:28:50.158 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-21T07:28:50.172 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-21T07:28:50.228 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2023-07-21T07:28:50.231 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-21T07:28:50.231 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-07-21T07:28:50.232 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T07:28:50.232 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T07:28:50.232 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T07:28:50.233 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T07:28:50.246 INFO:teuthology.orchestra.run.smithi086.stderr:bash: ntpq: command not found 2023-07-21T07:28:50.249 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-21T07:28:50.249 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2023-07-21T07:28:50.249 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T07:28:50.250 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T07:28:50.250 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T07:28:50.250 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T07:28:50.251 INFO:teuthology.run_tasks:Running task install... 2023-07-21T07:28:50.259 DEBUG:teuthology.task.install:project ceph 2023-07-21T07:28:50.260 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}} 2023-07-21T07:28:50.260 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'} 2023-07-21T07:28:50.260 INFO:teuthology.task.install:Using flavor: default 2023-07-21T07:28:50.268 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-21T07:28:50.268 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-21T07:28:50.269 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5', 'tag': None, 'wait_for_package': False} 2023-07-21T07:28:50.269 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-21T07:28:50.271 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5', 'tag': None, 'wait_for_package': False} 2023-07-21T07:28:50.271 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-21T07:28:50.650 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/centos/8/flavors/default/ 2023-07-21T07:28:50.651 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5042.ge2c50893 2023-07-21T07:28:50.662 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/centos/8/flavors/default/ 2023-07-21T07:28:50.662 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5042.ge2c50893 2023-07-21T07:28:50.963 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-21T07:28:50.964 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:28:50.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-21T07:28:50.968 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-21T07:28:50.969 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:28:50.969 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-21T07:28:51.003 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-21T07:28:51.003 DEBUG:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2c50893bf78471cc8ee960317cc10390300dfd5/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-21T07:28:51.004 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-21T07:28:51.005 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2c50893bf78471cc8ee960317cc10390300dfd5/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-21T07:28:51.075 DEBUG:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-21T07:28:51.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-21T07:28:51.156 DEBUG:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-21T07:28:51.162 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-21T07:28:51.224 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2023-07-21T07:28:51.225 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum clean all 2023-07-21T07:28:51.231 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2023-07-21T07:28:51.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2023-07-21T07:28:51.596 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-07-21T07:28:51.627 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-07-21T07:28:51.872 INFO:teuthology.orchestra.run.smithi086.stdout:44 files removed 2023-07-21T07:28:51.907 INFO:teuthology.orchestra.run.smithi006.stdout:44 files removed 2023-07-21T07:28:51.918 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-21T07:28:51.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-21T07:28:52.249 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-07-21T07:28:52.305 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-07-21T07:28:53.330 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 117 kB/s | 81 kB 00:00 2023-07-21T07:28:53.399 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 120 kB/s | 81 kB 00:00 2023-07-21T07:28:53.956 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 16 kB/s | 9.4 kB 00:00 2023-07-21T07:28:54.242 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 12 kB/s | 9.4 kB 00:00 2023-07-21T07:28:54.590 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 2.4 kB/s | 1.5 kB 00:00 2023-07-21T07:28:54.851 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 2.5 kB/s | 1.5 kB 00:00 2023-07-21T07:28:54.974 INFO:teuthology.orchestra.run.smithi086.stdout:Copr repo for python3-asyncssh owned by ceph 9.5 kB/s | 3.5 kB 00:00 2023-07-21T07:28:55.193 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-07-21T07:28:56.707 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 16 MB 00:01 2023-07-21T07:28:57.111 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 8.2 MB/s | 16 MB 00:01 2023-07-21T07:29:00.157 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 405 kB/s | 24 kB 00:00 2023-07-21T07:29:00.719 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 591 kB/s | 24 kB 00:00 2023-07-21T07:29:01.068 INFO:teuthology.orchestra.run.smithi086.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-07-21T07:29:01.696 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-07-21T07:29:08.935 INFO:teuthology.orchestra.run.smithi086.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 MB/s | 53 MB 00:00 2023-07-21T07:29:10.356 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 52 MB/s | 47 MB 00:00 2023-07-21T07:29:20.026 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-21T07:29:20.028 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-21T07:29:20.042 INFO:teuthology.orchestra.run.smithi086.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-21T07:29:20.043 INFO:teuthology.orchestra.run.smithi086.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-21T07:29:20.044 INFO:teuthology.orchestra.run.smithi086.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-21T07:29:20.045 INFO:teuthology.orchestra.run.smithi086.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-21T07:29:20.047 INFO:teuthology.orchestra.run.smithi086.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-21T07:29:20.050 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-21T07:29:20.051 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-21T07:29:20.182 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2023-07-21T07:29:20.194 INFO:teuthology.orchestra.run.smithi086.stdout:=========================================================================================================================== 2023-07-21T07:29:20.194 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2023-07-21T07:29:20.194 INFO:teuthology.orchestra.run.smithi086.stdout:=========================================================================================================================== 2023-07-21T07:29:20.195 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2023-07-21T07:29:20.195 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-21T07:29:20.195 INFO:teuthology.orchestra.run.smithi086.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-21T07:29:20.195 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 6.4 k 2023-07-21T07:29:20.195 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 5.4 M 2023-07-21T07:29:20.196 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 849 k 2023-07-21T07:29:20.196 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 167 k 2023-07-21T07:29:20.196 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 1.6 M 2023-07-21T07:29:20.196 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 129 k 2023-07-21T07:29:20.197 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 1.7 M 2023-07-21T07:29:20.197 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 7.4 M 2023-07-21T07:29:20.198 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 47 k 2023-07-21T07:29:20.198 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 14 M 2023-07-21T07:29:20.198 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 48 M 2023-07-21T07:29:20.198 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 258 k 2023-07-21T07:29:20.198 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 168 k 2023-07-21T07:29:20.198 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 260 k 2023-07-21T07:29:20.198 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 18 k 2023-07-21T07:29:20.199 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-21T07:29:20.199 INFO:teuthology.orchestra.run.smithi086.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-21T07:29:20.199 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-21T07:29:20.199 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 31 k 2023-07-21T07:29:20.200 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 773 k 2023-07-21T07:29:20.200 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 139 k 2023-07-21T07:29:20.200 INFO:teuthology.orchestra.run.smithi086.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-21T07:29:20.200 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-21T07:29:20.200 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-21T07:29:20.201 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-21T07:29:20.201 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-21T07:29:20.201 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-21T07:29:20.201 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 197 k 2023-07-21T07:29:20.201 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 371 k 2023-07-21T07:29:20.201 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 364 k 2023-07-21T07:29:20.201 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 107 k 2023-07-21T07:29:20.202 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 94 k 2023-07-21T07:29:20.202 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 3.5 M 2023-07-21T07:29:20.202 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 179 k 2023-07-21T07:29:20.202 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-21T07:29:20.202 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2023-07-21T07:29:20.202 INFO:teuthology.orchestra.run.smithi086.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-21T07:29:20.202 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 3.7 M 2023-07-21T07:29:20.203 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 3.6 M 2023-07-21T07:29:20.203 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2023-07-21T07:29:20.203 INFO:teuthology.orchestra.run.smithi086.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-21T07:29:20.203 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 22 M 2023-07-21T07:29:20.203 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 23 k 2023-07-21T07:29:20.203 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 2.3 M 2023-07-21T07:29:20.204 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 241 k 2023-07-21T07:29:20.204 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 4.6 M 2023-07-21T07:29:20.204 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 18 M 2023-07-21T07:29:20.204 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 15 k 2023-07-21T07:29:20.204 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 24 k 2023-07-21T07:29:20.204 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-21T07:29:20.204 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-21T07:29:20.205 INFO:teuthology.orchestra.run.smithi086.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-21T07:29:20.205 INFO:teuthology.orchestra.run.smithi086.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-21T07:29:20.205 INFO:teuthology.orchestra.run.smithi086.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-21T07:29:20.205 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 139 k 2023-07-21T07:29:20.205 INFO:teuthology.orchestra.run.smithi086.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-21T07:29:20.205 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-21T07:29:20.205 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-21T07:29:20.206 INFO:teuthology.orchestra.run.smithi086.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-21T07:29:20.206 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-21T07:29:20.206 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-21T07:29:20.206 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 472 k 2023-07-21T07:29:20.206 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-21T07:29:20.206 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 6.8 M 2023-07-21T07:29:20.206 INFO:teuthology.orchestra.run.smithi086.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-21T07:29:20.207 INFO:teuthology.orchestra.run.smithi086.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-21T07:29:20.207 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-21T07:29:20.207 INFO:teuthology.orchestra.run.smithi086.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-21T07:29:20.207 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-21T07:29:20.207 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-21T07:29:20.207 INFO:teuthology.orchestra.run.smithi086.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-21T07:29:20.207 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-21T07:29:20.208 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-21T07:29:20.208 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-21T07:29:20.208 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-21T07:29:20.208 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-21T07:29:20.208 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-21T07:29:20.208 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-21T07:29:20.208 INFO:teuthology.orchestra.run.smithi086.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-21T07:29:20.209 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-21T07:29:20.209 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 45 k 2023-07-21T07:29:20.209 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 122 k 2023-07-21T07:29:20.209 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-21T07:29:20.210 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-21T07:29:20.210 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-21T07:29:20.210 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-21T07:29:20.210 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-21T07:29:20.210 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-21T07:29:20.211 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-21T07:29:20.211 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-21T07:29:20.211 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-21T07:29:20.211 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-21T07:29:20.212 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-21T07:29:20.212 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-21T07:29:20.212 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-21T07:29:20.212 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-21T07:29:20.212 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-21T07:29:20.212 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-21T07:29:20.213 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-21T07:29:20.213 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-21T07:29:20.213 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-21T07:29:20.213 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-21T07:29:20.213 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-21T07:29:20.213 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-21T07:29:20.213 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-21T07:29:20.214 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-21T07:29:20.214 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-21T07:29:20.214 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-21T07:29:20.214 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-21T07:29:20.214 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-21T07:29:20.214 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-21T07:29:20.214 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-21T07:29:20.215 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-21T07:29:20.215 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-21T07:29:20.215 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-21T07:29:20.215 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-21T07:29:20.215 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-21T07:29:20.215 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-21T07:29:20.215 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-21T07:29:20.216 INFO:teuthology.orchestra.run.smithi086.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-21T07:29:20.216 INFO:teuthology.orchestra.run.smithi086.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-21T07:29:20.216 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-21T07:29:20.216 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-21T07:29:20.216 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-21T07:29:20.216 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-21T07:29:20.216 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-21T07:29:20.217 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-21T07:29:20.217 INFO:teuthology.orchestra.run.smithi086.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-21T07:29:20.217 INFO:teuthology.orchestra.run.smithi086.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-21T07:29:20.217 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-21T07:29:20.217 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-21T07:29:20.217 INFO:teuthology.orchestra.run.smithi086.stdout:Enabling module streams: 2023-07-21T07:29:20.217 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql 10 2023-07-21T07:29:20.218 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:29:20.218 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2023-07-21T07:29:20.218 INFO:teuthology.orchestra.run.smithi086.stdout:=========================================================================================================================== 2023-07-21T07:29:20.218 INFO:teuthology.orchestra.run.smithi086.stdout:Install 128 Packages 2023-07-21T07:29:20.218 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 3 Packages 2023-07-21T07:29:20.218 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:29:20.219 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 206 M 2023-07-21T07:29:20.219 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2023-07-21T07:29:20.721 INFO:teuthology.orchestra.run.smithi086.stdout:(1/131): ceph-18.0.0-5042.ge2c50893.el8.x86_64. 13 kB/s | 6.4 kB 00:00 2023-07-21T07:29:22.023 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-21T07:29:22.025 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-21T07:29:22.040 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-21T07:29:22.041 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-21T07:29:22.042 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-21T07:29:22.043 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-21T07:29:22.046 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-21T07:29:22.049 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-21T07:29:22.050 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-21T07:29:22.195 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-07-21T07:29:22.208 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2023-07-21T07:29:22.209 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2023-07-21T07:29:22.209 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2023-07-21T07:29:22.209 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2023-07-21T07:29:22.209 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-21T07:29:22.209 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-21T07:29:22.209 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 6.4 k 2023-07-21T07:29:22.210 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 5.4 M 2023-07-21T07:29:22.210 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 849 k 2023-07-21T07:29:22.210 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 167 k 2023-07-21T07:29:22.210 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 1.6 M 2023-07-21T07:29:22.210 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 129 k 2023-07-21T07:29:22.210 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 1.7 M 2023-07-21T07:29:22.211 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 7.4 M 2023-07-21T07:29:22.211 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 47 k 2023-07-21T07:29:22.211 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 14 M 2023-07-21T07:29:22.211 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 48 M 2023-07-21T07:29:22.211 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 258 k 2023-07-21T07:29:22.211 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 168 k 2023-07-21T07:29:22.212 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 260 k 2023-07-21T07:29:22.212 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 18 k 2023-07-21T07:29:22.212 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-21T07:29:22.212 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-21T07:29:22.212 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-21T07:29:22.213 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 31 k 2023-07-21T07:29:22.213 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 773 k 2023-07-21T07:29:22.213 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 139 k 2023-07-21T07:29:22.213 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-21T07:29:22.213 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-21T07:29:22.213 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-21T07:29:22.214 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-21T07:29:22.214 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-21T07:29:22.214 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-21T07:29:22.214 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 197 k 2023-07-21T07:29:22.214 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 371 k 2023-07-21T07:29:22.214 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 364 k 2023-07-21T07:29:22.215 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 107 k 2023-07-21T07:29:22.215 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 94 k 2023-07-21T07:29:22.215 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 3.5 M 2023-07-21T07:29:22.215 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 179 k 2023-07-21T07:29:22.215 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-21T07:29:22.215 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2023-07-21T07:29:22.215 INFO:teuthology.orchestra.run.smithi006.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-21T07:29:22.216 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 3.7 M 2023-07-21T07:29:22.216 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 3.6 M 2023-07-21T07:29:22.216 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2023-07-21T07:29:22.216 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-21T07:29:22.216 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 22 M 2023-07-21T07:29:22.217 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 23 k 2023-07-21T07:29:22.217 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 2.3 M 2023-07-21T07:29:22.217 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 241 k 2023-07-21T07:29:22.217 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 4.6 M 2023-07-21T07:29:22.217 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 18 M 2023-07-21T07:29:22.218 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5042.ge2c50893.el8 ceph-noarch 15 k 2023-07-21T07:29:22.218 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 24 k 2023-07-21T07:29:22.218 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-21T07:29:22.218 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-21T07:29:22.218 INFO:teuthology.orchestra.run.smithi006.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-21T07:29:22.218 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-21T07:29:22.219 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-21T07:29:22.219 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 139 k 2023-07-21T07:29:22.219 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-21T07:29:22.219 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-21T07:29:22.219 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-21T07:29:22.219 INFO:teuthology.orchestra.run.smithi006.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-21T07:29:22.220 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-21T07:29:22.220 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-21T07:29:22.220 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 472 k 2023-07-21T07:29:22.220 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-21T07:29:22.220 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 6.8 M 2023-07-21T07:29:22.221 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-21T07:29:22.221 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-21T07:29:22.221 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-21T07:29:22.221 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-21T07:29:22.221 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-21T07:29:22.221 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-21T07:29:22.221 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-21T07:29:22.222 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-21T07:29:22.222 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-21T07:29:22.222 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-21T07:29:22.222 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-21T07:29:22.222 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-21T07:29:22.222 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-21T07:29:22.223 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-21T07:29:22.223 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-21T07:29:22.223 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-21T07:29:22.223 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 45 k 2023-07-21T07:29:22.223 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:18.0.0-5042.ge2c50893.el8 ceph 122 k 2023-07-21T07:29:22.223 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-21T07:29:22.223 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-21T07:29:22.224 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-21T07:29:22.224 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-21T07:29:22.224 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-21T07:29:22.224 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-21T07:29:22.224 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-21T07:29:22.224 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-21T07:29:22.224 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-21T07:29:22.225 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-21T07:29:22.225 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-21T07:29:22.225 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-21T07:29:22.225 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-21T07:29:22.225 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-21T07:29:22.225 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-21T07:29:22.225 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-21T07:29:22.226 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-21T07:29:22.226 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-21T07:29:22.226 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-21T07:29:22.226 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-21T07:29:22.226 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-21T07:29:22.227 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-21T07:29:22.227 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-21T07:29:22.227 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-21T07:29:22.227 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-21T07:29:22.227 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-21T07:29:22.227 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-21T07:29:22.227 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-21T07:29:22.228 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-21T07:29:22.228 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-21T07:29:22.228 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-21T07:29:22.228 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-21T07:29:22.229 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-21T07:29:22.229 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-21T07:29:22.229 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-21T07:29:22.229 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-21T07:29:22.229 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-21T07:29:22.229 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-21T07:29:22.230 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-21T07:29:22.230 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-21T07:29:22.230 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-21T07:29:22.230 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-21T07:29:22.230 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-21T07:29:22.231 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-21T07:29:22.231 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-21T07:29:22.231 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-21T07:29:22.231 INFO:teuthology.orchestra.run.smithi006.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-21T07:29:22.231 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-21T07:29:22.231 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-21T07:29:22.232 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling module streams: 2023-07-21T07:29:22.232 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql 10 2023-07-21T07:29:22.232 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:29:22.232 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-07-21T07:29:22.232 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2023-07-21T07:29:22.232 INFO:teuthology.orchestra.run.smithi006.stdout:Install 128 Packages 2023-07-21T07:29:22.233 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 3 Packages 2023-07-21T07:29:22.233 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:29:22.233 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 206 M 2023-07-21T07:29:22.234 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2023-07-21T07:29:23.040 INFO:teuthology.orchestra.run.smithi006.stdout:(1/131): ceph-18.0.0-5042.ge2c50893.el8.x86_64. 11 kB/s | 6.4 kB 00:00 2023-07-21T07:29:24.779 INFO:teuthology.orchestra.run.smithi086.stdout:(2/131): ceph-fuse-18.0.0-5042.ge2c50893.el8.x8 209 kB/s | 849 kB 00:04 2023-07-21T07:29:25.137 INFO:teuthology.orchestra.run.smithi086.stdout:(3/131): ceph-immutable-object-cache-18.0.0-504 467 kB/s | 167 kB 00:00 2023-07-21T07:29:26.601 INFO:teuthology.orchestra.run.smithi006.stdout:(2/131): ceph-fuse-18.0.0-5042.ge2c50893.el8.x8 239 kB/s | 849 kB 00:03 2023-07-21T07:29:27.316 INFO:teuthology.orchestra.run.smithi006.stdout:(3/131): ceph-immutable-object-cache-18.0.0-504 234 kB/s | 167 kB 00:00 2023-07-21T07:29:30.589 INFO:teuthology.orchestra.run.smithi086.stdout:(4/131): ceph-mds-18.0.0-5042.ge2c50893.el8.x86 430 kB/s | 2.3 MB 00:05 2023-07-21T07:29:33.497 INFO:teuthology.orchestra.run.smithi086.stdout:(5/131): ceph-mgr-18.0.0-5042.ge2c50893.el8.x86 547 kB/s | 1.6 MB 00:02 2023-07-21T07:29:33.589 INFO:teuthology.orchestra.run.smithi086.stdout:(6/131): ceph-base-18.0.0-5042.ge2c50893.el8.x8 412 kB/s | 5.4 MB 00:13 2023-07-21T07:29:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:(4/131): ceph-mds-18.0.0-5042.ge2c50893.el8.x86 372 kB/s | 2.3 MB 00:06 2023-07-21T07:29:34.299 INFO:teuthology.orchestra.run.smithi006.stdout:(5/131): ceph-base-18.0.0-5042.ge2c50893.el8.x8 464 kB/s | 5.4 MB 00:11 2023-07-21T07:29:36.025 INFO:teuthology.orchestra.run.smithi006.stdout:(6/131): ceph-mgr-18.0.0-5042.ge2c50893.el8.x86 662 kB/s | 1.6 MB 00:02 2023-07-21T07:29:41.755 INFO:teuthology.orchestra.run.smithi086.stdout:(7/131): ceph-mon-18.0.0-5042.ge2c50893.el8.x86 571 kB/s | 4.6 MB 00:08 2023-07-21T07:29:42.408 INFO:teuthology.orchestra.run.smithi006.stdout:(7/131): ceph-mon-18.0.0-5042.ge2c50893.el8.x86 582 kB/s | 4.6 MB 00:08 2023-07-21T07:30:00.921 INFO:teuthology.orchestra.run.smithi086.stdout:(8/131): ceph-common-18.0.0-5042.ge2c50893.el8. 558 kB/s | 22 MB 00:40 2023-07-21T07:30:01.047 INFO:teuthology.orchestra.run.smithi086.stdout:(9/131): ceph-selinux-18.0.0-5042.ge2c50893.el8 195 kB/s | 24 kB 00:00 2023-07-21T07:30:03.191 INFO:teuthology.orchestra.run.smithi006.stdout:(8/131): ceph-common-18.0.0-5042.ge2c50893.el8. 557 kB/s | 22 MB 00:40 2023-07-21T07:30:03.307 INFO:teuthology.orchestra.run.smithi006.stdout:(9/131): ceph-selinux-18.0.0-5042.ge2c50893.el8 209 kB/s | 24 kB 00:00 2023-07-21T07:30:13.030 INFO:teuthology.orchestra.run.smithi086.stdout:(10/131): ceph-osd-18.0.0-5042.ge2c50893.el8.x8 461 kB/s | 18 MB 00:39 2023-07-21T07:30:13.863 INFO:teuthology.orchestra.run.smithi086.stdout:(11/131): cephfs-mirror-18.0.0-5042.ge2c50893.e 312 kB/s | 260 kB 00:00 2023-07-21T07:30:14.038 INFO:teuthology.orchestra.run.smithi086.stdout:(12/131): libcephfs-devel-18.0.0-5042.ge2c50893 177 kB/s | 31 kB 00:00 2023-07-21T07:30:14.240 INFO:teuthology.orchestra.run.smithi006.stdout:(10/131): ceph-osd-18.0.0-5042.ge2c50893.el8.x8 476 kB/s | 18 MB 00:38 2023-07-21T07:30:15.641 INFO:teuthology.orchestra.run.smithi006.stdout:(11/131): cephfs-mirror-18.0.0-5042.ge2c50893.e 186 kB/s | 260 kB 00:01 2023-07-21T07:30:15.774 INFO:teuthology.orchestra.run.smithi006.stdout:(12/131): libcephfs-devel-18.0.0-5042.ge2c50893 233 kB/s | 31 kB 00:00 2023-07-21T07:30:15.897 INFO:teuthology.orchestra.run.smithi086.stdout:(13/131): ceph-radosgw-18.0.0-5042.ge2c50893.el 406 kB/s | 14 MB 00:34 2023-07-21T07:30:16.022 INFO:teuthology.orchestra.run.smithi086.stdout:(14/131): libcephfs2-18.0.0-5042.ge2c50893.el8. 390 kB/s | 773 kB 00:01 2023-07-21T07:30:16.355 INFO:teuthology.orchestra.run.smithi086.stdout:(15/131): libcephsqlite-18.0.0-5042.ge2c50893.e 304 kB/s | 139 kB 00:00 2023-07-21T07:30:16.380 INFO:teuthology.orchestra.run.smithi086.stdout:(16/131): librados-devel-18.0.0-5042.ge2c50893. 388 kB/s | 139 kB 00:00 2023-07-21T07:30:16.399 INFO:teuthology.orchestra.run.smithi006.stdout:(13/131): ceph-radosgw-18.0.0-5042.ge2c50893.el 408 kB/s | 14 MB 00:33 2023-07-21T07:30:16.883 INFO:teuthology.orchestra.run.smithi006.stdout:(14/131): libcephsqlite-18.0.0-5042.ge2c50893.e 288 kB/s | 139 kB 00:00 2023-07-21T07:30:17.309 INFO:teuthology.orchestra.run.smithi006.stdout:(15/131): librados-devel-18.0.0-5042.ge2c50893. 327 kB/s | 139 kB 00:00 2023-07-21T07:30:17.672 INFO:teuthology.orchestra.run.smithi086.stdout:(17/131): libradosstriper1-18.0.0-5042.ge2c5089 359 kB/s | 472 kB 00:01 2023-07-21T07:30:17.881 INFO:teuthology.orchestra.run.smithi086.stdout:(18/131): python3-ceph-argparse-18.0.0-5042.ge2 215 kB/s | 45 kB 00:00 2023-07-21T07:30:17.975 INFO:teuthology.orchestra.run.smithi006.stdout:(16/131): libcephfs2-18.0.0-5042.ge2c50893.el8. 351 kB/s | 773 kB 00:02 2023-07-21T07:30:18.206 INFO:teuthology.orchestra.run.smithi086.stdout:(19/131): python3-ceph-common-18.0.0-5042.ge2c5 377 kB/s | 122 kB 00:00 2023-07-21T07:30:18.426 INFO:teuthology.orchestra.run.smithi006.stdout:(17/131): libradosstriper1-18.0.0-5042.ge2c5089 423 kB/s | 472 kB 00:01 2023-07-21T07:30:18.590 INFO:teuthology.orchestra.run.smithi086.stdout:(20/131): python3-cephfs-18.0.0-5042.ge2c50893. 514 kB/s | 197 kB 00:00 2023-07-21T07:30:18.618 INFO:teuthology.orchestra.run.smithi006.stdout:(18/131): python3-ceph-argparse-18.0.0-5042.ge2 233 kB/s | 45 kB 00:00 2023-07-21T07:30:18.893 INFO:teuthology.orchestra.run.smithi006.stdout:(19/131): python3-ceph-common-18.0.0-5042.ge2c5 446 kB/s | 122 kB 00:00 2023-07-21T07:30:19.260 INFO:teuthology.orchestra.run.smithi006.stdout:(20/131): python3-cephfs-18.0.0-5042.ge2c50893. 537 kB/s | 197 kB 00:00 2023-07-21T07:30:19.590 INFO:teuthology.orchestra.run.smithi086.stdout:(21/131): python3-rados-18.0.0-5042.ge2c50893.e 371 kB/s | 371 kB 00:00 2023-07-21T07:30:19.810 INFO:teuthology.orchestra.run.smithi006.stdout:(21/131): python3-rados-18.0.0-5042.ge2c50893.e 676 kB/s | 371 kB 00:00 2023-07-21T07:30:20.444 INFO:teuthology.orchestra.run.smithi006.stdout:(22/131): python3-rbd-18.0.0-5042.ge2c50893.el8 575 kB/s | 364 kB 00:00 2023-07-21T07:30:20.636 INFO:teuthology.orchestra.run.smithi006.stdout:(23/131): python3-rgw-18.0.0-5042.ge2c50893.el8 557 kB/s | 107 kB 00:00 2023-07-21T07:30:20.765 INFO:teuthology.orchestra.run.smithi086.stdout:(22/131): python3-rbd-18.0.0-5042.ge2c50893.el8 310 kB/s | 364 kB 00:01 2023-07-21T07:30:20.828 INFO:teuthology.orchestra.run.smithi006.stdout:(24/131): rbd-fuse-18.0.0-5042.ge2c50893.el8.x8 488 kB/s | 94 kB 00:00 2023-07-21T07:30:21.174 INFO:teuthology.orchestra.run.smithi086.stdout:(23/131): python3-rgw-18.0.0-5042.ge2c50893.el8 261 kB/s | 107 kB 00:00 2023-07-21T07:30:21.524 INFO:teuthology.orchestra.run.smithi086.stdout:(24/131): rbd-fuse-18.0.0-5042.ge2c50893.el8.x8 267 kB/s | 94 kB 00:00 2023-07-21T07:30:28.303 INFO:teuthology.orchestra.run.smithi006.stdout:(25/131): rbd-mirror-18.0.0-5042.ge2c50893.el8. 484 kB/s | 3.5 MB 00:07 2023-07-21T07:30:28.499 INFO:teuthology.orchestra.run.smithi086.stdout:(25/131): rbd-mirror-18.0.0-5042.ge2c50893.el8. 518 kB/s | 3.5 MB 00:06 2023-07-21T07:30:28.719 INFO:teuthology.orchestra.run.smithi006.stdout:(26/131): rbd-nbd-18.0.0-5042.ge2c50893.el8.x86 430 kB/s | 179 kB 00:00 2023-07-21T07:30:28.841 INFO:teuthology.orchestra.run.smithi086.stdout:(26/131): rbd-nbd-18.0.0-5042.ge2c50893.el8.x86 524 kB/s | 179 kB 00:00 2023-07-21T07:30:28.844 INFO:teuthology.orchestra.run.smithi006.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5042.g 184 kB/s | 23 kB 00:00 2023-07-21T07:30:28.991 INFO:teuthology.orchestra.run.smithi086.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5042.g 154 kB/s | 23 kB 00:00 2023-07-21T07:30:29.158 INFO:teuthology.orchestra.run.smithi086.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5042.ge2c5089 776 kB/s | 129 kB 00:00 2023-07-21T07:30:29.161 INFO:teuthology.orchestra.run.smithi006.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5042.ge2c5089 408 kB/s | 129 kB 00:00 2023-07-21T07:30:29.775 INFO:teuthology.orchestra.run.smithi086.stdout:(29/131): librgw2-18.0.0-5042.ge2c50893.el8.x86 518 kB/s | 6.8 MB 00:13 2023-07-21T07:30:31.292 INFO:teuthology.orchestra.run.smithi086.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5042.ge2c50 823 kB/s | 1.7 MB 00:02 2023-07-21T07:30:31.304 INFO:teuthology.orchestra.run.smithi006.stdout:(29/131): ceph-mgr-dashboard-18.0.0-5042.ge2c50 820 kB/s | 1.7 MB 00:02 2023-07-21T07:30:31.834 INFO:teuthology.orchestra.run.smithi086.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5042.ge2 445 kB/s | 241 kB 00:00 2023-07-21T07:30:32.009 INFO:teuthology.orchestra.run.smithi086.stdout:(32/131): ceph-mgr-rook-18.0.0-5042.ge2c50893.e 271 kB/s | 47 kB 00:00 2023-07-21T07:30:32.109 INFO:teuthology.orchestra.run.smithi086.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5042.ge 145 kB/s | 15 kB 00:00 2023-07-21T07:30:32.601 INFO:teuthology.orchestra.run.smithi086.stdout:(34/131): ceph-volume-18.0.0-5042.ge2c50893.el8 525 kB/s | 258 kB 00:00 2023-07-21T07:30:32.854 INFO:teuthology.orchestra.run.smithi006.stdout:(30/131): librgw2-18.0.0-5042.ge2c50893.el8.x86 466 kB/s | 6.8 MB 00:14 2023-07-21T07:30:32.893 INFO:teuthology.orchestra.run.smithi086.stdout:(35/131): cephadm-18.0.0-5042.ge2c50893.el8.noa 575 kB/s | 168 kB 00:00 2023-07-21T07:30:32.994 INFO:teuthology.orchestra.run.smithi086.stdout:(36/131): cephfs-top-18.0.0-5042.ge2c50893.el8. 179 kB/s | 18 kB 00:00 2023-07-21T07:30:33.387 INFO:teuthology.orchestra.run.smithi006.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5042.ge2 452 kB/s | 241 kB 00:00 2023-07-21T07:30:33.510 INFO:teuthology.orchestra.run.smithi086.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 593 kB/s | 306 kB 00:00 2023-07-21T07:30:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:(32/131): ceph-mgr-rook-18.0.0-5042.ge2c50893.e 219 kB/s | 47 kB 00:00 2023-07-21T07:30:33.694 INFO:teuthology.orchestra.run.smithi086.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 321 kB/s | 59 kB 00:00 2023-07-21T07:30:33.721 INFO:teuthology.orchestra.run.smithi006.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5042.ge 125 kB/s | 15 kB 00:00 2023-07-21T07:30:33.803 INFO:teuthology.orchestra.run.smithi086.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 692 kB/s | 75 kB 00:00 2023-07-21T07:30:34.363 INFO:teuthology.orchestra.run.smithi006.stdout:(34/131): ceph-volume-18.0.0-5042.ge2c50893.el8 403 kB/s | 258 kB 00:00 2023-07-21T07:30:34.428 INFO:teuthology.orchestra.run.smithi086.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 761 kB/s | 476 kB 00:00 2023-07-21T07:30:34.570 INFO:teuthology.orchestra.run.smithi086.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 308 kB/s | 44 kB 00:00 2023-07-21T07:30:34.797 INFO:teuthology.orchestra.run.smithi006.stdout:(35/131): cephadm-18.0.0-5042.ge2c50893.el8.noa 387 kB/s | 168 kB 00:00 2023-07-21T07:30:34.837 INFO:teuthology.orchestra.run.smithi086.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 695 kB/s | 185 kB 00:00 2023-07-21T07:30:34.959 INFO:teuthology.orchestra.run.smithi006.stdout:(36/131): cephfs-top-18.0.0-5042.ge2c50893.el8. 111 kB/s | 18 kB 00:00 2023-07-21T07:30:34.979 INFO:teuthology.orchestra.run.smithi086.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 233 kB/s | 33 kB 00:00 2023-07-21T07:30:35.129 INFO:teuthology.orchestra.run.smithi086.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 109 kB/s | 16 kB 00:00 2023-07-21T07:30:35.396 INFO:teuthology.orchestra.run.smithi086.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 647 kB/s | 173 kB 00:00 2023-07-21T07:30:35.731 INFO:teuthology.orchestra.run.smithi006.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 397 kB/s | 306 kB 00:00 2023-07-21T07:30:35.872 INFO:teuthology.orchestra.run.smithi086.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 810 kB/s | 384 kB 00:00 2023-07-21T07:30:35.898 INFO:teuthology.orchestra.run.smithi006.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 353 kB/s | 59 kB 00:00 2023-07-21T07:30:36.063 INFO:teuthology.orchestra.run.smithi086.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 424 kB/s | 81 kB 00:00 2023-07-21T07:30:36.147 INFO:teuthology.orchestra.run.smithi086.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-07-21T07:30:36.322 INFO:teuthology.orchestra.run.smithi086.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 101 kB/s | 18 kB 00:00 2023-07-21T07:30:36.439 INFO:teuthology.orchestra.run.smithi006.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 139 kB/s | 75 kB 00:00 2023-07-21T07:30:36.715 INFO:teuthology.orchestra.run.smithi006.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.7 MB/s | 476 kB 00:00 2023-07-21T07:30:36.823 INFO:teuthology.orchestra.run.smithi006.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2023-07-21T07:30:37.049 INFO:teuthology.orchestra.run.smithi086.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 1.6 MB/s | 1.2 MB 00:00 2023-07-21T07:30:37.156 INFO:teuthology.orchestra.run.smithi086.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 457 kB/s | 49 kB 00:00 2023-07-21T07:30:37.281 INFO:teuthology.orchestra.run.smithi086.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 469 kB/s | 59 kB 00:00 2023-07-21T07:30:37.307 INFO:teuthology.orchestra.run.smithi006.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 383 kB/s | 185 kB 00:00 2023-07-21T07:30:37.391 INFO:teuthology.orchestra.run.smithi006.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 394 kB/s | 33 kB 00:00 2023-07-21T07:30:37.432 INFO:teuthology.orchestra.run.smithi086.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 402 kB/s | 60 kB 00:00 2023-07-21T07:30:37.474 INFO:teuthology.orchestra.run.smithi006.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 196 kB/s | 16 kB 00:00 2023-07-21T07:30:37.632 INFO:teuthology.orchestra.run.smithi086.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-07-21T07:30:37.633 INFO:teuthology.orchestra.run.smithi006.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-07-21T07:30:38.075 INFO:teuthology.orchestra.run.smithi006.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 871 kB/s | 384 kB 00:00 2023-07-21T07:30:38.091 INFO:teuthology.orchestra.run.smithi086.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 34 kB/s | 16 kB 00:00 2023-07-21T07:30:38.225 INFO:teuthology.orchestra.run.smithi086.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 252 kB/s | 34 kB 00:00 2023-07-21T07:30:38.392 INFO:teuthology.orchestra.run.smithi006.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 257 kB/s | 81 kB 00:00 2023-07-21T07:30:38.483 INFO:teuthology.orchestra.run.smithi086.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 761 kB/s | 196 kB 00:00 2023-07-21T07:30:38.583 INFO:teuthology.orchestra.run.smithi086.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 616 kB/s | 61 kB 00:00 2023-07-21T07:30:38.667 INFO:teuthology.orchestra.run.smithi086.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 225 kB/s | 19 kB 00:00 2023-07-21T07:30:38.776 INFO:teuthology.orchestra.run.smithi006.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 29 kB/s | 11 kB 00:00 2023-07-21T07:30:38.868 INFO:teuthology.orchestra.run.smithi006.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 192 kB/s | 18 kB 00:00 2023-07-21T07:30:38.901 INFO:teuthology.orchestra.run.smithi086.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 103 kB/s | 24 kB 00:00 2023-07-21T07:30:38.992 INFO:teuthology.orchestra.run.smithi086.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 319 kB/s | 29 kB 00:00 2023-07-21T07:30:39.134 INFO:teuthology.orchestra.run.smithi086.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 194 kB/s | 27 kB 00:00 2023-07-21T07:30:39.418 INFO:teuthology.orchestra.run.smithi086.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 902 kB/s | 255 kB 00:00 2023-07-21T07:30:39.843 INFO:teuthology.orchestra.run.smithi086.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 591 kB/s | 251 kB 00:00 2023-07-21T07:30:40.019 INFO:teuthology.orchestra.run.smithi086.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 350 kB/s | 61 kB 00:00 2023-07-21T07:30:40.194 INFO:teuthology.orchestra.run.smithi086.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 488 kB/s | 85 kB 00:00 2023-07-21T07:30:40.296 INFO:teuthology.orchestra.run.smithi086.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2023-07-21T07:30:41.226 INFO:teuthology.orchestra.run.smithi006.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 506 kB/s | 1.2 MB 00:02 2023-07-21T07:30:41.410 INFO:teuthology.orchestra.run.smithi006.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 266 kB/s | 49 kB 00:00 2023-07-21T07:30:41.660 INFO:teuthology.orchestra.run.smithi006.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 235 kB/s | 59 kB 00:00 2023-07-21T07:30:41.860 INFO:teuthology.orchestra.run.smithi006.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 301 kB/s | 60 kB 00:00 2023-07-21T07:30:42.011 INFO:teuthology.orchestra.run.smithi086.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 1.0 MB/s | 1.7 MB 00:01 2023-07-21T07:30:42.036 INFO:teuthology.orchestra.run.smithi086.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-21T07:30:42.345 INFO:teuthology.orchestra.run.smithi086.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 44 MB/s | 14 MB 00:00 2023-07-21T07:30:42.403 INFO:teuthology.orchestra.run.smithi086.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.9 MB/s | 110 kB 00:00 2023-07-21T07:30:42.454 INFO:teuthology.orchestra.run.smithi086.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-07-21T07:30:42.477 INFO:teuthology.orchestra.run.smithi006.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 459 kB/s | 283 kB 00:00 2023-07-21T07:30:42.504 INFO:teuthology.orchestra.run.smithi086.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-07-21T07:30:42.554 INFO:teuthology.orchestra.run.smithi086.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-07-21T07:30:42.569 INFO:teuthology.orchestra.run.smithi006.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-07-21T07:30:42.604 INFO:teuthology.orchestra.run.smithi086.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 777 kB/s | 39 kB 00:00 2023-07-21T07:30:42.663 INFO:teuthology.orchestra.run.smithi086.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-07-21T07:30:42.695 INFO:teuthology.orchestra.run.smithi006.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 269 kB/s | 34 kB 00:00 2023-07-21T07:30:42.752 INFO:teuthology.orchestra.run.smithi086.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 5.9 MB/s | 538 kB 00:00 2023-07-21T07:30:42.822 INFO:teuthology.orchestra.run.smithi086.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.2 MB/s | 157 kB 00:00 2023-07-21T07:30:42.872 INFO:teuthology.orchestra.run.smithi086.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-07-21T07:30:42.931 INFO:teuthology.orchestra.run.smithi086.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-07-21T07:30:43.073 INFO:teuthology.orchestra.run.smithi086.stdout:(81/131): python3-babel-2.5.1-7.el8.noarch.rpm 34 MB/s | 4.8 MB 00:00 2023-07-21T07:30:43.123 INFO:teuthology.orchestra.run.smithi086.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 533 kB/s | 27 kB 00:00 2023-07-21T07:30:43.178 INFO:teuthology.orchestra.run.smithi006.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 407 kB/s | 196 kB 00:00 2023-07-21T07:30:43.182 INFO:teuthology.orchestra.run.smithi086.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 5.3 MB/s | 320 kB 00:00 2023-07-21T07:30:43.224 INFO:teuthology.orchestra.run.smithi086.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-07-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi006.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 351 kB/s | 61 kB 00:00 2023-07-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi086.stdout:(85/131): python3-numpy-1.14.3-10.el8.x86_64.rp 28 MB/s | 3.7 MB 00:00 2023-07-21T07:30:43.416 INFO:teuthology.orchestra.run.smithi086.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2023-07-21T07:30:43.470 INFO:teuthology.orchestra.run.smithi006.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 160 kB/s | 19 kB 00:00 2023-07-21T07:30:43.483 INFO:teuthology.orchestra.run.smithi086.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.3 MB/s | 225 kB 00:00 2023-07-21T07:30:43.534 INFO:teuthology.orchestra.run.smithi086.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2023-07-21T07:30:43.584 INFO:teuthology.orchestra.run.smithi086.stdout:(89/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-07-21T07:30:43.596 INFO:teuthology.orchestra.run.smithi006.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 191 kB/s | 24 kB 00:00 2023-07-21T07:30:43.651 INFO:teuthology.orchestra.run.smithi086.stdout:(90/131): python3-jsonpointer-1.10-11.el8.noarc 299 kB/s | 20 kB 00:00 2023-07-21T07:30:43.688 INFO:teuthology.orchestra.run.smithi006.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 319 kB/s | 29 kB 00:00 2023-07-21T07:30:43.701 INFO:teuthology.orchestra.run.smithi086.stdout:(91/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-07-21T07:30:43.768 INFO:teuthology.orchestra.run.smithi086.stdout:(92/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-07-21T07:30:43.796 INFO:teuthology.orchestra.run.smithi006.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 254 kB/s | 27 kB 00:00 2023-07-21T07:30:43.902 INFO:teuthology.orchestra.run.smithi086.stdout:(93/131): openblas-threads-0.3.15-3.el8.x86_64. 36 MB/s | 4.9 MB 00:00 2023-07-21T07:30:43.952 INFO:teuthology.orchestra.run.smithi086.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-07-21T07:30:44.086 INFO:teuthology.orchestra.run.smithi086.stdout:(95/131): openblas-0.3.15-3.el8.x86_64.rpm 35 MB/s | 4.7 MB 00:00 2023-07-21T07:30:44.175 INFO:teuthology.orchestra.run.smithi086.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 2.2 MB/s | 202 kB 00:00 2023-07-21T07:30:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 5.7 MB/s | 354 kB 00:00 2023-07-21T07:30:44.370 INFO:teuthology.orchestra.run.smithi086.stdout:(98/131): postgresql-server-10.21-2.module+el8. 38 MB/s | 5.1 MB 00:00 2023-07-21T07:30:44.437 INFO:teuthology.orchestra.run.smithi086.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 12 MB/s | 808 kB 00:00 2023-07-21T07:30:44.512 INFO:teuthology.orchestra.run.smithi086.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 20 MB/s | 1.5 MB 00:00 2023-07-21T07:30:44.587 INFO:teuthology.orchestra.run.smithi086.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 625 kB/s | 47 kB 00:00 2023-07-21T07:30:44.622 INFO:teuthology.orchestra.run.smithi006.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 310 kB/s | 255 kB 00:00 2023-07-21T07:30:44.638 INFO:teuthology.orchestra.run.smithi086.stdout:(102/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-07-21T07:30:44.696 INFO:teuthology.orchestra.run.smithi086.stdout:(103/131): python3-jwt-1.6.1-2.el8.noarch.rpm 732 kB/s | 43 kB 00:00 2023-07-21T07:30:44.755 INFO:teuthology.orchestra.run.smithi086.stdout:(104/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-07-21T07:30:44.813 INFO:teuthology.orchestra.run.smithi086.stdout:(105/131): keyutils-libs-devel-1.5.10-9.el8.x86 824 kB/s | 48 kB 00:00 2023-07-21T07:30:44.888 INFO:teuthology.orchestra.run.smithi086.stdout:(106/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2023-07-21T07:30:44.939 INFO:teuthology.orchestra.run.smithi086.stdout:(107/131): python3-requests-oauthlib-1.0.0-1.el 853 kB/s | 43 kB 00:00 2023-07-21T07:30:44.989 INFO:teuthology.orchestra.run.smithi086.stdout:(108/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-07-21T07:30:45.048 INFO:teuthology.orchestra.run.smithi086.stdout:(109/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-07-21T07:30:45.106 INFO:teuthology.orchestra.run.smithi086.stdout:(110/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-07-21T07:30:45.182 INFO:teuthology.orchestra.run.smithi086.stdout:(111/131): libaio-devel-0.3.112-1.el8.x86_64.rp 249 kB/s | 19 kB 00:00 2023-07-21T07:30:45.232 INFO:teuthology.orchestra.run.smithi086.stdout:(112/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-07-21T07:30:45.307 INFO:teuthology.orchestra.run.smithi086.stdout:(113/131): python3-cryptography-3.2.1-5.el8.x86 7.3 MB/s | 559 kB 00:00 2023-07-21T07:30:45.375 INFO:teuthology.orchestra.run.smithi086.stdout:(114/131): libverto-devel-0.3.0-5.el8.x86_64.rp 267 kB/s | 18 kB 00:00 2023-07-21T07:30:45.439 INFO:teuthology.orchestra.run.smithi006.stdout:(64/131): ceph-mgr-diskprediction-local-18.0.0- 536 kB/s | 7.4 MB 00:14 2023-07-21T07:30:45.441 INFO:teuthology.orchestra.run.smithi086.stdout:(115/131): pcre2-devel-10.32-2.el8.x86_64.rpm 8.9 MB/s | 605 kB 00:00 2023-07-21T07:30:45.525 INFO:teuthology.orchestra.run.smithi086.stdout:(116/131): ceph-mgr-diskprediction-local-18.0.0 481 kB/s | 7.4 MB 00:15 2023-07-21T07:30:45.580 INFO:teuthology.orchestra.run.smithi086.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.7 MB/s | 238 kB 00:00 2023-07-21T07:30:45.642 INFO:teuthology.orchestra.run.smithi086.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.3 MB/s | 72 kB 00:00 2023-07-21T07:30:45.647 INFO:teuthology.orchestra.run.smithi006.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 294 kB/s | 61 kB 00:00 2023-07-21T07:30:45.672 INFO:teuthology.orchestra.run.smithi006.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 239 kB/s | 251 kB 00:01 2023-07-21T07:30:45.709 INFO:teuthology.orchestra.run.smithi086.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 13 MB/s | 2.3 MB 00:00 2023-07-21T07:30:45.734 INFO:teuthology.orchestra.run.smithi086.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 901 kB/s | 83 kB 00:00 2023-07-21T07:30:45.760 INFO:teuthology.orchestra.run.smithi086.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-07-21T07:30:45.773 INFO:teuthology.orchestra.run.smithi006.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 681 kB/s | 85 kB 00:00 2023-07-21T07:30:45.798 INFO:teuthology.orchestra.run.smithi006.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 183 kB/s | 23 kB 00:00 2023-07-21T07:30:45.810 INFO:teuthology.orchestra.run.smithi086.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.3 MB/s | 98 kB 00:00 2023-07-21T07:30:45.817 INFO:teuthology.orchestra.run.smithi006.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 3.6 MB/s | 70 kB 00:00 2023-07-21T07:30:45.827 INFO:teuthology.orchestra.run.smithi086.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 863 kB/s | 58 kB 00:00 2023-07-21T07:30:45.877 INFO:teuthology.orchestra.run.smithi086.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 578 kB/s | 39 kB 00:00 2023-07-21T07:30:45.884 INFO:teuthology.orchestra.run.smithi006.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 703 kB/s | 47 kB 00:00 2023-07-21T07:30:45.911 INFO:teuthology.orchestra.run.smithi086.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 7.5 MB/s | 644 kB 00:00 2023-07-21T07:30:45.943 INFO:teuthology.orchestra.run.smithi006.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2023-07-21T07:30:45.944 INFO:teuthology.orchestra.run.smithi086.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-07-21T07:30:45.970 INFO:teuthology.orchestra.run.smithi086.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.3 MB/s | 138 kB 00:00 2023-07-21T07:30:45.985 INFO:teuthology.orchestra.run.smithi006.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-07-21T07:30:46.035 INFO:teuthology.orchestra.run.smithi006.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-07-21T07:30:46.077 INFO:teuthology.orchestra.run.smithi006.stdout:(74/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-07-21T07:30:46.119 INFO:teuthology.orchestra.run.smithi006.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-07-21T07:30:46.161 INFO:teuthology.orchestra.run.smithi006.stdout:(76/131): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2023-07-21T07:30:46.220 INFO:teuthology.orchestra.run.smithi006.stdout:(77/131): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-07-21T07:30:46.262 INFO:teuthology.orchestra.run.smithi006.stdout:(78/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2023-07-21T07:30:46.312 INFO:teuthology.orchestra.run.smithi006.stdout:(79/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 11 MB/s | 560 kB 00:00 2023-07-21T07:30:46.354 INFO:teuthology.orchestra.run.smithi006.stdout:(80/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 452 kB/s | 19 kB 00:00 2023-07-21T07:30:46.396 INFO:teuthology.orchestra.run.smithi006.stdout:(81/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-07-21T07:30:46.446 INFO:teuthology.orchestra.run.smithi006.stdout:(82/131): python3-cryptography-3.2.1-5.el8.x86_ 11 MB/s | 559 kB 00:00 2023-07-21T07:30:46.480 INFO:teuthology.orchestra.run.smithi006.stdout:(83/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 536 kB/s | 18 kB 00:00 2023-07-21T07:30:46.530 INFO:teuthology.orchestra.run.smithi006.stdout:(84/131): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-07-21T07:30:46.580 INFO:teuthology.orchestra.run.smithi006.stdout:(85/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2023-07-21T07:30:46.672 INFO:teuthology.orchestra.run.smithi006.stdout:(86/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 25 MB/s | 2.3 MB 00:00 2023-07-21T07:30:46.723 INFO:teuthology.orchestra.run.smithi006.stdout:(87/131): thrift-0.13.0-2.el8.x86_64.rpm 1.8 MB/s | 1.7 MB 00:00 2023-07-21T07:30:46.748 INFO:teuthology.orchestra.run.smithi006.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 959 kB/s | 72 kB 00:00 2023-07-21T07:30:46.815 INFO:teuthology.orchestra.run.smithi006.stdout:(89/131): elfutils-libelf-devel-0.186-1.el8.x86 1.0 MB/s | 60 kB 00:00 2023-07-21T07:30:46.840 INFO:teuthology.orchestra.run.smithi006.stdout:(90/131): fuse-2.9.7-15.el8.x86_64.rpm 706 kB/s | 83 kB 00:00 2023-07-21T07:30:46.866 INFO:teuthology.orchestra.run.smithi006.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-07-21T07:30:46.910 INFO:teuthology.orchestra.run.smithi006.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 839 kB/s | 58 kB 00:00 2023-07-21T07:30:46.941 INFO:teuthology.orchestra.run.smithi006.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 512 kB/s | 39 kB 00:00 2023-07-21T07:30:46.983 INFO:teuthology.orchestra.run.smithi006.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 8.6 MB/s | 644 kB 00:00 2023-07-21T07:30:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-07-21T07:30:47.034 INFO:teuthology.orchestra.run.smithi006.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-07-21T07:30:47.076 INFO:teuthology.orchestra.run.smithi006.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-07-21T07:30:47.118 INFO:teuthology.orchestra.run.smithi006.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-07-21T07:30:47.168 INFO:teuthology.orchestra.run.smithi006.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-07-21T07:30:47.285 INFO:teuthology.orchestra.run.smithi006.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2023-07-21T07:30:47.327 INFO:teuthology.orchestra.run.smithi006.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 934 kB/s | 39 kB 00:00 2023-07-21T07:30:47.386 INFO:teuthology.orchestra.run.smithi006.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-07-21T07:30:47.444 INFO:teuthology.orchestra.run.smithi006.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 9.0 MB/s | 538 kB 00:00 2023-07-21T07:30:47.604 INFO:teuthology.orchestra.run.smithi006.stdout:(104/131): python3-scipy-1.0.0-21.module+el8.5. 23 MB/s | 14 MB 00:00 2023-07-21T07:30:47.628 INFO:teuthology.orchestra.run.smithi006.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 855 kB/s | 157 kB 00:00 2023-07-21T07:30:47.645 INFO:teuthology.orchestra.run.smithi006.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2023-07-21T07:30:47.687 INFO:teuthology.orchestra.run.smithi006.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-07-21T07:30:47.754 INFO:teuthology.orchestra.run.smithi006.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 399 kB/s | 27 kB 00:00 2023-07-21T07:30:47.846 INFO:teuthology.orchestra.run.smithi006.stdout:(109/131): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-07-21T07:30:47.880 INFO:teuthology.orchestra.run.smithi006.stdout:(110/131): flex-2.6.1-9.el8.x86_64.rpm 2.5 MB/s | 320 kB 00:00 2023-07-21T07:30:47.905 INFO:teuthology.orchestra.run.smithi006.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 752 kB/s | 44 kB 00:00 2023-07-21T07:30:47.955 INFO:teuthology.orchestra.run.smithi006.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-07-21T07:30:47.998 INFO:teuthology.orchestra.run.smithi006.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-07-21T07:30:48.056 INFO:teuthology.orchestra.run.smithi006.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 21 MB/s | 3.7 MB 00:00 2023-07-21T07:30:48.081 INFO:teuthology.orchestra.run.smithi006.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 766 kB/s | 64 kB 00:00 2023-07-21T07:30:48.106 INFO:teuthology.orchestra.run.smithi006.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-07-21T07:30:48.132 INFO:teuthology.orchestra.run.smithi006.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 399 kB/s | 20 kB 00:00 2023-07-21T07:30:48.148 INFO:teuthology.orchestra.run.smithi006.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-07-21T07:30:48.182 INFO:teuthology.orchestra.run.smithi006.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-07-21T07:30:48.224 INFO:teuthology.orchestra.run.smithi006.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-07-21T07:30:48.350 INFO:teuthology.orchestra.run.smithi006.stdout:(121/131): openblas-threads-0.3.15-3.el8.x86_64 24 MB/s | 4.9 MB 00:00 2023-07-21T07:30:48.391 INFO:teuthology.orchestra.run.smithi006.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-07-21T07:30:48.467 INFO:teuthology.orchestra.run.smithi006.stdout:(123/131): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-07-21T07:30:48.509 INFO:teuthology.orchestra.run.smithi006.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2023-07-21T07:30:48.559 INFO:teuthology.orchestra.run.smithi006.stdout:(125/131): postgresql-contrib-10.21-2.module+el 16 MB/s | 808 kB 00:00 2023-07-21T07:30:48.660 INFO:teuthology.orchestra.run.smithi006.stdout:(126/131): postgresql-server-10.21-2.module+el8 26 MB/s | 5.1 MB 00:00 2023-07-21T07:30:48.702 INFO:teuthology.orchestra.run.smithi006.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-07-21T07:30:52.428 INFO:teuthology.orchestra.run.smithi086.stdout:(128/131): librbd1-18.0.0-5042.ge2c50893.el8.x8 576 kB/s | 3.6 MB 00:06 2023-07-21T07:30:52.495 INFO:teuthology.orchestra.run.smithi086.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 12 MB/s | 798 kB 00:00 2023-07-21T07:30:52.670 INFO:teuthology.orchestra.run.smithi086.stdout:(130/131): librados2-18.0.0-5042.ge2c50893.el8. 560 kB/s | 3.7 MB 00:06 2023-07-21T07:30:57.143 INFO:teuthology.orchestra.run.smithi006.stdout:(128/131): librados2-18.0.0-5042.ge2c50893.el8. 444 kB/s | 3.7 MB 00:08 2023-07-21T07:30:57.193 INFO:teuthology.orchestra.run.smithi006.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-07-21T07:30:59.660 INFO:teuthology.orchestra.run.smithi006.stdout:(130/131): librbd1-18.0.0-5042.ge2c50893.el8.x8 339 kB/s | 3.6 MB 00:10 2023-07-21T07:31:45.190 INFO:teuthology.orchestra.run.smithi006.stdout:(131/131): ceph-test-18.0.0-5042.ge2c50893.el8. 482 kB/s | 48 MB 01:41 2023-07-21T07:31:45.193 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-07-21T07:31:45.194 INFO:teuthology.orchestra.run.smithi006.stdout:Total 1.4 MB/s | 206 MB 02:22 2023-07-21T07:31:46.008 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2023-07-21T07:31:46.139 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2023-07-21T07:31:46.140 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2023-07-21T07:31:47.317 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2023-07-21T07:31:47.322 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2023-07-21T07:31:47.824 INFO:teuthology.orchestra.run.smithi086.stdout:(131/131): ceph-test-18.0.0-5042.ge2c50893.el8. 460 kB/s | 48 MB 01:46 2023-07-21T07:31:47.826 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2023-07-21T07:31:47.827 INFO:teuthology.orchestra.run.smithi086.stdout:Total 1.4 MB/s | 206 MB 02:27 2023-07-21T07:31:48.595 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2023-07-21T07:31:48.714 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2023-07-21T07:31:48.714 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2023-07-21T07:31:49.842 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2023-07-21T07:31:49.846 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2023-07-21T07:31:52.512 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2023-07-21T07:31:52.675 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-21T07:31:52.834 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-21T07:31:52.985 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-21T07:31:53.131 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-21T07:31:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-21T07:31:53.742 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-21T07:31:54.001 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:18.0.0-5042.ge2c50893.el8.x86_64 5/134 2023-07-21T07:31:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:18.0.0-5042.ge2c50893.el8.x86_64 5/134 2023-07-21T07:31:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:18.0.0-5042.ge2c50893.el8.x86_64 6/134 2023-07-21T07:31:54.717 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2023-07-21T07:31:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:18.0.0-5042.ge2c50893.el8.x86_64 6/134 2023-07-21T07:31:54.913 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-21T07:31:55.068 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:18.0.0-5042.ge2c50893.el8.x86_64 7/134 2023-07-21T07:31:55.097 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-21T07:31:55.148 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:18.0.0-5042.ge2c50893.el8.x86_64 7/134 2023-07-21T07:31:55.331 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:18.0.0-5042.ge2c50893.el8.x86_64 8/134 2023-07-21T07:31:55.346 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-21T07:31:55.520 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-07-21T07:31:55.540 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-21T07:31:55.656 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-21T07:31:55.769 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-21T07:31:55.890 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-21T07:31:56.031 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-21T07:31:56.303 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-21T07:31:56.462 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-21T07:31:56.507 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:18.0.0-5042.ge2c50893.el8.x86_64 6/134 2023-07-21T07:31:56.722 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-21T07:31:56.886 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:18.0.0-5042.ge2c50893.el8.x86_64 6/134 2023-07-21T07:31:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:18.0.0-5042.ge2c50893.el8.x86_64 14/134 2023-07-21T07:31:56.990 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5042.ge2c50893.el8.x86_64 14/134 2023-07-21T07:31:57.073 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:18.0.0-5042.ge2c50893.el8.x86_64 7/134 2023-07-21T07:31:57.160 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:18.0.0-5042.ge2c50893.el8.x86 15/134 2023-07-21T07:31:57.184 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:18.0.0-5042.ge2c50893.el8.x86_64 7/134 2023-07-21T07:31:57.298 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5042.ge2c50893.el8.x86 15/134 2023-07-21T07:31:57.415 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:18.0.0-5042.ge2c50893.el8.x86_64 8/134 2023-07-21T07:31:57.481 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-07-21T07:31:57.513 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:18.0.0-5042.ge2c50893.el8.x86_64 8/134 2023-07-21T07:31:57.668 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-07-21T07:31:57.742 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:18.0.0-5042.ge2c50893.el8.x86_64 9/134 2023-07-21T07:31:57.851 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-07-21T07:31:57.984 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-21T07:31:58.026 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-21T07:31:58.159 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-21T07:31:58.234 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-21T07:31:58.309 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-21T07:31:58.632 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-21T07:31:58.906 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-21T07:31:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-21T07:31:59.106 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephsqlite-2:18.0.0-5042.ge2c50893.el8.x86_64 14/134 2023-07-21T07:31:59.159 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-21T07:31:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5042.ge2c50893.el8.x86_64 14/134 2023-07-21T07:31:59.398 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:18.0.0-5042.ge2c50893.el8.x86 15/134 2023-07-21T07:31:59.459 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5042.ge2c50893.el8.x86 15/134 2023-07-21T07:31:59.656 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-21T07:31:59.794 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-21T07:31:59.797 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-21T07:31:59.964 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-21T07:32:00.000 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-07-21T07:32:00.582 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-21T07:32:00.748 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-07-21T07:32:00.765 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-21T07:32:01.007 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-07-21T07:32:01.195 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-07-21T07:32:01.355 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-21T07:32:01.414 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-21T07:32:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-21T07:32:01.624 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:18.0.0-5042.ge2c50893.el8. 26/134 2023-07-21T07:32:01.747 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:18.0.0-5042.ge2c50893.el 27/134 2023-07-21T07:32:01.994 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:18.0.0-5042.ge2c50893.el8.x86_6 28/134 2023-07-21T07:32:02.201 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-21T07:32:02.279 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-21T07:32:02.585 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-21T07:32:02.815 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-21T07:32:03.034 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-21T07:32:03.245 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-21T07:32:03.462 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-21T07:32:03.691 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-21T07:32:03.879 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:18.0.0-5042.ge2c50893.el8. 26/134 2023-07-21T07:32:04.000 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:18.0.0-5042.ge2c50893.el 27/134 2023-07-21T07:32:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-21T07:32:05.162 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-07-21T07:32:05.179 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:18.0.0-5042.ge2c50893.el8.x86_6 28/134 2023-07-21T07:32:05.473 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-07-21T07:32:05.504 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-21T07:32:05.715 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-07-21T07:32:05.766 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-21T07:32:05.941 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-07-21T07:32:06.039 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-21T07:32:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-21T07:32:06.255 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-21T07:32:06.355 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-21T07:32:06.557 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:18.0.0-5042.ge2c50893.el8.x86_64 36/134 2023-07-21T07:32:06.707 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:18.0.0-5042.ge2c50893.el8.x86_6 37/134 2023-07-21T07:32:06.866 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-07-21T07:32:07.026 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-07-21T07:32:07.225 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-07-21T07:32:07.298 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-07-21T07:32:07.522 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-07-21T07:32:07.730 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-07-21T07:32:07.908 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-21T07:32:07.993 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-21T07:32:08.008 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-21T07:32:08.207 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-07-21T07:32:08.332 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-21T07:32:08.363 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-07-21T07:32:08.528 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-07-21T07:32:08.533 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-21T07:32:08.708 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-21T07:32:08.720 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-07-21T07:32:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-07-21T07:32:08.928 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:18.0.0-5042.ge2c50893.el8.x86_64 36/134 2023-07-21T07:32:09.039 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-07-21T07:32:09.084 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:18.0.0-5042.ge2c50893.el8.x86_6 37/134 2023-07-21T07:32:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-21T07:32:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-21T07:32:09.528 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-07-21T07:32:09.658 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-21T07:32:09.753 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-07-21T07:32:09.792 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-21T07:32:10.011 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-21T07:32:10.130 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-07-21T07:32:10.251 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-21T07:32:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-07-21T07:32:10.622 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-21T07:32:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-07-21T07:32:10.875 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-21T07:32:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-07-21T07:32:11.081 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-21T07:32:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-07-21T07:32:11.290 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-21T07:32:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-07-21T07:32:11.517 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-21T07:32:11.683 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-07-21T07:32:11.861 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-21T07:32:11.874 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-07-21T07:32:12.092 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-07-21T07:32:12.129 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-21T07:32:12.282 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-07-21T07:32:12.359 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-21T07:32:12.447 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-07-21T07:32:12.596 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-21T07:32:12.775 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-07-21T07:32:12.776 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-21T07:32:12.941 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-21T07:32:13.058 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-07-21T07:32:13.289 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-21T07:32:13.316 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-07-21T07:32:13.558 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-21T07:32:13.585 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-07-21T07:32:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-21T07:32:13.809 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-21T07:32:13.930 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-21T07:32:14.028 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-21T07:32:14.187 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-21T07:32:14.210 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-21T07:32:14.347 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-21T07:32:14.424 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-21T07:32:14.571 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-21T07:32:14.579 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-21T07:32:14.654 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-21T07:32:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-21T07:32:14.887 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-21T07:32:14.964 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-21T07:32:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-21T07:32:15.173 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-21T07:32:15.313 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-21T07:32:15.364 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-21T07:32:15.374 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-21T07:32:15.519 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-21T07:32:15.600 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-21T07:32:15.690 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-21T07:32:15.772 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-21T07:32:15.919 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-21T07:32:15.963 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-21T07:32:16.130 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-21T07:32:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-21T07:32:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-21T07:32:16.417 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-21T07:32:16.606 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-21T07:32:16.670 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-21T07:32:16.833 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-21T07:32:16.834 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-21T07:32:16.991 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-21T07:32:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-21T07:32:17.182 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-21T07:32:17.222 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-21T07:32:17.410 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-21T07:32:17.592 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-21T07:32:17.749 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-21T07:32:17.894 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-21T07:32:18.119 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-21T07:32:18.316 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-21T07:32:18.378 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-21T07:32:18.502 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-21T07:32:18.681 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-21T07:32:18.741 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-21T07:32:18.885 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-21T07:32:19.053 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-21T07:32:19.187 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-21T07:32:19.220 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-21T07:32:19.446 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-21T07:32:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-21T07:32:19.667 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-21T07:32:20.534 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-21T07:32:20.585 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-21T07:32:20.757 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:18.0.0-5042.ge2c50893.el8.x86_64 92/134 2023-07-21T07:32:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-21T07:32:20.833 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:18.0.0-5042.ge2c50893.el8.x86_64 92/134 2023-07-21T07:32:20.999 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:18.0.0-5042.ge2c50893.el8.x86_64 93/134 2023-07-21T07:32:21.045 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-21T07:32:21.352 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-21T07:32:21.624 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-21T07:32:21.837 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-21T07:32:22.638 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-21T07:32:22.820 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:18.0.0-5042.ge2c50893.el8.x86_64 92/134 2023-07-21T07:32:22.890 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:18.0.0-5042.ge2c50893.el8.x86_64 92/134 2023-07-21T07:32:23.080 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:18.0.0-5042.ge2c50893.el8.x86_64 93/134 2023-07-21T07:32:24.870 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:18.0.0-5042.ge2c50893.el8.x86_64 94/134 2023-07-21T07:32:25.587 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:18.0.0-5042.ge2c50893.el8.x86_64 94/134 2023-07-21T07:32:26.216 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:18.0.0-5042.ge2c50893.el8.x86_64 94/134 2023-07-21T07:32:26.470 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:18.0.0-5042.ge2c50893.el8.x86_64 95/134 2023-07-21T07:32:26.553 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:18.0.0-5042.ge2c50893.el8.x86_64 95/134 2023-07-21T07:32:26.690 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:18.0.0-5042.ge2c50893.el8.x86_64 96/134 2023-07-21T07:32:26.708 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:18.0.0-5042.ge2c50893.el8.x86_64 94/134 2023-07-21T07:32:26.954 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:18.0.0-5042.ge2c50893.el8.x86_64 94/134 2023-07-21T07:32:27.554 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:18.0.0-5042.ge2c50893.el8.x86_64 94/134 2023-07-21T07:32:27.858 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:18.0.0-5042.ge2c50893.el8.x86_64 95/134 2023-07-21T07:32:27.945 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:18.0.0-5042.ge2c50893.el8.x86_64 95/134 2023-07-21T07:32:28.129 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:18.0.0-5042.ge2c50893.el8.x86_64 96/134 2023-07-21T07:32:46.156 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5042.ge2c50893.el8.x86_64 96/134 2023-07-21T07:32:46.157 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2023-07-21T07:32:46.157 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2023-07-21T07:32:46.157 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-07-21T07:32:46.157 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /run 2023-07-21T07:32:46.157 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2023-07-21T07:32:46.158 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2023-07-21T07:32:46.158 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2023-07-21T07:32:46.158 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2023-07-21T07:32:46.158 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-07-21T07:32:46.158 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:32:46.497 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:18.0.0-5042.ge2c50893.el8.noarch 97/134 2023-07-21T07:32:46.523 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5042.ge2c50893.el8.x86_64 96/134 2023-07-21T07:32:46.524 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2023-07-21T07:32:46.524 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2023-07-21T07:32:46.524 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /dev 2023-07-21T07:32:46.525 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /run 2023-07-21T07:32:46.525 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2023-07-21T07:32:46.525 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2023-07-21T07:32:46.526 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2023-07-21T07:32:46.526 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2023-07-21T07:32:46.526 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /dev 2023-07-21T07:32:46.527 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:32:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-volume-2:18.0.0-5042.ge2c50893.el8.noarch 97/134 2023-07-21T07:32:48.171 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:18.0.0-5042.ge2c50893.el8.noarch 97/134 2023-07-21T07:32:48.375 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:18.0.0-5042.ge2c50893.el8.x86_64 98/134 2023-07-21T07:32:48.419 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-volume-2:18.0.0-5042.ge2c50893.el8.noarch 97/134 2023-07-21T07:32:48.573 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:18.0.0-5042.ge2c50893.el8.x86_64 98/134 2023-07-21T07:32:48.606 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:18.0.0-5042.ge2c50893.el8.x86_64 98/134 2023-07-21T07:32:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:18.0.0-5042.ge2c50893.el8.x86_64 99/134 2023-07-21T07:32:48.789 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:18.0.0-5042.ge2c50893.el8.x86_64 98/134 2023-07-21T07:32:48.943 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:18.0.0-5042.ge2c50893.el8.x86_64 99/134 2023-07-21T07:32:49.237 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:18.0.0-5042.ge2c50893.el8.x86_64 99/134 2023-07-21T07:32:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:18.0.0-5042.ge2c50893.el8.x86_64 99/134 2023-07-21T07:32:49.405 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:18.0.0-5042.ge2c50893.el8.x86_64 100/134 2023-07-21T07:32:49.422 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:18.0.0-5042.ge2c50893.el8.x86_64 100/134 2023-07-21T07:32:49.593 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:18.0.0-5042.ge2c50893.el8.x86_64 100/134 2023-07-21T07:32:49.609 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:18.0.0-5042.ge2c50893.el8.x86_64 100/134 2023-07-21T07:32:51.203 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:18.0.0-5042.ge2c50893.el8.noarch 101/134 2023-07-21T07:32:51.293 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:18.0.0-5042.ge2c50893.el8.noarch 101/134 2023-07-21T07:32:51.403 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:18.0.0-5042.ge2c50893.el8.noarch 101/134 2023-07-21T07:32:51.492 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephadm-2:18.0.0-5042.ge2c50893.el8.noarch 101/134 2023-07-21T07:32:51.536 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5042.ge2c50893.e 102/134 2023-07-21T07:32:51.615 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5042.ge2c50893.e 102/134 2023-07-21T07:32:51.738 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5042.ge2c50893. 103/134 2023-07-21T07:32:51.816 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5042.ge2c50893. 103/134 2023-07-21T07:32:51.979 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5042.ge2c50893.el8.noa 104/134 2023-07-21T07:32:52.034 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5042.ge2c50893.el8.noa 104/134 2023-07-21T07:32:52.202 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5042.ge2c50893.el8.noa 104/134 2023-07-21T07:32:52.248 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5042.ge2c50893.el8.noa 104/134 2023-07-21T07:32:52.481 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5042.ge2c50893.el8.n 105/134 2023-07-21T07:32:52.531 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5042.ge2c50893.el8.n 105/134 2023-07-21T07:32:53.486 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5042.ge2c50893.el8.n 105/134 2023-07-21T07:32:53.504 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5042.ge2c50893.el8.n 105/134 2023-07-21T07:32:53.643 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5042.ge2c 106/134 2023-07-21T07:32:53.654 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5042.ge2c 106/134 2023-07-21T07:32:53.732 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5042.ge2c 106/134 2023-07-21T07:32:53.750 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5042.ge2c 106/134 2023-07-21T07:32:54.083 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5042.ge2c50893.el 107/134 2023-07-21T07:32:54.146 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5042.ge2c50893.el 107/134 2023-07-21T07:32:54.264 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:18.0.0-5042.ge2c50893.el8.x86_64 108/134 2023-07-21T07:32:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5042.ge2c50893.el8.x86_64 108/134 2023-07-21T07:32:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:18.0.0-5042.ge2c50893.el8.x86_64 108/134 2023-07-21T07:32:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5042.ge2c50893.el8.x86_64 108/134 2023-07-21T07:32:54.475 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-rook-2:18.0.0-5042.ge2c50893.el8.noarch 109/134 2023-07-21T07:32:54.486 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5042.ge2c50893.el8.noarch 109/134 2023-07-21T07:32:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:18.0.0-5042.ge2c50893.el8.noarch 109/134 2023-07-21T07:32:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5042.ge2c50893.el8.noarch 109/134 2023-07-21T07:32:55.773 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:18.0.0-5042.ge2c50893.el8.x86_64 110/134 2023-07-21T07:32:55.979 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:18.0.0-5042.ge2c50893.el8.x86_64 110/134 2023-07-21T07:32:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:18.0.0-5042.ge2c50893.el8.x86_64 111/134 2023-07-21T07:32:56.023 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5042.ge2c50893.el8.x86_64 111/134 2023-07-21T07:32:56.199 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5042.ge2c50 112/134 2023-07-21T07:32:56.207 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:18.0.0-5042.ge2c50893.el8.x86_64 111/134 2023-07-21T07:32:56.240 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5042.ge2c50 112/134 2023-07-21T07:32:56.242 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5042.ge2c50893.el8.x86_64 111/134 2023-07-21T07:32:56.384 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 113/134 2023-07-21T07:32:56.396 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5042.ge2c50 112/134 2023-07-21T07:32:56.439 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5042.ge2c50 112/134 2023-07-21T07:32:56.596 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 113/134 2023-07-21T07:32:56.735 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 113/134 2023-07-21T07:32:56.918 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 114/134 2023-07-21T07:32:56.970 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 113/134 2023-07-21T07:32:57.137 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 114/134 2023-07-21T07:33:01.449 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 114/134 2023-07-21T07:33:01.728 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:18.0.0-5042.ge2c50893.el8.x86_64 115/134 2023-07-21T07:33:01.925 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-21T07:33:02.059 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 114/134 2023-07-21T07:33:02.114 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-21T07:33:02.973 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:18.0.0-5042.ge2c50893.el8.x86_64 115/134 2023-07-21T07:33:02.989 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-21T07:33:03.298 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-21T07:33:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-07-21T07:33:03.446 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:18.0.0-5042.ge2c50893.el8.x86_64 119/134 2023-07-21T07:33:03.620 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-21T07:33:03.623 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:18.0.0-5042.ge2c50893.el8.x86_64 117/134 2023-07-21T07:33:03.795 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:18.0.0-5042.ge2c50893.el8.x86_ 121/134 2023-07-21T07:33:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-07-21T07:33:03.934 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-21T07:33:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-07-21T07:33:04.260 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-07-21T07:33:04.558 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-07-21T07:33:04.733 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:18.0.0-5042.ge2c50893.el8.x86_ 121/134 2023-07-21T07:33:04.879 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-21T07:33:06.136 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T07:33:06.400 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T07:33:06.417 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T07:33:06.575 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-top-2:18.0.0-5042.ge2c50893.el8.noarch 124/134 2023-07-21T07:33:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:18.0.0-5042.ge2c50893.el8.x86_64 125/134 2023-07-21T07:33:07.156 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:18.0.0-5042.ge2c50893.el8.x86_64 126/134 2023-07-21T07:33:07.165 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T07:33:07.445 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T07:33:07.451 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-21T07:33:07.464 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T07:33:07.629 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:18.0.0-5042.ge2c50893.el8.noarch 124/134 2023-07-21T07:33:07.641 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-21T07:33:07.649 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-21T07:33:07.839 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-21T07:33:07.887 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:18.0.0-5042.ge2c50893.el8.x86_64 125/134 2023-07-21T07:33:08.032 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-21T07:33:08.119 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-21T07:33:08.220 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:18.0.0-5042.ge2c50893.el8.x86_64 126/134 2023-07-21T07:33:08.358 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-21T07:33:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-21T07:33:08.370 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T07:33:08.531 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-21T07:33:08.585 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T07:33:08.586 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-21T07:33:08.711 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-07-21T07:33:08.793 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-07-21T07:33:08.822 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-21T07:33:08.994 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-07-21T07:33:09.007 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-07-21T07:33:09.048 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T07:33:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-21T07:33:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-21T07:33:09.280 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-07-21T07:33:09.281 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T07:33:09.514 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T07:33:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-21T07:33:09.539 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T07:33:09.540 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:18.0.0-5042.ge2c50893.el8.x86_64 1/134 2023-07-21T07:33:09.540 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:18.0.0-5042.ge2c50893.el8.x86_64 2/134 2023-07-21T07:33:09.540 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:18.0.0-5042.ge2c50893.el8.x86_64 3/134 2023-07-21T07:33:09.540 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:18.0.0-5042.ge2c50893.el8.x86_64 4/134 2023-07-21T07:33:09.540 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5042.ge2c50 5/134 2023-07-21T07:33:09.540 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:18.0.0-5042.ge2c50893.el8.x86_64 6/134 2023-07-21T07:33:09.541 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:18.0.0-5042.ge2c50893.el8.x86_64 7/134 2023-07-21T07:33:09.541 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:18.0.0-5042.ge2c50893.el8.x86_64 8/134 2023-07-21T07:33:09.541 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:18.0.0-5042.ge2c50893.el8.x86_64 9/134 2023-07-21T07:33:09.541 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:18.0.0-5042.ge2c50893.el8.x86_64 10/134 2023-07-21T07:33:09.541 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:18.0.0-5042.ge2c50893.el8.x86_64 11/134 2023-07-21T07:33:09.541 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:18.0.0-5042.ge2c50893.el8.x86_64 12/134 2023-07-21T07:33:09.541 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 13/134 2023-07-21T07:33:09.542 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:18.0.0-5042.ge2c50893.el8.x86_ 14/134 2023-07-21T07:33:09.542 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:18.0.0-5042.ge2c50893.el8.x86_64 15/134 2023-07-21T07:33:09.542 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephsqlite-2:18.0.0-5042.ge2c50893.el8.x86_64 16/134 2023-07-21T07:33:09.542 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:18.0.0-5042.ge2c50893.el8.x86_6 17/134 2023-07-21T07:33:09.542 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:18.0.0-5042.ge2c50893.el8.x86 18/134 2023-07-21T07:33:09.542 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:18.0.0-5042.ge2c50893.el8.x86_64 19/134 2023-07-21T07:33:09.543 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5042.ge2c50893.el 20/134 2023-07-21T07:33:09.543 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:18.0.0-5042.ge2c50893.el8. 21/134 2023-07-21T07:33:09.543 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:18.0.0-5042.ge2c50893.el8.x86_6 22/134 2023-07-21T07:33:09.543 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:18.0.0-5042.ge2c50893.el8.x86_64 23/134 2023-07-21T07:33:09.543 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:18.0.0-5042.ge2c50893.el8.x86_64 24/134 2023-07-21T07:33:09.543 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:18.0.0-5042.ge2c50893.el8.x86_64 25/134 2023-07-21T07:33:09.543 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:18.0.0-5042.ge2c50893.el8.x86_64 26/134 2023-07-21T07:33:09.544 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 27/134 2023-07-21T07:33:09.544 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:18.0.0-5042.ge2c50893.el8.x86_64 28/134 2023-07-21T07:33:09.544 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5042.ge2c50893. 29/134 2023-07-21T07:33:09.544 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5042.ge2c50893.el8.noa 30/134 2023-07-21T07:33:09.552 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5042.ge2c50893.el8.n 31/134 2023-07-21T07:33:09.552 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5042.ge2c 32/134 2023-07-21T07:33:09.552 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5042.ge2c50893.el 33/134 2023-07-21T07:33:09.552 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5042.ge2c50893.el8.noarch 34/134 2023-07-21T07:33:09.552 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5042.ge2c50893.e 35/134 2023-07-21T07:33:09.553 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-volume-2:18.0.0-5042.ge2c50893.el8.noarch 36/134 2023-07-21T07:33:09.553 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephadm-2:18.0.0-5042.ge2c50893.el8.noarch 37/134 2023-07-21T07:33:09.553 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-top-2:18.0.0-5042.ge2c50893.el8.noarch 38/134 2023-07-21T07:33:09.553 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-21T07:33:09.553 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-21T07:33:09.553 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-21T07:33:09.553 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-21T07:33:09.553 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-21T07:33:09.554 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-21T07:33:09.554 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-21T07:33:09.554 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-21T07:33:09.554 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-21T07:33:09.554 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-21T07:33:09.554 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-21T07:33:09.554 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-21T07:33:09.555 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-21T07:33:09.555 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-21T07:33:09.555 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-21T07:33:09.555 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-21T07:33:09.555 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-21T07:33:09.555 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-21T07:33:09.555 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-21T07:33:09.555 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-21T07:33:09.556 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-21T07:33:09.556 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-21T07:33:09.556 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-21T07:33:09.556 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-21T07:33:09.556 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-21T07:33:09.556 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-21T07:33:09.556 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-21T07:33:09.557 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-21T07:33:09.557 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-21T07:33:09.557 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-21T07:33:09.557 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-21T07:33:09.557 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-21T07:33:09.557 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-21T07:33:09.558 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-21T07:33:09.558 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-21T07:33:09.558 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-21T07:33:09.558 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-21T07:33:09.558 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-21T07:33:09.558 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-21T07:33:09.558 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-21T07:33:09.559 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-21T07:33:09.559 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-21T07:33:09.559 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-21T07:33:09.559 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-21T07:33:09.559 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-21T07:33:09.559 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-21T07:33:09.559 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-21T07:33:09.559 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-21T07:33:09.560 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-21T07:33:09.560 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-21T07:33:09.560 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-21T07:33:09.560 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-21T07:33:09.560 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-21T07:33:09.560 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-21T07:33:09.561 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-21T07:33:09.561 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-21T07:33:09.561 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-21T07:33:09.561 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-21T07:33:09.561 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-21T07:33:09.561 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-21T07:33:09.561 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-21T07:33:09.561 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-21T07:33:09.562 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-21T07:33:09.562 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-21T07:33:09.562 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-21T07:33:09.562 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-21T07:33:09.562 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-21T07:33:09.562 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-21T07:33:09.562 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-21T07:33:09.562 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-21T07:33:09.563 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-21T07:33:09.563 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-21T07:33:09.563 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-21T07:33:09.563 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-21T07:33:09.563 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-21T07:33:09.563 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-21T07:33:09.564 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-21T07:33:09.564 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-21T07:33:09.564 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-21T07:33:09.564 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-21T07:33:09.564 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-21T07:33:09.564 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-21T07:33:09.564 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-21T07:33:09.565 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-21T07:33:09.565 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-21T07:33:09.565 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-21T07:33:09.565 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-21T07:33:09.565 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-21T07:33:09.565 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-21T07:33:09.565 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-21T07:33:09.565 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:18.0.0-5042.ge2c50893.el8.x86_64 129/134 2023-07-21T07:33:09.566 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-21T07:33:09.566 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:18.0.0-5042.ge2c50893.el8.x86_64 131/134 2023-07-21T07:33:09.566 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T07:33:09.566 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-21T07:33:09.743 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-21T07:33:09.910 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T07:33:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T07:33:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:18.0.0-5042.ge2c50893.el8.x86_64 1/134 2023-07-21T07:33:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:18.0.0-5042.ge2c50893.el8.x86_64 2/134 2023-07-21T07:33:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:18.0.0-5042.ge2c50893.el8.x86_64 3/134 2023-07-21T07:33:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:18.0.0-5042.ge2c50893.el8.x86_64 4/134 2023-07-21T07:33:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5042.ge2c50 5/134 2023-07-21T07:33:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:18.0.0-5042.ge2c50893.el8.x86_64 6/134 2023-07-21T07:33:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:18.0.0-5042.ge2c50893.el8.x86_64 7/134 2023-07-21T07:33:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:18.0.0-5042.ge2c50893.el8.x86_64 8/134 2023-07-21T07:33:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:18.0.0-5042.ge2c50893.el8.x86_64 9/134 2023-07-21T07:33:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:18.0.0-5042.ge2c50893.el8.x86_64 10/134 2023-07-21T07:33:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:18.0.0-5042.ge2c50893.el8.x86_64 11/134 2023-07-21T07:33:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:18.0.0-5042.ge2c50893.el8.x86_64 12/134 2023-07-21T07:33:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 13/134 2023-07-21T07:33:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:18.0.0-5042.ge2c50893.el8.x86_ 14/134 2023-07-21T07:33:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:18.0.0-5042.ge2c50893.el8.x86_64 15/134 2023-07-21T07:33:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:18.0.0-5042.ge2c50893.el8.x86_64 16/134 2023-07-21T07:33:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:18.0.0-5042.ge2c50893.el8.x86_6 17/134 2023-07-21T07:33:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:18.0.0-5042.ge2c50893.el8.x86 18/134 2023-07-21T07:33:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:18.0.0-5042.ge2c50893.el8.x86_64 19/134 2023-07-21T07:33:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5042.ge2c50893.el 20/134 2023-07-21T07:33:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:18.0.0-5042.ge2c50893.el8. 21/134 2023-07-21T07:33:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:18.0.0-5042.ge2c50893.el8.x86_6 22/134 2023-07-21T07:33:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:18.0.0-5042.ge2c50893.el8.x86_64 23/134 2023-07-21T07:33:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:18.0.0-5042.ge2c50893.el8.x86_64 24/134 2023-07-21T07:33:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:18.0.0-5042.ge2c50893.el8.x86_64 25/134 2023-07-21T07:33:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:18.0.0-5042.ge2c50893.el8.x86_64 26/134 2023-07-21T07:33:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 27/134 2023-07-21T07:33:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:18.0.0-5042.ge2c50893.el8.x86_64 28/134 2023-07-21T07:33:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5042.ge2c50893. 29/134 2023-07-21T07:33:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5042.ge2c50893.el8.noa 30/134 2023-07-21T07:33:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5042.ge2c50893.el8.n 31/134 2023-07-21T07:33:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5042.ge2c 32/134 2023-07-21T07:33:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5042.ge2c50893.el 33/134 2023-07-21T07:33:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5042.ge2c50893.el8.noarch 34/134 2023-07-21T07:33:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5042.ge2c50893.e 35/134 2023-07-21T07:33:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:18.0.0-5042.ge2c50893.el8.noarch 36/134 2023-07-21T07:33:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:18.0.0-5042.ge2c50893.el8.noarch 37/134 2023-07-21T07:33:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:18.0.0-5042.ge2c50893.el8.noarch 38/134 2023-07-21T07:33:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-21T07:33:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-21T07:33:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-21T07:33:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-21T07:33:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-21T07:33:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-21T07:33:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-21T07:33:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-21T07:33:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-21T07:33:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-21T07:33:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-21T07:33:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-21T07:33:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-21T07:33:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-21T07:33:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-21T07:33:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-21T07:33:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-21T07:33:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-21T07:33:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-21T07:33:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-21T07:33:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-21T07:33:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-21T07:33:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-21T07:33:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-21T07:33:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-21T07:33:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-21T07:33:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-21T07:33:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-21T07:33:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-21T07:33:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-21T07:33:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-21T07:33:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-21T07:33:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-21T07:33:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-07-21T07:33:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-07-21T07:33:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-07-21T07:33:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-07-21T07:33:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-07-21T07:33:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-07-21T07:33:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-07-21T07:33:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-07-21T07:33:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-07-21T07:33:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-07-21T07:33:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-07-21T07:33:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-07-21T07:33:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-07-21T07:33:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-07-21T07:33:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-07-21T07:33:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-07-21T07:33:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-07-21T07:33:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-07-21T07:33:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-07-21T07:33:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-07-21T07:33:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-07-21T07:33:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-07-21T07:33:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-07-21T07:33:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-07-21T07:33:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-07-21T07:33:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-07-21T07:33:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-07-21T07:33:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-07-21T07:33:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-07-21T07:33:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-07-21T07:33:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-07-21T07:33:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-07-21T07:33:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-07-21T07:33:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-07-21T07:33:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-07-21T07:33:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-07-21T07:33:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-07-21T07:33:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-07-21T07:33:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-07-21T07:33:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-07-21T07:33:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-07-21T07:33:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-07-21T07:33:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-07-21T07:33:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-07-21T07:33:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-07-21T07:33:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-07-21T07:33:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-07-21T07:33:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-07-21T07:33:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-07-21T07:33:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-07-21T07:33:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-07-21T07:33:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-07-21T07:33:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-07-21T07:33:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-07-21T07:33:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-07-21T07:33:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-07-21T07:33:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-07-21T07:33:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:18.0.0-5042.ge2c50893.el8.x86_64 129/134 2023-07-21T07:33:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-21T07:33:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:18.0.0-5042.ge2c50893.el8.x86_64 131/134 2023-07-21T07:33:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T07:33:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-21T07:33:12.119 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T07:33:12.119 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:04:04 ago on Fri 21 Jul 2023 07:29:08 AM UTC. 2023-07-21T07:33:12.916 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T07:33:12.916 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:04:03 ago on Fri 21 Jul 2023 07:29:09 AM UTC. 2023-07-21T07:33:14.890 INFO:teuthology.orchestra.run.smithi086.stdout:Installed products updated. 2023-07-21T07:33:15.132 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:15.133 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2023-07-21T07:33:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-21T07:33:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.133 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.134 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2023-07-21T07:33:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-21T07:33:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: automake-1.16.1-7.el8.noarch 2023-07-21T07:33:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: bison-3.0.4-10.el8.x86_64 2023-07-21T07:33:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.134 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:15.135 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.136 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-21T07:33:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: flex-2.6.1-9.el8.x86_64 2023-07-21T07:33:15.137 INFO:teuthology.orchestra.run.smithi086.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-21T07:33:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-21T07:33:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: jq-1.6-3.el8.x86_64 2023-07-21T07:33:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-21T07:33:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-21T07:33:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-21T07:33:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.138 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-21T07:33:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-21T07:33:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-21T07:33:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: libpq-13.5-1.el8.x86_64 2023-07-21T07:33:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-21T07:33:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-21T07:33:15.139 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-21T07:33:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-21T07:33:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-21T07:33:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-21T07:33:15.140 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-21T07:33:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-21T07:33:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-21T07:33:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-21T07:33:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-21T07:33:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-21T07:33:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-21T07:33:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-21T07:33:15.141 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-21T07:33:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-21T07:33:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-21T07:33:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T07:33:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T07:33:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T07:33:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-21T07:33:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-21T07:33:15.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-21T07:33:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-21T07:33:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-21T07:33:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-21T07:33:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-21T07:33:15.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-21T07:33:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-21T07:33:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-21T07:33:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-21T07:33:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-21T07:33:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-21T07:33:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-21T07:33:15.144 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-21T07:33:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-21T07:33:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-21T07:33:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-21T07:33:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-21T07:33:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-21T07:33:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-21T07:33:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-21T07:33:15.145 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-21T07:33:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-21T07:33:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-21T07:33:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-21T07:33:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-21T07:33:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-2.6-1.el8.noarch 2023-07-21T07:33:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-21T07:33:15.146 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-21T07:33:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-21T07:33:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-21T07:33:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-21T07:33:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-21T07:33:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-21T07:33:15.147 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-21T07:33:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-21T07:33:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-21T07:33:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-21T07:33:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-21T07:33:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-21T07:33:15.148 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-21T07:33:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-21T07:33:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-21T07:33:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-21T07:33:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-21T07:33:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-21T07:33:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-21T07:33:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-21T07:33:15.149 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-21T07:33:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-21T07:33:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-21T07:33:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-21T07:33:15.150 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-21T07:33:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-21T07:33:15.151 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:15.151 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2023-07-21T07:33:15.363 DEBUG:teuthology.parallel:result is None 2023-07-21T07:33:16.275 INFO:teuthology.orchestra.run.smithi006.stdout:Installed products updated. 2023-07-21T07:33:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:16.528 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2023-07-21T07:33:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-21T07:33:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.529 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2023-07-21T07:33:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-21T07:33:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.1-7.el8.noarch 2023-07-21T07:33:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.0.4-10.el8.x86_64 2023-07-21T07:33:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.529 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.530 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.531 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.532 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:18.0.0-5042.ge2c50893.el8.noarch 2023-07-21T07:33:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-21T07:33:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.1-9.el8.x86_64 2023-07-21T07:33:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-21T07:33:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-21T07:33:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: jq-1.6-3.el8.x86_64 2023-07-21T07:33:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-21T07:33:16.533 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-21T07:33:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-21T07:33:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-21T07:33:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-21T07:33:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-21T07:33:16.534 INFO:teuthology.orchestra.run.smithi006.stdout: libpq-13.5-1.el8.x86_64 2023-07-21T07:33:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-21T07:33:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-21T07:33:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-21T07:33:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.535 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-21T07:33:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-21T07:33:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-21T07:33:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-21T07:33:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-21T07:33:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-21T07:33:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-21T07:33:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-21T07:33:16.536 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-21T07:33:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-21T07:33:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-21T07:33:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-21T07:33:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-21T07:33:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-21T07:33:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T07:33:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T07:33:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T07:33:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-21T07:33:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-21T07:33:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-21T07:33:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-21T07:33:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-21T07:33:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-21T07:33:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-21T07:33:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-21T07:33:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-21T07:33:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-21T07:33:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-21T07:33:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-21T07:33:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-21T07:33:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-21T07:33:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-21T07:33:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-21T07:33:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-21T07:33:16.540 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-21T07:33:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-21T07:33:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-21T07:33:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-21T07:33:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-21T07:33:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-21T07:33:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-21T07:33:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-21T07:33:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-21T07:33:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-21T07:33:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-2.6-1.el8.noarch 2023-07-21T07:33:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-21T07:33:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-21T07:33:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-21T07:33:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-21T07:33:16.542 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-21T07:33:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-21T07:33:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-21T07:33:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-21T07:33:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.543 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-21T07:33:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-21T07:33:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-21T07:33:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-21T07:33:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-21T07:33:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-21T07:33:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-21T07:33:16.544 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-21T07:33:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-21T07:33:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-21T07:33:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-21T07:33:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-21T07:33:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-21T07:33:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.545 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:18.0.0-5042.ge2c50893.el8.x86_64 2023-07-21T07:33:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-21T07:33:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-21T07:33:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-21T07:33:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-21T07:33:16.546 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-21T07:33:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-21T07:33:16.547 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:16.547 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-07-21T07:33:16.741 DEBUG:teuthology.parallel:result is None 2023-07-21T07:33:16.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-21T07:33:22.051 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-21T07:33:22.076 INFO:teuthology.orchestra.run.smithi006.stdout:18.0.0-5042.ge2c50893.el8 2023-07-21T07:33:22.077 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5042.ge2c50893.el8 2023-07-21T07:33:22.077 INFO:teuthology.task.install:The correct ceph version 18.0.0-5042.ge2c50893 is installed. 2023-07-21T07:33:22.078 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-21T07:33:27.336 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-21T07:33:27.359 INFO:teuthology.orchestra.run.smithi086.stdout:18.0.0-5042.ge2c50893.el8 2023-07-21T07:33:27.360 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5042.ge2c50893.el8 2023-07-21T07:33:27.360 INFO:teuthology.task.install:The correct ceph version 18.0.0-5042.ge2c50893 is installed. 2023-07-21T07:33:27.360 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-21T07:33:27.361 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:33:27.361 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-21T07:33:27.405 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:33:27.406 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-21T07:33:27.515 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-21T07:33:27.516 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:33:27.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2023-07-21T07:33:27.543 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-21T07:33:27.610 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:33:27.610 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2023-07-21T07:33:27.638 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-21T07:33:27.704 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-21T07:33:27.704 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:33:27.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-21T07:33:27.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-21T07:33:27.799 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:33:27.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-21T07:33:27.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-21T07:33:27.890 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-21T07:33:27.890 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:33:27.890 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2023-07-21T07:33:27.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-21T07:33:27.985 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:33:27.986 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2023-07-21T07:33:28.012 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-21T07:33:28.078 INFO:teuthology.run_tasks:Running task ceph... 2023-07-21T07:33:28.163 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-21T07:33:28.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2023-07-21T07:33:28.167 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2023-07-21T07:33:28.193 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-21T07:33:28.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-21T07:33:28.235 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-21T07:33:28.261 INFO:tasks.ceph:Creating extra log directories... 2023-07-21T07:33:28.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-21T07:33:28.302 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-21T07:33:28.358 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-21T07:33:28.358 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-21T07:33:28.358 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-21T07:33:28.359 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:33:28.359 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-21T07:33:28.384 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-21T07:33:33.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-21T07:33:33.646 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:33:33.646 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-21T07:33:33.663 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-21T07:33:38.798 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-21T07:33:38.838 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-21T07:33:38.838 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-21T07:33:38.839 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-07-21_06:30:09-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7346414', 'branch': 'wip-vshankar-testing-20230720.042515', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7346414', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-07-21_06:30:09-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230720.042515'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230720.042515', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 632, 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5', 'sleep_before_teardown': 0, 'subset': '14/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230720.042515', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e2c50893bf78471cc8ee960317cc10390300dfd5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi006.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi086.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '79491cb69dd37a1eafb93b3471998174bdfa2fd9', 'timestamp': '2023-07-21_06:30:09', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-21T07:33:38.841 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-21T07:33:38.844 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-21T07:33:38.892 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2023-07-21T07:33:38.905 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2023-07-21T07:33:38.962 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:33:38.962 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2023-07-21T07:33:38.996 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-21T07:33:38.996 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2023-07-21T07:33:39.057 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-21T07:33:39.057 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T07:33:39.057 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 373495 Links: 1 2023-07-21T07:33:39.058 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T07:33:39.058 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T07:33:39.058 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-07-21 07:33:10.082065031 +0000 2023-07-21T07:33:39.058 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-07-21 07:28:09.176191874 +0000 2023-07-21T07:33:39.058 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-07-21 07:28:09.176191874 +0000 2023-07-21T07:33:39.058 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-07-21T07:33:39.058 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-21T07:33:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-07-21T07:33:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-07-21T07:33:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000251571 s, 2.0 MB/s 2023-07-21T07:33:39.129 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-21T07:33:39.190 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2023-07-21T07:33:39.249 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-21T07:33:39.249 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T07:33:39.249 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 378864 Links: 1 2023-07-21T07:33:39.250 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T07:33:39.250 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T07:33:39.250 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-07-21 07:33:10.082065031 +0000 2023-07-21T07:33:39.250 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-07-21 07:28:09.721186198 +0000 2023-07-21T07:33:39.250 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-07-21 07:28:09.721186198 +0000 2023-07-21T07:33:39.250 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-07-21T07:33:39.251 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-21T07:33:39.317 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-07-21T07:33:39.317 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-07-21T07:33:39.317 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000230621 s, 2.2 MB/s 2023-07-21T07:33:39.318 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-21T07:33:39.377 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2023-07-21T07:33:39.436 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-21T07:33:39.436 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T07:33:39.436 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 384065 Links: 1 2023-07-21T07:33:39.436 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T07:33:39.436 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T07:33:39.437 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-07-21 07:33:10.082065031 +0000 2023-07-21T07:33:39.437 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-07-21 07:28:10.250180688 +0000 2023-07-21T07:33:39.437 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-07-21 07:28:10.250180688 +0000 2023-07-21T07:33:39.437 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-07-21T07:33:39.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-21T07:33:39.502 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-07-21T07:33:39.502 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-07-21T07:33:39.503 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000227437 s, 2.3 MB/s 2023-07-21T07:33:39.504 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-21T07:33:39.563 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2023-07-21T07:33:39.620 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-21T07:33:39.621 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T07:33:39.621 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 373666 Links: 1 2023-07-21T07:33:39.621 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T07:33:39.621 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T07:33:39.621 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-07-21 07:33:10.082065031 +0000 2023-07-21T07:33:39.621 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-07-21 07:28:10.817174783 +0000 2023-07-21T07:33:39.622 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-07-21 07:28:10.817174783 +0000 2023-07-21T07:33:39.622 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-07-21T07:33:39.622 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-21T07:33:39.687 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-07-21T07:33:39.687 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-07-21T07:33:39.688 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000196169 s, 2.6 MB/s 2023-07-21T07:33:39.688 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-21T07:33:39.747 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T07:33:39.748 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:33:39.749 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2023-07-21T07:33:39.769 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-21T07:33:39.770 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2023-07-21T07:33:39.831 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-21T07:33:39.831 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T07:33:39.832 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 381027 Links: 1 2023-07-21T07:33:39.832 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T07:33:39.832 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T07:33:39.833 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-07-21 07:33:09.197492220 +0000 2023-07-21T07:33:39.833 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-07-21 07:25:43.980404008 +0000 2023-07-21T07:33:39.833 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-07-21 07:25:43.980404008 +0000 2023-07-21T07:33:39.833 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-07-21T07:33:39.834 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-21T07:33:39.900 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-07-21T07:33:39.900 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-07-21T07:33:39.900 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000268426 s, 1.9 MB/s 2023-07-21T07:33:39.902 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-21T07:33:39.961 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2023-07-21T07:33:40.019 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-21T07:33:40.019 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T07:33:40.019 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 371673 Links: 1 2023-07-21T07:33:40.019 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T07:33:40.019 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T07:33:40.020 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-07-21 07:33:09.197492220 +0000 2023-07-21T07:33:40.020 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-07-21 07:25:44.482392850 +0000 2023-07-21T07:33:40.020 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-07-21 07:25:44.482392850 +0000 2023-07-21T07:33:40.020 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-07-21T07:33:40.021 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-21T07:33:40.085 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-07-21T07:33:40.085 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-07-21T07:33:40.085 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000248301 s, 2.1 MB/s 2023-07-21T07:33:40.087 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-21T07:33:40.145 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2023-07-21T07:33:40.202 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-21T07:33:40.203 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T07:33:40.203 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 380928 Links: 1 2023-07-21T07:33:40.203 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T07:33:40.203 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T07:33:40.203 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-07-21 07:33:09.197492220 +0000 2023-07-21T07:33:40.203 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-07-21 07:25:44.984381693 +0000 2023-07-21T07:33:40.204 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-07-21 07:25:44.984381693 +0000 2023-07-21T07:33:40.204 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-07-21T07:33:40.204 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-21T07:33:40.268 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-07-21T07:33:40.268 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-07-21T07:33:40.268 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000256813 s, 2.0 MB/s 2023-07-21T07:33:40.269 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-21T07:33:40.327 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2023-07-21T07:33:40.384 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-21T07:33:40.385 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T07:33:40.385 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 379481 Links: 1 2023-07-21T07:33:40.385 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T07:33:40.385 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T07:33:40.386 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-07-21 07:33:09.197492220 +0000 2023-07-21T07:33:40.386 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-07-21 07:25:45.484370581 +0000 2023-07-21T07:33:40.386 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-07-21 07:25:45.484370581 +0000 2023-07-21T07:33:40.386 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-07-21T07:33:40.387 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-21T07:33:40.449 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-07-21T07:33:40.449 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-07-21T07:33:40.449 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000192736 s, 2.7 MB/s 2023-07-21T07:33:40.450 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-21T07:33:40.508 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T07:33:40.508 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-21T07:33:40.509 INFO:tasks.ceph:Generating config... 2023-07-21T07:33:40.510 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-21T07:33:40.510 INFO:tasks.ceph:[client] debug client = 20 2023-07-21T07:33:40.511 INFO:tasks.ceph:[client] debug ms = 1 2023-07-21T07:33:40.511 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-21T07:33:40.511 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-21T07:33:40.511 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-21T07:33:40.512 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-21T07:33:40.512 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-21T07:33:40.512 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-21T07:33:40.512 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-21T07:33:40.512 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-21T07:33:40.513 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-21T07:33:40.513 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-21T07:33:40.513 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-21T07:33:40.513 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-21T07:33:40.514 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-21T07:33:40.514 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-21T07:33:40.514 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-21T07:33:40.514 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-21T07:33:40.514 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-21T07:33:40.515 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-21T07:33:40.515 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-21T07:33:40.515 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-21T07:33:40.515 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-21T07:33:40.515 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-21T07:33:40.516 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-21T07:33:40.516 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-21T07:33:40.516 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-21T07:33:40.516 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-21T07:33:40.516 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-21T07:33:40.517 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-21T07:33:40.517 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-21T07:33:40.517 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-21T07:33:40.517 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-21T07:33:40.517 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-21T07:33:40.518 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-21T07:33:40.518 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-21T07:33:40.519 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-21T07:33:40.519 INFO:tasks.ceph:Setting up mon.a... 2023-07-21T07:33:40.520 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-21T07:33:40.581 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2023-07-21T07:33:40.584 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-21T07:33:40.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-21T07:33:40.663 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.b', '172.21.15.86'), ('mon.c', '[v2:172.21.15.86:3301,v1:172.21.15.86:6790]')] 2023-07-21T07:33:40.663 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-21T07:33:40.665 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:33:40.665 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-21T07:33:40.721 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --add b 172.21.15.86 --addv c '[v2:172.21.15.86:3301,v1:172.21.15.86:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:33:40.809 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:33:40.810 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid 8c602ac0-17b3-4df5-8928-640a7524b3b3 2023-07-21T07:33:40.810 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = pacific 2023-07-21T07:33:40.810 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2023-07-21T07:33:40.810 INFO:teuthology.orchestra.run.smithi006.stdout:fsid 8c602ac0-17b3-4df5-8928-640a7524b3b3 2023-07-21T07:33:40.810 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2023-07-21T07:33:40.762006+0000 2023-07-21T07:33:40.811 INFO:teuthology.orchestra.run.smithi006.stdout:created 2023-07-21T07:33:40.762006+0000 2023-07-21T07:33:40.811 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 16 (pacific) 2023-07-21T07:33:40.811 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2023-07-21T07:33:40.811 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2023-07-21T07:33:40.811 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2023-07-21T07:33:40.811 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] mon.c 2023-07-21T07:33:40.811 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-21T07:33:40.813 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-21T07:33:40.829 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8c602ac0-17b3-4df5-8928-640a7524b3b3... 2023-07-21T07:33:40.830 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-21T07:33:40.872 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-21T07:33:40.916 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2023-07-21T07:33:40.916 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2023-07-21T07:33:40.916 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-21T07:33:40.916 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2023-07-21T07:33:40.917 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.917 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2023-07-21T07:33:40.917 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.917 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2023-07-21T07:33:40.917 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.917 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2023-07-21T07:33:40.918 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2023-07-21T07:33:40.918 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.918 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2023-07-21T07:33:40.918 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2023-07-21T07:33:40.919 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.919 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-21T07:33:40.919 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2023-07-21T07:33:40.920 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.920 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2023-07-21T07:33:40.920 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-21T07:33:40.920 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.921 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2023-07-21T07:33:40.921 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.921 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2023-07-21T07:33:40.922 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2023-07-21T07:33:40.922 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2023-07-21T07:33:40.922 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2023-07-21T07:33:40.923 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2023-07-21T07:33:40.923 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2023-07-21T07:33:40.923 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2023-07-21T07:33:40.924 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-21T07:33:40.924 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-21T07:33:40.925 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2023-07-21T07:33:40.925 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.925 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-21T07:33:40.925 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.926 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2023-07-21T07:33:40.926 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.926 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2023-07-21T07:33:40.926 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.926 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2023-07-21T07:33:40.927 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2023-07-21T07:33:40.927 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2023-07-21T07:33:40.927 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2023-07-21T07:33:40.927 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on skipped message = False 2023-07-21T07:33:40.928 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 8c602ac0-17b3-4df5-8928-640a7524b3b3 2023-07-21T07:33:40.928 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.928 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2023-07-21T07:33:40.928 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2023-07-21T07:33:40.929 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.929 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2023-07-21T07:33:40.929 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2023-07-21T07:33:40.929 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2023-07-21T07:33:40.929 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.929 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2023-07-21T07:33:40.929 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2023-07-21T07:33:40.930 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.930 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2023-07-21T07:33:40.930 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2023-07-21T07:33:40.930 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2023-07-21T07:33:40.930 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.930 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2023-07-21T07:33:40.930 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2023-07-21T07:33:40.930 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.931 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2023-07-21T07:33:40.931 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.931 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2023-07-21T07:33:40.931 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.931 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2023-07-21T07:33:40.931 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.931 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2023-07-21T07:33:40.932 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2023-07-21T07:33:40.932 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.932 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2023-07-21T07:33:40.932 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2023-07-21T07:33:40.932 INFO:teuthology.orchestra.run.smithi006.stdout: bdev async discard = True 2023-07-21T07:33:40.933 INFO:teuthology.orchestra.run.smithi006.stdout: bdev enable discard = True 2023-07-21T07:33:40.933 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore allocator = bitmap 2023-07-21T07:33:40.933 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2023-07-21T07:33:40.933 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2023-07-21T07:33:40.933 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 1/20 2023-07-21T07:33:40.933 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 1/20 2023-07-21T07:33:40.933 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-21T07:33:40.934 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2023-07-21T07:33:40.934 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 4/10 2023-07-21T07:33:40.934 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2023-07-21T07:33:40.934 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2023-07-21T07:33:40.934 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2023-07-21T07:33:40.934 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2023-07-21T07:33:40.934 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2023-07-21T07:33:40.934 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-07-21T07:33:40.935 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.935 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2023-07-21T07:33:40.935 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-21T07:33:40.935 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2023-07-21T07:33:40.935 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-07-21T07:33:40.935 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-07-21T07:33:40.935 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-07-21T07:33:40.935 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-07-21T07:33:40.936 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2023-07-21T07:33:40.936 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.936 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2023-07-21T07:33:40.936 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-21T07:33:40.936 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-07-21T07:33:40.936 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2023-07-21T07:33:40.936 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-07-21T07:33:40.937 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2023-07-21T07:33:40.937 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2023-07-21T07:33:40.937 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-07-21T07:33:40.937 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2023-07-21T07:33:40.937 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2023-07-21T07:33:40.937 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-07-21T07:33:40.937 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.937 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-21T07:33:40.938 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2023-07-21T07:33:40.938 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2023-07-21T07:33:40.938 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.938 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2023-07-21T07:33:40.938 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-21T07:33:40.938 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-21T07:33:40.938 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.938 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2023-07-21T07:33:40.939 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2023-07-21T07:33:40.939 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.939 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2023-07-21T07:33:40.939 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2023-07-21T07:33:40.939 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:33:40.940 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2023-07-21T07:33:40.940 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2023-07-21T07:33:40.940 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2023-07-21T07:33:40.940 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2023-07-21T07:33:40.940 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-21T07:33:40.940 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-21T07:33:40.941 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2023-07-21T07:33:40.941 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2023-07-21T07:33:40.941 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-21T07:33:40.941 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-07-21T07:33:40.941 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-07-21T07:33:40.941 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2023-07-21T07:33:40.941 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2023-07-21T07:33:40.941 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2023-07-21T07:33:40.942 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-07-21T07:33:40.942 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-07-21T07:33:40.942 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-07-21T07:33:40.942 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2023-07-21T07:33:40.942 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2023-07-21T07:33:40.942 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2023-07-21T07:33:40.942 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds balancer = 20 2023-07-21T07:33:40.942 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-21T07:33:40.943 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2023-07-21T07:33:40.943 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2023-07-21T07:33:40.943 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2023-07-21T07:33:40.943 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2023-07-21T07:33:40.943 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-07-21T07:33:40.943 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-07-21T07:33:40.943 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-07-21T07:33:40.945 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2023-07-21T07:33:40.945 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2023-07-21T07:33:40.945 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-21T07:33:40.945 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2023-07-21T07:33:40.945 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.945 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2023-07-21T07:33:40.946 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.946 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2023-07-21T07:33:40.946 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.946 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2023-07-21T07:33:40.946 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2023-07-21T07:33:40.946 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.946 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2023-07-21T07:33:40.946 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2023-07-21T07:33:40.947 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.947 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-21T07:33:40.947 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2023-07-21T07:33:40.947 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.947 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2023-07-21T07:33:40.947 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-21T07:33:40.948 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.948 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2023-07-21T07:33:40.948 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.948 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2023-07-21T07:33:40.949 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2023-07-21T07:33:40.949 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2023-07-21T07:33:40.949 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2023-07-21T07:33:40.949 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2023-07-21T07:33:40.949 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2023-07-21T07:33:40.949 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2023-07-21T07:33:40.949 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-21T07:33:40.950 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-21T07:33:40.950 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2023-07-21T07:33:40.950 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.950 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-21T07:33:40.950 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.950 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2023-07-21T07:33:40.951 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.951 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2023-07-21T07:33:40.951 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.951 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2023-07-21T07:33:40.951 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2023-07-21T07:33:40.951 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2023-07-21T07:33:40.951 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.6,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2023-07-21T07:33:40.952 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on skipped message = False 2023-07-21T07:33:40.952 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 8c602ac0-17b3-4df5-8928-640a7524b3b3 2023-07-21T07:33:40.952 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.952 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2023-07-21T07:33:40.952 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2023-07-21T07:33:40.952 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.952 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2023-07-21T07:33:40.953 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2023-07-21T07:33:40.953 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2023-07-21T07:33:40.953 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.953 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2023-07-21T07:33:40.953 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2023-07-21T07:33:40.953 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.953 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2023-07-21T07:33:40.953 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2023-07-21T07:33:40.954 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2023-07-21T07:33:40.954 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.954 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2023-07-21T07:33:40.954 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2023-07-21T07:33:40.954 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.954 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2023-07-21T07:33:40.954 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.955 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2023-07-21T07:33:40.955 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.955 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2023-07-21T07:33:40.955 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.955 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2023-07-21T07:33:40.955 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2023-07-21T07:33:40.955 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.955 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2023-07-21T07:33:40.956 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2023-07-21T07:33:40.956 INFO:teuthology.orchestra.run.smithi086.stdout: bdev async discard = True 2023-07-21T07:33:40.956 INFO:teuthology.orchestra.run.smithi086.stdout: bdev enable discard = True 2023-07-21T07:33:40.956 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore allocator = bitmap 2023-07-21T07:33:40.956 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2023-07-21T07:33:40.956 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2023-07-21T07:33:40.956 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 1/20 2023-07-21T07:33:40.957 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 1/20 2023-07-21T07:33:40.957 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-07-21T07:33:40.957 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2023-07-21T07:33:40.957 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 4/10 2023-07-21T07:33:40.957 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2023-07-21T07:33:40.957 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2023-07-21T07:33:40.957 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2023-07-21T07:33:40.957 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2023-07-21T07:33:40.958 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2023-07-21T07:33:40.958 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2023-07-21T07:33:40.958 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.958 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2023-07-21T07:33:40.958 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-07-21T07:33:40.958 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2023-07-21T07:33:40.958 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2023-07-21T07:33:40.959 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2023-07-21T07:33:40.959 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2023-07-21T07:33:40.959 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2023-07-21T07:33:40.959 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2023-07-21T07:33:40.959 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.959 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2023-07-21T07:33:40.959 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-07-21T07:33:40.959 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2023-07-21T07:33:40.960 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2023-07-21T07:33:40.960 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2023-07-21T07:33:40.960 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2023-07-21T07:33:40.960 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2023-07-21T07:33:40.960 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2023-07-21T07:33:40.961 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2023-07-21T07:33:40.961 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2023-07-21T07:33:40.961 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2023-07-21T07:33:40.961 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.962 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-21T07:33:40.962 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2023-07-21T07:33:40.962 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2023-07-21T07:33:40.963 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.963 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2023-07-21T07:33:40.963 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-21T07:33:40.963 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-21T07:33:40.964 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.964 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2023-07-21T07:33:40.964 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2023-07-21T07:33:40.965 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.965 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2023-07-21T07:33:40.965 INFO:teuthology.orchestra.run.smithi086.stdout: mon op complaint time = 120 2023-07-21T07:33:40.966 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-21T07:33:40.966 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2023-07-21T07:33:40.966 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2023-07-21T07:33:40.966 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2023-07-21T07:33:40.967 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2023-07-21T07:33:40.967 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-21T07:33:40.967 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-21T07:33:40.967 INFO:teuthology.orchestra.run.smithi086.stdout: client mount timeout = 600 2023-07-21T07:33:40.968 INFO:teuthology.orchestra.run.smithi086.stdout: debug client = 20 2023-07-21T07:33:40.968 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-07-21T07:33:40.968 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2023-07-21T07:33:40.968 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2023-07-21T07:33:40.968 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2023-07-21T07:33:40.969 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2023-07-21T07:33:40.969 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2023-07-21T07:33:40.969 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2023-07-21T07:33:40.970 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2023-07-21T07:33:40.970 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2023-07-21T07:33:40.970 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2023-07-21T07:33:40.970 INFO:teuthology.orchestra.run.smithi086.stdout:[mds] 2023-07-21T07:33:40.970 INFO:teuthology.orchestra.run.smithi086.stdout: debug mds = 20 2023-07-21T07:33:40.970 INFO:teuthology.orchestra.run.smithi086.stdout: debug mds balancer = 20 2023-07-21T07:33:40.971 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-07-21T07:33:40.971 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug frag = True 2023-07-21T07:33:40.971 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug scatterstat = True 2023-07-21T07:33:40.971 INFO:teuthology.orchestra.run.smithi086.stdout: mds op complaint time = 180 2023-07-21T07:33:40.971 INFO:teuthology.orchestra.run.smithi086.stdout: mds verify scatter = True 2023-07-21T07:33:40.971 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2023-07-21T07:33:40.971 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2023-07-21T07:33:40.972 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2023-07-21T07:33:40.972 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-21T07:33:40.972 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-21T07:33:41.043 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-21T07:33:41.043 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:33:41.043 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-21T07:33:41.060 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:33:41.060 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-21T07:33:41.117 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T07:33:41.117 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:33:41.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-21T07:33:41.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-21T07:33:41.194 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:33:41.195 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:33:41.251 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2023-07-21T07:33:41.251 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:33:41.252 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-21T07:33:41.252 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-21T07:33:41.288 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:33:41.288 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:33:41.344 INFO:tasks.ceph:Setting up mon nodes... 2023-07-21T07:33:41.345 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-21T07:33:41.345 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-21T07:33:41.400 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-21T07:33:41.402 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-21T07:33:41.462 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-21T07:33:41.464 INFO:tasks.ceph:Setting up mds nodes... 2023-07-21T07:33:41.465 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-21T07:33:41.520 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-21T07:33:41.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-21T07:33:41.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-21T07:33:41.645 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-21T07:33:41.648 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-21T07:33:41.674 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-21T07:33:41.728 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-21T07:33:41.730 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-21T07:33:41.756 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-21T07:33:41.848 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-21T07:33:41.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-21T07:33:41.876 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-21T07:33:41.877 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-21T07:33:41.971 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-21T07:33:41.984 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-21T07:33:42.027 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-21T07:33:42.047 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-21T07:33:42.048 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-21T07:33:42.048 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-21T07:33:42.076 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T07:33:42.076 INFO:tasks.ceph:role: osd.0 2023-07-21T07:33:42.077 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T07:33:42.077 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-21T07:33:42.151 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T07:33:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T07:33:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T07:33:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T07:33:42.152 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T07:33:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-07-21T07:33:42.153 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T07:33:42.153 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T07:33:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T07:33:42.154 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T07:33:42.585 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-07-21T07:33:42.587 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-07-21T07:33:42.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-21T07:33:42.782 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-21T07:33:42.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-21T07:33:42.891 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T07:33:42.892 INFO:tasks.ceph:role: osd.1 2023-07-21T07:33:42.892 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T07:33:42.892 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-21T07:33:42.968 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T07:33:42.968 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T07:33:42.968 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T07:33:42.969 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T07:33:42.969 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T07:33:42.969 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-07-21T07:33:42.969 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T07:33:42.969 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T07:33:42.969 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T07:33:42.969 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T07:33:43.375 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-07-21T07:33:43.377 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-07-21T07:33:43.377 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-21T07:33:43.504 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-21T07:33:43.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-21T07:33:43.613 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T07:33:43.613 INFO:tasks.ceph:role: osd.2 2023-07-21T07:33:43.613 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T07:33:43.614 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-21T07:33:43.691 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T07:33:43.691 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T07:33:43.691 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T07:33:43.691 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T07:33:43.692 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T07:33:43.692 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-07-21T07:33:43.692 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T07:33:43.692 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T07:33:43.692 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T07:33:43.692 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T07:33:44.134 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-07-21T07:33:44.136 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-07-21T07:33:44.137 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-21T07:33:44.315 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-21T07:33:44.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-21T07:33:44.427 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T07:33:44.427 INFO:tasks.ceph:role: osd.3 2023-07-21T07:33:44.427 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T07:33:44.427 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-21T07:33:44.505 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T07:33:44.506 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T07:33:44.506 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T07:33:44.506 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T07:33:44.506 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T07:33:44.506 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-07-21T07:33:44.507 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T07:33:44.507 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T07:33:44.507 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T07:33:44.507 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T07:33:44.936 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-07-21T07:33:44.938 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-07-21T07:33:44.939 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-21T07:33:45.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-21T07:33:45.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:33:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:45.225+0000 7f6b57b94640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-21T07:33:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:45.225+0000 7f6b57b94640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-21T07:33:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:45.225+0000 7f6b57b94640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-21T07:33:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:45.225+0000 7f6b57b94640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-21T07:33:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:45.225+0000 7f6b57b94640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-21T07:33:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:45.226+0000 7f6b57b94640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-21T07:33:48.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-21T07:33:48.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:33:48.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:48.225+0000 7f187c997640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-21T07:33:48.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:48.225+0000 7f187c997640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-21T07:33:48.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:48.225+0000 7f187c997640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-21T07:33:48.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:48.225+0000 7f187c997640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-21T07:33:48.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:48.225+0000 7f187c997640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-21T07:33:48.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:48.226+0000 7f187c997640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-21T07:33:51.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-21T07:33:51.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:33:51.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:51.221+0000 7f84c82e9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-21T07:33:51.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:51.221+0000 7f84c82e9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-21T07:33:51.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:51.221+0000 7f84c82e9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-21T07:33:51.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:51.221+0000 7f84c82e9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-21T07:33:51.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:51.221+0000 7f84c82e9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-21T07:33:51.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:51.222+0000 7f84c82e9640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-21T07:33:54.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-21T07:33:54.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:33:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:54.220+0000 7f0189aa5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-21T07:33:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:54.220+0000 7f0189aa5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-21T07:33:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:54.220+0000 7f0189aa5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-21T07:33:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:54.220+0000 7f0189aa5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-21T07:33:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:54.220+0000 7f0189aa5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-21T07:33:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:33:54.221+0000 7f0189aa5640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-21T07:33:57.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-21T07:33:57.174 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-21T07:33:57.207 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T07:33:57.207 INFO:tasks.ceph:role: osd.4 2023-07-21T07:33:57.207 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com 2023-07-21T07:33:57.208 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-21T07:33:57.284 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T07:33:57.285 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T07:33:57.285 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T07:33:57.285 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T07:33:57.285 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T07:33:57.285 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2023-07-21T07:33:57.286 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T07:33:57.286 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T07:33:57.286 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T07:33:57.286 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T07:33:57.716 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2023-07-21T07:33:57.718 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2023-07-21T07:33:57.718 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-21T07:33:57.906 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-21T07:33:57.943 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-21T07:33:58.011 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T07:33:58.011 INFO:tasks.ceph:role: osd.5 2023-07-21T07:33:58.012 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com 2023-07-21T07:33:58.012 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-21T07:33:58.086 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T07:33:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T07:33:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T07:33:58.086 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T07:33:58.087 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T07:33:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2023-07-21T07:33:58.087 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T07:33:58.087 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T07:33:58.087 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T07:33:58.087 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T07:33:58.509 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2023-07-21T07:33:58.511 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2023-07-21T07:33:58.512 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-21T07:33:58.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-21T07:33:58.656 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-21T07:33:58.723 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T07:33:58.723 INFO:tasks.ceph:role: osd.6 2023-07-21T07:33:58.724 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com 2023-07-21T07:33:58.724 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-21T07:33:58.797 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T07:33:58.798 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T07:33:58.798 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T07:33:58.798 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T07:33:58.798 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T07:33:58.798 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2023-07-21T07:33:58.798 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T07:33:58.798 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T07:33:58.799 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T07:33:58.799 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T07:33:59.250 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2023-07-21T07:33:59.252 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2023-07-21T07:33:59.252 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-21T07:33:59.422 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-21T07:33:59.456 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-21T07:33:59.524 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T07:33:59.524 INFO:tasks.ceph:role: osd.7 2023-07-21T07:33:59.524 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com 2023-07-21T07:33:59.525 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-21T07:33:59.598 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T07:33:59.598 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T07:33:59.598 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T07:33:59.598 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T07:33:59.598 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T07:33:59.598 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2023-07-21T07:33:59.599 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T07:33:59.599 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T07:33:59.599 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T07:33:59.599 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T07:34:00.036 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2023-07-21T07:34:00.038 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2023-07-21T07:34:00.039 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-21T07:34:00.215 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-21T07:34:00.249 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:34:00.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:00.307+0000 7fa43817e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-21T07:34:00.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:00.307+0000 7fa43817e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-21T07:34:00.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:00.307+0000 7fa43817e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-21T07:34:00.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:00.307+0000 7fa43817e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-21T07:34:00.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:00.307+0000 7fa43817e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-21T07:34:00.357 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:00.308+0000 7fa43817e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-21T07:34:03.231 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-21T07:34:03.264 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:34:03.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:03.305+0000 7f5935de2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-21T07:34:03.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:03.306+0000 7f5935de2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-21T07:34:03.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:03.306+0000 7f5935de2640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-21T07:34:03.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:03.306+0000 7f5935de2640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-21T07:34:03.355 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:03.306+0000 7f5935de2640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-21T07:34:03.356 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:03.306+0000 7f5935de2640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-21T07:34:06.221 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-21T07:34:06.252 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:34:06.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:06.294+0000 7facc4e8b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-21T07:34:06.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:06.294+0000 7facc4e8b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-21T07:34:06.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:06.294+0000 7facc4e8b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-21T07:34:06.344 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:06.295+0000 7facc4e8b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-21T07:34:06.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:06.295+0000 7facc4e8b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-21T07:34:06.345 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:06.295+0000 7facc4e8b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-21T07:34:08.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:34:08.845 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:34:09.207 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-21T07:34:09.238 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:34:09.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:09.280+0000 7f6701072640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-21T07:34:09.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:09.281+0000 7f6701072640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-21T07:34:09.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:09.281+0000 7f6701072640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-21T07:34:09.330 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:09.281+0000 7f6701072640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-21T07:34:09.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:09.281+0000 7f6701072640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-21T07:34:09.331 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:09.281+0000 7f6701072640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-21T07:34:12.203 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-21T07:34:12.233 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-21T07:34:12.233 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:34:12.234 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-21T07:34:12.267 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:34:12.267 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-21T07:34:12.338 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:34:12.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-21T07:34:12.408 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:34:12.409 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-21T07:34:12.478 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:34:12.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-21T07:34:12.547 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:34:12.548 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-21T07:34:12.615 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:34:12.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-21T07:34:12.685 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:34:12.685 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-21T07:34:12.716 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:34:12.717 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-21T07:34:12.787 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:34:12.788 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-21T07:34:12.857 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:34:12.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-21T07:34:12.925 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:34:12.925 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-21T07:34:12.993 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:34:12.993 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-21T07:34:13.059 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:34:13.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-21T07:34:13.125 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:34:13.126 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-21T07:34:13.146 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:34:13.147 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-21T07:34:13.181 INFO:tasks.ceph:Adding keys to all mons... 2023-07-21T07:34:13.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-21T07:34:13.188 DEBUG:teuthology.orchestra.run.smithi086:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-21T07:34:13.224 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2023-07-21T07:34:13.224 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDVNLpkkOYAFRAAxh0V44ESZiIEES+3GWKyAQ== 2023-07-21T07:34:13.224 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-07-21T07:34:13.224 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDVNLpk0z4rHBAAYud3Yf8vYEhpCM6Z6VgXHA== 2023-07-21T07:34:13.224 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-07-21T07:34:13.224 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDVNLpkNSGcIxAARuNmmUnW9ym/xs6LvW8IbQ== 2023-07-21T07:34:13.225 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2023-07-21T07:34:13.225 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDZNLpk1HKJDRAAA7k2o/9a+6cPD25oW+dzFw== 2023-07-21T07:34:13.225 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2023-07-21T07:34:13.225 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDcNLpk8USEDRAAyEhBUafsvjZmS1ohCCTVmA== 2023-07-21T07:34:13.225 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2023-07-21T07:34:13.225 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDfNLpkDEVIDRAAGx/lupvJ0CwjQw78KGvrKA== 2023-07-21T07:34:13.225 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2023-07-21T07:34:13.226 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDiNLpkdwQ7DRAAbkOprHrWx2EJ6xPNKv7QDQ== 2023-07-21T07:34:13.226 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2023-07-21T07:34:13.226 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDVNLpkWv2zGBAADpiO2+8RH3B7PbW3GZ5ndw== 2023-07-21T07:34:13.226 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-07-21T07:34:13.226 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDVNLpku4+LKBAAxi3bH3yBdtlwmeTikK80bg== 2023-07-21T07:34:13.226 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2023-07-21T07:34:13.227 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDVNLpkU+XALxAAxJNRVW7qFMskSDxzL3C/cA== 2023-07-21T07:34:13.227 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2023-07-21T07:34:13.227 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDoNLpkdOldEhAAhUmrtb4x6TODMTc92laajg== 2023-07-21T07:34:13.227 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2023-07-21T07:34:13.227 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDrNLpk/+5CEhAA1WwlM+hQhnRj1Z2e8XC95A== 2023-07-21T07:34:13.227 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2023-07-21T07:34:13.227 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDuNLpkIN+YERAAze6JtDcxO3PCh12/2nVF+g== 2023-07-21T07:34:13.228 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2023-07-21T07:34:13.228 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDxNLpkU2LGEBAAY6RKoHI1Qo2NK7L2/gWtNw== 2023-07-21T07:34:13.228 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T07:34:13.228 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDVNLpkoWkHNxAAuz8SyrpFX/iEiqy/znfHAQ== 2023-07-21T07:34:13.228 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2023-07-21T07:34:13.228 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDVNLpkvOxjOhAA2c1WuwU8rO+o7NzkpQOe0w== 2023-07-21T07:34:13.245 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.y] 2023-07-21T07:34:13.246 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDVNLpkkOYAFRAAxh0V44ESZiIEES+3GWKyAQ== 2023-07-21T07:34:13.246 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2023-07-21T07:34:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDVNLpk0z4rHBAAYud3Yf8vYEhpCM6Z6VgXHA== 2023-07-21T07:34:13.247 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2023-07-21T07:34:13.247 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDVNLpkNSGcIxAARuNmmUnW9ym/xs6LvW8IbQ== 2023-07-21T07:34:13.247 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.0] 2023-07-21T07:34:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDZNLpk1HKJDRAAA7k2o/9a+6cPD25oW+dzFw== 2023-07-21T07:34:13.248 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.1] 2023-07-21T07:34:13.248 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDcNLpk8USEDRAAyEhBUafsvjZmS1ohCCTVmA== 2023-07-21T07:34:13.249 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.2] 2023-07-21T07:34:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDfNLpkDEVIDRAAGx/lupvJ0CwjQw78KGvrKA== 2023-07-21T07:34:13.249 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.3] 2023-07-21T07:34:13.249 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDiNLpkdwQ7DRAAbkOprHrWx2EJ6xPNKv7QDQ== 2023-07-21T07:34:13.250 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.x] 2023-07-21T07:34:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDVNLpkWv2zGBAADpiO2+8RH3B7PbW3GZ5ndw== 2023-07-21T07:34:13.250 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2023-07-21T07:34:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDVNLpku4+LKBAAxi3bH3yBdtlwmeTikK80bg== 2023-07-21T07:34:13.251 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2023-07-21T07:34:13.251 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDVNLpkU+XALxAAxJNRVW7qFMskSDxzL3C/cA== 2023-07-21T07:34:13.251 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.4] 2023-07-21T07:34:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDoNLpkdOldEhAAhUmrtb4x6TODMTc92laajg== 2023-07-21T07:34:13.252 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.5] 2023-07-21T07:34:13.252 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDrNLpk/+5CEhAA1WwlM+hQhnRj1Z2e8XC95A== 2023-07-21T07:34:13.252 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.6] 2023-07-21T07:34:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDuNLpkIN+YERAAze6JtDcxO3PCh12/2nVF+g== 2023-07-21T07:34:13.253 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.7] 2023-07-21T07:34:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDxNLpkU2LGEBAAY6RKoHI1Qo2NK7L2/gWtNw== 2023-07-21T07:34:13.253 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2023-07-21T07:34:13.253 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDVNLpkoWkHNxAAuz8SyrpFX/iEiqy/znfHAQ== 2023-07-21T07:34:13.253 INFO:teuthology.orchestra.run.smithi086.stdout:[client.1] 2023-07-21T07:34:13.254 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDVNLpkvOxjOhAA2c1WuwU8rO+o7NzkpQOe0w== 2023-07-21T07:34:13.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T07:34:13.271 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T07:34:13.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T07:34:13.349 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T07:34:13.409 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T07:34:13.412 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T07:34:13.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:13.471 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:13.523 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:13.525 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:13.579 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:13.581 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:13.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:13.636 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:13.688 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T07:34:13.690 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T07:34:13.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T07:34:13.746 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T07:34:13.802 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T07:34:13.804 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T07:34:13.860 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:13.862 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:13.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:13.918 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:13.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:13.973 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:14.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:14.028 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T07:34:14.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T07:34:14.084 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T07:34:14.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T07:34:14.143 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T07:34:14.200 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-21T07:34:14.200 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-21T07:34:14.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-21T07:34:14.328 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-21T07:34:14.355 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-21T07:34:14.382 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-21T07:34:14.481 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-21T07:34:14.507 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-21T07:34:14.574 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-21T07:34:14.671 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-21T07:34:14.699 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:34:14.702 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-21T07:34:14.755 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-21T07:34:14.756 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-21T07:34:14.756 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-21T07:34:14.759 INFO:tasks.ceph.mon.a:Started 2023-07-21T07:34:14.759 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-21T07:34:14.760 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-21T07:34:14.797 INFO:tasks.ceph.mon.b:Started 2023-07-21T07:34:14.797 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-21T07:34:14.798 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-21T07:34:14.799 INFO:tasks.ceph.mon.c:Started 2023-07-21T07:34:14.800 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-21T07:34:14.800 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-21T07:34:14.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-21T07:34:14.802 INFO:tasks.ceph.mgr.y:Started 2023-07-21T07:34:14.802 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-21T07:34:14.803 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-21T07:34:14.805 INFO:tasks.ceph.mgr.x:Started 2023-07-21T07:34:14.805 INFO:tasks.ceph:Setting crush tunables to default 2023-07-21T07:34:14.805 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2023-07-21T07:34:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.882+0000 7f691d138700 1 Processor -- start 2023-07-21T07:34:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.882+0000 7f691d138700 1 -- start start 2023-07-21T07:34:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691d138700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f69180ba140 0x7f69180c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691d138700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 0x7f69180c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691d138700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6918155530 con 0x7f691806a300 2023-07-21T07:34:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691d138700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69180c1a30 con 0x7f69180ba140 2023-07-21T07:34:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691d138700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6918154920 con 0x7f691806d8a0 2023-07-21T07:34:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f6916d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f691806a300 0x7f69181519b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39792/0 (socket says 172.21.15.6:39792) 2023-07-21T07:34:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f6916d9d700 1 -- 172.21.15.6:0/2199991433 learned_addr learned my addr 172.21.15.6:0/2199991433 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691659c700 1 --2- 172.21.15.6:0/2199991433 >> v2:172.21.15.86:3300/0 conn(0x7f69180ba140 0x7f69180c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691759e700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 0x7f69180c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691659c700 1 -- 172.21.15.6:0/2199991433 >> v2:172.21.15.86:3300/0 conn(0x7f69180ba140 msgr2=0x7f69180c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-21T07:34:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691659c700 1 -- 172.21.15.6:0/2199991433 >> v2:172.21.15.86:3300/0 conn(0x7f69180ba140 msgr2=0x7f69180c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T07:34:14.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691659c700 1 --2- 172.21.15.6:0/2199991433 >> v2:172.21.15.86:3300/0 conn(0x7f69180ba140 0x7f69180c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T07:34:14.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691759e700 1 -- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 msgr2=0x7f69180c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-21T07:34:14.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691759e700 1 -- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 msgr2=0x7f69180c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T07:34:14.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691759e700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 0x7f69180c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T07:34:14.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.883+0000 7f691659c700 1 --2- 172.21.15.6:0/2199991433 >> v2:172.21.15.86:3300/0 conn(0x7f69180ba140 0x7f69180c4a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T07:34:14.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:14.884+0000 7f691759e700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 0x7f69180c4f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T07:34:15.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.084+0000 7f691659c700 1 --2- 172.21.15.6:0/2199991433 >> v2:172.21.15.86:3300/0 conn(0x7f69180ba140 0x7f69180c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:15.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.084+0000 7f691659c700 1 -- 172.21.15.6:0/2199991433 >> v2:172.21.15.86:3300/0 conn(0x7f69180ba140 msgr2=0x7f69180c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-21T07:34:15.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.084+0000 7f691659c700 1 -- 172.21.15.6:0/2199991433 >> v2:172.21.15.86:3300/0 conn(0x7f69180ba140 msgr2=0x7f69180c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T07:34:15.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.084+0000 7f691659c700 1 --2- 172.21.15.6:0/2199991433 >> v2:172.21.15.86:3300/0 conn(0x7f69180ba140 0x7f69180c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T07:34:15.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.084+0000 7f691659c700 1 --2- 172.21.15.6:0/2199991433 >> v2:172.21.15.86:3300/0 conn(0x7f69180ba140 0x7f69180c4a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T07:34:15.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.085+0000 7f691759e700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 0x7f69180c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:15.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.085+0000 7f691759e700 1 -- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 msgr2=0x7f69180c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-21T07:34:15.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.085+0000 7f691759e700 1 -- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 msgr2=0x7f69180c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T07:34:15.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.085+0000 7f691759e700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 0x7f69180c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T07:34:15.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.085+0000 7f691759e700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 0x7f69180c4f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T07:34:15.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610956945 0 0) 0x7f6918155530 con 0x7f691806a300 2023-07-21T07:34:15.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69040035b0 con 0x7f691806a300 2023-07-21T07:34:15.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2682912493 0 0) 0x7f69040035b0 con 0x7f691806a300 2023-07-21T07:34:15.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 msgr2=0x7f69180c4f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T07:34:15.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 0x7f69180c4f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 >> v2:172.21.15.86:3300/0 conn(0x7f69180ba140 msgr2=0x7f69180c4a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T07:34:15.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 --2- 172.21.15.6:0/2199991433 >> v2:172.21.15.86:3300/0 conn(0x7f69180ba140 0x7f69180c4a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6918154c00 con 0x7f691806a300 2023-07-21T07:34:15.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f69100019f0 con 0x7f691806a300 2023-07-21T07:34:15.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 >> v1:172.21.15.6:6789/0 conn(0x7f691806a300 legacy=0x7f69181519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:15.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6904003a00 0x7f6904003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:15.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6904004850 0x7f6904004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:15.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 0x7f69040052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:15.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69180c1a30 con 0x7f6904003a00 2023-07-21T07:34:15.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6918154920 con 0x7f6904004850 2023-07-21T07:34:15.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690400bbf0 con 0x7f691806d8a0 2023-07-21T07:34:15.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6916d9d700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6904003a00 0x7f6904003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:15.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f691659c700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6904004850 0x7f6904004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:15.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f691759e700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 0x7f69040052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:15.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6916d9d700 1 -- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 msgr2=0x7f69040052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:15.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6916d9d700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f691806d8a0 0x7f69040052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6916d9d700 1 -- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6904004850 msgr2=0x7f6904004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:15.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6916d9d700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6904004850 0x7f6904004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.091+0000 7f6916d9d700 1 -- 172.21.15.6:0/2199991433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69040035b0 con 0x7f6904003a00 2023-07-21T07:34:15.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.092+0000 7f6916d9d700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6904003a00 0x7f6904003e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f691000a8d0 tx=0x7f6904005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb66161948d5b6d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:15.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.092+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000a340 con 0x7f6904003a00 2023-07-21T07:34:15.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.092+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6910012600 con 0x7f6904003a00 2023-07-21T07:34:15.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.092+0000 7f6915d9b700 1 -- 172.21.15.6:0/2199991433 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69100129b0 con 0x7f6904003a00 2023-07-21T07:34:15.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.092+0000 7f691d138700 1 -- 172.21.15.6:0/2199991433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6904003a00 msgr2=0x7f6904003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:15.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.092+0000 7f691d138700 1 --2- 172.21.15.6:0/2199991433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6904003a00 0x7f6904003e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f691000a8d0 tx=0x7f6904005880 comp rx=0 tx=0).stop 2023-07-21T07:34:15.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.092+0000 7f691759e700 1 -- 172.21.15.6:0/2199991433 reap_dead start 2023-07-21T07:34:15.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.092+0000 7f691d138700 1 -- 172.21.15.6:0/2199991433 shutdown_connections 2023-07-21T07:34:15.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.092+0000 7f691d138700 1 -- 172.21.15.6:0/2199991433 >> 172.21.15.6:0/2199991433 conn(0x7f69180a8660 msgr2=0x7f69180a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:15.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.093+0000 7f691d138700 1 -- 172.21.15.6:0/2199991433 shutdown_connections 2023-07-21T07:34:15.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.093+0000 7f691d138700 1 -- 172.21.15.6:0/2199991433 wait complete. 2023-07-21T07:34:15.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.094+0000 7f691d138700 1 Processor -- start 2023-07-21T07:34:15.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.094+0000 7f691d138700 1 -- start start 2023-07-21T07:34:15.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691d138700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6904003a00 0x7f6918071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:15.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691d138700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69181ed3f0 0x7f69180be300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:15.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691d138700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69181ea530 0x7f69181ea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:15.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691d138700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69181e9e20 con 0x7f69181ea530 2023-07-21T07:34:15.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691d138700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69180c0b70 con 0x7f6904003a00 2023-07-21T07:34:15.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691d138700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691814bf50 con 0x7f69181ed3f0 2023-07-21T07:34:15.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69181ea530 0x7f69181ea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:15.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69181ea530 0x7f69181ea9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60034/0 (socket says 172.21.15.6:60034) 2023-07-21T07:34:15.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691759e700 1 -- 172.21.15.6:0/625909654 learned_addr learned my addr 172.21.15.6:0/625909654 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:15.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f6916d9d700 1 --2- 172.21.15.6:0/625909654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6904003a00 0x7f6918071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:15.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691659c700 1 --2- 172.21.15.6:0/625909654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69181ed3f0 0x7f69180be300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:15.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691759e700 1 -- 172.21.15.6:0/625909654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69181ed3f0 msgr2=0x7f69180be300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:15.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691759e700 1 --2- 172.21.15.6:0/625909654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69181ed3f0 0x7f69180be300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691759e700 1 -- 172.21.15.6:0/625909654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6904003a00 msgr2=0x7f6918071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:15.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691759e700 1 --2- 172.21.15.6:0/625909654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6904003a00 0x7f6918071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691759e700 1 -- 172.21.15.6:0/625909654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691814c230 con 0x7f69181ea530 2023-07-21T07:34:15.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.095+0000 7f691759e700 1 --2- 172.21.15.6:0/625909654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69181ea530 0x7f69181ea9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f69180c1f00 tx=0x7f690800e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:15.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.096+0000 7f690f7fe700 1 -- 172.21.15.6:0/625909654 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800ee10 con 0x7f69181ea530 2023-07-21T07:34:15.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.096+0000 7f690f7fe700 1 -- 172.21.15.6:0/625909654 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690800c040 con 0x7f69181ea530 2023-07-21T07:34:15.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.096+0000 7f691d138700 1 -- 172.21.15.6:0/625909654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691814c510 con 0x7f69181ea530 2023-07-21T07:34:15.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.096+0000 7f690f7fe700 1 -- 172.21.15.6:0/625909654 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690801e650 con 0x7f69181ea530 2023-07-21T07:34:15.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.096+0000 7f691d138700 1 -- 172.21.15.6:0/625909654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6918072110 con 0x7f69181ea530 2023-07-21T07:34:15.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.096+0000 7f690f7fe700 1 -- 172.21.15.6:0/625909654 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f690801eb50 con 0x7f69181ea530 2023-07-21T07:34:15.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.096+0000 7f690f7fe700 1 -- 172.21.15.6:0/625909654 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f690801d3c0 con 0x7f69181ea530 2023-07-21T07:34:15.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.097+0000 7f691d138700 1 -- 172.21.15.6:0/625909654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691814c700 con 0x7f69181ea530 2023-07-21T07:34:15.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.099+0000 7f690f7fe700 1 -- 172.21.15.6:0/625909654 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f690803cb00 con 0x7f69181ea530 2023-07-21T07:34:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.176+0000 7f691d138700 1 -- 172.21.15.6:0/625909654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6918074500 con 0x7f69181ea530 2023-07-21T07:34:15.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.178+0000 7f690f7fe700 1 -- 172.21.15.6:0/625909654 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f690802b070 con 0x7f69181ea530 2023-07-21T07:34:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.179+0000 7f691d138700 1 -- 172.21.15.6:0/625909654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69181ea530 msgr2=0x7f69181ea9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.179+0000 7f691d138700 1 --2- 172.21.15.6:0/625909654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69181ea530 0x7f69181ea9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f69180c1f00 tx=0x7f690800e840 comp rx=0 tx=0).stop 2023-07-21T07:34:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.179+0000 7f691d138700 1 -- 172.21.15.6:0/625909654 shutdown_connections 2023-07-21T07:34:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.179+0000 7f691d138700 1 --2- 172.21.15.6:0/625909654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69181ea530 0x7f69181ea9b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.179+0000 7f691d138700 1 --2- 172.21.15.6:0/625909654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6904003a00 0x7f6918071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.179+0000 7f691d138700 1 --2- 172.21.15.6:0/625909654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69181ed3f0 0x7f69180be300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.179+0000 7f691d138700 1 -- 172.21.15.6:0/625909654 >> 172.21.15.6:0/625909654 conn(0x7f69180a8660 msgr2=0x7f6918150bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.179+0000 7f691d138700 1 -- 172.21.15.6:0/625909654 shutdown_connections 2023-07-21T07:34:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:15.179+0000 7f691d138700 1 -- 172.21.15.6:0/625909654 wait complete. 2023-07-21T07:34:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2023-07-21T07:34:15.240 INFO:tasks.ceph:check_enable_crimson: False 2023-07-21T07:34:15.240 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-21T07:34:15.241 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:34:15.241 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-21T07:34:15.254 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:15.205+0000 7f940a281200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T07:34:15.267 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:34:15.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-21T07:34:15.319 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:15.270+0000 7f940a281200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T07:34:15.334 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:34:15.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-21T07:34:15.394 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:15.345+0000 7f940a281200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T07:34:15.401 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:34:15.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-21T07:34:15.468 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:34:15.468 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-21T07:34:15.473 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:15.424+0000 7f940a281200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T07:34:15.495 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:34:15.495 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-21T07:34:15.562 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:34:15.563 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-21T07:34:15.602 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:15.552+0000 7f713aa7a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T07:34:15.628 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:34:15.628 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-21T07:34:15.631 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:15.582+0000 7f940a281200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T07:34:15.656 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 5ceae1ca-30ae-426d-92bb-ae9cb464a5ab 0 2023-07-21T07:34:15.670 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:15.621+0000 7f713aa7a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T07:34:15.749 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:15.700+0000 7f713aa7a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T07:34:15.815 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.766+0000 7f6cbb188700 1 Processor -- start 2023-07-21T07:34:15.816 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.766+0000 7f6cbb188700 1 -- start start 2023-07-21T07:34:15.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.767+0000 7f6cbb188700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6cb40ba140 0x7f6cb40c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:15.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.767+0000 7f6cbb188700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb4155530 con 0x7f6cb406a300 2023-07-21T07:34:15.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.767+0000 7f6cbb188700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb40c5690 con 0x7f6cb406d8a0 2023-07-21T07:34:15.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.767+0000 7f6cbb188700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb40c1a30 con 0x7f6cb40ba140 2023-07-21T07:34:15.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.767+0000 7f6cb3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6cb40ba140 0x7f6cb40c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:15.818 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.767+0000 7f6cb9725700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6cb406d8a0 0x7f6cb40c4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36724/0 (socket says 172.21.15.86:36724) 2023-07-21T07:34:15.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.767+0000 7f6cb3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6cb40ba140 0x7f6cb40c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50220/0 (socket says 172.21.15.86:50220) 2023-07-21T07:34:15.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.767+0000 7f6cb9725700 1 -- 172.21.15.86:0/2155630790 learned_addr learned my addr 172.21.15.86:0/2155630790 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-07-21T07:34:15.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.767+0000 7f6cb3fff700 1 -- 172.21.15.86:0/2155630790 >> v1:172.21.15.86:6789/0 conn(0x7f6cb406d8a0 legacy=0x7f6cb40c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:15.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.767+0000 7f6cb37fe700 1 -- 172.21.15.86:0/2155630790 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689833876 0 0) 0x7f6cb40c5690 con 0x7f6cb406d8a0 2023-07-21T07:34:15.819 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.767+0000 7f6cb3fff700 1 -- 172.21.15.86:0/2155630790 >> v1:172.21.15.6:6789/0 conn(0x7f6cb406a300 legacy=0x7f6cb41519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:15.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.767+0000 7f6cb3fff700 1 -- 172.21.15.86:0/2155630790 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb4154920 con 0x7f6cb40ba140 2023-07-21T07:34:15.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.768+0000 7f6cb3fff700 1 --2- 172.21.15.86:0/2155630790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb40ba140 0x7f6cb40c4a40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009840 tx=0x7f6ca0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b9990c12f774acf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:15.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.768+0000 7f6cb37fe700 1 -- 172.21.15.86:0/2155630790 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0011830 con 0x7f6cb40ba140 2023-07-21T07:34:15.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.768+0000 7f6cb37fe700 1 -- 172.21.15.86:0/2155630790 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca0011990 con 0x7f6cb40ba140 2023-07-21T07:34:15.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.768+0000 7f6cb37fe700 1 -- 172.21.15.86:0/2155630790 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0011d20 con 0x7f6cb40ba140 2023-07-21T07:34:15.820 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.768+0000 7f6cbb188700 1 -- 172.21.15.86:0/2155630790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb40ba140 msgr2=0x7f6cb40c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:15.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.768+0000 7f6cbb188700 1 --2- 172.21.15.86:0/2155630790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb40ba140 0x7f6cb40c4a40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009840 tx=0x7f6ca0009b50 comp rx=0 tx=0).stop 2023-07-21T07:34:15.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.768+0000 7f6cbb188700 1 -- 172.21.15.86:0/2155630790 shutdown_connections 2023-07-21T07:34:15.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.768+0000 7f6cbb188700 1 --2- 172.21.15.86:0/2155630790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb40ba140 0x7f6cb40c4a40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.768+0000 7f6cbb188700 1 -- 172.21.15.86:0/2155630790 >> 172.21.15.86:0/2155630790 conn(0x7f6cb40a8660 msgr2=0x7f6cb40a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:15.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.768+0000 7f6cbb188700 1 -- 172.21.15.86:0/2155630790 shutdown_connections 2023-07-21T07:34:15.821 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.768+0000 7f6cbb188700 1 -- 172.21.15.86:0/2155630790 wait complete. 2023-07-21T07:34:15.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.770+0000 7f6cbb188700 1 Processor -- start 2023-07-21T07:34:15.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.770+0000 7f6cbb188700 1 -- start start 2023-07-21T07:34:15.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cbb188700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb406a300 0x7f6cb4157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:15.823 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cbb188700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb406d8a0 0x7f6cb414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:15.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cbb188700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb40ba140 0x7f6cb4155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:15.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cbb188700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb41ee0d0 con 0x7f6cb406a300 2023-07-21T07:34:15.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cbb188700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4158a90 con 0x7f6cb406d8a0 2023-07-21T07:34:15.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cbb188700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4154660 con 0x7f6cb40ba140 2023-07-21T07:34:15.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cb3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb406d8a0 0x7f6cb414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:15.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cb3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb406d8a0 0x7f6cb414f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50226/0 (socket says 172.21.15.86:50226) 2023-07-21T07:34:15.824 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cb3fff700 1 -- 172.21.15.86:0/2839503297 learned_addr learned my addr 172.21.15.86:0/2839503297 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-07-21T07:34:15.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cb9725700 1 --2- 172.21.15.86:0/2839503297 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb40ba140 0x7f6cb4155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:15.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cb8f24700 1 --2- 172.21.15.86:0/2839503297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb406a300 0x7f6cb4157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:15.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cb3fff700 1 -- 172.21.15.86:0/2839503297 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb40ba140 msgr2=0x7f6cb4155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:15.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cb3fff700 1 --2- 172.21.15.86:0/2839503297 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb40ba140 0x7f6cb4155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.825 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cb3fff700 1 -- 172.21.15.86:0/2839503297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb406a300 msgr2=0x7f6cb4157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:15.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cb3fff700 1 --2- 172.21.15.86:0/2839503297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb406a300 0x7f6cb4157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cb3fff700 1 -- 172.21.15.86:0/2839503297 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca00094a0 con 0x7f6cb406d8a0 2023-07-21T07:34:15.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.771+0000 7f6cb3fff700 1 --2- 172.21.15.86:0/2839503297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb406d8a0 0x7f6cb414f740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00090b0 tx=0x7f6ca0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:15.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.772+0000 7f6cb17fa700 1 -- 172.21.15.86:0/2839503297 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca001a7e0 con 0x7f6cb406d8a0 2023-07-21T07:34:15.826 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.772+0000 7f6cb17fa700 1 -- 172.21.15.86:0/2839503297 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca001a940 con 0x7f6cb406d8a0 2023-07-21T07:34:15.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.772+0000 7f6cbb188700 1 -- 172.21.15.86:0/2839503297 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb4153dc0 con 0x7f6cb406d8a0 2023-07-21T07:34:15.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.772+0000 7f6cb17fa700 1 -- 172.21.15.86:0/2839503297 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca001acb0 con 0x7f6cb406d8a0 2023-07-21T07:34:15.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.772+0000 7f6cbb188700 1 -- 172.21.15.86:0/2839503297 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb4154380 con 0x7f6cb406d8a0 2023-07-21T07:34:15.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.772+0000 7f6cb17fa700 1 -- 172.21.15.86:0/2839503297 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6ca0022070 con 0x7f6cb406d8a0 2023-07-21T07:34:15.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.772+0000 7f6cb17fa700 1 -- 172.21.15.86:0/2839503297 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6ca0024420 con 0x7f6cb406d8a0 2023-07-21T07:34:15.827 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.773+0000 7f6cbb188700 1 -- 172.21.15.86:0/2839503297 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb4155b80 con 0x7f6cb406d8a0 2023-07-21T07:34:15.828 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.775+0000 7f6cb17fa700 1 -- 172.21.15.86:0/2839503297 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6cb4155b80 con 0x7f6cb406d8a0 2023-07-21T07:34:15.831 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:15.782+0000 7f713aa7a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T07:34:15.916 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.867+0000 7f6cbb188700 1 -- 172.21.15.86:0/2839503297 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5ceae1ca-30ae-426d-92bb-ae9cb464a5ab", "id": 0} v 0) v1 -- 0x7f6cb4074500 con 0x7f6cb406d8a0 2023-07-21T07:34:15.921 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.872+0000 7f6cb17fa700 1 -- 172.21.15.86:0/2839503297 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5ceae1ca-30ae-426d-92bb-ae9cb464a5ab", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6ca0029070 con 0x7f6cb406d8a0 2023-07-21T07:34:15.922 INFO:teuthology.orchestra.run.smithi086.stdout:0 2023-07-21T07:34:15.922 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.873+0000 7f6cbb188700 1 -- 172.21.15.86:0/2839503297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb406d8a0 msgr2=0x7f6cb414f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:15.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.873+0000 7f6cbb188700 1 --2- 172.21.15.86:0/2839503297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb406d8a0 0x7f6cb414f740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00090b0 tx=0x7f6ca0004750 comp rx=0 tx=0).stop 2023-07-21T07:34:15.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.873+0000 7f6cbb188700 1 -- 172.21.15.86:0/2839503297 shutdown_connections 2023-07-21T07:34:15.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.873+0000 7f6cbb188700 1 --2- 172.21.15.86:0/2839503297 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb40ba140 0x7f6cb4155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.873+0000 7f6cbb188700 1 --2- 172.21.15.86:0/2839503297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb406a300 0x7f6cb4157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.923 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.873+0000 7f6cbb188700 1 --2- 172.21.15.86:0/2839503297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb406d8a0 0x7f6cb414f740 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:15.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.873+0000 7f6cbb188700 1 -- 172.21.15.86:0/2839503297 >> 172.21.15.86:0/2839503297 conn(0x7f6cb40a8660 msgr2=0x7f6cb40c3610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:15.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.873+0000 7f6cbb188700 1 -- 172.21.15.86:0/2839503297 shutdown_connections 2023-07-21T07:34:15.924 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:15.873+0000 7f6cbb188700 1 -- 172.21.15.86:0/2839503297 wait complete. 2023-07-21T07:34:15.934 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new b02b714f-db39-498d-8132-8eb25620599f 1 2023-07-21T07:34:15.981 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:15.931+0000 7f713aa7a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T07:34:15.995 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:15.946+0000 7f940a281200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T07:34:16.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.005+0000 7f7ebc05d700 1 Processor -- start 2023-07-21T07:34:16.058 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.005+0000 7f7ebc05d700 1 -- start start 2023-07-21T07:34:16.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7ebc05d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 0x7f7eb4154f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7ebc05d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7eb40c7bd0 0x7f7eb40c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.059 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7ebc05d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb40ca030 con 0x7f7eb40c4b90 2023-07-21T07:34:16.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7ebc05d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb40c65e0 con 0x7f7eb40c7bd0 2023-07-21T07:34:16.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7ebc05d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40c80e0 con 0x7f7eb4151ad0 2023-07-21T07:34:16.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7eb9df9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 0x7f7eb4154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7eb9df9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 0x7f7eb4154f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:47464/0 (socket says 172.21.15.86:47464) 2023-07-21T07:34:16.060 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7eb9df9700 1 -- 172.21.15.86:0/1010407861 learned_addr learned my addr 172.21.15.86:0/1010407861 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-07-21T07:34:16.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7eb95f8700 1 --2- 172.21.15.86:0/1010407861 >> v2:172.21.15.6:3300/0 conn(0x7f7eb40c7bd0 0x7f7eb40c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7eb9df9700 1 -- 172.21.15.86:0/1010407861 >> v2:172.21.15.6:3300/0 conn(0x7f7eb40c7bd0 msgr2=0x7f7eb40c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:16.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7eb9df9700 1 --2- 172.21.15.86:0/1010407861 >> v2:172.21.15.6:3300/0 conn(0x7f7eb40c7bd0 0x7f7eb40c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7eb9df9700 1 -- 172.21.15.86:0/1010407861 >> v1:172.21.15.6:6789/0 conn(0x7f7eb40c4b90 legacy=0x7f7eb40c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7eb9df9700 1 -- 172.21.15.86:0/1010407861 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4151eb0 con 0x7f7eb4151ad0 2023-07-21T07:34:16.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7eb95f8700 1 --2- 172.21.15.86:0/1010407861 >> v2:172.21.15.6:3300/0 conn(0x7f7eb40c7bd0 0x7f7eb40c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:16.061 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.006+0000 7f7eb9df9700 1 --2- 172.21.15.86:0/1010407861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 0x7f7eb4154f40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40098f0 tx=0x7f7ea4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c893b94b92a400f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:16.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.007+0000 7f7eb8df7700 1 -- 172.21.15.86:0/1010407861 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea400b8a0 con 0x7f7eb4151ad0 2023-07-21T07:34:16.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.007+0000 7f7eb8df7700 1 -- 172.21.15.86:0/1010407861 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea400ba00 con 0x7f7eb4151ad0 2023-07-21T07:34:16.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.007+0000 7f7eb8df7700 1 -- 172.21.15.86:0/1010407861 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea400bd90 con 0x7f7eb4151ad0 2023-07-21T07:34:16.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.007+0000 7f7ebc05d700 1 -- 172.21.15.86:0/1010407861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 msgr2=0x7f7eb4154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.007+0000 7f7ebc05d700 1 --2- 172.21.15.86:0/1010407861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 0x7f7eb4154f40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40098f0 tx=0x7f7ea4009c00 comp rx=0 tx=0).stop 2023-07-21T07:34:16.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.007+0000 7f7ebc05d700 1 -- 172.21.15.86:0/1010407861 shutdown_connections 2023-07-21T07:34:16.062 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.007+0000 7f7ebc05d700 1 --2- 172.21.15.86:0/1010407861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 0x7f7eb4154f40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.007+0000 7f7ebc05d700 1 --2- 172.21.15.86:0/1010407861 >> v2:172.21.15.6:3300/0 conn(0x7f7eb40c7bd0 0x7f7eb40c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.007+0000 7f7ebc05d700 1 -- 172.21.15.86:0/1010407861 >> 172.21.15.86:0/1010407861 conn(0x7f7eb40719a0 msgr2=0x7f7eb4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:16.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.007+0000 7f7ebc05d700 1 -- 172.21.15.86:0/1010407861 shutdown_connections 2023-07-21T07:34:16.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.007+0000 7f7ebc05d700 1 -- 172.21.15.86:0/1010407861 wait complete. 2023-07-21T07:34:16.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.008+0000 7f7ebc05d700 1 Processor -- start 2023-07-21T07:34:16.063 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.009+0000 7f7ebc05d700 1 -- start start 2023-07-21T07:34:16.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.009+0000 7f7ebc05d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7eb40c4b90 0x7f7eb40beb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.065 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.009+0000 7f7ebc05d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7eb40c7bd0 0x7f7eb41e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.009+0000 7f7ebc05d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 0x7f7eb41e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.009+0000 7f7ebc05d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40ac660 con 0x7f7eb40c4b90 2023-07-21T07:34:16.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.009+0000 7f7ebc05d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4155a30 con 0x7f7eb40c7bd0 2023-07-21T07:34:16.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.009+0000 7f7ebc05d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4155d10 con 0x7f7eb4151ad0 2023-07-21T07:34:16.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.009+0000 7f7eba5fa700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 0x7f7eb41e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.009+0000 7f7eb95f8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7eb40c7bd0 0x7f7eb41e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.009+0000 7f7eba5fa700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 0x7f7eb41e70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:47472/0 (socket says 172.21.15.86:47472) 2023-07-21T07:34:16.066 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.009+0000 7f7eb95f8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7eb40c7bd0 0x7f7eb41e6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50236/0 (socket says 172.21.15.86:50236) 2023-07-21T07:34:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.009+0000 7f7eba5fa700 1 -- 172.21.15.86:0/102307861 learned_addr learned my addr 172.21.15.86:0/102307861 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-07-21T07:34:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.009+0000 7f7eb9df9700 1 --2- 172.21.15.86:0/102307861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7eb40c4b90 0x7f7eb40beb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.010+0000 7f7eba5fa700 1 -- 172.21.15.86:0/102307861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7eb40c7bd0 msgr2=0x7f7eb41e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.010+0000 7f7eba5fa700 1 --2- 172.21.15.86:0/102307861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7eb40c7bd0 0x7f7eb41e6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.010+0000 7f7eba5fa700 1 -- 172.21.15.86:0/102307861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7eb40c4b90 msgr2=0x7f7eb40beb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.010+0000 7f7eba5fa700 1 --2- 172.21.15.86:0/102307861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7eb40c4b90 0x7f7eb40beb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.067 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.010+0000 7f7eba5fa700 1 -- 172.21.15.86:0/102307861 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4009550 con 0x7f7eb4151ad0 2023-07-21T07:34:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.010+0000 7f7eba5fa700 1 --2- 172.21.15.86:0/102307861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 0x7f7eb41e70f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00cc50 tx=0x7f7eac00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.010+0000 7f7eaa7fc700 1 -- 172.21.15.86:0/102307861 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac003c00 con 0x7f7eb4151ad0 2023-07-21T07:34:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.010+0000 7f7eaa7fc700 1 -- 172.21.15.86:0/102307861 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac003d60 con 0x7f7eb4151ad0 2023-07-21T07:34:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.010+0000 7f7ebc05d700 1 -- 172.21.15.86:0/102307861 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb40bf050 con 0x7f7eb4151ad0 2023-07-21T07:34:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.010+0000 7f7eaa7fc700 1 -- 172.21.15.86:0/102307861 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00aab0 con 0x7f7eb4151ad0 2023-07-21T07:34:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.010+0000 7f7ebc05d700 1 -- 172.21.15.86:0/102307861 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb40bf500 con 0x7f7eb4151ad0 2023-07-21T07:34:16.068 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.010+0000 7f7eaa7fc700 1 -- 172.21.15.86:0/102307861 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7eac0050d0 con 0x7f7eb4151ad0 2023-07-21T07:34:16.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.010+0000 7f7eaa7fc700 1 -- 172.21.15.86:0/102307861 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f7eac0125f0 con 0x7f7eb4151ad0 2023-07-21T07:34:16.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.011+0000 7f7ebc05d700 1 -- 172.21.15.86:0/102307861 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb4074500 con 0x7f7eb4151ad0 2023-07-21T07:34:16.069 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.015+0000 7f7eaa7fc700 1 -- 172.21.15.86:0/102307861 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7eb40ca030 con 0x7f7eb4151ad0 2023-07-21T07:34:16.078 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:16.029+0000 7f940a281200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T07:34:16.148 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.099+0000 7f7ebc05d700 1 -- 172.21.15.86:0/102307861 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b02b714f-db39-498d-8132-8eb25620599f", "id": 1} v 0) v1 -- 0x7f7eb406c080 con 0x7f7eb4151ad0 2023-07-21T07:34:16.156 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.107+0000 7f7eaa7fc700 1 -- 172.21.15.86:0/102307861 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b02b714f-db39-498d-8132-8eb25620599f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7eac005510 con 0x7f7eb4151ad0 2023-07-21T07:34:16.156 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-07-21T07:34:16.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.108+0000 7f7ebc05d700 1 -- 172.21.15.86:0/102307861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 msgr2=0x7f7eb41e70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.108+0000 7f7ebc05d700 1 --2- 172.21.15.86:0/102307861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 0x7f7eb41e70f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00cc50 tx=0x7f7eac00cf60 comp rx=0 tx=0).stop 2023-07-21T07:34:16.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.108+0000 7f7ebc05d700 1 -- 172.21.15.86:0/102307861 shutdown_connections 2023-07-21T07:34:16.157 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.108+0000 7f7ebc05d700 1 --2- 172.21.15.86:0/102307861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7eb4151ad0 0x7f7eb41e70f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.108+0000 7f7ebc05d700 1 --2- 172.21.15.86:0/102307861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7eb40c4b90 0x7f7eb40beb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.108+0000 7f7ebc05d700 1 --2- 172.21.15.86:0/102307861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7eb40c7bd0 0x7f7eb41e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.108+0000 7f7ebc05d700 1 -- 172.21.15.86:0/102307861 >> 172.21.15.86:0/102307861 conn(0x7f7eb40719a0 msgr2=0x7f7eb40c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:16.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.108+0000 7f7ebc05d700 1 -- 172.21.15.86:0/102307861 shutdown_connections 2023-07-21T07:34:16.158 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.108+0000 7f7ebc05d700 1 -- 172.21.15.86:0/102307861 wait complete. 2023-07-21T07:34:16.168 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new cfd9db11-934c-47d5-9455-ab05f8ee9849 2 2023-07-21T07:34:16.211 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:16.162+0000 7f940a281200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T07:34:16.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.240+0000 7f9afbbf6700 1 Processor -- start 2023-07-21T07:34:16.289 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.240+0000 7f9afbbf6700 1 -- start start 2023-07-21T07:34:16.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9afbbf6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af414f4b0 0x7f9af414f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9afbbf6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af4155d20 con 0x7f9af406d680 2023-07-21T07:34:16.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9afbbf6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af40c4ce0 con 0x7f9af40abee0 2023-07-21T07:34:16.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9afbbf6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40c5de0 con 0x7f9af414f4b0 2023-07-21T07:34:16.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9afa193700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af414f4b0 0x7f9af414f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9af9992700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9af40abee0 0x7f9af4152da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36742/0 (socket says 172.21.15.86:36742) 2023-07-21T07:34:16.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9af9992700 1 -- 172.21.15.86:0/2552983141 learned_addr learned my addr 172.21.15.86:0/2552983141 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-07-21T07:34:16.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9afa193700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af414f4b0 0x7f9af414f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:47476/0 (socket says 172.21.15.86:47476) 2023-07-21T07:34:16.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9af8990700 1 -- 172.21.15.86:0/2552983141 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307979363 0 0) 0x7f9af40c4ce0 con 0x7f9af40abee0 2023-07-21T07:34:16.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9afa193700 1 -- 172.21.15.86:0/2552983141 >> v1:172.21.15.86:6789/0 conn(0x7f9af40abee0 legacy=0x7f9af4152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9afa193700 1 -- 172.21.15.86:0/2552983141 >> v1:172.21.15.6:6789/0 conn(0x7f9af406d680 legacy=0x7f9af41561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9afa193700 1 -- 172.21.15.86:0/2552983141 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40c4fc0 con 0x7f9af414f4b0 2023-07-21T07:34:16.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9afa193700 1 --2- 172.21.15.86:0/2552983141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af414f4b0 0x7f9af414f940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009dc0 tx=0x7f9aec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b77bc537dfb57396 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:16.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9af8990700 1 -- 172.21.15.86:0/2552983141 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00e070 con 0x7f9af414f4b0 2023-07-21T07:34:16.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9af8990700 1 -- 172.21.15.86:0/2552983141 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec00bbd0 con 0x7f9af414f4b0 2023-07-21T07:34:16.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.241+0000 7f9af8990700 1 -- 172.21.15.86:0/2552983141 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec012430 con 0x7f9af414f4b0 2023-07-21T07:34:16.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.242+0000 7f9afbbf6700 1 -- 172.21.15.86:0/2552983141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af414f4b0 msgr2=0x7f9af414f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.242+0000 7f9afbbf6700 1 --2- 172.21.15.86:0/2552983141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af414f4b0 0x7f9af414f940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009dc0 tx=0x7f9aec00b330 comp rx=0 tx=0).stop 2023-07-21T07:34:16.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.242+0000 7f9afbbf6700 1 -- 172.21.15.86:0/2552983141 shutdown_connections 2023-07-21T07:34:16.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.242+0000 7f9afbbf6700 1 --2- 172.21.15.86:0/2552983141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af414f4b0 0x7f9af414f940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.242+0000 7f9afbbf6700 1 -- 172.21.15.86:0/2552983141 >> 172.21.15.86:0/2552983141 conn(0x7f9af40a8660 msgr2=0x7f9af40a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:16.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.242+0000 7f9afbbf6700 1 -- 172.21.15.86:0/2552983141 shutdown_connections 2023-07-21T07:34:16.295 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.242+0000 7f9afbbf6700 1 -- 172.21.15.86:0/2552983141 wait complete. 2023-07-21T07:34:16.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.243+0000 7f9afbbf6700 1 Processor -- start 2023-07-21T07:34:16.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.243+0000 7f9afbbf6700 1 -- start start 2023-07-21T07:34:16.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9afbbf6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af406d680 0x7f9af40bef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9afbbf6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af40abee0 0x7f9af40bf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.298 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9afbbf6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af414f4b0 0x7f9af41eac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9afbbf6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af41568c0 con 0x7f9af40abee0 2023-07-21T07:34:16.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9afbbf6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af414c5d0 con 0x7f9af414f4b0 2023-07-21T07:34:16.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9afbbf6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40c35c0 con 0x7f9af406d680 2023-07-21T07:34:16.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9af9992700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af406d680 0x7f9af40bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9afa193700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af414f4b0 0x7f9af41eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.299 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9afa193700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af414f4b0 0x7f9af41eac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50248/0 (socket says 172.21.15.86:50248) 2023-07-21T07:34:16.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9af9992700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af406d680 0x7f9af40bef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:47478/0 (socket says 172.21.15.86:47478) 2023-07-21T07:34:16.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9afa193700 1 -- 172.21.15.86:0/1603158998 learned_addr learned my addr 172.21.15.86:0/1603158998 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-07-21T07:34:16.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9af9191700 1 --2- 172.21.15.86:0/1603158998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af40abee0 0x7f9af40bf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9af9992700 1 -- 172.21.15.86:0/1603158998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af414f4b0 msgr2=0x7f9af41eac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9af9992700 1 --2- 172.21.15.86:0/1603158998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af414f4b0 0x7f9af41eac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9af9992700 1 -- 172.21.15.86:0/1603158998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af40abee0 msgr2=0x7f9af40bf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.300 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9af9992700 1 --2- 172.21.15.86:0/1603158998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af40abee0 0x7f9af40bf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9af9992700 1 -- 172.21.15.86:0/1603158998 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec009a70 con 0x7f9af406d680 2023-07-21T07:34:16.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9afa193700 1 --2- 172.21.15.86:0/1603158998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af414f4b0 0x7f9af41eac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:16.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9af9992700 1 --2- 172.21.15.86:0/1603158998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af406d680 0x7f9af40bef50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9af000c450 tx=0x7f9af000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:16.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.244+0000 7f9aea7fc700 1 -- 172.21.15.86:0/1603158998 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0004c80 con 0x7f9af406d680 2023-07-21T07:34:16.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.245+0000 7f9aea7fc700 1 -- 172.21.15.86:0/1603158998 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af0004e00 con 0x7f9af406d680 2023-07-21T07:34:16.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.245+0000 7f9afbbf6700 1 -- 172.21.15.86:0/1603158998 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af414bdc0 con 0x7f9af406d680 2023-07-21T07:34:16.301 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.245+0000 7f9aea7fc700 1 -- 172.21.15.86:0/1603158998 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0007310 con 0x7f9af406d680 2023-07-21T07:34:16.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.245+0000 7f9afbbf6700 1 -- 172.21.15.86:0/1603158998 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af414c010 con 0x7f9af406d680 2023-07-21T07:34:16.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.245+0000 7f9aea7fc700 1 -- 172.21.15.86:0/1603158998 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9af001d3f0 con 0x7f9af406d680 2023-07-21T07:34:16.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.245+0000 7f9afbbf6700 1 -- 172.21.15.86:0/1603158998 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af4074500 con 0x7f9af406d680 2023-07-21T07:34:16.302 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.245+0000 7f9aea7fc700 1 -- 172.21.15.86:0/1603158998 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f9af00137e0 con 0x7f9af406d680 2023-07-21T07:34:16.303 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:16.249+0000 7f940a281200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T07:34:16.303 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.249+0000 7f9aea7fc700 1 -- 172.21.15.86:0/1603158998 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9af00133c0 con 0x7f9af406d680 2023-07-21T07:34:16.331 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:16.281+0000 7f713aa7a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T07:34:16.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.332+0000 7f9afbbf6700 1 -- 172.21.15.86:0/1603158998 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cfd9db11-934c-47d5-9455-ab05f8ee9849", "id": 2} v 0) v1 -- 0x7f9af40ac3d0 con 0x7f9af406d680 2023-07-21T07:34:16.389 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.340+0000 7f9aea7fc700 1 -- 172.21.15.86:0/1603158998 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cfd9db11-934c-47d5-9455-ab05f8ee9849", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9af0013630 con 0x7f9af406d680 2023-07-21T07:34:16.389 INFO:teuthology.orchestra.run.smithi086.stdout:2 2023-07-21T07:34:16.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.340+0000 7f9afbbf6700 1 -- 172.21.15.86:0/1603158998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af406d680 msgr2=0x7f9af40bef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.340+0000 7f9afbbf6700 1 --2- 172.21.15.86:0/1603158998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af406d680 0x7f9af40bef50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9af000c450 tx=0x7f9af000c760 comp rx=0 tx=0).stop 2023-07-21T07:34:16.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.341+0000 7f9afbbf6700 1 -- 172.21.15.86:0/1603158998 shutdown_connections 2023-07-21T07:34:16.390 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.341+0000 7f9afbbf6700 1 --2- 172.21.15.86:0/1603158998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af414f4b0 0x7f9af41eac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.341+0000 7f9afbbf6700 1 --2- 172.21.15.86:0/1603158998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af406d680 0x7f9af40bef50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.341+0000 7f9afbbf6700 1 --2- 172.21.15.86:0/1603158998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af40abee0 0x7f9af40bf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.341+0000 7f9afbbf6700 1 -- 172.21.15.86:0/1603158998 >> 172.21.15.86:0/1603158998 conn(0x7f9af40a8660 msgr2=0x7f9af40c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:16.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.341+0000 7f9afbbf6700 1 -- 172.21.15.86:0/1603158998 shutdown_connections 2023-07-21T07:34:16.391 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.341+0000 7f9afbbf6700 1 -- 172.21.15.86:0/1603158998 wait complete. 2023-07-21T07:34:16.401 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 793561e2-f037-4898-9161-405770446e23 3 2023-07-21T07:34:16.409 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:16.360+0000 7f713aa7a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T07:34:16.547 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:16.498+0000 7f713aa7a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T07:34:16.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.512+0000 7fb071ddc700 1 Processor -- start 2023-07-21T07:34:16.562 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.512+0000 7fb071ddc700 1 -- start start 2023-07-21T07:34:16.563 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.513+0000 7fb071ddc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb06c0c3f80 0x7fb06c151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.513+0000 7fb071ddc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06c1517c0 con 0x7fb06c0c5260 2023-07-21T07:34:16.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.513+0000 7fb071ddc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06c0c4e50 con 0x7fb06c0c1860 2023-07-21T07:34:16.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.513+0000 7fb071ddc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06c1519f0 con 0x7fb06c0c3f80 2023-07-21T07:34:16.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.513+0000 7fb06b7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb06c0c1860 0x7fb06c06dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36752/0 (socket says 172.21.15.86:36752) 2023-07-21T07:34:16.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.513+0000 7fb06b7fe700 1 -- 172.21.15.86:0/2967997880 learned_addr learned my addr 172.21.15.86:0/2967997880 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-07-21T07:34:16.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.513+0000 7fb06bfff700 1 --2- 172.21.15.86:0/2967997880 >> v2:172.21.15.6:3300/0 conn(0x7fb06c0c3f80 0x7fb06c151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.564 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.514+0000 7fb06a7fc700 1 -- 172.21.15.86:0/2967997880 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189820149 0 0) 0x7fb06c0c4e50 con 0x7fb06c0c1860 2023-07-21T07:34:16.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.514+0000 7fb06a7fc700 1 -- 172.21.15.86:0/2967997880 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0540035b0 con 0x7fb06c0c1860 2023-07-21T07:34:16.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.514+0000 7fb06a7fc700 1 -- 172.21.15.86:0/2967997880 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689844645 0 0) 0x7fb06c1517c0 con 0x7fb06c0c5260 2023-07-21T07:34:16.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.514+0000 7fb06a7fc700 1 -- 172.21.15.86:0/2967997880 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb06c0c4e50 con 0x7fb06c0c5260 2023-07-21T07:34:16.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.514+0000 7fb06bfff700 1 -- 172.21.15.86:0/2967997880 >> v1:172.21.15.86:6789/0 conn(0x7fb06c0c1860 legacy=0x7fb06c06dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.514+0000 7fb06bfff700 1 -- 172.21.15.86:0/2967997880 >> v1:172.21.15.6:6789/0 conn(0x7fb06c0c5260 legacy=0x7fb06c0c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.514+0000 7fb06bfff700 1 -- 172.21.15.86:0/2967997880 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c151cd0 con 0x7fb06c0c3f80 2023-07-21T07:34:16.565 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.514+0000 7fb06bfff700 1 --2- 172.21.15.86:0/2967997880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c0c3f80 0x7fb06c151280 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb064009d90 tx=0x7fb06400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9ecbe90841988c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:16.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.514+0000 7fb06a7fc700 1 -- 172.21.15.86:0/2967997880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06400e070 con 0x7fb06c0c3f80 2023-07-21T07:34:16.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.514+0000 7fb06a7fc700 1 -- 172.21.15.86:0/2967997880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06400bb20 con 0x7fb06c0c3f80 2023-07-21T07:34:16.566 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.514+0000 7fb06a7fc700 1 -- 172.21.15.86:0/2967997880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064012430 con 0x7fb06c0c3f80 2023-07-21T07:34:16.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.515+0000 7fb071ddc700 1 -- 172.21.15.86:0/2967997880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c0c3f80 msgr2=0x7fb06c151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.515+0000 7fb071ddc700 1 --2- 172.21.15.86:0/2967997880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c0c3f80 0x7fb06c151280 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb064009d90 tx=0x7fb06400b330 comp rx=0 tx=0).stop 2023-07-21T07:34:16.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.515+0000 7fb071ddc700 1 -- 172.21.15.86:0/2967997880 shutdown_connections 2023-07-21T07:34:16.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.515+0000 7fb071ddc700 1 --2- 172.21.15.86:0/2967997880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c0c3f80 0x7fb06c151280 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.568 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.515+0000 7fb071ddc700 1 -- 172.21.15.86:0/2967997880 >> 172.21.15.86:0/2967997880 conn(0x7fb06c0a8660 msgr2=0x7fb06c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:16.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.515+0000 7fb071ddc700 1 -- 172.21.15.86:0/2967997880 shutdown_connections 2023-07-21T07:34:16.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.515+0000 7fb071ddc700 1 -- 172.21.15.86:0/2967997880 wait complete. 2023-07-21T07:34:16.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.516+0000 7fb071ddc700 1 Processor -- start 2023-07-21T07:34:16.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.516+0000 7fb071ddc700 1 -- start start 2023-07-21T07:34:16.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb071ddc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c0c1860 0x7fb06c14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb071ddc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb06c0c3f80 0x7fb06c0a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.569 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb071ddc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb06c0c5260 0x7fb06c14a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb071ddc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c1ed830 con 0x7fb06c0c1860 2023-07-21T07:34:16.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb071ddc700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c1eca70 con 0x7fb06c0c3f80 2023-07-21T07:34:16.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb071ddc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c1ecd50 con 0x7fb06c0c5260 2023-07-21T07:34:16.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb06c0c3f80 0x7fb06c0a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06bfff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb06c0c5260 0x7fb06c14a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c0c1860 0x7fb06c14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.570 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c0c1860 0x7fb06c14e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.86:40734/0 (socket says 172.21.15.86:40734) 2023-07-21T07:34:16.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06affd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb06c0c3f80 0x7fb06c0a9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50258/0 (socket says 172.21.15.86:50258) 2023-07-21T07:34:16.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06bfff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb06c0c5260 0x7fb06c14a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:47494/0 (socket says 172.21.15.86:47494) 2023-07-21T07:34:16.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06b7fe700 1 -- 172.21.15.86:0/2377780785 learned_addr learned my addr 172.21.15.86:0/2377780785 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-07-21T07:34:16.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06b7fe700 1 -- 172.21.15.86:0/2377780785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb06c0c5260 msgr2=0x7fb06c14a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06b7fe700 1 --2- 172.21.15.86:0/2377780785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb06c0c5260 0x7fb06c14a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06b7fe700 1 -- 172.21.15.86:0/2377780785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb06c0c3f80 msgr2=0x7fb06c0a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06b7fe700 1 --2- 172.21.15.86:0/2377780785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb06c0c3f80 0x7fb06c0a9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.571 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06b7fe700 1 -- 172.21.15.86:0/2377780785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb064009a70 con 0x7fb06c0c1860 2023-07-21T07:34:16.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06affd700 1 --2- 172.21.15.86:0/2377780785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb06c0c3f80 0x7fb06c0a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:16.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06bfff700 1 --2- 172.21.15.86:0/2377780785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb06c0c5260 0x7fb06c14a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:16.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb06b7fe700 1 --2- 172.21.15.86:0/2377780785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c0c1860 0x7fb06c14e0d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb060001eb0 tx=0x7fb06000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:16.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb053fff700 1 -- 172.21.15.86:0/2377780785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb060005d70 con 0x7fb06c0c1860 2023-07-21T07:34:16.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb053fff700 1 -- 172.21.15.86:0/2377780785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0600070d0 con 0x7fb06c0c1860 2023-07-21T07:34:16.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb071ddc700 1 -- 172.21.15.86:0/2377780785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06c1ed030 con 0x7fb06c0c1860 2023-07-21T07:34:16.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb053fff700 1 -- 172.21.15.86:0/2377780785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb060007440 con 0x7fb06c0c1860 2023-07-21T07:34:16.572 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.517+0000 7fb071ddc700 1 -- 172.21.15.86:0/2377780785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06c0aa540 con 0x7fb06c0c1860 2023-07-21T07:34:16.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.518+0000 7fb053fff700 1 -- 172.21.15.86:0/2377780785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb06001c440 con 0x7fb06c0c1860 2023-07-21T07:34:16.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.518+0000 7fb053fff700 1 -- 172.21.15.86:0/2377780785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fb06001cb80 con 0x7fb06c0c1860 2023-07-21T07:34:16.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.518+0000 7fb071ddc700 1 -- 172.21.15.86:0/2377780785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06c151f90 con 0x7fb06c0c1860 2023-07-21T07:34:16.573 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.521+0000 7fb053fff700 1 -- 172.21.15.86:0/2377780785 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb06c151f90 con 0x7fb06c0c1860 2023-07-21T07:34:16.632 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:16.583+0000 7f713aa7a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T07:34:16.653 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.603+0000 7fb071ddc700 1 -- 172.21.15.86:0/2377780785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd new", "uuid": "793561e2-f037-4898-9161-405770446e23", "id": 3} v 0) v1 -- 0x7fb06c074500 con 0x7fb06c0c1860 2023-07-21T07:34:16.660 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.611+0000 7fb053fff700 1 -- 172.21.15.86:0/2377780785 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "793561e2-f037-4898-9161-405770446e23", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb060021060 con 0x7fb06c0c1860 2023-07-21T07:34:16.660 INFO:teuthology.orchestra.run.smithi086.stdout:3 2023-07-21T07:34:16.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.612+0000 7fb071ddc700 1 -- 172.21.15.86:0/2377780785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c0c1860 msgr2=0x7fb06c14e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.661 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.612+0000 7fb071ddc700 1 --2- 172.21.15.86:0/2377780785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c0c1860 0x7fb06c14e0d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb060001eb0 tx=0x7fb06000c7b0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.612+0000 7fb071ddc700 1 -- 172.21.15.86:0/2377780785 shutdown_connections 2023-07-21T07:34:16.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.612+0000 7fb071ddc700 1 --2- 172.21.15.86:0/2377780785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb06c0c5260 0x7fb06c14a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.612+0000 7fb071ddc700 1 --2- 172.21.15.86:0/2377780785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c0c1860 0x7fb06c14e0d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.612+0000 7fb071ddc700 1 --2- 172.21.15.86:0/2377780785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb06c0c3f80 0x7fb06c0a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.612+0000 7fb071ddc700 1 -- 172.21.15.86:0/2377780785 >> 172.21.15.86:0/2377780785 conn(0x7fb06c0a8660 msgr2=0x7fb06c0a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:16.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.612+0000 7fb071ddc700 1 -- 172.21.15.86:0/2377780785 shutdown_connections 2023-07-21T07:34:16.662 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.612+0000 7fb071ddc700 1 -- 172.21.15.86:0/2377780785 wait complete. 2023-07-21T07:34:16.673 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 1f861df6-be24-4dd7-8ba9-d6bc55c83ee7 4 2023-07-21T07:34:16.742 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:16.693+0000 7f940a281200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T07:34:16.794 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.745+0000 7fa786579700 1 Processor -- start 2023-07-21T07:34:16.795 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.745+0000 7fa786579700 1 -- start start 2023-07-21T07:34:16.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa786579700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7800a6f80 0x7fa780152380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa786579700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa780072160 0x7fa78014f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.798 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa786579700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7800c3c90 con 0x7fa7800c4120 2023-07-21T07:34:16.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa786579700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7800c26e0 con 0x7fa780072160 2023-07-21T07:34:16.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa786579700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7800c3680 con 0x7fa7800a6f80 2023-07-21T07:34:16.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa77ffff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7800a6f80 0x7fa780152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.799 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa784b16700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa7800c4120 0x7fa7800c5a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36768/0 (socket says 172.21.15.86:36768) 2023-07-21T07:34:16.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa784b16700 1 -- 172.21.15.86:0/3744581637 learned_addr learned my addr 172.21.15.86:0/3744581637 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-07-21T07:34:16.800 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa77f7fe700 1 --2- 172.21.15.86:0/3744581637 >> v2:172.21.15.6:3300/0 conn(0x7fa780072160 0x7fa78014f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa77ffff700 1 -- 172.21.15.86:0/3744581637 >> v2:172.21.15.6:3300/0 conn(0x7fa780072160 msgr2=0x7fa78014f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:16.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa77ffff700 1 --2- 172.21.15.86:0/3744581637 >> v2:172.21.15.6:3300/0 conn(0x7fa780072160 0x7fa78014f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa77effd700 1 -- 172.21.15.86:0/3744581637 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517001735 0 0) 0x7fa7800c3c90 con 0x7fa7800c4120 2023-07-21T07:34:16.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa77ffff700 1 -- 172.21.15.86:0/3744581637 >> v1:172.21.15.86:6789/0 conn(0x7fa7800c4120 legacy=0x7fa7800c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa77ffff700 1 -- 172.21.15.86:0/3744581637 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7800c6fe0 con 0x7fa7800a6f80 2023-07-21T07:34:16.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa77f7fe700 1 --2- 172.21.15.86:0/3744581637 >> v2:172.21.15.6:3300/0 conn(0x7fa780072160 0x7fa78014f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:16.801 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa77ffff700 1 --2- 172.21.15.86:0/3744581637 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7800a6f80 0x7fa780152380 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa770009840 tx=0x7fa770009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e70d30528994161 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:16.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa77effd700 1 -- 172.21.15.86:0/3744581637 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770011830 con 0x7fa7800a6f80 2023-07-21T07:34:16.802 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa77effd700 1 -- 172.21.15.86:0/3744581637 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa770011990 con 0x7fa7800a6f80 2023-07-21T07:34:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.746+0000 7fa77effd700 1 -- 172.21.15.86:0/3744581637 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770011d20 con 0x7fa7800a6f80 2023-07-21T07:34:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.747+0000 7fa786579700 1 -- 172.21.15.86:0/3744581637 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7800a6f80 msgr2=0x7fa780152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.747+0000 7fa786579700 1 --2- 172.21.15.86:0/3744581637 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7800a6f80 0x7fa780152380 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa770009840 tx=0x7fa770009b50 comp rx=0 tx=0).stop 2023-07-21T07:34:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.747+0000 7fa786579700 1 -- 172.21.15.86:0/3744581637 shutdown_connections 2023-07-21T07:34:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.747+0000 7fa786579700 1 --2- 172.21.15.86:0/3744581637 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7800a6f80 0x7fa780152380 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.803 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.747+0000 7fa786579700 1 --2- 172.21.15.86:0/3744581637 >> v2:172.21.15.6:3300/0 conn(0x7fa780072160 0x7fa78014f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.747+0000 7fa786579700 1 -- 172.21.15.86:0/3744581637 >> 172.21.15.86:0/3744581637 conn(0x7fa7800c7b50 msgr2=0x7fa7800c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:16.804 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.747+0000 7fa786579700 1 -- 172.21.15.86:0/3744581637 shutdown_connections 2023-07-21T07:34:16.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.747+0000 7fa786579700 1 -- 172.21.15.86:0/3744581637 wait complete. 2023-07-21T07:34:16.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.748+0000 7fa786579700 1 Processor -- start 2023-07-21T07:34:16.805 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.748+0000 7fa786579700 1 -- start start 2023-07-21T07:34:16.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.749+0000 7fa786579700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa780072160 0x7fa7801487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.749+0000 7fa786579700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7800a6f80 0x7fa78014a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.749+0000 7fa786579700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7800c4120 0x7fa78014a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:16.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.749+0000 7fa786579700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa780149910 con 0x7fa780072160 2023-07-21T07:34:16.808 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.749+0000 7fa786579700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa780149b20 con 0x7fa7800c4120 2023-07-21T07:34:16.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.749+0000 7fa786579700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7801e97b0 con 0x7fa7800a6f80 2023-07-21T07:34:16.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.749+0000 7fa77f7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7800a6f80 0x7fa78014a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.749+0000 7fa784b16700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7800c4120 0x7fa78014a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.749+0000 7fa77f7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7800a6f80 0x7fa78014a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:47504/0 (socket says 172.21.15.86:47504) 2023-07-21T07:34:16.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.749+0000 7fa77f7fe700 1 -- 172.21.15.86:0/4032457435 learned_addr learned my addr 172.21.15.86:0/4032457435 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-07-21T07:34:16.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.749+0000 7fa77ffff700 1 --2- 172.21.15.86:0/4032457435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa780072160 0x7fa7801487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:16.809 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa77f7fe700 1 -- 172.21.15.86:0/4032457435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7800c4120 msgr2=0x7fa78014a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa77f7fe700 1 --2- 172.21.15.86:0/4032457435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7800c4120 0x7fa78014a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa77f7fe700 1 -- 172.21.15.86:0/4032457435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa780072160 msgr2=0x7fa7801487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.810 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa77f7fe700 1 --2- 172.21.15.86:0/4032457435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa780072160 0x7fa7801487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa77f7fe700 1 -- 172.21.15.86:0/4032457435 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7700094a0 con 0x7fa7800a6f80 2023-07-21T07:34:16.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa784b16700 1 --2- 172.21.15.86:0/4032457435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7800c4120 0x7fa78014a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:16.811 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa77f7fe700 1 --2- 172.21.15.86:0/4032457435 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7800a6f80 0x7fa78014a150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa77400e810 tx=0x7fa77400eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:16.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa77cff9700 1 -- 172.21.15.86:0/4032457435 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77400c070 con 0x7fa7800a6f80 2023-07-21T07:34:16.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa77cff9700 1 -- 172.21.15.86:0/4032457435 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa774004230 con 0x7fa7800a6f80 2023-07-21T07:34:16.812 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa786579700 1 -- 172.21.15.86:0/4032457435 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7801e9a90 con 0x7fa7800a6f80 2023-07-21T07:34:16.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa77cff9700 1 -- 172.21.15.86:0/4032457435 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7740036a0 con 0x7fa7800a6f80 2023-07-21T07:34:16.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa786579700 1 -- 172.21.15.86:0/4032457435 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa780148ce0 con 0x7fa7800a6f80 2023-07-21T07:34:16.813 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa77cff9700 1 -- 172.21.15.86:0/4032457435 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa774003b00 con 0x7fa7800a6f80 2023-07-21T07:34:16.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.750+0000 7fa77cff9700 1 -- 172.21.15.86:0/4032457435 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa77401c400 con 0x7fa7800a6f80 2023-07-21T07:34:16.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.751+0000 7fa786579700 1 -- 172.21.15.86:0/4032457435 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa780147a80 con 0x7fa7800a6f80 2023-07-21T07:34:16.814 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.753+0000 7fa77cff9700 1 -- 172.21.15.86:0/4032457435 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa77400f040 con 0x7fa7800a6f80 2023-07-21T07:34:16.888 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.838+0000 7fa786579700 1 -- 172.21.15.86:0/4032457435 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1f861df6-be24-4dd7-8ba9-d6bc55c83ee7", "id": 4} v 0) v1 -- 0x7fa7801e9fb0 con 0x7fa7800a6f80 2023-07-21T07:34:16.895 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.846+0000 7fa77cff9700 1 -- 172.21.15.86:0/4032457435 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f861df6-be24-4dd7-8ba9-d6bc55c83ee7", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa7801e9fb0 con 0x7fa7800a6f80 2023-07-21T07:34:16.896 INFO:teuthology.orchestra.run.smithi086.stdout:4 2023-07-21T07:34:16.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.847+0000 7fa786579700 1 -- 172.21.15.86:0/4032457435 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7800a6f80 msgr2=0x7fa78014a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:16.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.847+0000 7fa786579700 1 --2- 172.21.15.86:0/4032457435 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7800a6f80 0x7fa78014a150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa77400e810 tx=0x7fa77400eb20 comp rx=0 tx=0).stop 2023-07-21T07:34:16.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.847+0000 7fa786579700 1 -- 172.21.15.86:0/4032457435 shutdown_connections 2023-07-21T07:34:16.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.847+0000 7fa786579700 1 --2- 172.21.15.86:0/4032457435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7800c4120 0x7fa78014a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.847+0000 7fa786579700 1 --2- 172.21.15.86:0/4032457435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa780072160 0x7fa7801487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.897 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.847+0000 7fa786579700 1 --2- 172.21.15.86:0/4032457435 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7800a6f80 0x7fa78014a150 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:16.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.847+0000 7fa786579700 1 -- 172.21.15.86:0/4032457435 >> 172.21.15.86:0/4032457435 conn(0x7fa7800c7b50 msgr2=0x7fa7800c45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:16.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.847+0000 7fa786579700 1 -- 172.21.15.86:0/4032457435 shutdown_connections 2023-07-21T07:34:16.898 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.847+0000 7fa786579700 1 -- 172.21.15.86:0/4032457435 wait complete. 2023-07-21T07:34:16.908 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 264a393b-14c1-4bb1-a174-f2ff3353229f 5 2023-07-21T07:34:17.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.977+0000 7faebd636700 1 Processor -- start 2023-07-21T07:34:17.028 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.977+0000 7faebd636700 1 -- start start 2023-07-21T07:34:17.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.978+0000 7faebd636700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c1860 0x7faeb8151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.030 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.978+0000 7faebd636700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faeb80c5260 0x7faeb806dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.978+0000 7faebd636700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb81517c0 con 0x7faeb80c3f80 2023-07-21T07:34:17.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.978+0000 7faebd636700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80c4e50 con 0x7faeb80c5260 2023-07-21T07:34:17.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.978+0000 7faebd636700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb81519f0 con 0x7faeb80c1860 2023-07-21T07:34:17.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.978+0000 7faeb67fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faeb80c5260 0x7faeb806dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.031 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.978+0000 7faeb6ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c1860 0x7faeb8151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.978+0000 7faeb67fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faeb80c5260 0x7faeb806dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50278/0 (socket says 172.21.15.86:50278) 2023-07-21T07:34:17.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.978+0000 7faeb6ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c1860 0x7faeb8151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:47508/0 (socket says 172.21.15.86:47508) 2023-07-21T07:34:17.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.978+0000 7faeb67fc700 1 -- 172.21.15.86:0/270380878 learned_addr learned my addr 172.21.15.86:0/270380878 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-07-21T07:34:17.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.979+0000 7faeb67fc700 1 -- 172.21.15.86:0/270380878 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c1860 msgr2=0x7faeb8151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:17.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.979+0000 7faeb67fc700 1 --2- 172.21.15.86:0/270380878 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c1860 0x7faeb8151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.032 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.979+0000 7faeb67fc700 1 -- 172.21.15.86:0/270380878 >> v1:172.21.15.86:6789/0 conn(0x7faeb80c3f80 legacy=0x7faeb80c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.979+0000 7faeb67fc700 1 -- 172.21.15.86:0/270380878 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb8151cd0 con 0x7faeb80c5260 2023-07-21T07:34:17.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.979+0000 7faeb5ffb700 1 -- 172.21.15.86:0/270380878 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627843559 0 0) 0x7faeb81517c0 con 0x7faeb80c3f80 2023-07-21T07:34:17.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.979+0000 7faeb6ffd700 1 --2- 172.21.15.86:0/270380878 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c1860 0x7faeb8151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:17.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.979+0000 7faeb67fc700 1 --2- 172.21.15.86:0/270380878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeb80c5260 0x7faeb806dd20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faea80098f0 tx=0x7faea8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce9cde6fff2f00cc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:17.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.979+0000 7faeb5ffb700 1 -- 172.21.15.86:0/270380878 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8011830 con 0x7faeb80c5260 2023-07-21T07:34:17.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.979+0000 7faeb5ffb700 1 -- 172.21.15.86:0/270380878 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8011990 con 0x7faeb80c5260 2023-07-21T07:34:17.033 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.979+0000 7faeb5ffb700 1 -- 172.21.15.86:0/270380878 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8011d20 con 0x7faeb80c5260 2023-07-21T07:34:17.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.979+0000 7faebd636700 1 -- 172.21.15.86:0/270380878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeb80c5260 msgr2=0x7faeb806dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.979+0000 7faebd636700 1 --2- 172.21.15.86:0/270380878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeb80c5260 0x7faeb806dd20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faea80098f0 tx=0x7faea8009c00 comp rx=0 tx=0).stop 2023-07-21T07:34:17.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.980+0000 7faebd636700 1 -- 172.21.15.86:0/270380878 shutdown_connections 2023-07-21T07:34:17.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.980+0000 7faebd636700 1 --2- 172.21.15.86:0/270380878 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c1860 0x7faeb8151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.980+0000 7faebd636700 1 --2- 172.21.15.86:0/270380878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeb80c5260 0x7faeb806dd20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.980+0000 7faebd636700 1 -- 172.21.15.86:0/270380878 >> 172.21.15.86:0/270380878 conn(0x7faeb80a8660 msgr2=0x7faeb80a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:17.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.980+0000 7faebd636700 1 -- 172.21.15.86:0/270380878 shutdown_connections 2023-07-21T07:34:17.034 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.980+0000 7faebd636700 1 -- 172.21.15.86:0/270380878 wait complete. 2023-07-21T07:34:17.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.981+0000 7faebd636700 1 Processor -- start 2023-07-21T07:34:17.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.981+0000 7faebd636700 1 -- start start 2023-07-21T07:34:17.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faebd636700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeb80c1860 0x7faeb81ea7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faebd636700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c3f80 0x7faeb80ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.037 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faebd636700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeb80c5260 0x7faeb81530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faebd636700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8153b20 con 0x7faeb80c5260 2023-07-21T07:34:17.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faebd636700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb81e84a0 con 0x7faeb80c1860 2023-07-21T07:34:17.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faebd636700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb81ead20 con 0x7faeb80c3f80 2023-07-21T07:34:17.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faeb67fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c3f80 0x7faeb80ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faeb6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeb80c1860 0x7faeb81ea7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.038 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faeb67fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c3f80 0x7faeb80ac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:47516/0 (socket says 172.21.15.86:47516) 2023-07-21T07:34:17.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faeb6ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeb80c1860 0x7faeb81ea7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50280/0 (socket says 172.21.15.86:50280) 2023-07-21T07:34:17.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faeb67fc700 1 -- 172.21.15.86:0/3990221030 learned_addr learned my addr 172.21.15.86:0/3990221030 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-07-21T07:34:17.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faeb77fe700 1 --2- 172.21.15.86:0/3990221030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeb80c5260 0x7faeb81530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.039 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faeb67fc700 1 -- 172.21.15.86:0/3990221030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeb80c1860 msgr2=0x7faeb81ea7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faeb67fc700 1 --2- 172.21.15.86:0/3990221030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeb80c1860 0x7faeb81ea7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faeb67fc700 1 -- 172.21.15.86:0/3990221030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeb80c5260 msgr2=0x7faeb81530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.040 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faeb67fc700 1 --2- 172.21.15.86:0/3990221030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeb80c5260 0x7faeb81530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faeb67fc700 1 -- 172.21.15.86:0/3990221030 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0094a0 con 0x7faeb80c3f80 2023-07-21T07:34:17.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faeb6ffd700 1 --2- 172.21.15.86:0/3990221030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeb80c1860 0x7faeb81ea7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:17.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faeb67fc700 1 --2- 172.21.15.86:0/3990221030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c3f80 0x7faeb80ac090 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faea8009130 tx=0x7faea8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:17.041 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7fae9f7fe700 1 -- 172.21.15.86:0/3990221030 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8004590 con 0x7faeb80c3f80 2023-07-21T07:34:17.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7fae9f7fe700 1 -- 172.21.15.86:0/3990221030 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea801e070 con 0x7faeb80c3f80 2023-07-21T07:34:17.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faebd636700 1 -- 172.21.15.86:0/3990221030 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea8009550 con 0x7faeb80c3f80 2023-07-21T07:34:17.042 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7fae9f7fe700 1 -- 172.21.15.86:0/3990221030 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea80038c0 con 0x7faeb80c3f80 2023-07-21T07:34:17.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.982+0000 7faebd636700 1 -- 172.21.15.86:0/3990221030 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb81e86f0 con 0x7faeb80c3f80 2023-07-21T07:34:17.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.983+0000 7fae9f7fe700 1 -- 172.21.15.86:0/3990221030 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faea8003d20 con 0x7faeb80c3f80 2023-07-21T07:34:17.043 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.983+0000 7fae9f7fe700 1 -- 172.21.15.86:0/3990221030 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7faea801a9a0 con 0x7faeb80c3f80 2023-07-21T07:34:17.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.983+0000 7faebd636700 1 -- 172.21.15.86:0/3990221030 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb80c1610 con 0x7faeb80c3f80 2023-07-21T07:34:17.044 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:16.985+0000 7fae9f7fe700 1 -- 172.21.15.86:0/3990221030 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7faea8020070 con 0x7faeb80c3f80 2023-07-21T07:34:17.079 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:17.030+0000 7f713aa7a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T07:34:17.119 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.069+0000 7faebd636700 1 -- 172.21.15.86:0/3990221030 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "264a393b-14c1-4bb1-a174-f2ff3353229f", "id": 5} v 0) v1 -- 0x7faeb8071900 con 0x7faeb80c3f80 2023-07-21T07:34:17.126 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.076+0000 7fae9f7fe700 1 -- 172.21.15.86:0/3990221030 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "264a393b-14c1-4bb1-a174-f2ff3353229f", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7faea8015020 con 0x7faeb80c3f80 2023-07-21T07:34:17.127 INFO:teuthology.orchestra.run.smithi086.stdout:5 2023-07-21T07:34:17.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.077+0000 7faebd636700 1 -- 172.21.15.86:0/3990221030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c3f80 msgr2=0x7faeb80ac090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.077+0000 7faebd636700 1 --2- 172.21.15.86:0/3990221030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c3f80 0x7faeb80ac090 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faea8009130 tx=0x7faea8004750 comp rx=0 tx=0).stop 2023-07-21T07:34:17.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.077+0000 7faebd636700 1 -- 172.21.15.86:0/3990221030 shutdown_connections 2023-07-21T07:34:17.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.077+0000 7faebd636700 1 --2- 172.21.15.86:0/3990221030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faeb80c5260 0x7faeb81530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.128 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.077+0000 7faebd636700 1 --2- 172.21.15.86:0/3990221030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeb80c1860 0x7faeb81ea7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.077+0000 7faebd636700 1 --2- 172.21.15.86:0/3990221030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb80c3f80 0x7faeb80ac090 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.077+0000 7faebd636700 1 -- 172.21.15.86:0/3990221030 >> 172.21.15.86:0/3990221030 conn(0x7faeb80a8660 msgr2=0x7faeb80a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:17.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.077+0000 7faebd636700 1 -- 172.21.15.86:0/3990221030 shutdown_connections 2023-07-21T07:34:17.129 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.077+0000 7faebd636700 1 -- 172.21.15.86:0/3990221030 wait complete. 2023-07-21T07:34:17.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new bef4ee26-5dd9-403a-8774-deb095924ba1 6 2023-07-21T07:34:17.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.230+0000 7f48e72b0700 1 Processor -- start 2023-07-21T07:34:17.281 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.230+0000 7f48e72b0700 1 -- start start 2023-07-21T07:34:17.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e72b0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48e006a300 0x7f48e01519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.283 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e72b0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48e00ba140 0x7f48e0151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e72b0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e0155530 con 0x7f48e006d8a0 2023-07-21T07:34:17.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e72b0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e00c1a30 con 0x7f48e006a300 2023-07-21T07:34:17.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e72b0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e0154920 con 0x7f48e00ba140 2023-07-21T07:34:17.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e484b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48e00ba140 0x7f48e0151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e584d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f48e006d8a0 0x7f48e00c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:36792/0 (socket says 172.21.15.86:36792) 2023-07-21T07:34:17.284 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e584d700 1 -- 172.21.15.86:0/2415122012 learned_addr learned my addr 172.21.15.86:0/2415122012 (peer_addr_for_me v1:172.21.15.86:0/0) 2023-07-21T07:34:17.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e484b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48e00ba140 0x7f48e0151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50286/0 (socket says 172.21.15.86:50286) 2023-07-21T07:34:17.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e504c700 1 --2- 172.21.15.86:0/2415122012 >> v2:172.21.15.6:3300/0 conn(0x7f48e006a300 0x7f48e01519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e484b700 1 -- 172.21.15.86:0/2415122012 >> v2:172.21.15.6:3300/0 conn(0x7f48e006a300 msgr2=0x7f48e01519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:17.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e484b700 1 --2- 172.21.15.86:0/2415122012 >> v2:172.21.15.6:3300/0 conn(0x7f48e006a300 0x7f48e01519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e484b700 1 -- 172.21.15.86:0/2415122012 >> v1:172.21.15.86:6789/0 conn(0x7f48e006d8a0 legacy=0x7f48e00c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.285 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48e484b700 1 -- 172.21.15.86:0/2415122012 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0154c00 con 0x7f48e00ba140 2023-07-21T07:34:17.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.231+0000 7f48d7fff700 1 -- 172.21.15.86:0/2415122012 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095045476 0 0) 0x7f48e0155530 con 0x7f48e006d8a0 2023-07-21T07:34:17.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.232+0000 7f48e484b700 1 --2- 172.21.15.86:0/2415122012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e00ba140 0x7f48e0151ef0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f48e00c1f00 tx=0x7f48d0009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b9ceaea2792f9cc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:17.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.232+0000 7f48d7fff700 1 -- 172.21.15.86:0/2415122012 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0011830 con 0x7f48e00ba140 2023-07-21T07:34:17.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.232+0000 7f48d7fff700 1 -- 172.21.15.86:0/2415122012 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d0011990 con 0x7f48e00ba140 2023-07-21T07:34:17.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.232+0000 7f48d7fff700 1 -- 172.21.15.86:0/2415122012 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0011d20 con 0x7f48e00ba140 2023-07-21T07:34:17.286 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.232+0000 7f48e72b0700 1 -- 172.21.15.86:0/2415122012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e00ba140 msgr2=0x7f48e0151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.232+0000 7f48e72b0700 1 --2- 172.21.15.86:0/2415122012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e00ba140 0x7f48e0151ef0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f48e00c1f00 tx=0x7f48d0009b20 comp rx=0 tx=0).stop 2023-07-21T07:34:17.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.232+0000 7f48e72b0700 1 -- 172.21.15.86:0/2415122012 shutdown_connections 2023-07-21T07:34:17.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.232+0000 7f48e72b0700 1 --2- 172.21.15.86:0/2415122012 >> v2:172.21.15.6:3300/0 conn(0x7f48e006a300 0x7f48e01519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.232+0000 7f48e72b0700 1 --2- 172.21.15.86:0/2415122012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e00ba140 0x7f48e0151ef0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.232+0000 7f48e72b0700 1 -- 172.21.15.86:0/2415122012 >> 172.21.15.86:0/2415122012 conn(0x7f48e00a8660 msgr2=0x7f48e00a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:17.287 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.233+0000 7f48e72b0700 1 -- 172.21.15.86:0/2415122012 shutdown_connections 2023-07-21T07:34:17.288 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.233+0000 7f48e72b0700 1 -- 172.21.15.86:0/2415122012 wait complete. 2023-07-21T07:34:17.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.234+0000 7f48e72b0700 1 Processor -- start 2023-07-21T07:34:17.290 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.234+0000 7f48e72b0700 1 -- start start 2023-07-21T07:34:17.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e72b0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48e006a300 0x7f48e01edc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e72b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e006d8a0 0x7f48e0150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e72b0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e00ba140 0x7f48e00b91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e72b0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e01ee1a0 con 0x7f48e006d8a0 2023-07-21T07:34:17.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e72b0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00a65a0 con 0x7f48e00ba140 2023-07-21T07:34:17.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e72b0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0070ad0 con 0x7f48e006a300 2023-07-21T07:34:17.291 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e584d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e00ba140 0x7f48e00b91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e504c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48e006a300 0x7f48e01edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e584d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e00ba140 0x7f48e00b91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:50296/0 (socket says 172.21.15.86:50296) 2023-07-21T07:34:17.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e584d700 1 -- 172.21.15.86:0/3186747565 learned_addr learned my addr 172.21.15.86:0/3186747565 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-07-21T07:34:17.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e484b700 1 --2- 172.21.15.86:0/3186747565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e006d8a0 0x7f48e0150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e504c700 1 -- 172.21.15.86:0/3186747565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e00ba140 msgr2=0x7f48e00b91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.292 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e504c700 1 --2- 172.21.15.86:0/3186747565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e00ba140 0x7f48e00b91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e504c700 1 -- 172.21.15.86:0/3186747565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e006d8a0 msgr2=0x7f48e0150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e504c700 1 --2- 172.21.15.86:0/3186747565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e006d8a0 0x7f48e0150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e504c700 1 -- 172.21.15.86:0/3186747565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d00094a0 con 0x7f48e006a300 2023-07-21T07:34:17.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.235+0000 7f48e584d700 1 --2- 172.21.15.86:0/3186747565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e00ba140 0x7f48e00b91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:17.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.236+0000 7f48e504c700 1 --2- 172.21.15.86:0/3186747565 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48e006a300 0x7f48e01edc60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00e870 tx=0x7f48dc00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:17.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.236+0000 7f48d5ffb700 1 -- 172.21.15.86:0/3186747565 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc013680 con 0x7f48e006a300 2023-07-21T07:34:17.293 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.236+0000 7f48d5ffb700 1 -- 172.21.15.86:0/3186747565 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc0137e0 con 0x7f48e006a300 2023-07-21T07:34:17.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.236+0000 7f48e72b0700 1 -- 172.21.15.86:0/3186747565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e0070db0 con 0x7f48e006a300 2023-07-21T07:34:17.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.236+0000 7f48d5ffb700 1 -- 172.21.15.86:0/3186747565 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc013b90 con 0x7f48e006a300 2023-07-21T07:34:17.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.236+0000 7f48e72b0700 1 -- 172.21.15.86:0/3186747565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e0071370 con 0x7f48e006a300 2023-07-21T07:34:17.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.236+0000 7f48d5ffb700 1 -- 172.21.15.86:0/3186747565 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f48dc005a20 con 0x7f48e006a300 2023-07-21T07:34:17.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.236+0000 7f48d5ffb700 1 -- 172.21.15.86:0/3186747565 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f48dc0066b0 con 0x7f48e006a300 2023-07-21T07:34:17.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.237+0000 7f48e72b0700 1 -- 172.21.15.86:0/3186747565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e00a68f0 con 0x7f48e006a300 2023-07-21T07:34:17.294 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.239+0000 7f48d5ffb700 1 -- 172.21.15.86:0/3186747565 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f48dc021060 con 0x7f48e006a300 2023-07-21T07:34:17.327 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:17.277+0000 7f940a281200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-21T07:34:17.372 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.322+0000 7f48e72b0700 1 -- 172.21.15.86:0/3186747565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bef4ee26-5dd9-403a-8774-deb095924ba1", "id": 6} v 0) v1 -- 0x7f48e0071560 con 0x7f48e006a300 2023-07-21T07:34:17.380 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.330+0000 7f48d5ffb700 1 -- 172.21.15.86:0/3186747565 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bef4ee26-5dd9-403a-8774-deb095924ba1", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f48dc017070 con 0x7f48e006a300 2023-07-21T07:34:17.380 INFO:teuthology.orchestra.run.smithi086.stdout:6 2023-07-21T07:34:17.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.331+0000 7f48e72b0700 1 -- 172.21.15.86:0/3186747565 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48e006a300 msgr2=0x7f48e01edc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.381 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.331+0000 7f48e72b0700 1 --2- 172.21.15.86:0/3186747565 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48e006a300 0x7f48e01edc60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00e870 tx=0x7f48dc00eb80 comp rx=0 tx=0).stop 2023-07-21T07:34:17.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.331+0000 7f48e72b0700 1 -- 172.21.15.86:0/3186747565 shutdown_connections 2023-07-21T07:34:17.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.331+0000 7f48e72b0700 1 --2- 172.21.15.86:0/3186747565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e00ba140 0x7f48e00b91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.331+0000 7f48e72b0700 1 --2- 172.21.15.86:0/3186747565 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48e006a300 0x7f48e01edc60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.331+0000 7f48e72b0700 1 --2- 172.21.15.86:0/3186747565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e006d8a0 0x7f48e0150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.382 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.331+0000 7f48e72b0700 1 -- 172.21.15.86:0/3186747565 >> 172.21.15.86:0/3186747565 conn(0x7f48e00a8660 msgr2=0x7f48e00c3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:17.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.331+0000 7f48e72b0700 1 -- 172.21.15.86:0/3186747565 shutdown_connections 2023-07-21T07:34:17.383 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.331+0000 7f48e72b0700 1 -- 172.21.15.86:0/3186747565 wait complete. 2023-07-21T07:34:17.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 7277270a-bbb3-4dfc-ae70-4aecf3a708e0 7 2023-07-21T07:34:17.487 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:17.437+0000 7f940a281200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T07:34:17.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.465+0000 7f6225828700 1 Processor -- start 2023-07-21T07:34:17.515 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.465+0000 7f6225828700 1 -- start start 2023-07-21T07:34:17.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.465+0000 7f6225828700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62200a6f80 0x7f6220152380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.517 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.465+0000 7f6225828700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f622014fb30 0x7f622015cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.465+0000 7f6225828700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62200c3c90 con 0x7f6220072160 2023-07-21T07:34:17.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f6225828700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62200c26e0 con 0x7f622014fb30 2023-07-21T07:34:17.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f6225828700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62200c3680 con 0x7f62200a6f80 2023-07-21T07:34:17.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f621effd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62200a6f80 0x7f6220152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f621f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f622014fb30 0x7f622015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f621effd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62200a6f80 0x7f6220152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:47532/0 (socket says 172.21.15.86:47532) 2023-07-21T07:34:17.518 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f621effd700 1 -- 172.21.15.86:0/419659263 learned_addr learned my addr 172.21.15.86:0/419659263 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-07-21T07:34:17.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f621effd700 1 -- 172.21.15.86:0/419659263 >> v2:172.21.15.86:3300/0 conn(0x7f622014fb30 msgr2=0x7f622015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:17.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f621effd700 1 --2- 172.21.15.86:0/419659263 >> v2:172.21.15.86:3300/0 conn(0x7f622014fb30 0x7f622015cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f621effd700 1 -- 172.21.15.86:0/419659263 >> v1:172.21.15.6:6789/0 conn(0x7f6220072160 legacy=0x7f622014f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:17.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f621effd700 1 -- 172.21.15.86:0/419659263 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62200c6fe0 con 0x7f62200a6f80 2023-07-21T07:34:17.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f621f7fe700 1 --2- 172.21.15.86:0/419659263 >> v2:172.21.15.86:3300/0 conn(0x7f622014fb30 0x7f622015cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:17.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f621effd700 1 --2- 172.21.15.86:0/419659263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62200a6f80 0x7f6220152380 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f62100098f0 tx=0x7f6210009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca8737ca3ca5de9f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:17.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f621dffb700 1 -- 172.21.15.86:0/419659263 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210011830 con 0x7f62200a6f80 2023-07-21T07:34:17.519 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f621dffb700 1 -- 172.21.15.86:0/419659263 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6210011990 con 0x7f62200a6f80 2023-07-21T07:34:17.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.466+0000 7f621dffb700 1 -- 172.21.15.86:0/419659263 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210011d20 con 0x7f62200a6f80 2023-07-21T07:34:17.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.467+0000 7f6225828700 1 -- 172.21.15.86:0/419659263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62200a6f80 msgr2=0x7f6220152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.467+0000 7f6225828700 1 --2- 172.21.15.86:0/419659263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62200a6f80 0x7f6220152380 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f62100098f0 tx=0x7f6210009c00 comp rx=0 tx=0).stop 2023-07-21T07:34:17.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.467+0000 7f6225828700 1 -- 172.21.15.86:0/419659263 shutdown_connections 2023-07-21T07:34:17.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.467+0000 7f6225828700 1 --2- 172.21.15.86:0/419659263 >> v2:172.21.15.86:3300/0 conn(0x7f622014fb30 0x7f622015cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.467+0000 7f6225828700 1 --2- 172.21.15.86:0/419659263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62200a6f80 0x7f6220152380 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.520 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.467+0000 7f6225828700 1 -- 172.21.15.86:0/419659263 >> 172.21.15.86:0/419659263 conn(0x7f62200c7b50 msgr2=0x7f62200c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:17.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.467+0000 7f6225828700 1 -- 172.21.15.86:0/419659263 shutdown_connections 2023-07-21T07:34:17.521 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.467+0000 7f6225828700 1 -- 172.21.15.86:0/419659263 wait complete. 2023-07-21T07:34:17.522 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.468+0000 7f6225828700 1 Processor -- start 2023-07-21T07:34:17.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.468+0000 7f6225828700 1 -- start start 2023-07-21T07:34:17.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f6225828700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6220072160 0x7f62200aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f6225828700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62200a6f80 0x7f6220152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f6225828700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f622014fb30 0x7f6220152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.523 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f6225828700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62201e8810 con 0x7f622014fb30 2023-07-21T07:34:17.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f6225828700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62201e8d50 con 0x7f62200a6f80 2023-07-21T07:34:17.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f6225828700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6220154e70 con 0x7f6220072160 2023-07-21T07:34:17.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f621effd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6220072160 0x7f62200aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f621e7fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62200a6f80 0x7f6220152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f621effd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6220072160 0x7f62200aaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:47538/0 (socket says 172.21.15.86:47538) 2023-07-21T07:34:17.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f621effd700 1 -- 172.21.15.86:0/2260807825 learned_addr learned my addr 172.21.15.86:0/2260807825 (peer_addr_for_me v2:172.21.15.86:0/0) 2023-07-21T07:34:17.524 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f621f7fe700 1 --2- 172.21.15.86:0/2260807825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f622014fb30 0x7f6220152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f621effd700 1 -- 172.21.15.86:0/2260807825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62200a6f80 msgr2=0x7f6220152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f621effd700 1 --2- 172.21.15.86:0/2260807825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62200a6f80 0x7f6220152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f621effd700 1 -- 172.21.15.86:0/2260807825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f622014fb30 msgr2=0x7f6220152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f621effd700 1 --2- 172.21.15.86:0/2260807825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f622014fb30 0x7f6220152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.469+0000 7f621effd700 1 -- 172.21.15.86:0/2260807825 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6218009a70 con 0x7f6220072160 2023-07-21T07:34:17.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.470+0000 7f621effd700 1 --2- 172.21.15.86:0/2260807825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6220072160 0x7f62200aaff0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6210000c00 tx=0x7f6210004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:17.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.470+0000 7f6207fff700 1 -- 172.21.15.86:0/2260807825 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62100043c0 con 0x7f6220072160 2023-07-21T07:34:17.525 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.470+0000 7f6207fff700 1 -- 172.21.15.86:0/2260807825 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621001f070 con 0x7f6220072160 2023-07-21T07:34:17.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.470+0000 7f6207fff700 1 -- 172.21.15.86:0/2260807825 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62100038c0 con 0x7f6220072160 2023-07-21T07:34:17.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.470+0000 7f6225828700 1 -- 172.21.15.86:0/2260807825 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6210009550 con 0x7f6220072160 2023-07-21T07:34:17.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.470+0000 7f6225828700 1 -- 172.21.15.86:0/2260807825 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6220155110 con 0x7f6220072160 2023-07-21T07:34:17.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.470+0000 7f6207fff700 1 -- 172.21.15.86:0/2260807825 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6210021030 con 0x7f6220072160 2023-07-21T07:34:17.526 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.470+0000 7f6207fff700 1 -- 172.21.15.86:0/2260807825 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6210024430 con 0x7f6220072160 2023-07-21T07:34:17.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.471+0000 7f6225828700 1 -- 172.21.15.86:0/2260807825 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62200ade50 con 0x7f6220072160 2023-07-21T07:34:17.528 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.473+0000 7f6207fff700 1 -- 172.21.15.86:0/2260807825 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6210015020 con 0x7f6220072160 2023-07-21T07:34:17.605 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.555+0000 7f6225828700 1 -- 172.21.15.86:0/2260807825 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7277270a-bbb3-4dfc-ae70-4aecf3a708e0", "id": 7} v 0) v1 -- 0x7f6220074500 con 0x7f6220072160 2023-07-21T07:34:17.616 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.566+0000 7f6207fff700 1 -- 172.21.15.86:0/2260807825 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7277270a-bbb3-4dfc-ae70-4aecf3a708e0", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f621001a450 con 0x7f6220072160 2023-07-21T07:34:17.617 INFO:teuthology.orchestra.run.smithi086.stdout:7 2023-07-21T07:34:17.617 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.567+0000 7f6225828700 1 -- 172.21.15.86:0/2260807825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6220072160 msgr2=0x7f62200aaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.567+0000 7f6225828700 1 --2- 172.21.15.86:0/2260807825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6220072160 0x7f62200aaff0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6210000c00 tx=0x7f6210004750 comp rx=0 tx=0).stop 2023-07-21T07:34:17.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.567+0000 7f6225828700 1 -- 172.21.15.86:0/2260807825 shutdown_connections 2023-07-21T07:34:17.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.567+0000 7f6225828700 1 --2- 172.21.15.86:0/2260807825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f622014fb30 0x7f6220152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.567+0000 7f6225828700 1 --2- 172.21.15.86:0/2260807825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6220072160 0x7f62200aaff0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.567+0000 7f6225828700 1 --2- 172.21.15.86:0/2260807825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62200a6f80 0x7f6220152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.618 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.567+0000 7f6225828700 1 -- 172.21.15.86:0/2260807825 >> 172.21.15.86:0/2260807825 conn(0x7f62200c7b50 msgr2=0x7f622014e540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:17.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.567+0000 7f6225828700 1 -- 172.21.15.86:0/2260807825 shutdown_connections 2023-07-21T07:34:17.619 INFO:teuthology.orchestra.run.smithi086.stderr:2023-07-21T07:34:17.567+0000 7f6225828700 1 -- 172.21.15.86:0/2260807825 wait complete. 2023-07-21T07:34:17.629 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-21T07:34:17.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-21T07:34:17.631 INFO:tasks.ceph.osd.0:Started 2023-07-21T07:34:17.631 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-21T07:34:17.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-21T07:34:17.634 INFO:tasks.ceph.osd.1:Started 2023-07-21T07:34:17.634 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-21T07:34:17.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-21T07:34:17.636 INFO:tasks.ceph.osd.2:Started 2023-07-21T07:34:17.636 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-21T07:34:17.637 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-21T07:34:17.639 INFO:tasks.ceph.osd.3:Started 2023-07-21T07:34:17.640 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-21T07:34:17.640 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-21T07:34:17.642 INFO:tasks.ceph.osd.4:Started 2023-07-21T07:34:17.642 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-21T07:34:17.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-21T07:34:17.646 INFO:tasks.ceph.osd.5:Started 2023-07-21T07:34:17.646 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-21T07:34:17.647 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-21T07:34:17.649 INFO:tasks.ceph.osd.6:Started 2023-07-21T07:34:17.650 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-21T07:34:17.650 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-21T07:34:17.653 INFO:tasks.ceph.osd.7:Started 2023-07-21T07:34:17.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:17.682 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:17.633+0000 7f713aa7a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-21T07:34:17.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.776+0000 7fc65f3ef700 1 Processor -- start 2023-07-21T07:34:17.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.777+0000 7fc65f3ef700 1 -- start start 2023-07-21T07:34:17.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65f3ef700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc65806a300 0x7fc658152f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65f3ef700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc65806beb0 0x7fc6580c3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65f3ef700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6580c3da0 0x7fc6580c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65f3ef700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc658153470 con 0x7fc6580c3da0 2023-07-21T07:34:17.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65f3ef700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6580ba3f0 con 0x7fc65806beb0 2023-07-21T07:34:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65f3ef700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65806d930 con 0x7fc65806a300 2023-07-21T07:34:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65d98c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6580c3da0 0x7fc6580c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65d98c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6580c3da0 0x7fc6580c4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60072/0 (socket says 172.21.15.6:60072) 2023-07-21T07:34:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65d98c700 1 -- 172.21.15.6:0/3632821379 learned_addr learned my addr 172.21.15.6:0/3632821379 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65d18b700 1 --2- 172.21.15.6:0/3632821379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc65806a300 0x7fc658152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65c98a700 1 --2- 172.21.15.6:0/3632821379 >> v2:172.21.15.86:3300/0 conn(0x7fc65806beb0 0x7fc6580c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65d98c700 1 -- 172.21.15.6:0/3632821379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc65806a300 msgr2=0x7fc658152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65d98c700 1 --2- 172.21.15.6:0/3632821379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc65806a300 0x7fc658152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65d98c700 1 -- 172.21.15.6:0/3632821379 >> v2:172.21.15.86:3300/0 conn(0x7fc65806beb0 msgr2=0x7fc6580c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65d98c700 1 --2- 172.21.15.6:0/3632821379 >> v2:172.21.15.86:3300/0 conn(0x7fc65806beb0 0x7fc6580c3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65d98c700 1 -- 172.21.15.6:0/3632821379 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65806dc10 con 0x7fc6580c3da0 2023-07-21T07:34:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.778+0000 7fc65d98c700 1 --2- 172.21.15.6:0/3632821379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6580c3da0 0x7fc6580c4cb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc6580c45b0 tx=0x7fc65000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab944c287bd97a65 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.779+0000 7fc64ffff700 1 -- 172.21.15.6:0/3632821379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65000e070 con 0x7fc6580c3da0 2023-07-21T07:34:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.779+0000 7fc64ffff700 1 -- 172.21.15.6:0/3632821379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65000b910 con 0x7fc6580c3da0 2023-07-21T07:34:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.779+0000 7fc64ffff700 1 -- 172.21.15.6:0/3632821379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65000bcc0 con 0x7fc6580c3da0 2023-07-21T07:34:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.779+0000 7fc65f3ef700 1 -- 172.21.15.6:0/3632821379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6580c3da0 msgr2=0x7fc6580c4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.779+0000 7fc65f3ef700 1 --2- 172.21.15.6:0/3632821379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6580c3da0 0x7fc6580c4cb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc6580c45b0 tx=0x7fc65000b330 comp rx=0 tx=0).stop 2023-07-21T07:34:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.779+0000 7fc65f3ef700 1 -- 172.21.15.6:0/3632821379 shutdown_connections 2023-07-21T07:34:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.779+0000 7fc65f3ef700 1 --2- 172.21.15.6:0/3632821379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6580c3da0 0x7fc6580c4cb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.779+0000 7fc65f3ef700 1 --2- 172.21.15.6:0/3632821379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc65806a300 0x7fc658152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.779+0000 7fc65f3ef700 1 --2- 172.21.15.6:0/3632821379 >> v2:172.21.15.86:3300/0 conn(0x7fc65806beb0 0x7fc6580c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.779+0000 7fc65f3ef700 1 -- 172.21.15.6:0/3632821379 >> 172.21.15.6:0/3632821379 conn(0x7fc6580a8c90 msgr2=0x7fc65806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.779+0000 7fc65f3ef700 1 -- 172.21.15.6:0/3632821379 shutdown_connections 2023-07-21T07:34:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.779+0000 7fc65f3ef700 1 -- 172.21.15.6:0/3632821379 wait complete. 2023-07-21T07:34:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.781+0000 7fc65f3ef700 1 Processor -- start 2023-07-21T07:34:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.781+0000 7fc65f3ef700 1 -- start start 2023-07-21T07:34:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65f3ef700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc65806a300 0x7fc6581ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65f3ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc65806beb0 0x7fc65814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65f3ef700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6580c3da0 0x7fc6580a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65f3ef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6581dd670 con 0x7fc65806beb0 2023-07-21T07:34:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65f3ef700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6581ee160 con 0x7fc6580c3da0 2023-07-21T07:34:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65f3ef700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6581ed8c0 con 0x7fc65806a300 2023-07-21T07:34:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65c98a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc65806beb0 0x7fc65814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65d18b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc65806a300 0x7fc6581ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65c98a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc65806beb0 0x7fc65814d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60076/0 (socket says 172.21.15.6:60076) 2023-07-21T07:34:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65d18b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc65806a300 0x7fc6581ed1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:57468/0 (socket says 172.21.15.6:57468) 2023-07-21T07:34:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65c98a700 1 -- 172.21.15.6:0/2148013432 learned_addr learned my addr 172.21.15.6:0/2148013432 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65d98c700 1 --2- 172.21.15.6:0/2148013432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6580c3da0 0x7fc6580a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65d18b700 1 -- 172.21.15.6:0/2148013432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6580c3da0 msgr2=0x7fc6580a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65d18b700 1 --2- 172.21.15.6:0/2148013432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6580c3da0 0x7fc6580a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65d18b700 1 -- 172.21.15.6:0/2148013432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc65806beb0 msgr2=0x7fc65814d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65d18b700 1 --2- 172.21.15.6:0/2148013432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc65806beb0 0x7fc65814d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65d18b700 1 -- 172.21.15.6:0/2148013432 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc650009b30 con 0x7fc65806a300 2023-07-21T07:34:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.782+0000 7fc65d18b700 1 --2- 172.21.15.6:0/2148013432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc65806a300 0x7fc6581ed1c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc65400e870 tx=0x7fc65400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.783+0000 7fc64dffb700 1 -- 172.21.15.6:0/2148013432 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654013680 con 0x7fc65806a300 2023-07-21T07:34:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.783+0000 7fc64dffb700 1 -- 172.21.15.6:0/2148013432 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6540137e0 con 0x7fc65806a300 2023-07-21T07:34:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.783+0000 7fc65f3ef700 1 -- 172.21.15.6:0/2148013432 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6581edba0 con 0x7fc65806a300 2023-07-21T07:34:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.783+0000 7fc64dffb700 1 -- 172.21.15.6:0/2148013432 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654013b50 con 0x7fc65806a300 2023-07-21T07:34:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.783+0000 7fc65f3ef700 1 -- 172.21.15.6:0/2148013432 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc658070730 con 0x7fc65806a300 2023-07-21T07:34:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.783+0000 7fc64dffb700 1 -- 172.21.15.6:0/2148013432 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc654005a20 con 0x7fc65806a300 2023-07-21T07:34:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.783+0000 7fc64dffb700 1 -- 172.21.15.6:0/2148013432 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc6540067f0 con 0x7fc65806a300 2023-07-21T07:34:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.784+0000 7fc65f3ef700 1 -- 172.21.15.6:0/2148013432 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc658070950 con 0x7fc65806a300 2023-07-21T07:34:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.788+0000 7fc64dffb700 1 -- 172.21.15.6:0/2148013432 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc654021060 con 0x7fc65806a300 2023-07-21T07:34:17.879 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:17.830+0000 7f713aa7a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T07:34:17.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.859+0000 7fc65f3ef700 1 -- 172.21.15.6:0/2148013432 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6580c6fd0 con 0x7fc65806a300 2023-07-21T07:34:17.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.860+0000 7fc64dffb700 1 -- 172.21.15.6:0/2148013432 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc654017070 con 0x7fc65806a300 2023-07-21T07:34:17.909 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:17.910 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:17.557774+0000","last_up_change":"0.000000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:17.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.861+0000 7fc65f3ef700 1 -- 172.21.15.6:0/2148013432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc65806a300 msgr2=0x7fc6581ed1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.861+0000 7fc65f3ef700 1 --2- 172.21.15.6:0/2148013432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc65806a300 0x7fc6581ed1c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc65400e870 tx=0x7fc65400eb80 comp rx=0 tx=0).stop 2023-07-21T07:34:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.861+0000 7fc65f3ef700 1 -- 172.21.15.6:0/2148013432 shutdown_connections 2023-07-21T07:34:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.861+0000 7fc65f3ef700 1 --2- 172.21.15.6:0/2148013432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6580c3da0 0x7fc6580a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.861+0000 7fc65f3ef700 1 --2- 172.21.15.6:0/2148013432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc65806a300 0x7fc6581ed1c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.861+0000 7fc65f3ef700 1 --2- 172.21.15.6:0/2148013432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc65806beb0 0x7fc65814d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.861+0000 7fc65f3ef700 1 -- 172.21.15.6:0/2148013432 >> 172.21.15.6:0/2148013432 conn(0x7fc6580a8c90 msgr2=0x7fc6580c68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.861+0000 7fc65f3ef700 1 -- 172.21.15.6:0/2148013432 shutdown_connections 2023-07-21T07:34:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:17.861+0000 7fc65f3ef700 1 -- 172.21.15.6:0/2148013432 wait complete. 2023-07-21T07:34:17.922 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-21T07:34:17.923 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-21T07:34:18.207 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:18.156+0000 7f940a281200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T07:34:18.261 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-21T07:34:18.211+0000 7f2632ce3640 -1 Falling back to public interface 2023-07-21T07:34:18.261 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-21T07:34:18.211+0000 7f23859a9640 -1 Falling back to public interface 2023-07-21T07:34:18.262 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-21T07:34:18.212+0000 7f262a0a1700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6808/0: (98) Address already in use 2023-07-21T07:34:18.263 INFO:tasks.ceph.osd.5.smithi086.stderr:2023-07-21T07:34:18.213+0000 7f0bb3633640 -1 Falling back to public interface 2023-07-21T07:34:18.271 INFO:tasks.ceph.osd.6.smithi086.stderr:2023-07-21T07:34:18.221+0000 7f5bbe81d640 -1 Falling back to public interface 2023-07-21T07:34:18.272 INFO:tasks.ceph.osd.7.smithi086.stderr:2023-07-21T07:34:18.222+0000 7fac877b7640 -1 Falling back to public interface 2023-07-21T07:34:18.273 INFO:tasks.ceph.osd.4.smithi086.stderr:2023-07-21T07:34:18.223+0000 7f9c02701640 -1 Falling back to public interface 2023-07-21T07:34:18.273 INFO:tasks.ceph.osd.6.smithi086.stderr:2023-07-21T07:34:18.223+0000 7f5bb5bdb700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6820/0: (98) Address already in use 2023-07-21T07:34:18.274 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-21T07:34:18.225+0000 7f37f63c1640 -1 Falling back to public interface 2023-07-21T07:34:18.281 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-21T07:34:18.232+0000 7f6e5f191640 -1 Falling back to public interface 2023-07-21T07:34:18.288 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:18.238+0000 7f940a281200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T07:34:18.430 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:18.379+0000 7f940a281200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T07:34:18.605 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:18.556+0000 7f713aa7a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T07:34:18.666 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:18.616+0000 7f940a281200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-21T07:34:18.686 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:18.637+0000 7f713aa7a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T07:34:18.728 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:18.741 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:18.691+0000 7f940a281200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T07:34:18.834 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:18.785+0000 7f713aa7a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T07:34:18.845 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.795+0000 7f6a4247c700 1 Processor -- start 2023-07-21T07:34:18.845 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.795+0000 7f6a4247c700 1 -- start start 2023-07-21T07:34:18.848 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a4247c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6a3c151ac0 0x7f6a3c0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:18.848 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a4247c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a3c0c47d0 0x7f6a3c0c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:18.848 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a4247c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c155390 con 0x7f6a3c0c67d0 2023-07-21T07:34:18.848 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a4247c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3c0bd7b0 con 0x7f6a3c151ac0 2023-07-21T07:34:18.849 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a4247c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c154570 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.849 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a40a19700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6a3c0c67d0 0x7f6a3c0c6c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39872/0 (socket says 172.21.15.6:39872) 2023-07-21T07:34:18.849 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a40a19700 1 -- 172.21.15.6:0/2109386457 learned_addr learned my addr 172.21.15.6:0/2109386457 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:18.850 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a3bfff700 1 --2- 172.21.15.6:0/2109386457 >> v2:172.21.15.86:3300/0 conn(0x7f6a3c151ac0 0x7f6a3c0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:18.850 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a3b7fe700 1 --2- 172.21.15.6:0/2109386457 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a3c0c47d0 0x7f6a3c0c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:18.850 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a3affd700 1 -- 172.21.15.6:0/2109386457 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442772648 0 0) 0x7f6a3c155390 con 0x7f6a3c0c67d0 2023-07-21T07:34:18.850 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a3affd700 1 -- 172.21.15.6:0/2109386457 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a240035b0 con 0x7f6a3c0c67d0 2023-07-21T07:34:18.850 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a3bfff700 1 -- 172.21.15.6:0/2109386457 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a3c0c47d0 msgr2=0x7f6a3c0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:18.851 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a3bfff700 1 --2- 172.21.15.6:0/2109386457 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a3c0c47d0 0x7f6a3c0c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:18.851 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a3bfff700 1 -- 172.21.15.6:0/2109386457 >> v1:172.21.15.6:6789/0 conn(0x7f6a3c0c67d0 legacy=0x7f6a3c0c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:18.851 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a3bfff700 1 -- 172.21.15.6:0/2109386457 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0c83e0 con 0x7f6a3c151ac0 2023-07-21T07:34:18.851 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a3b7fe700 1 --2- 172.21.15.6:0/2109386457 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a3c0c47d0 0x7f6a3c0c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:18.851 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.797+0000 7f6a3bfff700 1 --2- 172.21.15.6:0/2109386457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a3c151ac0 0x7f6a3c0c7ea0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009840 tx=0x7f6a2c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a048637d5ffddb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:18.851 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.798+0000 7f6a3affd700 1 -- 172.21.15.6:0/2109386457 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c011830 con 0x7f6a3c151ac0 2023-07-21T07:34:18.851 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.798+0000 7f6a3affd700 1 -- 172.21.15.6:0/2109386457 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c011990 con 0x7f6a3c151ac0 2023-07-21T07:34:18.851 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.798+0000 7f6a3affd700 1 -- 172.21.15.6:0/2109386457 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c011d20 con 0x7f6a3c151ac0 2023-07-21T07:34:18.852 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.798+0000 7f6a4247c700 1 -- 172.21.15.6:0/2109386457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a3c151ac0 msgr2=0x7f6a3c0c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:18.852 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.798+0000 7f6a4247c700 1 --2- 172.21.15.6:0/2109386457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a3c151ac0 0x7f6a3c0c7ea0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009840 tx=0x7f6a2c009b50 comp rx=0 tx=0).stop 2023-07-21T07:34:18.852 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.798+0000 7f6a4247c700 1 -- 172.21.15.6:0/2109386457 shutdown_connections 2023-07-21T07:34:18.852 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.798+0000 7f6a4247c700 1 --2- 172.21.15.6:0/2109386457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a3c151ac0 0x7f6a3c0c7ea0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:18.852 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.798+0000 7f6a4247c700 1 --2- 172.21.15.6:0/2109386457 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a3c0c47d0 0x7f6a3c0c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:18.852 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.798+0000 7f6a4247c700 1 -- 172.21.15.6:0/2109386457 >> 172.21.15.6:0/2109386457 conn(0x7f6a3c0717c0 msgr2=0x7f6a3c071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:18.852 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.798+0000 7f6a4247c700 1 -- 172.21.15.6:0/2109386457 shutdown_connections 2023-07-21T07:34:18.853 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.798+0000 7f6a4247c700 1 -- 172.21.15.6:0/2109386457 wait complete. 2023-07-21T07:34:18.855 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.799+0000 7f6a4247c700 1 Processor -- start 2023-07-21T07:34:18.855 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.800+0000 7f6a4247c700 1 -- start start 2023-07-21T07:34:18.855 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.800+0000 7f6a4247c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a3c0c47d0 0x7f6a3c1ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:18.855 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.800+0000 7f6a4247c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a3c0c67d0 0x7f6a3c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:18.855 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.800+0000 7f6a4247c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a3c151ac0 0x7f6a3c0bbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:18.855 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.800+0000 7f6a4247c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c157620 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.856 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.800+0000 7f6a4247c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0bcae0 con 0x7f6a3c151ac0 2023-07-21T07:34:18.856 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.800+0000 7f6a4247c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0bd0a0 con 0x7f6a3c0c67d0 2023-07-21T07:34:18.856 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.800+0000 7f6a3bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a3c0c47d0 0x7f6a3c1ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:18.856 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.800+0000 7f6a3bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a3c0c47d0 0x7f6a3c1ea2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60086/0 (socket says 172.21.15.6:60086) 2023-07-21T07:34:18.856 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.800+0000 7f6a3bfff700 1 -- 172.21.15.6:0/1314110534 learned_addr learned my addr 172.21.15.6:0/1314110534 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:18.856 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.800+0000 7f6a3b7fe700 1 --2- 172.21.15.6:0/1314110534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a3c0c67d0 0x7f6a3c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:18.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.800+0000 7f6a40a19700 1 --2- 172.21.15.6:0/1314110534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a3c151ac0 0x7f6a3c0bbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:18.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.801+0000 7f6a3bfff700 1 -- 172.21.15.6:0/1314110534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a3c0c67d0 msgr2=0x7f6a3c0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:18.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.801+0000 7f6a3bfff700 1 --2- 172.21.15.6:0/1314110534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a3c0c67d0 0x7f6a3c0c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:18.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.801+0000 7f6a3bfff700 1 -- 172.21.15.6:0/1314110534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a3c151ac0 msgr2=0x7f6a3c0bbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:18.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.801+0000 7f6a3bfff700 1 --2- 172.21.15.6:0/1314110534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a3c151ac0 0x7f6a3c0bbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:18.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.801+0000 7f6a3bfff700 1 -- 172.21.15.6:0/1314110534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a300094a0 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.801+0000 7f6a3bfff700 1 --2- 172.21.15.6:0/1314110534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a3c0c47d0 0x7f6a3c1ea2d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c000c00 tx=0x7f6a2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:18.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.801+0000 7f6a38ff9700 1 -- 172.21.15.6:0/1314110534 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c004590 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.858 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.801+0000 7f6a38ff9700 1 -- 172.21.15.6:0/1314110534 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c01f070 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.858 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.801+0000 7f6a38ff9700 1 -- 172.21.15.6:0/1314110534 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0038e0 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.858 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.801+0000 7f6a4247c700 1 -- 172.21.15.6:0/1314110534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c0094a0 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.858 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.801+0000 7f6a4247c700 1 -- 172.21.15.6:0/1314110534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c1ea810 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.858 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.801+0000 7f6a38ff9700 1 -- 172.21.15.6:0/1314110534 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6a2c003d40 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.858 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.801+0000 7f6a38ff9700 1 -- 172.21.15.6:0/1314110534 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6a2c021070 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.858 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.802+0000 7f6a4247c700 1 -- 172.21.15.6:0/1314110534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c074500 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.859 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.804+0000 7f6a38ff9700 1 -- 172.21.15.6:0/1314110534 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6a2c045b00 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.925 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.876+0000 7f6a4247c700 1 -- 172.21.15.6:0/1314110534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a3c06c090 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.926 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.876+0000 7f6a38ff9700 1 -- 172.21.15.6:0/1314110534 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6a2c034030 con 0x7f6a3c0c47d0 2023-07-21T07:34:18.926 INFO:teuthology.misc.health.smithi006.stdout: 2023-07-21T07:34:18.926 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":10,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:17.557774+0000","last_up_change":"0.000000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:18.927 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.877+0000 7f6a4247c700 1 -- 172.21.15.6:0/1314110534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a3c0c47d0 msgr2=0x7f6a3c1ea2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:18.927 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.877+0000 7f6a4247c700 1 --2- 172.21.15.6:0/1314110534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a3c0c47d0 0x7f6a3c1ea2d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c000c00 tx=0x7f6a2c004750 comp rx=0 tx=0).stop 2023-07-21T07:34:18.927 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.877+0000 7f6a4247c700 1 -- 172.21.15.6:0/1314110534 shutdown_connections 2023-07-21T07:34:18.927 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.877+0000 7f6a4247c700 1 --2- 172.21.15.6:0/1314110534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a3c151ac0 0x7f6a3c0bbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:18.928 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.877+0000 7f6a4247c700 1 --2- 172.21.15.6:0/1314110534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a3c0c47d0 0x7f6a3c1ea2d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:18.928 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.877+0000 7f6a4247c700 1 --2- 172.21.15.6:0/1314110534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a3c0c67d0 0x7f6a3c0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:18.928 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.877+0000 7f6a4247c700 1 -- 172.21.15.6:0/1314110534 >> 172.21.15.6:0/1314110534 conn(0x7f6a3c0717c0 msgr2=0x7f6a3c150d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:18.928 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.877+0000 7f6a4247c700 1 -- 172.21.15.6:0/1314110534 shutdown_connections 2023-07-21T07:34:18.928 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:18.877+0000 7f6a4247c700 1 -- 172.21.15.6:0/1314110534 wait complete. 2023-07-21T07:34:18.938 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-21T07:34:19.020 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:18.969+0000 7f940a281200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T07:34:19.080 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:19.031+0000 7f713aa7a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-21T07:34:19.159 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:19.109+0000 7f713aa7a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T07:34:19.240 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:19.189+0000 7f940a281200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T07:34:19.397 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:19.346+0000 7f940a281200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T07:34:19.440 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:19.390+0000 7f713aa7a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T07:34:19.511 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:19.461+0000 7f940a281200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T07:34:19.665 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:19.615+0000 7f713aa7a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T07:34:19.826 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:19.776+0000 7f713aa7a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T07:34:19.834 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:19.783+0000 7f940a281200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T07:34:19.935 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:19.885+0000 7f940a281200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T07:34:19.947 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:19.897+0000 7f713aa7a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T07:34:20.120 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:20.069+0000 7f940a281200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T07:34:20.279 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:20.229+0000 7f713aa7a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T07:34:20.381 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:20.332+0000 7f713aa7a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T07:34:20.573 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:20.523+0000 7f713aa7a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T07:34:20.718 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:20.667+0000 7f940a281200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T07:34:21.253 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T07:34:21.203+0000 7f713aa7a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T07:34:21.745 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:21.694+0000 7f93c2488700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-21T07:34:21.745 INFO:tasks.ceph.mgr.x.smithi086.stderr:2023-07-21T07:34:21.695+0000 7f93c2488700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-21T07:34:21.753 INFO:tasks.ceph.osd.5.smithi086.stderr:2023-07-21T07:34:21.703+0000 7f0bb3633640 -1 osd.5 0 log_to_monitors true 2023-07-21T07:34:21.767 INFO:tasks.ceph.osd.7.smithi086.stderr:2023-07-21T07:34:21.717+0000 7fac877b7640 -1 osd.7 0 log_to_monitors true 2023-07-21T07:34:21.778 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-21T07:34:21.729+0000 7f2632ce3640 -1 osd.2 0 log_to_monitors true 2023-07-21T07:34:21.780 INFO:tasks.ceph.osd.4.smithi086.stderr:2023-07-21T07:34:21.730+0000 7f9c02701640 -1 osd.4 0 log_to_monitors true 2023-07-21T07:34:21.790 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-21T07:34:21.741+0000 7f23859a9640 -1 osd.1 0 log_to_monitors true 2023-07-21T07:34:21.796 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-21T07:34:21.746+0000 7f37f63c1640 -1 osd.0 0 log_to_monitors true 2023-07-21T07:34:21.808 INFO:tasks.ceph.osd.6.smithi086.stderr:2023-07-21T07:34:21.758+0000 7f5bbe81d640 -1 osd.6 0 log_to_monitors true 2023-07-21T07:34:21.820 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-21T07:34:21.771+0000 7f6e5f191640 -1 osd.3 0 log_to_monitors true 2023-07-21T07:34:25.745 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:25.767 INFO:tasks.ceph.osd.5.smithi086.stderr:2023-07-21T07:34:25.716+0000 7f0ba71ea700 -1 osd.5 0 waiting for initial osdmap 2023-07-21T07:34:25.768 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-21T07:34:25.719+0000 7f37e9f78700 -1 osd.0 0 waiting for initial osdmap 2023-07-21T07:34:25.780 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-21T07:34:25.731+0000 7f37e2354700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T07:34:25.781 INFO:tasks.ceph.osd.5.smithi086.stderr:2023-07-21T07:34:25.731+0000 7f0b9f5c6700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T07:34:25.786 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-21T07:34:25.736+0000 7f6e52d48700 -1 osd.3 0 waiting for initial osdmap 2023-07-21T07:34:25.796 INFO:tasks.ceph.osd.4.smithi086.stderr:2023-07-21T07:34:25.744+0000 7f9bf62b8700 -1 osd.4 0 waiting for initial osdmap 2023-07-21T07:34:25.797 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-21T07:34:25.744+0000 7f262689a700 -1 osd.2 0 waiting for initial osdmap 2023-07-21T07:34:25.799 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-21T07:34:25.750+0000 7f6e4b124700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T07:34:25.800 INFO:tasks.ceph.osd.6.smithi086.stderr:2023-07-21T07:34:25.749+0000 7f5bb3bd7700 -1 osd.6 0 waiting for initial osdmap 2023-07-21T07:34:25.801 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-21T07:34:25.752+0000 7f2379560700 -1 osd.1 0 waiting for initial osdmap 2023-07-21T07:34:25.802 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-21T07:34:25.753+0000 7f261ec76700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T07:34:25.810 INFO:tasks.ceph.osd.4.smithi086.stderr:2023-07-21T07:34:25.760+0000 7f9bee694700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T07:34:25.818 INFO:tasks.ceph.osd.6.smithi086.stderr:2023-07-21T07:34:25.768+0000 7f5baa7b0700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T07:34:25.820 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-21T07:34:25.771+0000 7f237193c700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T07:34:25.835 INFO:tasks.ceph.osd.7.smithi086.stderr:2023-07-21T07:34:25.785+0000 7fac7b36e700 -1 osd.7 0 waiting for initial osdmap 2023-07-21T07:34:25.853 INFO:tasks.ceph.osd.7.smithi086.stderr:2023-07-21T07:34:25.803+0000 7fac7374a700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T07:34:25.881 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.831+0000 7f4c0822a700 1 Processor -- start 2023-07-21T07:34:25.881 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.832+0000 7f4c0822a700 1 -- start start 2023-07-21T07:34:25.884 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.832+0000 7f4c0822a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c0006a300 0x7f4c0006da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:25.884 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.832+0000 7f4c0822a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4c00155050 0x7f4c00151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:25.884 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.832+0000 7f4c0822a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c000c2ab0 con 0x7f4c00151c50 2023-07-21T07:34:25.885 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.832+0000 7f4c0822a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c00152090 con 0x7f4c0006a300 2023-07-21T07:34:25.885 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.832+0000 7f4c0822a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0006e000 con 0x7f4c00155050 2023-07-21T07:34:25.885 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.832+0000 7f4c05fc6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c0006a300 0x7f4c0006da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:25.885 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.832+0000 7f4c05fc6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c0006a300 0x7f4c0006da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60142/0 (socket says 172.21.15.6:60142) 2023-07-21T07:34:25.885 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.833+0000 7f4c05fc6700 1 -- 172.21.15.6:0/2943494971 learned_addr learned my addr 172.21.15.6:0/2943494971 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:25.885 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.833+0000 7f4c067c7700 1 --1- 172.21.15.6:0/2943494971 >> v1:172.21.15.6:6789/0 conn(0x7f4c00151c50 0x7f4c000c2f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39934/0 (socket says 172.21.15.6:39934) 2023-07-21T07:34:25.886 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.833+0000 7f4c057c5700 1 --2- 172.21.15.6:0/2943494971 >> v2:172.21.15.86:3300/0 conn(0x7f4c00155050 0x7f4c00151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:25.886 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.833+0000 7f4c05fc6700 1 -- 172.21.15.6:0/2943494971 >> v2:172.21.15.86:3300/0 conn(0x7f4c00155050 msgr2=0x7f4c00151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:25.886 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.833+0000 7f4c05fc6700 1 --2- 172.21.15.6:0/2943494971 >> v2:172.21.15.86:3300/0 conn(0x7f4c00155050 0x7f4c00151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:25.886 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.833+0000 7f4c05fc6700 1 -- 172.21.15.6:0/2943494971 >> v1:172.21.15.6:6789/0 conn(0x7f4c00151c50 legacy=0x7f4c000c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:25.886 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.833+0000 7f4c05fc6700 1 -- 172.21.15.6:0/2943494971 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0006e2e0 con 0x7f4c0006a300 2023-07-21T07:34:25.886 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.833+0000 7f4c05fc6700 1 --2- 172.21.15.6:0/2943494971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c0006a300 0x7f4c0006da20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40098f0 tx=0x7f4bf4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afc3018b983c418 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:25.886 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.833+0000 7f4c04fc4700 1 -- 172.21.15.6:0/2943494971 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf400b860 con 0x7f4c0006a300 2023-07-21T07:34:25.887 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.833+0000 7f4c04fc4700 1 -- 172.21.15.6:0/2943494971 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf400b9c0 con 0x7f4c0006a300 2023-07-21T07:34:25.887 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.833+0000 7f4c04fc4700 1 -- 172.21.15.6:0/2943494971 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf400bd50 con 0x7f4c0006a300 2023-07-21T07:34:25.887 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.834+0000 7f4c0822a700 1 -- 172.21.15.6:0/2943494971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c0006a300 msgr2=0x7f4c0006da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:25.887 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.834+0000 7f4c0822a700 1 --2- 172.21.15.6:0/2943494971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c0006a300 0x7f4c0006da20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40098f0 tx=0x7f4bf4009c00 comp rx=0 tx=0).stop 2023-07-21T07:34:25.887 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.834+0000 7f4c0822a700 1 -- 172.21.15.6:0/2943494971 shutdown_connections 2023-07-21T07:34:25.887 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.834+0000 7f4c0822a700 1 --2- 172.21.15.6:0/2943494971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c0006a300 0x7f4c0006da20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:25.887 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.834+0000 7f4c0822a700 1 --2- 172.21.15.6:0/2943494971 >> v2:172.21.15.86:3300/0 conn(0x7f4c00155050 0x7f4c00151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:25.888 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.834+0000 7f4c0822a700 1 -- 172.21.15.6:0/2943494971 >> 172.21.15.6:0/2943494971 conn(0x7f4c000a8c90 msgr2=0x7f4c0006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:25.888 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.834+0000 7f4c0822a700 1 -- 172.21.15.6:0/2943494971 shutdown_connections 2023-07-21T07:34:25.888 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.834+0000 7f4c0822a700 1 -- 172.21.15.6:0/2943494971 wait complete. 2023-07-21T07:34:25.890 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.835+0000 7f4c0822a700 1 Processor -- start 2023-07-21T07:34:25.891 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.835+0000 7f4c0822a700 1 -- start start 2023-07-21T07:34:25.891 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c0822a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c0006a300 0x7f4c000be600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:25.891 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c0822a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c00151c50 0x7f4c000718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:25.891 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c0822a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c00155050 0x7f4c0014d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:25.891 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c0822a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c001577c0 con 0x7f4c00155050 2023-07-21T07:34:25.891 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c0822a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000bef70 con 0x7f4c00151c50 2023-07-21T07:34:25.892 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c0822a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c001579d0 con 0x7f4c0006a300 2023-07-21T07:34:25.892 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c067c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c00155050 0x7f4c0014d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:25.892 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c067c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c00155050 0x7f4c0014d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60152/0 (socket says 172.21.15.6:60152) 2023-07-21T07:34:25.892 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c067c7700 1 -- 172.21.15.6:0/3549098409 learned_addr learned my addr 172.21.15.6:0/3549098409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:25.892 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c057c5700 1 --2- 172.21.15.6:0/3549098409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c00151c50 0x7f4c000718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:25.893 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c067c7700 1 -- 172.21.15.6:0/3549098409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c0006a300 msgr2=0x7f4c000be600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:25.893 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c067c7700 1 --2- 172.21.15.6:0/3549098409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c0006a300 0x7f4c000be600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:25.893 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c067c7700 1 -- 172.21.15.6:0/3549098409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c00151c50 msgr2=0x7f4c000718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:25.893 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c067c7700 1 --2- 172.21.15.6:0/3549098409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c00151c50 0x7f4c000718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:25.894 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c067c7700 1 -- 172.21.15.6:0/3549098409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf4009550 con 0x7f4c00155050 2023-07-21T07:34:25.894 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c067c7700 1 --2- 172.21.15.6:0/3549098409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c00155050 0x7f4c0014d6d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800cc00 tx=0x7f4bf800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:25.894 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4bf27fc700 1 -- 172.21.15.6:0/3549098409 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf800aba0 con 0x7f4c00155050 2023-07-21T07:34:25.895 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4bf27fc700 1 -- 172.21.15.6:0/3549098409 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf800ad00 con 0x7f4c00155050 2023-07-21T07:34:25.895 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c0822a700 1 -- 172.21.15.6:0/3549098409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c000c3e80 con 0x7f4c00155050 2023-07-21T07:34:25.895 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4bf27fc700 1 -- 172.21.15.6:0/3549098409 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8007270 con 0x7f4c00155050 2023-07-21T07:34:25.895 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.836+0000 7f4c0822a700 1 -- 172.21.15.6:0/3549098409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c00157c70 con 0x7f4c00155050 2023-07-21T07:34:25.896 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.837+0000 7f4c0822a700 1 -- 172.21.15.6:0/3549098409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c00074500 con 0x7f4c00155050 2023-07-21T07:34:25.896 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.838+0000 7f4bf27fc700 1 -- 172.21.15.6:0/3549098409 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f4bf80073d0 con 0x7f4c00155050 2023-07-21T07:34:25.896 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.838+0000 7f4bf27fc700 1 --2- 172.21.15.6:0/3549098409 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4be406ac50 0x7f4be406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:25.897 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.838+0000 7f4bf27fc700 1 -- 172.21.15.6:0/3549098409 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f4bf8088250 con 0x7f4c00155050 2023-07-21T07:34:25.897 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.838+0000 7f4c05fc6700 1 --2- 172.21.15.6:0/3549098409 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4be406ac50 0x7f4be406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:25.897 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.839+0000 7f4c05fc6700 1 --2- 172.21.15.6:0/3549098409 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4be406ac50 0x7f4be406d110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009130 tx=0x7f4bf4010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:25.898 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:25.843+0000 7f4bf27fc700 1 -- 172.21.15.6:0/3549098409 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4bf8054380 con 0x7f4c00155050 2023-07-21T07:34:26.088 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.039+0000 7f4c0822a700 1 -- 172.21.15.6:0/3549098409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c000c79a0 con 0x7f4c00155050 2023-07-21T07:34:26.089 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.039+0000 7f4bf27fc700 1 -- 172.21.15.6:0/3549098409 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4bf8017070 con 0x7f4c00155050 2023-07-21T07:34:26.089 INFO:teuthology.misc.health.smithi006.stdout: 2023-07-21T07:34:26.089 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":12,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:23.690865+0000","last_up_change":"0.000000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:26.091 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.041+0000 7f4c0822a700 1 -- 172.21.15.6:0/3549098409 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4be406ac50 msgr2=0x7f4be406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:26.091 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.041+0000 7f4c0822a700 1 --2- 172.21.15.6:0/3549098409 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4be406ac50 0x7f4be406d110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009130 tx=0x7f4bf4010000 comp rx=0 tx=0).stop 2023-07-21T07:34:26.091 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.041+0000 7f4c0822a700 1 -- 172.21.15.6:0/3549098409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c00155050 msgr2=0x7f4c0014d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:26.091 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.041+0000 7f4c0822a700 1 --2- 172.21.15.6:0/3549098409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c00155050 0x7f4c0014d6d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800cc00 tx=0x7f4bf800a060 comp rx=0 tx=0).stop 2023-07-21T07:34:26.092 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.041+0000 7f4c0822a700 1 -- 172.21.15.6:0/3549098409 shutdown_connections 2023-07-21T07:34:26.092 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.041+0000 7f4c0822a700 1 --2- 172.21.15.6:0/3549098409 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4be406ac50 0x7f4be406d110 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:26.092 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.041+0000 7f4c0822a700 1 --2- 172.21.15.6:0/3549098409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c00155050 0x7f4c0014d6d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:26.092 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.041+0000 7f4c0822a700 1 --2- 172.21.15.6:0/3549098409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c0006a300 0x7f4c000be600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:26.092 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.041+0000 7f4c0822a700 1 --2- 172.21.15.6:0/3549098409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c00151c50 0x7f4c000718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:26.092 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.041+0000 7f4c0822a700 1 -- 172.21.15.6:0/3549098409 >> 172.21.15.6:0/3549098409 conn(0x7f4c000a8c90 msgr2=0x7f4c000b9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:26.093 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.041+0000 7f4c0822a700 1 -- 172.21.15.6:0/3549098409 shutdown_connections 2023-07-21T07:34:26.093 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:26.041+0000 7f4c0822a700 1 -- 172.21.15.6:0/3549098409 wait complete. 2023-07-21T07:34:26.102 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-21T07:34:32.908 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:33.036 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.986+0000 7fc6ac6fd700 1 Processor -- start 2023-07-21T07:34:33.036 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.986+0000 7fc6ac6fd700 1 -- start start 2023-07-21T07:34:33.038 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.987+0000 7fc6ac6fd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc6a414f9a0 0x7fc6a41523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:33.038 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.987+0000 7fc6ac6fd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6a406f620 0x7fc6a4156240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:33.038 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.987+0000 7fc6ac6fd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a41528f0 con 0x7fc6a414fd80 2023-07-21T07:34:33.038 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.987+0000 7fc6ac6fd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a40c2a10 con 0x7fc6a406f620 2023-07-21T07:34:33.038 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.987+0000 7fc6ac6fd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a4155db0 con 0x7fc6a414f9a0 2023-07-21T07:34:33.039 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.987+0000 7fc6a9c98700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6a406f620 0x7fc6a4156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:33.039 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.987+0000 7fc6a9c98700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6a406f620 0x7fc6a4156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60340/0 (socket says 172.21.15.6:60340) 2023-07-21T07:34:33.039 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.987+0000 7fc6a9c98700 1 -- 172.21.15.6:0/3208622331 learned_addr learned my addr 172.21.15.6:0/3208622331 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:33.040 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.987+0000 7fc6aa499700 1 --2- 172.21.15.6:0/3208622331 >> v2:172.21.15.86:3300/0 conn(0x7fc6a414f9a0 0x7fc6a41523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:33.040 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.987+0000 7fc6a9c98700 1 -- 172.21.15.6:0/3208622331 >> v2:172.21.15.86:3300/0 conn(0x7fc6a414f9a0 msgr2=0x7fc6a41523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:33.040 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.987+0000 7fc6a9c98700 1 --2- 172.21.15.6:0/3208622331 >> v2:172.21.15.86:3300/0 conn(0x7fc6a414f9a0 0x7fc6a41523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.040 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.988+0000 7fc6a9c98700 1 -- 172.21.15.6:0/3208622331 >> v1:172.21.15.86:6789/0 conn(0x7fc6a414fd80 legacy=0x7fc6a40c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:33.040 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.988+0000 7fc6a9c98700 1 -- 172.21.15.6:0/3208622331 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a406e8c0 con 0x7fc6a406f620 2023-07-21T07:34:33.040 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.988+0000 7fc6a9c98700 1 --2- 172.21.15.6:0/3208622331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a406f620 0x7fc6a4156240 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4071c50 tx=0x7fc6a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0b4c6939608dfd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:33.040 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.988+0000 7fc6a9497700 1 -- 172.21.15.6:0/3208622331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0004230 con 0x7fc6a406f620 2023-07-21T07:34:33.041 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.988+0000 7fc6a9497700 1 -- 172.21.15.6:0/3208622331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a0004390 con 0x7fc6a406f620 2023-07-21T07:34:33.041 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.988+0000 7fc6a9497700 1 -- 172.21.15.6:0/3208622331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a00036a0 con 0x7fc6a406f620 2023-07-21T07:34:33.043 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.988+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/3208622331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a406f620 msgr2=0x7fc6a4156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:33.043 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.988+0000 7fc6ac6fd700 1 --2- 172.21.15.6:0/3208622331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a406f620 0x7fc6a4156240 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4071c50 tx=0x7fc6a0009bd0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.043 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.989+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/3208622331 shutdown_connections 2023-07-21T07:34:33.044 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.989+0000 7fc6ac6fd700 1 --2- 172.21.15.6:0/3208622331 >> v2:172.21.15.86:3300/0 conn(0x7fc6a414f9a0 0x7fc6a41523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.044 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.989+0000 7fc6ac6fd700 1 --2- 172.21.15.6:0/3208622331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a406f620 0x7fc6a4156240 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.044 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.989+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/3208622331 >> 172.21.15.6:0/3208622331 conn(0x7fc6a406a480 msgr2=0x7fc6a406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:33.044 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.989+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/3208622331 shutdown_connections 2023-07-21T07:34:33.044 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.989+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/3208622331 wait complete. 2023-07-21T07:34:33.044 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.990+0000 7fc6ac6fd700 1 Processor -- start 2023-07-21T07:34:33.044 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.990+0000 7fc6ac6fd700 1 -- start start 2023-07-21T07:34:33.045 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.990+0000 7fc6ac6fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a406f620 0x7fc6a40c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:33.045 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6ac6fd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a414f9a0 0x7fc6a41ea150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:33.045 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6ac6fd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a414fd80 0x7fc6a406c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:33.045 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6ac6fd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a414ab00 con 0x7fc6a406f620 2023-07-21T07:34:33.045 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6ac6fd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a406c2d0 con 0x7fc6a414fd80 2023-07-21T07:34:33.045 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6ac6fd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40c1d40 con 0x7fc6a414f9a0 2023-07-21T07:34:33.045 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6aa499700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a406f620 0x7fc6a40c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:33.046 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6aa499700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a406f620 0x7fc6a40c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60346/0 (socket says 172.21.15.6:60346) 2023-07-21T07:34:33.046 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6aa499700 1 -- 172.21.15.6:0/4140770014 learned_addr learned my addr 172.21.15.6:0/4140770014 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:33.046 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6aac9a700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a414fd80 0x7fc6a406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:33.046 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6a9c98700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a414f9a0 0x7fc6a41ea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:33.046 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6aa499700 1 -- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a414f9a0 msgr2=0x7fc6a41ea150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:33.046 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6aa499700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a414f9a0 0x7fc6a41ea150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.046 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6aa499700 1 -- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a414fd80 msgr2=0x7fc6a406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:33.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6aa499700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a414fd80 0x7fc6a406c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6aa499700 1 -- 172.21.15.6:0/4140770014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a0009550 con 0x7fc6a406f620 2023-07-21T07:34:33.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6aa499700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a406f620 0x7fc6a40c5de0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc69400e810 tx=0x7fc69400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:33.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc69affd700 1 -- 172.21.15.6:0/4140770014 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69400c070 con 0x7fc6a406f620 2023-07-21T07:34:33.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc69affd700 1 -- 172.21.15.6:0/4140770014 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694013610 con 0x7fc6a406f620 2023-07-21T07:34:33.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/4140770014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a414ad50 con 0x7fc6a406f620 2023-07-21T07:34:33.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc69affd700 1 -- 172.21.15.6:0/4140770014 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6940139c0 con 0x7fc6a406f620 2023-07-21T07:34:33.048 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.991+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/4140770014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a41edca0 con 0x7fc6a406f620 2023-07-21T07:34:33.048 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.992+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/4140770014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a4074500 con 0x7fc6a406f620 2023-07-21T07:34:33.048 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.993+0000 7fc69affd700 1 -- 172.21.15.6:0/4140770014 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc694013b20 con 0x7fc6a406f620 2023-07-21T07:34:33.048 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.993+0000 7fc69affd700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc68806ace0 0x7fc68806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:33.048 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.993+0000 7fc69affd700 1 -- 172.21.15.6:0/4140770014 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc694088da0 con 0x7fc6a406f620 2023-07-21T07:34:33.048 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.994+0000 7fc6a9c98700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc68806ace0 0x7fc68806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:33.049 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.994+0000 7fc6a9c98700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc68806ace0 0x7fc68806d1a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009130 tx=0x7fc6a0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:33.049 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:32.998+0000 7fc69affd700 1 -- 172.21.15.6:0/4140770014 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc694054270 con 0x7fc6a406f620 2023-07-21T07:34:33.244 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.194+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/4140770014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6a40c1f20 con 0x7fc6a406f620 2023-07-21T07:34:33.245 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.195+0000 7fc69affd700 1 -- 172.21.15.6:0/4140770014 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12742 (secure 0 0 0) 0x7fc694057890 con 0x7fc6a406f620 2023-07-21T07:34:33.245 INFO:teuthology.misc.health.smithi006.stdout: 2023-07-21T07:34:33.245 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":17,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:30.833346+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:33.247 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.197+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc68806ace0 msgr2=0x7fc68806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:33.247 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.197+0000 7fc6ac6fd700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc68806ace0 0x7fc68806d1a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009130 tx=0x7fc6a0008030 comp rx=0 tx=0).stop 2023-07-21T07:34:33.247 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.197+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/4140770014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a406f620 msgr2=0x7fc6a40c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:33.247 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.197+0000 7fc6ac6fd700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a406f620 0x7fc6a40c5de0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc69400e810 tx=0x7fc69400eb20 comp rx=0 tx=0).stop 2023-07-21T07:34:33.247 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.197+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/4140770014 shutdown_connections 2023-07-21T07:34:33.248 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.197+0000 7fc6ac6fd700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc68806ace0 0x7fc68806d1a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.248 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.197+0000 7fc6ac6fd700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a414fd80 0x7fc6a406c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.248 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.197+0000 7fc6ac6fd700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a406f620 0x7fc6a40c5de0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.248 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.197+0000 7fc6ac6fd700 1 --2- 172.21.15.6:0/4140770014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a414f9a0 0x7fc6a41ea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.248 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.197+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/4140770014 >> 172.21.15.6:0/4140770014 conn(0x7fc6a406a480 msgr2=0x7fc6a40be050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:33.248 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.197+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/4140770014 shutdown_connections 2023-07-21T07:34:33.248 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T07:34:33.197+0000 7fc6ac6fd700 1 -- 172.21.15.6:0/4140770014 wait complete. 2023-07-21T07:34:33.258 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-21T07:34:33.258 INFO:tasks.ceph:Creating RBD pool 2023-07-21T07:34:33.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-21T07:34:33.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.332+0000 7f6df8c8a700 1 Processor -- start 2023-07-21T07:34:33.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.332+0000 7f6df8c8a700 1 -- start start 2023-07-21T07:34:33.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.333+0000 7f6df8c8a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6df40a6f80 0x7f6df4152380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:33.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.333+0000 7f6df8c8a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6df414fb30 0x7f6df415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:33.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.333+0000 7f6df8c8a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df40c3c90 con 0x7f6df4072160 2023-07-21T07:34:33.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.333+0000 7f6df8c8a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df40c26e0 con 0x7f6df40a6f80 2023-07-21T07:34:33.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.333+0000 7f6df8c8a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df40c3680 con 0x7f6df414fb30 2023-07-21T07:34:33.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.333+0000 7f6df259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6df40a6f80 0x7f6df4152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:33.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.333+0000 7f6df1d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6df4072160 0x7f6df414f420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40142/0 (socket says 172.21.15.6:40142) 2023-07-21T07:34:33.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.333+0000 7f6df1d9b700 1 -- 172.21.15.6:0/2229663512 learned_addr learned my addr 172.21.15.6:0/2229663512 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:33.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.333+0000 7f6df2d9d700 1 --2- 172.21.15.6:0/2229663512 >> v2:172.21.15.86:3300/0 conn(0x7f6df414fb30 0x7f6df415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:33.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.334+0000 7f6df259c700 1 -- 172.21.15.6:0/2229663512 >> v2:172.21.15.86:3300/0 conn(0x7f6df414fb30 msgr2=0x7f6df415cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:33.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.334+0000 7f6df259c700 1 --2- 172.21.15.6:0/2229663512 >> v2:172.21.15.86:3300/0 conn(0x7f6df414fb30 0x7f6df415cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.334+0000 7f6df259c700 1 -- 172.21.15.6:0/2229663512 >> v1:172.21.15.6:6789/0 conn(0x7f6df4072160 legacy=0x7f6df414f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:33.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.334+0000 7f6df159a700 1 -- 172.21.15.6:0/2229663512 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546999885 0 0) 0x7f6df40c3c90 con 0x7f6df4072160 2023-07-21T07:34:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.334+0000 7f6df259c700 1 -- 172.21.15.6:0/2229663512 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df40c6fe0 con 0x7f6df40a6f80 2023-07-21T07:34:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.334+0000 7f6df259c700 1 --2- 172.21.15.6:0/2229663512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40a6f80 0x7f6df4152380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6df4070e20 tx=0x7f6de8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a3d5916da7e6a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.334+0000 7f6df159a700 1 -- 172.21.15.6:0/2229663512 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8011830 con 0x7f6df40a6f80 2023-07-21T07:34:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.334+0000 7f6df159a700 1 -- 172.21.15.6:0/2229663512 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de8011990 con 0x7f6df40a6f80 2023-07-21T07:34:33.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.334+0000 7f6df159a700 1 -- 172.21.15.6:0/2229663512 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8011d20 con 0x7f6df40a6f80 2023-07-21T07:34:33.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.334+0000 7f6df8c8a700 1 -- 172.21.15.6:0/2229663512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40a6f80 msgr2=0x7f6df4152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:33.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.334+0000 7f6df8c8a700 1 --2- 172.21.15.6:0/2229663512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40a6f80 0x7f6df4152380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6df4070e20 tx=0x7f6de8009b20 comp rx=0 tx=0).stop 2023-07-21T07:34:33.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.335+0000 7f6df8c8a700 1 -- 172.21.15.6:0/2229663512 shutdown_connections 2023-07-21T07:34:33.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.335+0000 7f6df8c8a700 1 --2- 172.21.15.6:0/2229663512 >> v2:172.21.15.86:3300/0 conn(0x7f6df414fb30 0x7f6df415cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.335+0000 7f6df8c8a700 1 --2- 172.21.15.6:0/2229663512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40a6f80 0x7f6df4152380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.335+0000 7f6df8c8a700 1 -- 172.21.15.6:0/2229663512 >> 172.21.15.6:0/2229663512 conn(0x7f6df40c7b50 msgr2=0x7f6df40c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:33.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.335+0000 7f6df8c8a700 1 -- 172.21.15.6:0/2229663512 shutdown_connections 2023-07-21T07:34:33.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.335+0000 7f6df8c8a700 1 -- 172.21.15.6:0/2229663512 wait complete. 2023-07-21T07:34:33.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.336+0000 7f6df8c8a700 1 Processor -- start 2023-07-21T07:34:33.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.336+0000 7f6df8c8a700 1 -- start start 2023-07-21T07:34:33.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.337+0000 7f6df8c8a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6df4072160 0x7f6df41e8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:33.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.337+0000 7f6df8c8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40a6f80 0x7f6df40aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:33.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.337+0000 7f6df8c8a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6df414fb30 0x7f6df4155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:33.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.337+0000 7f6df8c8a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df4154660 con 0x7f6df40a6f80 2023-07-21T07:34:33.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.337+0000 7f6df8c8a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df4153770 con 0x7f6df414fb30 2023-07-21T07:34:33.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.337+0000 7f6df8c8a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df4153a50 con 0x7f6df4072160 2023-07-21T07:34:33.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.337+0000 7f6df1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40a6f80 0x7f6df40aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:33.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.337+0000 7f6df1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40a6f80 0x7f6df40aaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60360/0 (socket says 172.21.15.6:60360) 2023-07-21T07:34:33.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.337+0000 7f6df1d9b700 1 -- 172.21.15.6:0/128013203 learned_addr learned my addr 172.21.15.6:0/128013203 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:33.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6df2d9d700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6df414fb30 0x7f6df4155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:33.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6df259c700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6df4072160 0x7f6df41e8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:33.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6df1d9b700 1 -- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6df4072160 msgr2=0x7f6df41e8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:33.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6df1d9b700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6df4072160 0x7f6df41e8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6df1d9b700 1 -- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6df414fb30 msgr2=0x7f6df4155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:33.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6df1d9b700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6df414fb30 0x7f6df4155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6df1d9b700 1 -- 172.21.15.6:0/128013203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de80094a0 con 0x7f6df40a6f80 2023-07-21T07:34:33.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6df2d9d700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6df414fb30 0x7f6df4155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:33.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6df259c700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6df4072160 0x7f6df41e8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:33.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6df1d9b700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40a6f80 0x7f6df40aaf80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c550 tx=0x7f6de400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:33.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6de2ffd700 1 -- 172.21.15.6:0/128013203 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4004c80 con 0x7f6df40a6f80 2023-07-21T07:34:33.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6de2ffd700 1 -- 172.21.15.6:0/128013203 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de4004e00 con 0x7f6df40a6f80 2023-07-21T07:34:33.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6df8c8a700 1 -- 172.21.15.6:0/128013203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df4153d30 con 0x7f6df40a6f80 2023-07-21T07:34:33.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6de2ffd700 1 -- 172.21.15.6:0/128013203 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4007310 con 0x7f6df40a6f80 2023-07-21T07:34:33.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.338+0000 7f6df8c8a700 1 -- 172.21.15.6:0/128013203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df41542f0 con 0x7f6df40a6f80 2023-07-21T07:34:33.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.339+0000 7f6df8c8a700 1 -- 172.21.15.6:0/128013203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df40c2f70 con 0x7f6df40a6f80 2023-07-21T07:34:33.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.339+0000 7f6de2ffd700 1 -- 172.21.15.6:0/128013203 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6de4007470 con 0x7f6df40a6f80 2023-07-21T07:34:33.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.340+0000 7f6de2ffd700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6dd406ace0 0x7f6dd406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:33.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.340+0000 7f6de2ffd700 1 -- 172.21.15.6:0/128013203 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6de4088c80 con 0x7f6df40a6f80 2023-07-21T07:34:33.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.340+0000 7f6df259c700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6dd406ace0 0x7f6dd406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:33.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.341+0000 7f6df259c700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6dd406ace0 0x7f6dd406d1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6de80090b0 tx=0x7f6de8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:33.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.344+0000 7f6de2ffd700 1 -- 172.21.15.6:0/128013203 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6de4054270 con 0x7f6df40a6f80 2023-07-21T07:34:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.542+0000 7f6df8c8a700 1 -- 172.21.15.6:0/128013203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f6df4074500 con 0x7f6df40a6f80 2023-07-21T07:34:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.841+0000 7f6de2ffd700 1 -- 172.21.15.6:0/128013203 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f6de4057890 con 0x7f6df40a6f80 2023-07-21T07:34:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.844+0000 7f6df8c8a700 1 -- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6dd406ace0 msgr2=0x7f6dd406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.844+0000 7f6df8c8a700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6dd406ace0 0x7f6dd406d1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6de80090b0 tx=0x7f6de8008030 comp rx=0 tx=0).stop 2023-07-21T07:34:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.844+0000 7f6df8c8a700 1 -- 172.21.15.6:0/128013203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40a6f80 msgr2=0x7f6df40aaf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.844+0000 7f6df8c8a700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40a6f80 0x7f6df40aaf80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c550 tx=0x7f6de400c910 comp rx=0 tx=0).stop 2023-07-21T07:34:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.844+0000 7f6df8c8a700 1 -- 172.21.15.6:0/128013203 shutdown_connections 2023-07-21T07:34:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.844+0000 7f6df8c8a700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6dd406ace0 0x7f6dd406d1a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.844+0000 7f6df8c8a700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6df414fb30 0x7f6df4155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.844+0000 7f6df8c8a700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6df4072160 0x7f6df41e8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.844+0000 7f6df8c8a700 1 --2- 172.21.15.6:0/128013203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40a6f80 0x7f6df40aaf80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.844+0000 7f6df8c8a700 1 -- 172.21.15.6:0/128013203 >> 172.21.15.6:0/128013203 conn(0x7f6df40c7b50 msgr2=0x7f6df40c4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.845+0000 7f6df8c8a700 1 -- 172.21.15.6:0/128013203 shutdown_connections 2023-07-21T07:34:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.845+0000 7f6df8c8a700 1 -- 172.21.15.6:0/128013203 wait complete. 2023-07-21T07:34:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'rbd' created 2023-07-21T07:34:33.909 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-21T07:34:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.988+0000 7f247b768700 1 Processor -- start 2023-07-21T07:34:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.988+0000 7f247b768700 1 -- start start 2023-07-21T07:34:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.989+0000 7f247b768700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2474151b20 0x7f247406a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.989+0000 7f247b768700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24740ba0d0 0x7f2474154690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.989+0000 7f247b768700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24740c2270 con 0x7f24740c3450 2023-07-21T07:34:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.989+0000 7f247b768700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2474151f00 con 0x7f2474151b20 2023-07-21T07:34:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.989+0000 7f247b768700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24740c24a0 con 0x7f24740ba0d0 2023-07-21T07:34:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.989+0000 7f2479504700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2474151b20 0x7f247406a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.989+0000 7f2478d03700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24740ba0d0 0x7f2474154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.989+0000 7f2479d05700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f24740c3450 0x7f2474154bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:43400/0 (socket says 172.21.15.6:43400) 2023-07-21T07:34:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.989+0000 7f2479d05700 1 -- 172.21.15.6:0/974350599 learned_addr learned my addr 172.21.15.6:0/974350599 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.990+0000 7f2478d03700 1 -- 172.21.15.6:0/974350599 >> v2:172.21.15.86:3300/0 conn(0x7f2474151b20 msgr2=0x7f247406a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.990+0000 7f2478d03700 1 --2- 172.21.15.6:0/974350599 >> v2:172.21.15.86:3300/0 conn(0x7f2474151b20 0x7f247406a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.990+0000 7f2478d03700 1 -- 172.21.15.6:0/974350599 >> v1:172.21.15.86:6789/0 conn(0x7f24740c3450 legacy=0x7f2474154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.990+0000 7f2478d03700 1 -- 172.21.15.6:0/974350599 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24740c2780 con 0x7f24740ba0d0 2023-07-21T07:34:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.990+0000 7f2479504700 1 --2- 172.21.15.6:0/974350599 >> v2:172.21.15.86:3300/0 conn(0x7f2474151b20 0x7f247406a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.990+0000 7f2478d03700 1 --2- 172.21.15.6:0/974350599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24740ba0d0 0x7f2474154690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2464009840 tx=0x7f2464009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=101f267a99b22119 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:34.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.990+0000 7f246bfff700 1 -- 172.21.15.6:0/974350599 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464011830 con 0x7f24740ba0d0 2023-07-21T07:34:34.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.990+0000 7f246bfff700 1 -- 172.21.15.6:0/974350599 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2464011990 con 0x7f24740ba0d0 2023-07-21T07:34:34.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.990+0000 7f246bfff700 1 -- 172.21.15.6:0/974350599 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464011d20 con 0x7f24740ba0d0 2023-07-21T07:34:34.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.991+0000 7f247b768700 1 -- 172.21.15.6:0/974350599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24740ba0d0 msgr2=0x7f2474154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:34.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.991+0000 7f247b768700 1 --2- 172.21.15.6:0/974350599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24740ba0d0 0x7f2474154690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2464009840 tx=0x7f2464009b50 comp rx=0 tx=0).stop 2023-07-21T07:34:34.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.991+0000 7f247b768700 1 -- 172.21.15.6:0/974350599 shutdown_connections 2023-07-21T07:34:34.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.991+0000 7f247b768700 1 --2- 172.21.15.6:0/974350599 >> v2:172.21.15.86:3300/0 conn(0x7f2474151b20 0x7f247406a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:34.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.991+0000 7f247b768700 1 --2- 172.21.15.6:0/974350599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24740ba0d0 0x7f2474154690 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:34.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.991+0000 7f247b768700 1 -- 172.21.15.6:0/974350599 >> 172.21.15.6:0/974350599 conn(0x7f24740a85f0 msgr2=0x7f24740a8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:34.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.991+0000 7f247b768700 1 -- 172.21.15.6:0/974350599 shutdown_connections 2023-07-21T07:34:34.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.991+0000 7f247b768700 1 -- 172.21.15.6:0/974350599 wait complete. 2023-07-21T07:34:34.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.992+0000 7f247b768700 1 Processor -- start 2023-07-21T07:34:34.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.992+0000 7f247b768700 1 -- start start 2023-07-21T07:34:34.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.993+0000 7f247b768700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24740ba0d0 0x7f24741e1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:34.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.993+0000 7f247b768700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24740c3450 0x7f24740bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:34.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.993+0000 7f247b768700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2474151b20 0x7f24741ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:34.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.993+0000 7f247b768700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24740ba500 con 0x7f24740c3450 2023-07-21T07:34:34.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.993+0000 7f247b768700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24740ba7e0 con 0x7f24740ba0d0 2023-07-21T07:34:34.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.993+0000 7f247b768700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24741ea920 con 0x7f2474151b20 2023-07-21T07:34:34.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.993+0000 7f2478d03700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24740c3450 0x7f24740bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:34.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.993+0000 7f2478d03700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24740c3450 0x7f24740bff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60374/0 (socket says 172.21.15.6:60374) 2023-07-21T07:34:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.993+0000 7f2478d03700 1 -- 172.21.15.6:0/3671862265 learned_addr learned my addr 172.21.15.6:0/3671862265 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.993+0000 7f2479504700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24740ba0d0 0x7f24741e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.994+0000 7f2479d05700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2474151b20 0x7f24741ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.994+0000 7f2478d03700 1 -- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2474151b20 msgr2=0x7f24741ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.994+0000 7f2478d03700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2474151b20 0x7f24741ea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.994+0000 7f2478d03700 1 -- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24740ba0d0 msgr2=0x7f24741e1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.994+0000 7f2478d03700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24740ba0d0 0x7f24741e1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:34.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.994+0000 7f2478d03700 1 -- 172.21.15.6:0/3671862265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24700094a0 con 0x7f24740c3450 2023-07-21T07:34:34.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.994+0000 7f2478d03700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24740c3450 0x7f24740bff50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2464009fd0 tx=0x7f2464004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:34.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.994+0000 7f2469ffb700 1 -- 172.21.15.6:0/3671862265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24640036a0 con 0x7f24740c3450 2023-07-21T07:34:34.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.994+0000 7f2469ffb700 1 -- 172.21.15.6:0/3671862265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246401f070 con 0x7f24740c3450 2023-07-21T07:34:34.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.994+0000 7f247b768700 1 -- 172.21.15.6:0/3671862265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24640094a0 con 0x7f24740c3450 2023-07-21T07:34:34.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.994+0000 7f2469ffb700 1 -- 172.21.15.6:0/3671862265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464003a40 con 0x7f24740c3450 2023-07-21T07:34:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.994+0000 7f247b768700 1 -- 172.21.15.6:0/3671862265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24741eaee0 con 0x7f24740c3450 2023-07-21T07:34:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.995+0000 7f247b768700 1 -- 172.21.15.6:0/3671862265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2474068190 con 0x7f24740c3450 2023-07-21T07:34:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.996+0000 7f2469ffb700 1 -- 172.21.15.6:0/3671862265 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2464003ba0 con 0x7f24740c3450 2023-07-21T07:34:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.996+0000 7f2469ffb700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f245806ace0 0x7f245806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.996+0000 7f2469ffb700 1 -- 172.21.15.6:0/3671862265 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f2464021070 con 0x7f24740c3450 2023-07-21T07:34:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.996+0000 7f2479504700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f245806ace0 0x7f245806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:33.997+0000 7f2479504700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f245806ace0 0x7f245806d1a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24740bcfd0 tx=0x7f2470009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.001+0000 7f2469ffb700 1 -- 172.21.15.6:0/3671862265 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2464055df0 con 0x7f24740c3450 2023-07-21T07:34:34.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.203+0000 7f247b768700 1 -- 172.21.15.6:0/3671862265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f24740ba950 con 0x7f24740c3450 2023-07-21T07:34:34.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.843+0000 7f2469ffb700 1 -- 172.21.15.6:0/3671862265 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2464059410 con 0x7f24740c3450 2023-07-21T07:34:34.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.847+0000 7f247b768700 1 -- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f245806ace0 msgr2=0x7f245806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:34.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.847+0000 7f247b768700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f245806ace0 0x7f245806d1a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24740bcfd0 tx=0x7f2470009210 comp rx=0 tx=0).stop 2023-07-21T07:34:34.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.847+0000 7f247b768700 1 -- 172.21.15.6:0/3671862265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24740c3450 msgr2=0x7f24740bff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:34.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.847+0000 7f247b768700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24740c3450 0x7f24740bff50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2464009fd0 tx=0x7f2464004750 comp rx=0 tx=0).stop 2023-07-21T07:34:34.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.847+0000 7f247b768700 1 -- 172.21.15.6:0/3671862265 shutdown_connections 2023-07-21T07:34:34.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.847+0000 7f247b768700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f245806ace0 0x7f245806d1a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:34.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.847+0000 7f247b768700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2474151b20 0x7f24741ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:34.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.847+0000 7f247b768700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24740ba0d0 0x7f24741e1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:34.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.847+0000 7f247b768700 1 --2- 172.21.15.6:0/3671862265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24740c3450 0x7f24740bff50 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2464009fd0 tx=0x7f2464004750 comp rx=0 tx=0).stop 2023-07-21T07:34:34.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.847+0000 7f247b768700 1 -- 172.21.15.6:0/3671862265 >> 172.21.15.6:0/3671862265 conn(0x7f24740a85f0 msgr2=0x7f2474153ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:34.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.848+0000 7f247b768700 1 -- 172.21.15.6:0/3671862265 shutdown_connections 2023-07-21T07:34:34.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:34.848+0000 7f247b768700 1 -- 172.21.15.6:0/3671862265 wait complete. 2023-07-21T07:34:34.899 INFO:teuthology.orchestra.run.smithi006.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-21T07:34:34.914 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-21T07:34:34.914 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T07:34:34.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T07:34:34.917 INFO:tasks.ceph.mds.a:Started 2023-07-21T07:34:34.918 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T07:34:34.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T07:34:34.920 INFO:tasks.ceph.mds.c:Started 2023-07-21T07:34:34.920 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T07:34:34.921 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T07:34:34.923 INFO:tasks.ceph.mds.b:Started 2023-07-21T07:34:34.923 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T07:34:34.924 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T07:34:34.925 INFO:tasks.ceph.mds.d:Started 2023-07-21T07:34:34.926 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-21T07:34:34.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:35.006 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T07:34:35.007 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T07:34:35.010 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2023-07-21T07:34:35.010 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2023-07-21T07:34:35.011 INFO:tasks.ceph.mds.b.smithi086.stderr:2023-07-21T07:34:34.960+0000 7fe326fa7700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-07-21T07:34:35.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.014+0000 7f0b1acd4700 1 Processor -- start 2023-07-21T07:34:35.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.014+0000 7f0b1acd4700 1 -- start start 2023-07-21T07:34:35.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b1acd4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0b140c3750 0x7f0b140c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b1acd4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b1414ed60 0x7f0b14154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b1acd4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b140ba440 con 0x7f0b140c6170 2023-07-21T07:34:35.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b1acd4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b140c15d0 con 0x7f0b140c3750 2023-07-21T07:34:35.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b1acd4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140c18b0 con 0x7f0b1414ed60 2023-07-21T07:34:35.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b13fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0b140c6170 0x7f0b1414e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40194/0 (socket says 172.21.15.6:40194) 2023-07-21T07:34:35.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b13fff700 1 -- 172.21.15.6:0/2482189183 learned_addr learned my addr 172.21.15.6:0/2482189183 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:35.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b18a70700 1 --2- 172.21.15.6:0/2482189183 >> v2:172.21.15.86:3300/0 conn(0x7f0b140c3750 0x7f0b140c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b19271700 1 --2- 172.21.15.6:0/2482189183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b1414ed60 0x7f0b14154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b137fe700 1 -- 172.21.15.6:0/2482189183 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591626931 0 0) 0x7f0b140ba440 con 0x7f0b140c6170 2023-07-21T07:34:35.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b137fe700 1 -- 172.21.15.6:0/2482189183 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b040035b0 con 0x7f0b140c6170 2023-07-21T07:34:35.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b18a70700 1 -- 172.21.15.6:0/2482189183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b1414ed60 msgr2=0x7f0b14154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:35.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b18a70700 1 --2- 172.21.15.6:0/2482189183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b1414ed60 0x7f0b14154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b137fe700 1 -- 172.21.15.6:0/2482189183 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2275989203 0 0) 0x7f0b040035b0 con 0x7f0b140c6170 2023-07-21T07:34:35.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b18a70700 1 -- 172.21.15.6:0/2482189183 >> v1:172.21.15.6:6789/0 conn(0x7f0b140c6170 legacy=0x7f0b1414e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.015+0000 7f0b18a70700 1 -- 172.21.15.6:0/2482189183 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b140c1b90 con 0x7f0b140c3750 2023-07-21T07:34:35.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.016+0000 7f0b18a70700 1 --2- 172.21.15.6:0/2482189183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b140c3750 0x7f0b140c53e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009840 tx=0x7f0b08009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b9e549d8112729a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:35.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.016+0000 7f0b137fe700 1 -- 172.21.15.6:0/2482189183 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b00001670 con 0x7f0b140c3750 2023-07-21T07:34:35.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.016+0000 7f0b137fe700 1 -- 172.21.15.6:0/2482189183 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b08004030 con 0x7f0b140c3750 2023-07-21T07:34:35.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.016+0000 7f0b137fe700 1 -- 172.21.15.6:0/2482189183 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080043c0 con 0x7f0b140c3750 2023-07-21T07:34:35.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.016+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2482189183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b140c3750 msgr2=0x7f0b140c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.016+0000 7f0b1acd4700 1 --2- 172.21.15.6:0/2482189183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b140c3750 0x7f0b140c53e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009840 tx=0x7f0b08009b50 comp rx=0 tx=0).stop 2023-07-21T07:34:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.016+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2482189183 shutdown_connections 2023-07-21T07:34:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.016+0000 7f0b1acd4700 1 --2- 172.21.15.6:0/2482189183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b1414ed60 0x7f0b14154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.016+0000 7f0b1acd4700 1 --2- 172.21.15.6:0/2482189183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b140c3750 0x7f0b140c53e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.016+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2482189183 >> 172.21.15.6:0/2482189183 conn(0x7f0b140a8c90 msgr2=0x7f0b1406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.016+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2482189183 shutdown_connections 2023-07-21T07:34:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.017+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2482189183 wait complete. 2023-07-21T07:34:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.018+0000 7f0b1acd4700 1 Processor -- start 2023-07-21T07:34:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.018+0000 7f0b1acd4700 1 -- start start 2023-07-21T07:34:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.018+0000 7f0b1acd4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b140c3750 0x7f0b14150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.018+0000 7f0b1acd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b140c6170 0x7f0b141508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.018+0000 7f0b1acd4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b1414ed60 0x7f0b141e6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.018+0000 7f0b1acd4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b141e7100 con 0x7f0b140c6170 2023-07-21T07:34:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.018+0000 7f0b1acd4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14151e40 con 0x7f0b1414ed60 2023-07-21T07:34:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.018+0000 7f0b1acd4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14151880 con 0x7f0b140c3750 2023-07-21T07:34:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b13fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b140c6170 0x7f0b141508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b18a70700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b140c3750 0x7f0b14150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b13fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b140c6170 0x7f0b141508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60414/0 (socket says 172.21.15.6:60414) 2023-07-21T07:34:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b13fff700 1 -- 172.21.15.6:0/2224066063 learned_addr learned my addr 172.21.15.6:0/2224066063 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b19271700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b1414ed60 0x7f0b141e6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b13fff700 1 -- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b140c3750 msgr2=0x7f0b14150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b13fff700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b140c3750 0x7f0b14150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b13fff700 1 -- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b1414ed60 msgr2=0x7f0b141e6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b13fff700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b1414ed60 0x7f0b141e6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b13fff700 1 -- 172.21.15.6:0/2224066063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b080094a0 con 0x7f0b140c6170 2023-07-21T07:34:35.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b19271700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b1414ed60 0x7f0b141e6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:35.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b18a70700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b140c3750 0x7f0b14150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:35.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b13fff700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b140c6170 0x7f0b141508b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000c780 tx=0x7f0b0000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:35.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b117fa700 1 -- 172.21.15.6:0/2224066063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b00004c80 con 0x7f0b140c6170 2023-07-21T07:34:35.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b117fa700 1 -- 172.21.15.6:0/2224066063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b00004de0 con 0x7f0b140c6170 2023-07-21T07:34:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2224066063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b14151b60 con 0x7f0b140c6170 2023-07-21T07:34:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b117fa700 1 -- 172.21.15.6:0/2224066063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b000072f0 con 0x7f0b140c6170 2023-07-21T07:34:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.019+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2224066063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b141e4110 con 0x7f0b140c6170 2023-07-21T07:34:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.020+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2224066063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1414fcb0 con 0x7f0b140c6170 2023-07-21T07:34:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.021+0000 7f0b117fa700 1 -- 172.21.15.6:0/2224066063 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b00007450 con 0x7f0b140c6170 2023-07-21T07:34:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.021+0000 7f0b117fa700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0af806ace0 0x7f0af806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.021+0000 7f0b117fa700 1 -- 172.21.15.6:0/2224066063 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0b00088e00 con 0x7f0b140c6170 2023-07-21T07:34:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.021+0000 7f0b18a70700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0af806ace0 0x7f0af806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.022+0000 7f0b18a70700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0af806ace0 0x7f0af806d1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0b080090b0 tx=0x7f0b08008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.026+0000 7f0b117fa700 1 -- 172.21.15.6:0/2224066063 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0b1414fcb0 con 0x7f0b140c6170 2023-07-21T07:34:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.225+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2224066063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b14150090 con 0x7f0b140c6170 2023-07-21T07:34:35.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.226+0000 7f0b117fa700 1 -- 172.21.15.6:0/2224066063 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14541 (secure 0 0 0) 0x7f0b14150090 con 0x7f0b140c6170 2023-07-21T07:34:35.277 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:35.277 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:34.839584+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:35.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.229+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0af806ace0 msgr2=0x7f0af806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.229+0000 7f0b1acd4700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0af806ace0 0x7f0af806d1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0b080090b0 tx=0x7f0b08008030 comp rx=0 tx=0).stop 2023-07-21T07:34:35.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.229+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2224066063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b140c6170 msgr2=0x7f0b141508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.229+0000 7f0b1acd4700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b140c6170 0x7f0b141508b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000c780 tx=0x7f0b0000ca90 comp rx=0 tx=0).stop 2023-07-21T07:34:35.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.229+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2224066063 shutdown_connections 2023-07-21T07:34:35.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.229+0000 7f0b1acd4700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0af806ace0 0x7f0af806d1a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.229+0000 7f0b1acd4700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b1414ed60 0x7f0b141e6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.229+0000 7f0b1acd4700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b140c3750 0x7f0b14150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.229+0000 7f0b1acd4700 1 --2- 172.21.15.6:0/2224066063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b140c6170 0x7f0b141508b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.229+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2224066063 >> 172.21.15.6:0/2224066063 conn(0x7f0b140a8c90 msgr2=0x7f0b1414db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:35.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.229+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2224066063 shutdown_connections 2023-07-21T07:34:35.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.229+0000 7f0b1acd4700 1 -- 172.21.15.6:0/2224066063 wait complete. 2023-07-21T07:34:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:34:35.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:34:35.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.369+0000 7f41b628b700 1 Processor -- start 2023-07-21T07:34:35.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.369+0000 7f41b628b700 1 -- start start 2023-07-21T07:34:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.369+0000 7f41b628b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41b00ba140 0x7f41b00c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.369+0000 7f41b628b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b0155530 con 0x7f41b006a300 2023-07-21T07:34:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41b628b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b00c5690 con 0x7f41b006d8a0 2023-07-21T07:34:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41b628b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b00c1a30 con 0x7f41b00ba140 2023-07-21T07:34:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41affff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f41b006a300 0x7f41b01519b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40208/0 (socket says 172.21.15.6:40208) 2023-07-21T07:34:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41affff700 1 -- 172.21.15.6:0/368169032 learned_addr learned my addr 172.21.15.6:0/368169032 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41af7fe700 1 --2- 172.21.15.6:0/368169032 >> v2:172.21.15.86:3300/0 conn(0x7f41b00ba140 0x7f41b00c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41aeffd700 1 -- 172.21.15.6:0/368169032 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399973195 0 0) 0x7f41b0155530 con 0x7f41b006a300 2023-07-21T07:34:35.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41aeffd700 1 -- 172.21.15.6:0/368169032 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41980035b0 con 0x7f41b006a300 2023-07-21T07:34:35.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41aeffd700 1 -- 172.21.15.6:0/368169032 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776560456 0 0) 0x7f41b00c5690 con 0x7f41b006d8a0 2023-07-21T07:34:35.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41aeffd700 1 -- 172.21.15.6:0/368169032 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41b0155530 con 0x7f41b006d8a0 2023-07-21T07:34:35.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41af7fe700 1 -- 172.21.15.6:0/368169032 >> v1:172.21.15.86:6789/0 conn(0x7f41b006d8a0 legacy=0x7f41b00c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41af7fe700 1 -- 172.21.15.6:0/368169032 >> v1:172.21.15.6:6789/0 conn(0x7f41b006a300 legacy=0x7f41b01519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41af7fe700 1 -- 172.21.15.6:0/368169032 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b0154920 con 0x7f41b00ba140 2023-07-21T07:34:35.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41af7fe700 1 --2- 172.21.15.6:0/368169032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41b00ba140 0x7f41b00c4a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009840 tx=0x7f41a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffe90409366fdfe2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:35.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41aeffd700 1 -- 172.21.15.6:0/368169032 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4004230 con 0x7f41b00ba140 2023-07-21T07:34:35.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41aeffd700 1 -- 172.21.15.6:0/368169032 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a4004390 con 0x7f41b00ba140 2023-07-21T07:34:35.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.370+0000 7f41aeffd700 1 -- 172.21.15.6:0/368169032 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a40036a0 con 0x7f41b00ba140 2023-07-21T07:34:35.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.371+0000 7f41b628b700 1 -- 172.21.15.6:0/368169032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41b00ba140 msgr2=0x7f41b00c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.371+0000 7f41b628b700 1 --2- 172.21.15.6:0/368169032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41b00ba140 0x7f41b00c4a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009840 tx=0x7f41a4009b50 comp rx=0 tx=0).stop 2023-07-21T07:34:35.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.371+0000 7f41b628b700 1 -- 172.21.15.6:0/368169032 shutdown_connections 2023-07-21T07:34:35.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.371+0000 7f41b628b700 1 --2- 172.21.15.6:0/368169032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41b00ba140 0x7f41b00c4a40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.371+0000 7f41b628b700 1 -- 172.21.15.6:0/368169032 >> 172.21.15.6:0/368169032 conn(0x7f41b00a8660 msgr2=0x7f41b00a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:35.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.371+0000 7f41b628b700 1 -- 172.21.15.6:0/368169032 shutdown_connections 2023-07-21T07:34:35.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.371+0000 7f41b628b700 1 -- 172.21.15.6:0/368169032 wait complete. 2023-07-21T07:34:35.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.372+0000 7f41b628b700 1 Processor -- start 2023-07-21T07:34:35.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.372+0000 7f41b628b700 1 -- start start 2023-07-21T07:34:35.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b628b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b006a300 0x7f41b0157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b628b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41b006d8a0 0x7f41b00b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b628b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b00ba140 0x7f41b00b9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b628b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b014af70 con 0x7f41b00ba140 2023-07-21T07:34:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b628b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b014d620 con 0x7f41b006d8a0 2023-07-21T07:34:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b628b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b00c5230 con 0x7f41b006a300 2023-07-21T07:34:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b4828700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b00ba140 0x7f41b00b9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b4828700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b00ba140 0x7f41b00b9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60430/0 (socket says 172.21.15.6:60430) 2023-07-21T07:34:35.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b4828700 1 -- 172.21.15.6:0/1005277873 learned_addr learned my addr 172.21.15.6:0/1005277873 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:35.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41af7fe700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41b006d8a0 0x7f41b00b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41affff700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b006a300 0x7f41b0157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b4828700 1 -- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b006a300 msgr2=0x7f41b0157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b4828700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b006a300 0x7f41b0157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b4828700 1 -- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41b006d8a0 msgr2=0x7f41b00b8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b4828700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41b006d8a0 0x7f41b00b8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41b4828700 1 -- 172.21.15.6:0/1005277873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a40094a0 con 0x7f41b00ba140 2023-07-21T07:34:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41af7fe700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41b006d8a0 0x7f41b00b8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.373+0000 7f41affff700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b006a300 0x7f41b0157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.374+0000 7f41b4828700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b00ba140 0x7f41b00b9250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41a800c810 tx=0x7f41a800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.374+0000 7f41acff9700 1 -- 172.21.15.6:0/1005277873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8003e30 con 0x7f41b00ba140 2023-07-21T07:34:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.374+0000 7f41acff9700 1 -- 172.21.15.6:0/1005277873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a8005070 con 0x7f41b00ba140 2023-07-21T07:34:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.374+0000 7f41b628b700 1 -- 172.21.15.6:0/1005277873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b014b1c0 con 0x7f41b00ba140 2023-07-21T07:34:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.374+0000 7f41acff9700 1 -- 172.21.15.6:0/1005277873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8005420 con 0x7f41b00ba140 2023-07-21T07:34:35.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.374+0000 7f41b628b700 1 -- 172.21.15.6:0/1005277873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b014d870 con 0x7f41b00ba140 2023-07-21T07:34:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.375+0000 7f41b628b700 1 -- 172.21.15.6:0/1005277873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b014b6e0 con 0x7f41b00ba140 2023-07-21T07:34:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.375+0000 7f41acff9700 1 -- 172.21.15.6:0/1005277873 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41a8005580 con 0x7f41b00ba140 2023-07-21T07:34:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.375+0000 7f41acff9700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f419c06ace0 0x7f419c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.376+0000 7f41acff9700 1 -- 172.21.15.6:0/1005277873 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f41a8088f40 con 0x7f41b00ba140 2023-07-21T07:34:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.376+0000 7f41affff700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f419c06ace0 0x7f419c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.376+0000 7f41affff700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f419c06ace0 0x7f419c06d1a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f41a00011e0 tx=0x7f41a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:35.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.380+0000 7f41acff9700 1 -- 172.21.15.6:0/1005277873 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f41a80542a0 con 0x7f41b00ba140 2023-07-21T07:34:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.576+0000 7f41b628b700 1 -- 172.21.15.6:0/1005277873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41b0074500 con 0x7f41b00ba140 2023-07-21T07:34:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.577+0000 7f41acff9700 1 -- 172.21.15.6:0/1005277873 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41a80578c0 con 0x7f41b00ba140 2023-07-21T07:34:35.627 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:34:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.579+0000 7f41b628b700 1 -- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f419c06ace0 msgr2=0x7f419c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.579+0000 7f41b628b700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f419c06ace0 0x7f419c06d1a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f41a00011e0 tx=0x7f41a0009040 comp rx=0 tx=0).stop 2023-07-21T07:34:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.579+0000 7f41b628b700 1 -- 172.21.15.6:0/1005277873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b00ba140 msgr2=0x7f41b00b9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.579+0000 7f41b628b700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b00ba140 0x7f41b00b9250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41a800c810 tx=0x7f41a800cbd0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.579+0000 7f41b628b700 1 -- 172.21.15.6:0/1005277873 shutdown_connections 2023-07-21T07:34:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.579+0000 7f41b628b700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f419c06ace0 0x7f419c06d1a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.579+0000 7f41b628b700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41b00ba140 0x7f41b00b9250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.579+0000 7f41b628b700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b006a300 0x7f41b0157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.579+0000 7f41b628b700 1 --2- 172.21.15.6:0/1005277873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41b006d8a0 0x7f41b00b8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.579+0000 7f41b628b700 1 -- 172.21.15.6:0/1005277873 >> 172.21.15.6:0/1005277873 conn(0x7f41b00a8660 msgr2=0x7f41b00c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:35.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.579+0000 7f41b628b700 1 -- 172.21.15.6:0/1005277873 shutdown_connections 2023-07-21T07:34:35.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.579+0000 7f41b628b700 1 -- 172.21.15.6:0/1005277873 wait complete. 2023-07-21T07:34:35.641 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:34:35.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.718+0000 7f79b729e700 1 Processor -- start 2023-07-21T07:34:35.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.718+0000 7f79b729e700 1 -- start start 2023-07-21T07:34:35.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.719+0000 7f79b729e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79b00abee0 0x7f79b006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.719+0000 7f79b729e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79b0152da0 0x7f79b01561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.719+0000 7f79b729e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b0155d20 con 0x7f79b014f4b0 2023-07-21T07:34:35.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.719+0000 7f79b729e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b00c5de0 con 0x7f79b00abee0 2023-07-21T07:34:35.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.719+0000 7f79b729e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b00c4ce0 con 0x7f79b0152da0 2023-07-21T07:34:35.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.719+0000 7f79b503a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79b00abee0 0x7f79b006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.719+0000 7f79b583b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f79b014f4b0 0x7f79b006a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40226/0 (socket says 172.21.15.6:40226) 2023-07-21T07:34:35.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.719+0000 7f79b583b700 1 -- 172.21.15.6:0/3202989113 learned_addr learned my addr 172.21.15.6:0/3202989113 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:35.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.719+0000 7f79b4839700 1 --2- 172.21.15.6:0/3202989113 >> v2:172.21.15.86:3300/0 conn(0x7f79b0152da0 0x7f79b01561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.719+0000 7f79b503a700 1 -- 172.21.15.6:0/3202989113 >> v2:172.21.15.86:3300/0 conn(0x7f79b0152da0 msgr2=0x7f79b01561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:35.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.719+0000 7f79b503a700 1 --2- 172.21.15.6:0/3202989113 >> v2:172.21.15.86:3300/0 conn(0x7f79b0152da0 0x7f79b01561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.719+0000 7f79b503a700 1 -- 172.21.15.6:0/3202989113 >> v1:172.21.15.6:6789/0 conn(0x7f79b014f4b0 legacy=0x7f79b006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.720+0000 7f79b503a700 1 -- 172.21.15.6:0/3202989113 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b00c4fc0 con 0x7f79b00abee0 2023-07-21T07:34:35.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.719+0000 7f79a7fff700 1 -- 172.21.15.6:0/3202989113 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107882105 0 0) 0x7f79b0155d20 con 0x7f79b014f4b0 2023-07-21T07:34:35.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.720+0000 7f79b503a700 1 --2- 172.21.15.6:0/3202989113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79b00abee0 0x7f79b006d680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79b00c0e40 tx=0x7f79a0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17dedb2ff0cb61e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:35.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.720+0000 7f79a7fff700 1 -- 172.21.15.6:0/3202989113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0011830 con 0x7f79b00abee0 2023-07-21T07:34:35.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.720+0000 7f79a7fff700 1 -- 172.21.15.6:0/3202989113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a0011990 con 0x7f79b00abee0 2023-07-21T07:34:35.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.720+0000 7f79a7fff700 1 -- 172.21.15.6:0/3202989113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0011d20 con 0x7f79b00abee0 2023-07-21T07:34:35.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.720+0000 7f79b729e700 1 -- 172.21.15.6:0/3202989113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79b00abee0 msgr2=0x7f79b006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.720+0000 7f79b729e700 1 --2- 172.21.15.6:0/3202989113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79b00abee0 0x7f79b006d680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79b00c0e40 tx=0x7f79a0009b20 comp rx=0 tx=0).stop 2023-07-21T07:34:35.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.720+0000 7f79b729e700 1 -- 172.21.15.6:0/3202989113 shutdown_connections 2023-07-21T07:34:35.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.720+0000 7f79b729e700 1 --2- 172.21.15.6:0/3202989113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79b00abee0 0x7f79b006d680 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.720+0000 7f79b729e700 1 --2- 172.21.15.6:0/3202989113 >> v2:172.21.15.86:3300/0 conn(0x7f79b0152da0 0x7f79b01561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.720+0000 7f79b729e700 1 -- 172.21.15.6:0/3202989113 >> 172.21.15.6:0/3202989113 conn(0x7f79b00a8660 msgr2=0x7f79b00a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:35.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.720+0000 7f79b729e700 1 -- 172.21.15.6:0/3202989113 shutdown_connections 2023-07-21T07:34:35.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.721+0000 7f79b729e700 1 -- 172.21.15.6:0/3202989113 wait complete. 2023-07-21T07:34:35.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.722+0000 7f79b729e700 1 Processor -- start 2023-07-21T07:34:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.722+0000 7f79b729e700 1 -- start start 2023-07-21T07:34:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.722+0000 7f79b729e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79b00abee0 0x7f79b014e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.722+0000 7f79b729e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79b014f4b0 0x7f79b01dd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.722+0000 7f79b729e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79b0152da0 0x7f79b01eb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.722+0000 7f79b729e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b01eaf50 con 0x7f79b0152da0 2023-07-21T07:34:35.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.722+0000 7f79b729e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b01ecca0 con 0x7f79b00abee0 2023-07-21T07:34:35.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.722+0000 7f79b729e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00ab6e0 con 0x7f79b014f4b0 2023-07-21T07:34:35.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.722+0000 7f79b583b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79b0152da0 0x7f79b01eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.722+0000 7f79b583b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79b0152da0 0x7f79b01eb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60444/0 (socket says 172.21.15.6:60444) 2023-07-21T07:34:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.722+0000 7f79b583b700 1 -- 172.21.15.6:0/3427303576 learned_addr learned my addr 172.21.15.6:0/3427303576 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.723+0000 7f79b503a700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79b00abee0 0x7f79b014e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.723+0000 7f79b4839700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79b014f4b0 0x7f79b01dd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.723+0000 7f79b583b700 1 -- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79b014f4b0 msgr2=0x7f79b01dd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.723+0000 7f79b583b700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79b014f4b0 0x7f79b01dd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.723+0000 7f79b583b700 1 -- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79b00abee0 msgr2=0x7f79b014e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.723+0000 7f79b583b700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79b00abee0 0x7f79b014e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.723+0000 7f79b583b700 1 -- 172.21.15.6:0/3427303576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a00094a0 con 0x7f79b0152da0 2023-07-21T07:34:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.723+0000 7f79b583b700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79b0152da0 0x7f79b01eb370 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f79a8002230 tx=0x7f79a800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.723+0000 7f79a5ffb700 1 -- 172.21.15.6:0/3427303576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800aa60 con 0x7f79b0152da0 2023-07-21T07:34:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.723+0000 7f79a5ffb700 1 -- 172.21.15.6:0/3427303576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a800abe0 con 0x7f79b0152da0 2023-07-21T07:34:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.723+0000 7f79a5ffb700 1 -- 172.21.15.6:0/3427303576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a80070d0 con 0x7f79b0152da0 2023-07-21T07:34:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.723+0000 7f79b729e700 1 -- 172.21.15.6:0/3427303576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b014eb80 con 0x7f79b0152da0 2023-07-21T07:34:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.723+0000 7f79b729e700 1 -- 172.21.15.6:0/3427303576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b01edcd0 con 0x7f79b0152da0 2023-07-21T07:34:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.724+0000 7f79b729e700 1 -- 172.21.15.6:0/3427303576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b01eb090 con 0x7f79b0152da0 2023-07-21T07:34:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.725+0000 7f79a5ffb700 1 -- 172.21.15.6:0/3427303576 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f79a8007230 con 0x7f79b0152da0 2023-07-21T07:34:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.725+0000 7f79a5ffb700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f799406ace0 0x7f799406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.725+0000 7f79a5ffb700 1 -- 172.21.15.6:0/3427303576 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f79a8088ab0 con 0x7f79b0152da0 2023-07-21T07:34:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.725+0000 7f79b503a700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f799406ace0 0x7f799406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.726+0000 7f79b503a700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f799406ace0 0x7f799406d1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79a00090b0 tx=0x7f79a001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:35.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.729+0000 7f79a5ffb700 1 -- 172.21.15.6:0/3427303576 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f79a8053f40 con 0x7f79b0152da0 2023-07-21T07:34:35.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.925+0000 7f79b729e700 1 -- 172.21.15.6:0/3427303576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f79b0074500 con 0x7f79b0152da0 2023-07-21T07:34:35.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.926+0000 7f79a5ffb700 1 -- 172.21.15.6:0/3427303576 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f79a80180a0 con 0x7f79b0152da0 2023-07-21T07:34:35.977 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:34:35.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.928+0000 7f79b729e700 1 -- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f799406ace0 msgr2=0x7f799406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.928+0000 7f79b729e700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f799406ace0 0x7f799406d1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79a00090b0 tx=0x7f79a001c040 comp rx=0 tx=0).stop 2023-07-21T07:34:35.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.928+0000 7f79b729e700 1 -- 172.21.15.6:0/3427303576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79b0152da0 msgr2=0x7f79b01eb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:35.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.928+0000 7f79b729e700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79b0152da0 0x7f79b01eb370 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f79a8002230 tx=0x7f79a800cf50 comp rx=0 tx=0).stop 2023-07-21T07:34:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.928+0000 7f79b729e700 1 -- 172.21.15.6:0/3427303576 shutdown_connections 2023-07-21T07:34:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.928+0000 7f79b729e700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f799406ace0 0x7f799406d1a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.928+0000 7f79b729e700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79b0152da0 0x7f79b01eb370 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.928+0000 7f79b729e700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79b00abee0 0x7f79b014e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.928+0000 7f79b729e700 1 --2- 172.21.15.6:0/3427303576 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79b014f4b0 0x7f79b01dd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.928+0000 7f79b729e700 1 -- 172.21.15.6:0/3427303576 >> 172.21.15.6:0/3427303576 conn(0x7f79b00a8660 msgr2=0x7f79b0154f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.928+0000 7f79b729e700 1 -- 172.21.15.6:0/3427303576 shutdown_connections 2023-07-21T07:34:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:35.928+0000 7f79b729e700 1 -- 172.21.15.6:0/3427303576 wait complete. 2023-07-21T07:34:35.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:34:36.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.065+0000 7fa8fd261700 1 Processor -- start 2023-07-21T07:34:36.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.065+0000 7fa8fd261700 1 -- start start 2023-07-21T07:34:36.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8fd261700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8f80c17f0 0x7fa8f8155030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8fd261700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa8f80a5f00 0x7fa8f80c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8fd261700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f8154ba0 con 0x7fa8f814e730 2023-07-21T07:34:36.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8fd261700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f8071770 con 0x7fa8f80c17f0 2023-07-21T07:34:36.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8fd261700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f80711b0 con 0x7fa8f80a5f00 2023-07-21T07:34:36.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8f67fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8f80c17f0 0x7fa8f8155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8f6ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa8f814e730 0x7fa8f80c4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40238/0 (socket says 172.21.15.6:40238) 2023-07-21T07:34:36.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8f6ffd700 1 -- 172.21.15.6:0/2299437397 learned_addr learned my addr 172.21.15.6:0/2299437397 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:36.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8f67fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8f80c17f0 0x7fa8f8155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60452/0 (socket says 172.21.15.6:60452) 2023-07-21T07:34:36.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8f77fe700 1 --2- 172.21.15.6:0/2299437397 >> v2:172.21.15.86:3300/0 conn(0x7fa8f80a5f00 0x7fa8f80c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8f5ffb700 1 -- 172.21.15.6:0/2299437397 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212187180 0 0) 0x7fa8f8154ba0 con 0x7fa8f814e730 2023-07-21T07:34:36.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8f5ffb700 1 -- 172.21.15.6:0/2299437397 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e00035b0 con 0x7fa8f814e730 2023-07-21T07:34:36.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8f67fc700 1 -- 172.21.15.6:0/2299437397 >> v2:172.21.15.86:3300/0 conn(0x7fa8f80a5f00 msgr2=0x7fa8f80c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:36.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8f67fc700 1 --2- 172.21.15.6:0/2299437397 >> v2:172.21.15.86:3300/0 conn(0x7fa8f80a5f00 0x7fa8f80c1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8f67fc700 1 -- 172.21.15.6:0/2299437397 >> v1:172.21.15.6:6789/0 conn(0x7fa8f814e730 legacy=0x7fa8f80c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8f67fc700 1 -- 172.21.15.6:0/2299437397 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f8071490 con 0x7fa8f80c17f0 2023-07-21T07:34:36.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.066+0000 7fa8f67fc700 1 --2- 172.21.15.6:0/2299437397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f80c17f0 0x7fa8f8155030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80a6530 tx=0x7fa8e8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00a56884d47f0c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.067+0000 7fa8f5ffb700 1 -- 172.21.15.6:0/2299437397 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8011830 con 0x7fa8f80c17f0 2023-07-21T07:34:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.067+0000 7fa8f5ffb700 1 -- 172.21.15.6:0/2299437397 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e8011990 con 0x7fa8f80c17f0 2023-07-21T07:34:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.067+0000 7fa8f5ffb700 1 -- 172.21.15.6:0/2299437397 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8011d20 con 0x7fa8f80c17f0 2023-07-21T07:34:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.067+0000 7fa8fd261700 1 -- 172.21.15.6:0/2299437397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f80c17f0 msgr2=0x7fa8f8155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.067+0000 7fa8fd261700 1 --2- 172.21.15.6:0/2299437397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f80c17f0 0x7fa8f8155030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80a6530 tx=0x7fa8e8009b20 comp rx=0 tx=0).stop 2023-07-21T07:34:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.067+0000 7fa8fd261700 1 -- 172.21.15.6:0/2299437397 shutdown_connections 2023-07-21T07:34:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.067+0000 7fa8fd261700 1 --2- 172.21.15.6:0/2299437397 >> v2:172.21.15.86:3300/0 conn(0x7fa8f80a5f00 0x7fa8f80c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.067+0000 7fa8fd261700 1 --2- 172.21.15.6:0/2299437397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f80c17f0 0x7fa8f8155030 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.067+0000 7fa8fd261700 1 -- 172.21.15.6:0/2299437397 >> 172.21.15.6:0/2299437397 conn(0x7fa8f806b1a0 msgr2=0x7fa8f806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:36.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.067+0000 7fa8fd261700 1 -- 172.21.15.6:0/2299437397 shutdown_connections 2023-07-21T07:34:36.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.067+0000 7fa8fd261700 1 -- 172.21.15.6:0/2299437397 wait complete. 2023-07-21T07:34:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.068+0000 7fa8fd261700 1 Processor -- start 2023-07-21T07:34:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.068+0000 7fa8fd261700 1 -- start start 2023-07-21T07:34:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.069+0000 7fa8fd261700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f80a5f00 0x7fa8f806dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.069+0000 7fa8fd261700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8f80c17f0 0x7fa8f8142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.069+0000 7fa8fd261700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8f814e730 0x7fa8f8143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.069+0000 7fa8fd261700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f814c030 con 0x7fa8f80a5f00 2023-07-21T07:34:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.069+0000 7fa8fd261700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f814ddf0 con 0x7fa8f80c17f0 2023-07-21T07:34:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.069+0000 7fa8fd261700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f814c480 con 0x7fa8f814e730 2023-07-21T07:34:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.069+0000 7fa8f6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f80a5f00 0x7fa8f806dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.069+0000 7fa8f6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f80a5f00 0x7fa8f806dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60456/0 (socket says 172.21.15.6:60456) 2023-07-21T07:34:36.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.069+0000 7fa8f6ffd700 1 -- 172.21.15.6:0/3773156131 learned_addr learned my addr 172.21.15.6:0/3773156131 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.069+0000 7fa8f6ffd700 1 -- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8f814e730 msgr2=0x7fa8f8143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.069+0000 7fa8f67fc700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8f80c17f0 0x7fa8f8142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.069+0000 7fa8f77fe700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8f814e730 0x7fa8f8143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.070+0000 7fa8f6ffd700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8f814e730 0x7fa8f8143490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.070+0000 7fa8f6ffd700 1 -- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8f80c17f0 msgr2=0x7fa8f8142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.070+0000 7fa8f6ffd700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8f80c17f0 0x7fa8f8142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.070+0000 7fa8f6ffd700 1 -- 172.21.15.6:0/3773156131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e80094a0 con 0x7fa8f80a5f00 2023-07-21T07:34:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.070+0000 7fa8f67fc700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8f80c17f0 0x7fa8f8142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.070+0000 7fa8f77fe700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8f814e730 0x7fa8f8143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.070+0000 7fa8f6ffd700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f80a5f00 0x7fa8f806dac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00c700 tx=0x7fa8ec00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.070+0000 7fa8df7fe700 1 -- 172.21.15.6:0/3773156131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec005d70 con 0x7fa8f80a5f00 2023-07-21T07:34:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.070+0000 7fa8df7fe700 1 -- 172.21.15.6:0/3773156131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec0070d0 con 0x7fa8f80a5f00 2023-07-21T07:34:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.070+0000 7fa8fd261700 1 -- 172.21.15.6:0/3773156131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f8153ef0 con 0x7fa8f80a5f00 2023-07-21T07:34:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.070+0000 7fa8df7fe700 1 -- 172.21.15.6:0/3773156131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec007460 con 0x7fa8f80a5f00 2023-07-21T07:34:36.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.070+0000 7fa8fd261700 1 -- 172.21.15.6:0/3773156131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f81449b0 con 0x7fa8f80a5f00 2023-07-21T07:34:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.071+0000 7fa8fd261700 1 -- 172.21.15.6:0/3773156131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f8074500 con 0x7fa8f80a5f00 2023-07-21T07:34:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.071+0000 7fa8df7fe700 1 -- 172.21.15.6:0/3773156131 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa8ec0075c0 con 0x7fa8f80a5f00 2023-07-21T07:34:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.072+0000 7fa8df7fe700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa8e406ace0 0x7fa8e406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.072+0000 7fa8df7fe700 1 -- 172.21.15.6:0/3773156131 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa8ec0887a0 con 0x7fa8f80a5f00 2023-07-21T07:34:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.072+0000 7fa8f67fc700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa8e406ace0 0x7fa8e406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.072+0000 7fa8f67fc700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa8e406ace0 0x7fa8e406d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa8f806e8a0 tx=0x7fa8e8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:36.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.076+0000 7fa8df7fe700 1 -- 172.21.15.6:0/3773156131 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa8ec053bb0 con 0x7fa8f80a5f00 2023-07-21T07:34:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.318+0000 7fa8fd261700 1 -- 172.21.15.6:0/3773156131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8f814c2d0 con 0x7fa8f80a5f00 2023-07-21T07:34:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.319+0000 7fa8df7fe700 1 -- 172.21.15.6:0/3773156131 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3515 (secure 0 0 0) 0x7fa8ec017dd0 con 0x7fa8f80a5f00 2023-07-21T07:34:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:36.370 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3052758988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3052758988},{"type":"v1","addr":"172.21.15.6:6833","nonce":3052758988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3514948644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3514948644},{"type":"v1","addr":"172.21.15.6:6835","nonce":3514948644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/3188395603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3188395603},{"type":"v1","addr":"172.21.15.86:6836","nonce":3188395603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/815488925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":815488925},{"type":"v1","addr":"172.21.15.86:6837","nonce":815488925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-21T07:34:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.321+0000 7fa8fd261700 1 -- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa8e406ace0 msgr2=0x7fa8e406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.321+0000 7fa8fd261700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa8e406ace0 0x7fa8e406d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa8f806e8a0 tx=0x7fa8e8008030 comp rx=0 tx=0).stop 2023-07-21T07:34:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.321+0000 7fa8fd261700 1 -- 172.21.15.6:0/3773156131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f80a5f00 msgr2=0x7fa8f806dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.321+0000 7fa8fd261700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f80a5f00 0x7fa8f806dac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00c700 tx=0x7fa8ec00cac0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.321+0000 7fa8fd261700 1 -- 172.21.15.6:0/3773156131 shutdown_connections 2023-07-21T07:34:36.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.321+0000 7fa8fd261700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa8e406ace0 0x7fa8e406d1a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.321+0000 7fa8fd261700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8f814e730 0x7fa8f8143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.321+0000 7fa8fd261700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f80a5f00 0x7fa8f806dac0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.321+0000 7fa8fd261700 1 --2- 172.21.15.6:0/3773156131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8f80c17f0 0x7fa8f8142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.321+0000 7fa8fd261700 1 -- 172.21.15.6:0/3773156131 >> 172.21.15.6:0/3773156131 conn(0x7fa8f806b1a0 msgr2=0x7fa8f80c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:36.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.321+0000 7fa8fd261700 1 -- 172.21.15.6:0/3773156131 shutdown_connections 2023-07-21T07:34:36.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.321+0000 7fa8fd261700 1 -- 172.21.15.6:0/3773156131 wait complete. 2023-07-21T07:34:36.373 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2023-07-21T07:34:36.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:36.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.458+0000 7fb88a4f6700 1 Processor -- start 2023-07-21T07:34:36.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.458+0000 7fb88a4f6700 1 -- start start 2023-07-21T07:34:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.458+0000 7fb88a4f6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb88406a300 0x7fb8840c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.458+0000 7fb88a4f6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8840c2bf0 0x7fb8841516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.458+0000 7fb88a4f6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8840c3120 con 0x7fb884151be0 2023-07-21T07:34:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.458+0000 7fb88a4f6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8840c1e60 con 0x7fb8840c2bf0 2023-07-21T07:34:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.458+0000 7fb88a4f6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb884154860 con 0x7fb88406a300 2023-07-21T07:34:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.458+0000 7fb8837fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8840c2bf0 0x7fb8841516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.458+0000 7fb888a93700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb884151be0 0x7fb884157b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40256/0 (socket says 172.21.15.6:40256) 2023-07-21T07:34:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.459+0000 7fb888a93700 1 -- 172.21.15.6:0/1155001525 learned_addr learned my addr 172.21.15.6:0/1155001525 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.459+0000 7fb883fff700 1 --2- 172.21.15.6:0/1155001525 >> v2:172.21.15.86:3300/0 conn(0x7fb88406a300 0x7fb8840c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.459+0000 7fb8837fe700 1 -- 172.21.15.6:0/1155001525 >> v2:172.21.15.86:3300/0 conn(0x7fb88406a300 msgr2=0x7fb8840c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.459+0000 7fb8837fe700 1 --2- 172.21.15.6:0/1155001525 >> v2:172.21.15.86:3300/0 conn(0x7fb88406a300 0x7fb8840c26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.459+0000 7fb8837fe700 1 -- 172.21.15.6:0/1155001525 >> v1:172.21.15.6:6789/0 conn(0x7fb884151be0 legacy=0x7fb884157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.459+0000 7fb8837fe700 1 -- 172.21.15.6:0/1155001525 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb884154b40 con 0x7fb8840c2bf0 2023-07-21T07:34:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.459+0000 7fb882ffd700 1 -- 172.21.15.6:0/1155001525 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960702834 0 0) 0x7fb8840c3120 con 0x7fb884151be0 2023-07-21T07:34:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.459+0000 7fb8837fe700 1 --2- 172.21.15.6:0/1155001525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8840c2bf0 0x7fb8841516a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8840c45e0 tx=0x7fb878009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c342c4d59c0d57c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.459+0000 7fb882ffd700 1 -- 172.21.15.6:0/1155001525 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb878011830 con 0x7fb8840c2bf0 2023-07-21T07:34:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.459+0000 7fb882ffd700 1 -- 172.21.15.6:0/1155001525 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb878011990 con 0x7fb8840c2bf0 2023-07-21T07:34:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.459+0000 7fb882ffd700 1 -- 172.21.15.6:0/1155001525 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb878011d20 con 0x7fb8840c2bf0 2023-07-21T07:34:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.460+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1155001525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8840c2bf0 msgr2=0x7fb8841516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.460+0000 7fb88a4f6700 1 --2- 172.21.15.6:0/1155001525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8840c2bf0 0x7fb8841516a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8840c45e0 tx=0x7fb878009b20 comp rx=0 tx=0).stop 2023-07-21T07:34:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.460+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1155001525 shutdown_connections 2023-07-21T07:34:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.460+0000 7fb88a4f6700 1 --2- 172.21.15.6:0/1155001525 >> v2:172.21.15.86:3300/0 conn(0x7fb88406a300 0x7fb8840c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.460+0000 7fb88a4f6700 1 --2- 172.21.15.6:0/1155001525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8840c2bf0 0x7fb8841516a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.460+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1155001525 >> 172.21.15.6:0/1155001525 conn(0x7fb8840a8c90 msgr2=0x7fb88406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.460+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1155001525 shutdown_connections 2023-07-21T07:34:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.460+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1155001525 wait complete. 2023-07-21T07:34:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.461+0000 7fb88a4f6700 1 Processor -- start 2023-07-21T07:34:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.461+0000 7fb88a4f6700 1 -- start start 2023-07-21T07:34:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb88a4f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb88406a300 0x7fb8841ea930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb88a4f6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8840c2bf0 0x7fb8841ed410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb88a4f6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb884151be0 0x7fb8841e9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb88a4f6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88406b870 con 0x7fb88406a300 2023-07-21T07:34:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb88a4f6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8841ed950 con 0x7fb8840c2bf0 2023-07-21T07:34:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb88a4f6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8841e9940 con 0x7fb884151be0 2023-07-21T07:34:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb883fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb88406a300 0x7fb8841ea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb883fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb88406a300 0x7fb8841ea930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60470/0 (socket says 172.21.15.6:60470) 2023-07-21T07:34:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb883fff700 1 -- 172.21.15.6:0/1835894977 learned_addr learned my addr 172.21.15.6:0/1835894977 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb888a93700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb884151be0 0x7fb8841e9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb8837fe700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8840c2bf0 0x7fb8841ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb883fff700 1 -- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb884151be0 msgr2=0x7fb8841e9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb883fff700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb884151be0 0x7fb8841e9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb883fff700 1 -- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8840c2bf0 msgr2=0x7fb8841ed410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb883fff700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8840c2bf0 0x7fb8841ed410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb883fff700 1 -- 172.21.15.6:0/1835894977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8780094a0 con 0x7fb88406a300 2023-07-21T07:34:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb883fff700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb88406a300 0x7fb8841ea930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb87400e8a0 tx=0x7fb87400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.462+0000 7fb880ff9700 1 -- 172.21.15.6:0/1835894977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874009590 con 0x7fb88406a300 2023-07-21T07:34:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.463+0000 7fb880ff9700 1 -- 172.21.15.6:0/1835894977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87400eea0 con 0x7fb88406a300 2023-07-21T07:34:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.463+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1835894977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8840720b0 con 0x7fb88406a300 2023-07-21T07:34:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.463+0000 7fb880ff9700 1 -- 172.21.15.6:0/1835894977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87400c9f0 con 0x7fb88406a300 2023-07-21T07:34:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.463+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1835894977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8841e95d0 con 0x7fb88406a300 2023-07-21T07:34:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.463+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1835894977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb884074500 con 0x7fb88406a300 2023-07-21T07:34:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.464+0000 7fb880ff9700 1 -- 172.21.15.6:0/1835894977 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb87400cb50 con 0x7fb88406a300 2023-07-21T07:34:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.464+0000 7fb880ff9700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb87006ace0 0x7fb87006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.464+0000 7fb880ff9700 1 -- 172.21.15.6:0/1835894977 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb874089060 con 0x7fb88406a300 2023-07-21T07:34:36.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.464+0000 7fb8837fe700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb87006ace0 0x7fb87006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.465+0000 7fb8837fe700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb87006ace0 0x7fb87006d1a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8840c3050 tx=0x7fb878008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:36.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.469+0000 7fb880ff9700 1 -- 172.21.15.6:0/1835894977 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb874057ef0 con 0x7fb88406a300 2023-07-21T07:34:36.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.668+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1835894977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb88406d780 con 0x7fb88406a300 2023-07-21T07:34:36.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.669+0000 7fb880ff9700 1 -- 172.21.15.6:0/1835894977 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14528 (secure 0 0 0) 0x7fb874057a80 con 0x7fb88406a300 2023-07-21T07:34:36.719 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:36.719 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:35.845200+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.671+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb87006ace0 msgr2=0x7fb87006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.671+0000 7fb88a4f6700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb87006ace0 0x7fb87006d1a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8840c3050 tx=0x7fb878008030 comp rx=0 tx=0).stop 2023-07-21T07:34:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.671+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1835894977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb88406a300 msgr2=0x7fb8841ea930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.671+0000 7fb88a4f6700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb88406a300 0x7fb8841ea930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb87400e8a0 tx=0x7fb87400ec60 comp rx=0 tx=0).stop 2023-07-21T07:34:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.671+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1835894977 shutdown_connections 2023-07-21T07:34:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.671+0000 7fb88a4f6700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb87006ace0 0x7fb87006d1a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.671+0000 7fb88a4f6700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb884151be0 0x7fb8841e9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.671+0000 7fb88a4f6700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb88406a300 0x7fb8841ea930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.671+0000 7fb88a4f6700 1 --2- 172.21.15.6:0/1835894977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8840c2bf0 0x7fb8841ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.671+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1835894977 >> 172.21.15.6:0/1835894977 conn(0x7fb8840a8c90 msgr2=0x7fb8841df4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:36.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.671+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1835894977 shutdown_connections 2023-07-21T07:34:36.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.671+0000 7fb88a4f6700 1 -- 172.21.15.6:0/1835894977 wait complete. 2023-07-21T07:34:36.733 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:34:36.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:34:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.812+0000 7f864f4bc700 1 Processor -- start 2023-07-21T07:34:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.812+0000 7f864f4bc700 1 -- start start 2023-07-21T07:34:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.813+0000 7f864f4bc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f864806d8a0 0x7f86480c5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.813+0000 7f864f4bc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8648155530 con 0x7f86480ba140 2023-07-21T07:34:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.813+0000 7f864f4bc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86480c5690 con 0x7f864806a300 2023-07-21T07:34:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.813+0000 7f864f4bc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86480c1a30 con 0x7f864806d8a0 2023-07-21T07:34:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.813+0000 7f864ca57700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f86480ba140 0x7f86480c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40268/0 (socket says 172.21.15.6:40268) 2023-07-21T07:34:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.813+0000 7f864ca57700 1 -- 172.21.15.6:0/565902875 learned_addr learned my addr 172.21.15.6:0/565902875 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.813+0000 7f864da59700 1 --2- 172.21.15.6:0/565902875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f864806d8a0 0x7f86480c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.813+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888795599 0 0) 0x7f8648155530 con 0x7f86480ba140 2023-07-21T07:34:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.813+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86340035b0 con 0x7f86480ba140 2023-07-21T07:34:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.813+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 315086401 0 0) 0x7f86340035b0 con 0x7f86480ba140 2023-07-21T07:34:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f864806d8a0 msgr2=0x7f86480c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 --2- 172.21.15.6:0/565902875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f864806d8a0 0x7f86480c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 >> v1:172.21.15.86:6789/0 conn(0x7f864806a300 legacy=0x7f86481519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8648154920 con 0x7f86480ba140 2023-07-21T07:34:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f8644001670 con 0x7f86480ba140 2023-07-21T07:34:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 >> v1:172.21.15.6:6789/0 conn(0x7f86480ba140 legacy=0x7f86480c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 --2- 172.21.15.6:0/565902875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8634003a30 0x7f8634003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 --2- 172.21.15.6:0/565902875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f864806d8a0 0x7f8634004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 --2- 172.21.15.6:0/565902875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8634004d90 0x7f8634005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86480c1a30 con 0x7f8634004d90 2023-07-21T07:34:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863400bba0 con 0x7f8634003a30 2023-07-21T07:34:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863400bd30 con 0x7f864806d8a0 2023-07-21T07:34:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f864da59700 1 --2- 172.21.15.6:0/565902875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8634004d90 0x7f8634005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f864d258700 1 --2- 172.21.15.6:0/565902875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8634003a30 0x7f8634003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f864ca57700 1 --2- 172.21.15.6:0/565902875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f864806d8a0 0x7f8634004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f864da59700 1 -- 172.21.15.6:0/565902875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f864806d8a0 msgr2=0x7f8634004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f864da59700 1 --2- 172.21.15.6:0/565902875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f864806d8a0 0x7f8634004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f864da59700 1 -- 172.21.15.6:0/565902875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8634003a30 msgr2=0x7f8634003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f864da59700 1 --2- 172.21.15.6:0/565902875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8634003a30 0x7f8634003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f864da59700 1 -- 172.21.15.6:0/565902875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86340035b0 con 0x7f8634004d90 2023-07-21T07:34:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f864da59700 1 --2- 172.21.15.6:0/565902875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8634004d90 0x7f8634005210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f864000e170 tx=0x7f8634005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d312cec7a343452a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864000ec90 con 0x7f8634004d90 2023-07-21T07:34:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864000f040 con 0x7f8634004d90 2023-07-21T07:34:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.814+0000 7f863ffff700 1 -- 172.21.15.6:0/565902875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640014480 con 0x7f8634004d90 2023-07-21T07:34:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.815+0000 7f864f4bc700 1 -- 172.21.15.6:0/565902875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8634004d90 msgr2=0x7f8634005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.815+0000 7f864f4bc700 1 --2- 172.21.15.6:0/565902875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8634004d90 0x7f8634005210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f864000e170 tx=0x7f8634005880 comp rx=0 tx=0).stop 2023-07-21T07:34:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.815+0000 7f864da59700 1 -- 172.21.15.6:0/565902875 reap_dead start 2023-07-21T07:34:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.815+0000 7f864f4bc700 1 -- 172.21.15.6:0/565902875 shutdown_connections 2023-07-21T07:34:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.815+0000 7f864f4bc700 1 -- 172.21.15.6:0/565902875 >> 172.21.15.6:0/565902875 conn(0x7f86480a8660 msgr2=0x7f86480a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.815+0000 7f864f4bc700 1 -- 172.21.15.6:0/565902875 shutdown_connections 2023-07-21T07:34:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.815+0000 7f864f4bc700 1 -- 172.21.15.6:0/565902875 wait complete. 2023-07-21T07:34:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.816+0000 7f864f4bc700 1 Processor -- start 2023-07-21T07:34:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.816+0000 7f864f4bc700 1 -- start start 2023-07-21T07:34:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864f4bc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8634004d90 0x7f86481ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864f4bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86480ba5e0 0x7f8648071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864f4bc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86480bbee0 0x7f86480bc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864f4bc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86480bcf90 con 0x7f86480ba5e0 2023-07-21T07:34:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864f4bc700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86481527b0 con 0x7f8634004d90 2023-07-21T07:34:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864f4bc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86480bc8a0 con 0x7f86480bbee0 2023-07-21T07:34:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864ca57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86480ba5e0 0x7f8648071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864ca57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86480ba5e0 0x7f8648071cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60492/0 (socket says 172.21.15.6:60492) 2023-07-21T07:34:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864ca57700 1 -- 172.21.15.6:0/3616920758 learned_addr learned my addr 172.21.15.6:0/3616920758 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864da59700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86480bbee0 0x7f86480bc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864d258700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8634004d90 0x7f86481ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864ca57700 1 -- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86480bbee0 msgr2=0x7f86480bc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864ca57700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86480bbee0 0x7f86480bc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864ca57700 1 -- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8634004d90 msgr2=0x7f86481ed180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864ca57700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8634004d90 0x7f86481ed180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864ca57700 1 -- 172.21.15.6:0/3616920758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86481ee0b0 con 0x7f86480ba5e0 2023-07-21T07:34:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864da59700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86480bbee0 0x7f86480bc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864d258700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8634004d90 0x7f86481ed180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.817+0000 7f864ca57700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86480ba5e0 0x7f8648071cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f86440072c0 tx=0x7f8644007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.818+0000 7f863dffb700 1 -- 172.21.15.6:0/3616920758 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86440077a0 con 0x7f86480ba5e0 2023-07-21T07:34:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.818+0000 7f863dffb700 1 -- 172.21.15.6:0/3616920758 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864400f8d0 con 0x7f86480ba5e0 2023-07-21T07:34:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.818+0000 7f864f4bc700 1 -- 172.21.15.6:0/3616920758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86481ed810 con 0x7f86480ba5e0 2023-07-21T07:34:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.818+0000 7f863dffb700 1 -- 172.21.15.6:0/3616920758 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864400fc80 con 0x7f86480ba5e0 2023-07-21T07:34:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.818+0000 7f864f4bc700 1 -- 172.21.15.6:0/3616920758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86481eddd0 con 0x7f86480ba5e0 2023-07-21T07:34:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.819+0000 7f864f4bc700 1 -- 172.21.15.6:0/3616920758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8648066990 con 0x7f86480ba5e0 2023-07-21T07:34:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.819+0000 7f863dffb700 1 -- 172.21.15.6:0/3616920758 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f864401d460 con 0x7f86480ba5e0 2023-07-21T07:34:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.819+0000 7f863dffb700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f862c06acb0 0x7f862c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.820+0000 7f863dffb700 1 -- 172.21.15.6:0/3616920758 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8644089150 con 0x7f86480ba5e0 2023-07-21T07:34:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.820+0000 7f864d258700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f862c06acb0 0x7f862c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.820+0000 7f864d258700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f862c06acb0 0x7f862c06d170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8638000c00 tx=0x7f8638009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:36.824+0000 7f863dffb700 1 -- 172.21.15.6:0/3616920758 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f86440545f0 con 0x7f86480ba5e0 2023-07-21T07:34:37.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.021+0000 7f864f4bc700 1 -- 172.21.15.6:0/3616920758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8648074500 con 0x7f86480ba5e0 2023-07-21T07:34:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.022+0000 7f863dffb700 1 -- 172.21.15.6:0/3616920758 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8644057c10 con 0x7f86480ba5e0 2023-07-21T07:34:37.072 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:34:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.024+0000 7f864f4bc700 1 -- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f862c06acb0 msgr2=0x7f862c06d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.024+0000 7f864f4bc700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f862c06acb0 0x7f862c06d170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8638000c00 tx=0x7f8638009040 comp rx=0 tx=0).stop 2023-07-21T07:34:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.024+0000 7f864f4bc700 1 -- 172.21.15.6:0/3616920758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86480ba5e0 msgr2=0x7f8648071cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.024+0000 7f864f4bc700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86480ba5e0 0x7f8648071cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f86440072c0 tx=0x7f8644007680 comp rx=0 tx=0).stop 2023-07-21T07:34:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.024+0000 7f864f4bc700 1 -- 172.21.15.6:0/3616920758 shutdown_connections 2023-07-21T07:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.024+0000 7f864f4bc700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f862c06acb0 0x7f862c06d170 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.024+0000 7f864f4bc700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86480bbee0 0x7f86480bc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.024+0000 7f864f4bc700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8634004d90 0x7f86481ed180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.024+0000 7f864f4bc700 1 --2- 172.21.15.6:0/3616920758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86480ba5e0 0x7f8648071cd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.024+0000 7f864f4bc700 1 -- 172.21.15.6:0/3616920758 >> 172.21.15.6:0/3616920758 conn(0x7f86480a8660 msgr2=0x7f86480c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.024+0000 7f864f4bc700 1 -- 172.21.15.6:0/3616920758 shutdown_connections 2023-07-21T07:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.024+0000 7f864f4bc700 1 -- 172.21.15.6:0/3616920758 wait complete. 2023-07-21T07:34:37.085 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:34:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.163+0000 7f2f5df26700 1 Processor -- start 2023-07-21T07:34:37.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.163+0000 7f2f5df26700 1 -- start start 2023-07-21T07:34:37.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.164+0000 7f2f5df26700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f580c3f80 0x7f2f58151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.164+0000 7f2f5df26700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f581517c0 con 0x7f2f580c5260 2023-07-21T07:34:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.164+0000 7f2f5df26700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f580c4e50 con 0x7f2f580c1860 2023-07-21T07:34:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.164+0000 7f2f5df26700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f581519f0 con 0x7f2f580c3f80 2023-07-21T07:34:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f56ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2f580c5260 0x7f2f580c3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40290/0 (socket says 172.21.15.6:40290) 2023-07-21T07:34:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f56ffd700 1 -- 172.21.15.6:0/613733446 learned_addr learned my addr 172.21.15.6:0/613733446 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f57fff700 1 --2- 172.21.15.6:0/613733446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f580c3f80 0x7f2f58151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444457702 0 0) 0x7f2f581517c0 con 0x7f2f580c5260 2023-07-21T07:34:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f440035b0 con 0x7f2f580c5260 2023-07-21T07:34:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381852485 0 0) 0x7f2f580c4e50 con 0x7f2f580c1860 2023-07-21T07:34:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f581517c0 con 0x7f2f580c1860 2023-07-21T07:34:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 944118888 0 0) 0x7f2f440035b0 con 0x7f2f580c5260 2023-07-21T07:34:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f580c3f80 msgr2=0x7f2f58151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 --2- 172.21.15.6:0/613733446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f580c3f80 0x7f2f58151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 >> v1:172.21.15.86:6789/0 conn(0x7f2f580c1860 legacy=0x7f2f5806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58151cd0 con 0x7f2f580c5260 2023-07-21T07:34:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f2f40001670 con 0x7f2f580c5260 2023-07-21T07:34:37.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 >> v1:172.21.15.6:6789/0 conn(0x7f2f580c5260 legacy=0x7f2f580c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 --2- 172.21.15.6:0/613733446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f44003bc0 0x7f2f44003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 --2- 172.21.15.6:0/613733446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f580c3f80 0x7f2f44004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 --2- 172.21.15.6:0/613733446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f44004d90 0x7f2f44005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f581519f0 con 0x7f2f44003bc0 2023-07-21T07:34:37.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4400bac0 con 0x7f2f44004d90 2023-07-21T07:34:37.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4400bc30 con 0x7f2f580c3f80 2023-07-21T07:34:37.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f577fe700 1 --2- 172.21.15.6:0/613733446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f44003bc0 0x7f2f44003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f56ffd700 1 --2- 172.21.15.6:0/613733446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f580c3f80 0x7f2f44004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.165+0000 7f2f57fff700 1 --2- 172.21.15.6:0/613733446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f44004d90 0x7f2f44005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.166+0000 7f2f577fe700 1 -- 172.21.15.6:0/613733446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f580c3f80 msgr2=0x7f2f44004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:37.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.166+0000 7f2f577fe700 1 --2- 172.21.15.6:0/613733446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f580c3f80 0x7f2f44004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.166+0000 7f2f577fe700 1 -- 172.21.15.6:0/613733446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f44004d90 msgr2=0x7f2f44005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:37.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.166+0000 7f2f577fe700 1 --2- 172.21.15.6:0/613733446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f44004d90 0x7f2f44005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.166+0000 7f2f577fe700 1 -- 172.21.15.6:0/613733446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f440035b0 con 0x7f2f44003bc0 2023-07-21T07:34:37.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.166+0000 7f2f577fe700 1 --2- 172.21.15.6:0/613733446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f44003bc0 0x7f2f44003fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2f48001980 tx=0x7f2f44005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e701f417467c12bd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:37.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.166+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48001470 con 0x7f2f44003bc0 2023-07-21T07:34:37.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.166+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f480052d0 con 0x7f2f44003bc0 2023-07-21T07:34:37.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.166+0000 7f2f567fc700 1 -- 172.21.15.6:0/613733446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48003680 con 0x7f2f44003bc0 2023-07-21T07:34:37.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.166+0000 7f2f5df26700 1 -- 172.21.15.6:0/613733446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f44003bc0 msgr2=0x7f2f44003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.166+0000 7f2f5df26700 1 --2- 172.21.15.6:0/613733446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f44003bc0 0x7f2f44003fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2f48001980 tx=0x7f2f44005880 comp rx=0 tx=0).stop 2023-07-21T07:34:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.166+0000 7f2f57fff700 1 -- 172.21.15.6:0/613733446 reap_dead start 2023-07-21T07:34:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.167+0000 7f2f5df26700 1 -- 172.21.15.6:0/613733446 shutdown_connections 2023-07-21T07:34:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.167+0000 7f2f5df26700 1 -- 172.21.15.6:0/613733446 >> 172.21.15.6:0/613733446 conn(0x7f2f580a8660 msgr2=0x7f2f580a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.167+0000 7f2f5df26700 1 -- 172.21.15.6:0/613733446 shutdown_connections 2023-07-21T07:34:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.167+0000 7f2f5df26700 1 -- 172.21.15.6:0/613733446 wait complete. 2023-07-21T07:34:37.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.168+0000 7f2f5df26700 1 Processor -- start 2023-07-21T07:34:37.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.168+0000 7f2f5df26700 1 -- start start 2023-07-21T07:34:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f5df26700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f44003bc0 0x7f2f5806a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f5df26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58152670 0x7f2f581467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f5df26700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f58146d30 0x7f2f581547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f5df26700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58153ad0 con 0x7f2f58152670 2023-07-21T07:34:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f5df26700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580ac7c0 con 0x7f2f44003bc0 2023-07-21T07:34:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f5df26700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f581540b0 con 0x7f2f58146d30 2023-07-21T07:34:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f56ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58152670 0x7f2f581467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f56ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58152670 0x7f2f581467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60512/0 (socket says 172.21.15.6:60512) 2023-07-21T07:34:37.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f56ffd700 1 -- 172.21.15.6:0/2151053839 learned_addr learned my addr 172.21.15.6:0/2151053839 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:37.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f57fff700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f58146d30 0x7f2f581547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f577fe700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f44003bc0 0x7f2f5806a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f56ffd700 1 -- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f58146d30 msgr2=0x7f2f581547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f56ffd700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f58146d30 0x7f2f581547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f56ffd700 1 -- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f44003bc0 msgr2=0x7f2f5806a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f56ffd700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f44003bc0 0x7f2f5806a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.169+0000 7f2f56ffd700 1 -- 172.21.15.6:0/2151053839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f581542c0 con 0x7f2f58152670 2023-07-21T07:34:37.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.170+0000 7f2f56ffd700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58152670 0x7f2f581467f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f40007310 tx=0x7f2f400076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:37.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.170+0000 7f2f4ffff700 1 -- 172.21.15.6:0/2151053839 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f400077f0 con 0x7f2f58152670 2023-07-21T07:34:37.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.170+0000 7f2f4ffff700 1 -- 172.21.15.6:0/2151053839 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4000f870 con 0x7f2f58152670 2023-07-21T07:34:37.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.170+0000 7f2f5df26700 1 -- 172.21.15.6:0/2151053839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f581512b0 con 0x7f2f58152670 2023-07-21T07:34:37.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.170+0000 7f2f4ffff700 1 -- 172.21.15.6:0/2151053839 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4000fc20 con 0x7f2f58152670 2023-07-21T07:34:37.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.170+0000 7f2f5df26700 1 -- 172.21.15.6:0/2151053839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f581ea830 con 0x7f2f58152670 2023-07-21T07:34:37.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.171+0000 7f2f5df26700 1 -- 172.21.15.6:0/2151053839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f58074500 con 0x7f2f58152670 2023-07-21T07:34:37.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.171+0000 7f2f4ffff700 1 -- 172.21.15.6:0/2151053839 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f4000fd80 con 0x7f2f58152670 2023-07-21T07:34:37.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.172+0000 7f2f4ffff700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2f3806ace0 0x7f2f3806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.172+0000 7f2f4ffff700 1 -- 172.21.15.6:0/2151053839 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2f40089180 con 0x7f2f58152670 2023-07-21T07:34:37.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.172+0000 7f2f577fe700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2f3806ace0 0x7f2f3806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.173+0000 7f2f577fe700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2f3806ace0 0x7f2f3806d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f48015040 tx=0x7f2f4800a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:37.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.176+0000 7f2f4ffff700 1 -- 172.21.15.6:0/2151053839 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2f40058010 con 0x7f2f58152670 2023-07-21T07:34:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.373+0000 7f2f5df26700 1 -- 172.21.15.6:0/2151053839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2f580a7b10 con 0x7f2f58152670 2023-07-21T07:34:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.374+0000 7f2f4ffff700 1 -- 172.21.15.6:0/2151053839 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2f40057ba0 con 0x7f2f58152670 2023-07-21T07:34:37.424 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:34:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.376+0000 7f2f5df26700 1 -- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2f3806ace0 msgr2=0x7f2f3806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.376+0000 7f2f5df26700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2f3806ace0 0x7f2f3806d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f48015040 tx=0x7f2f4800a000 comp rx=0 tx=0).stop 2023-07-21T07:34:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.376+0000 7f2f5df26700 1 -- 172.21.15.6:0/2151053839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58152670 msgr2=0x7f2f581467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.376+0000 7f2f5df26700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58152670 0x7f2f581467f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f40007310 tx=0x7f2f400076d0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.376+0000 7f2f5df26700 1 -- 172.21.15.6:0/2151053839 shutdown_connections 2023-07-21T07:34:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.376+0000 7f2f5df26700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2f3806ace0 0x7f2f3806d1a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.376+0000 7f2f5df26700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f58146d30 0x7f2f581547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.376+0000 7f2f5df26700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f44003bc0 0x7f2f5806a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.376+0000 7f2f5df26700 1 --2- 172.21.15.6:0/2151053839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58152670 0x7f2f581467f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.376+0000 7f2f5df26700 1 -- 172.21.15.6:0/2151053839 >> 172.21.15.6:0/2151053839 conn(0x7f2f580a8660 msgr2=0x7f2f580c3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.376+0000 7f2f5df26700 1 -- 172.21.15.6:0/2151053839 shutdown_connections 2023-07-21T07:34:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.376+0000 7f2f5df26700 1 -- 172.21.15.6:0/2151053839 wait complete. 2023-07-21T07:34:37.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T07:34:37.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.512+0000 7facb7874700 1 Processor -- start 2023-07-21T07:34:37.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.513+0000 7facb7874700 1 -- start start 2023-07-21T07:34:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.513+0000 7facb7874700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7facb00abdb0 0x7facb00aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.513+0000 7facb7874700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7facb0066210 0x7facb00aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.513+0000 7facb7874700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb00c6cc0 con 0x7facb014fa10 2023-07-21T07:34:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.513+0000 7facb7874700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb0152df0 con 0x7facb00abdb0 2023-07-21T07:34:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.513+0000 7facb7874700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb01530d0 con 0x7facb0066210 2023-07-21T07:34:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.513+0000 7facb4e0f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7facb00abdb0 0x7facb00aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.514+0000 7facb4e0f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7facb00abdb0 0x7facb00aa9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60520/0 (socket says 172.21.15.6:60520) 2023-07-21T07:34:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.514+0000 7facb4e0f700 1 -- 172.21.15.6:0/1351732559 learned_addr learned my addr 172.21.15.6:0/1351732559 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.514+0000 7facb5e11700 1 --2- 172.21.15.6:0/1351732559 >> v2:172.21.15.86:3300/0 conn(0x7facb0066210 0x7facb00aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.514+0000 7facb4e0f700 1 -- 172.21.15.6:0/1351732559 >> v2:172.21.15.86:3300/0 conn(0x7facb0066210 msgr2=0x7facb00aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.514+0000 7facb4e0f700 1 --2- 172.21.15.6:0/1351732559 >> v2:172.21.15.86:3300/0 conn(0x7facb0066210 0x7facb00aaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.514+0000 7facb4e0f700 1 -- 172.21.15.6:0/1351732559 >> v1:172.21.15.86:6789/0 conn(0x7facb014fa10 legacy=0x7facb006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.514+0000 7facb4e0f700 1 -- 172.21.15.6:0/1351732559 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb00c6f10 con 0x7facb00abdb0 2023-07-21T07:34:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.514+0000 7facb5e11700 1 --2- 172.21.15.6:0/1351732559 >> v2:172.21.15.86:3300/0 conn(0x7facb0066210 0x7facb00aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.514+0000 7facb4e0f700 1 --2- 172.21.15.6:0/1351732559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb00abdb0 0x7facb00aa9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7facb006fd90 tx=0x7faca0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ec4d02b9ba028 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.514+0000 7faca7fff700 1 -- 172.21.15.6:0/1351732559 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca000b870 con 0x7facb00abdb0 2023-07-21T07:34:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.514+0000 7faca7fff700 1 -- 172.21.15.6:0/1351732559 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca000b9d0 con 0x7facb00abdb0 2023-07-21T07:34:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.514+0000 7faca7fff700 1 -- 172.21.15.6:0/1351732559 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca000bd60 con 0x7facb00abdb0 2023-07-21T07:34:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.515+0000 7facb7874700 1 -- 172.21.15.6:0/1351732559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb00abdb0 msgr2=0x7facb00aa9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.515+0000 7facb7874700 1 --2- 172.21.15.6:0/1351732559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb00abdb0 0x7facb00aa9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7facb006fd90 tx=0x7faca0009bd0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.515+0000 7facb7874700 1 -- 172.21.15.6:0/1351732559 shutdown_connections 2023-07-21T07:34:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.515+0000 7facb7874700 1 --2- 172.21.15.6:0/1351732559 >> v2:172.21.15.86:3300/0 conn(0x7facb0066210 0x7facb00aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.515+0000 7facb7874700 1 --2- 172.21.15.6:0/1351732559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb00abdb0 0x7facb00aa9d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.515+0000 7facb7874700 1 -- 172.21.15.6:0/1351732559 >> 172.21.15.6:0/1351732559 conn(0x7facb00c6140 msgr2=0x7facb00c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.515+0000 7facb7874700 1 -- 172.21.15.6:0/1351732559 shutdown_connections 2023-07-21T07:34:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.515+0000 7facb7874700 1 -- 172.21.15.6:0/1351732559 wait complete. 2023-07-21T07:34:37.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.516+0000 7facb7874700 1 Processor -- start 2023-07-21T07:34:37.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.516+0000 7facb7874700 1 -- start start 2023-07-21T07:34:37.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb7874700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb0066210 0x7facb00c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb7874700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facb00abdb0 0x7facb014a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb7874700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7facb014fa10 0x7facb014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb7874700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb014b0b0 con 0x7facb0066210 2023-07-21T07:34:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb7874700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb00c5c90 con 0x7facb00abdb0 2023-07-21T07:34:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb7874700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb0156640 con 0x7facb014fa10 2023-07-21T07:34:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb5610700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb0066210 0x7facb00c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb5610700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb0066210 0x7facb00c5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60524/0 (socket says 172.21.15.6:60524) 2023-07-21T07:34:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb5610700 1 -- 172.21.15.6:0/2167039590 learned_addr learned my addr 172.21.15.6:0/2167039590 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb4e0f700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facb00abdb0 0x7facb014a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb5e11700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7facb014fa10 0x7facb014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb5610700 1 -- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7facb014fa10 msgr2=0x7facb014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb5610700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7facb014fa10 0x7facb014ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb5610700 1 -- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facb00abdb0 msgr2=0x7facb014a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb5610700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facb00abdb0 0x7facb014a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb5610700 1 -- 172.21.15.6:0/2167039590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca0009550 con 0x7facb0066210 2023-07-21T07:34:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb4e0f700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facb00abdb0 0x7facb014a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb5610700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb0066210 0x7facb00c5200 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facac00c480 tx=0x7facac00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7faca5ffb700 1 -- 172.21.15.6:0/2167039590 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac0052d0 con 0x7facb0066210 2023-07-21T07:34:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7faca5ffb700 1 -- 172.21.15.6:0/2167039590 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac005430 con 0x7facb0066210 2023-07-21T07:34:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7facb7874700 1 -- 172.21.15.6:0/2167039590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb0150270 con 0x7facb0066210 2023-07-21T07:34:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.517+0000 7faca5ffb700 1 -- 172.21.15.6:0/2167039590 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac0038c0 con 0x7facb0066210 2023-07-21T07:34:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.518+0000 7facb7874700 1 -- 172.21.15.6:0/2167039590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb0150830 con 0x7facb0066210 2023-07-21T07:34:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.518+0000 7facb7874700 1 -- 172.21.15.6:0/2167039590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb0074500 con 0x7facb0066210 2023-07-21T07:34:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.519+0000 7faca5ffb700 1 -- 172.21.15.6:0/2167039590 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7facac003a20 con 0x7facb0066210 2023-07-21T07:34:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.519+0000 7faca5ffb700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac9406ace0 0x7fac9406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.519+0000 7faca5ffb700 1 -- 172.21.15.6:0/2167039590 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7facac0884d0 con 0x7facb0066210 2023-07-21T07:34:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.520+0000 7facb4e0f700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac9406ace0 0x7fac9406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.520+0000 7facb4e0f700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac9406ace0 0x7fac9406d1a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facb00ac220 tx=0x7faca0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.524+0000 7faca5ffb700 1 -- 172.21.15.6:0/2167039590 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7facac053960 con 0x7facb0066210 2023-07-21T07:34:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.723+0000 7facb7874700 1 -- 172.21.15.6:0/2167039590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7facb006b9c0 con 0x7facb0066210 2023-07-21T07:34:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.723+0000 7faca5ffb700 1 -- 172.21.15.6:0/2167039590 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7facac056f80 con 0x7facb0066210 2023-07-21T07:34:37.773 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:37.774 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T07:34:37.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:34:37.774 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T07:34:37.774 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T07:34:37.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:34:37.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:34:37.774 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T07:34:37.775 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T07:34:37.775 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:34:37.775 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T07:34:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.725+0000 7facb7874700 1 -- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac9406ace0 msgr2=0x7fac9406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.725+0000 7facb7874700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac9406ace0 0x7fac9406d1a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facb00ac220 tx=0x7faca0008030 comp rx=0 tx=0).stop 2023-07-21T07:34:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.725+0000 7facb7874700 1 -- 172.21.15.6:0/2167039590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb0066210 msgr2=0x7facb00c5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.725+0000 7facb7874700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb0066210 0x7facb00c5200 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facac00c480 tx=0x7facac00c840 comp rx=0 tx=0).stop 2023-07-21T07:34:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.725+0000 7facb7874700 1 -- 172.21.15.6:0/2167039590 shutdown_connections 2023-07-21T07:34:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.725+0000 7facb7874700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac9406ace0 0x7fac9406d1a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.725+0000 7facb7874700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7facb014fa10 0x7facb014ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.725+0000 7facb7874700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facb0066210 0x7facb00c5200 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.725+0000 7facb7874700 1 --2- 172.21.15.6:0/2167039590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facb00abdb0 0x7facb014a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.725+0000 7facb7874700 1 -- 172.21.15.6:0/2167039590 >> 172.21.15.6:0/2167039590 conn(0x7facb00c6140 msgr2=0x7facb00c1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.725+0000 7facb7874700 1 -- 172.21.15.6:0/2167039590 shutdown_connections 2023-07-21T07:34:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.725+0000 7facb7874700 1 -- 172.21.15.6:0/2167039590 wait complete. 2023-07-21T07:34:37.787 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T07:34:37.787 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T07:34:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.866+0000 7f8cd8404700 1 Processor -- start 2023-07-21T07:34:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.866+0000 7f8cd8404700 1 -- start start 2023-07-21T07:34:37.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.867+0000 7f8cd8404700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8cd006d780 0x7f8cd00bc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.867+0000 7f8cd8404700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8cd00bc560 0x7f8cd0151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.867+0000 7f8cd8404700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd00bcfa0 con 0x7f8cd0071ef0 2023-07-21T07:34:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.867+0000 7f8cd8404700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd00c0450 con 0x7f8cd00bc560 2023-07-21T07:34:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.867+0000 7f8cd8404700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd00bfab0 con 0x7f8cd006d780 2023-07-21T07:34:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd69a1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8cd00bc560 0x7f8cd0151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd599f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8cd0071ef0 0x7f8cd0150c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40320/0 (socket says 172.21.15.6:40320) 2023-07-21T07:34:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd69a1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8cd00bc560 0x7f8cd0151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60534/0 (socket says 172.21.15.6:60534) 2023-07-21T07:34:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd599f700 1 -- 172.21.15.6:0/632572609 learned_addr learned my addr 172.21.15.6:0/632572609 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd61a0700 1 --2- 172.21.15.6:0/632572609 >> v2:172.21.15.86:3300/0 conn(0x7f8cd006d780 0x7f8cd00bc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd69a1700 1 -- 172.21.15.6:0/632572609 >> v2:172.21.15.86:3300/0 conn(0x7f8cd006d780 msgr2=0x7f8cd00bc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:37.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd69a1700 1 --2- 172.21.15.6:0/632572609 >> v2:172.21.15.86:3300/0 conn(0x7f8cd006d780 0x7f8cd00bc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd69a1700 1 -- 172.21.15.6:0/632572609 >> v1:172.21.15.6:6789/0 conn(0x7f8cd0071ef0 legacy=0x7f8cd0150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd519e700 1 -- 172.21.15.6:0/632572609 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820949369 0 0) 0x7f8cd00bcfa0 con 0x7f8cd0071ef0 2023-07-21T07:34:37.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd69a1700 1 -- 172.21.15.6:0/632572609 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd00bfd90 con 0x7f8cd00bc560 2023-07-21T07:34:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd69a1700 1 --2- 172.21.15.6:0/632572609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd00bc560 0x7f8cd0151350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0073a20 tx=0x7f8cc800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dc0826d5c6a64c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd519e700 1 -- 172.21.15.6:0/632572609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8010070 con 0x7f8cd00bc560 2023-07-21T07:34:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd519e700 1 -- 172.21.15.6:0/632572609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc800d9d0 con 0x7f8cd00bc560 2023-07-21T07:34:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.868+0000 7f8cd519e700 1 -- 172.21.15.6:0/632572609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800dd80 con 0x7f8cd00bc560 2023-07-21T07:34:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.869+0000 7f8cd8404700 1 -- 172.21.15.6:0/632572609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd00bc560 msgr2=0x7f8cd0151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.869+0000 7f8cd8404700 1 --2- 172.21.15.6:0/632572609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd00bc560 0x7f8cd0151350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0073a20 tx=0x7f8cc800d330 comp rx=0 tx=0).stop 2023-07-21T07:34:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.869+0000 7f8cd8404700 1 -- 172.21.15.6:0/632572609 shutdown_connections 2023-07-21T07:34:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.869+0000 7f8cd8404700 1 --2- 172.21.15.6:0/632572609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd00bc560 0x7f8cd0151350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.869+0000 7f8cd8404700 1 --2- 172.21.15.6:0/632572609 >> v2:172.21.15.86:3300/0 conn(0x7f8cd006d780 0x7f8cd00bc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.869+0000 7f8cd8404700 1 -- 172.21.15.6:0/632572609 >> 172.21.15.6:0/632572609 conn(0x7f8cd00c4f70 msgr2=0x7f8cd00c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.869+0000 7f8cd8404700 1 -- 172.21.15.6:0/632572609 shutdown_connections 2023-07-21T07:34:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.869+0000 7f8cd8404700 1 -- 172.21.15.6:0/632572609 wait complete. 2023-07-21T07:34:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.870+0000 7f8cd8404700 1 Processor -- start 2023-07-21T07:34:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.870+0000 7f8cd8404700 1 -- start start 2023-07-21T07:34:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd8404700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd006d780 0x7f8cd006a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd8404700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8cd0071ef0 0x7f8cd01497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd8404700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd00bc560 0x7f8cd014afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd8404700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd006ad50 con 0x7f8cd00bc560 2023-07-21T07:34:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd8404700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd006aeb0 con 0x7f8cd006d780 2023-07-21T07:34:37.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd8404700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd014dba0 con 0x7f8cd0071ef0 2023-07-21T07:34:37.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd69a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd00bc560 0x7f8cd014afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd69a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd00bc560 0x7f8cd014afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60540/0 (socket says 172.21.15.6:60540) 2023-07-21T07:34:37.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd69a1700 1 -- 172.21.15.6:0/3176438743 learned_addr learned my addr 172.21.15.6:0/3176438743 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:37.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd61a0700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd006d780 0x7f8cd006a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd599f700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8cd0071ef0 0x7f8cd01497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd69a1700 1 -- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8cd0071ef0 msgr2=0x7f8cd01497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd69a1700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8cd0071ef0 0x7f8cd01497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd69a1700 1 -- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd006d780 msgr2=0x7f8cd006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:37.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd69a1700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd006d780 0x7f8cd006a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:37.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd69a1700 1 -- 172.21.15.6:0/3176438743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc800bc80 con 0x7f8cd00bc560 2023-07-21T07:34:37.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.871+0000 7f8cd69a1700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd00bc560 0x7f8cd014afd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8004270 tx=0x7f8cc8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:37.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.872+0000 7f8cc6ffd700 1 -- 172.21.15.6:0/3176438743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc80046a0 con 0x7f8cd00bc560 2023-07-21T07:34:37.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.872+0000 7f8cc6ffd700 1 -- 172.21.15.6:0/3176438743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc8004820 con 0x7f8cd00bc560 2023-07-21T07:34:37.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.872+0000 7f8cc6ffd700 1 -- 172.21.15.6:0/3176438743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800b260 con 0x7f8cd00bc560 2023-07-21T07:34:37.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.872+0000 7f8cd8404700 1 -- 172.21.15.6:0/3176438743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd0149d20 con 0x7f8cd00bc560 2023-07-21T07:34:37.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.872+0000 7f8cd8404700 1 -- 172.21.15.6:0/3176438743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd006aa70 con 0x7f8cd00bc560 2023-07-21T07:34:37.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.873+0000 7f8cd8404700 1 -- 172.21.15.6:0/3176438743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd0074500 con 0x7f8cd00bc560 2023-07-21T07:34:37.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.873+0000 7f8cc6ffd700 1 -- 172.21.15.6:0/3176438743 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8cc800a570 con 0x7f8cd00bc560 2023-07-21T07:34:37.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.873+0000 7f8cc6ffd700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8cb406ace0 0x7f8cb406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:37.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.874+0000 7f8cc6ffd700 1 -- 172.21.15.6:0/3176438743 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8cc808cc50 con 0x7f8cd00bc560 2023-07-21T07:34:37.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.874+0000 7f8cd61a0700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8cb406ace0 0x7f8cb406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:37.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.874+0000 7f8cd61a0700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8cb406ace0 0x7f8cb406d1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009be0 tx=0x7f8cc0009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:37.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:37.878+0000 7f8cc6ffd700 1 -- 172.21.15.6:0/3176438743 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8cc8092020 con 0x7f8cd00bc560 2023-07-21T07:34:38.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.077+0000 7f8cd8404700 1 -- 172.21.15.6:0/3176438743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8cd00bbbc0 con 0x7f8cd00bc560 2023-07-21T07:34:38.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:34:38.925 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:34:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.981+0000 7f8cc6ffd700 1 -- 172.21.15.6:0/3176438743 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8cc80580e0 con 0x7f8cd00bc560 2023-07-21T07:34:39.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.986+0000 7f8cd8404700 1 -- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8cb406ace0 msgr2=0x7f8cb406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.986+0000 7f8cd8404700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8cb406ace0 0x7f8cb406d1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009be0 tx=0x7f8cc0009210 comp rx=0 tx=0).stop 2023-07-21T07:34:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.986+0000 7f8cd8404700 1 -- 172.21.15.6:0/3176438743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd00bc560 msgr2=0x7f8cd014afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.986+0000 7f8cd8404700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd00bc560 0x7f8cd014afd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8004270 tx=0x7f8cc8004ad0 comp rx=0 tx=0).stop 2023-07-21T07:34:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.986+0000 7f8cd8404700 1 -- 172.21.15.6:0/3176438743 shutdown_connections 2023-07-21T07:34:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.986+0000 7f8cd8404700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8cb406ace0 0x7f8cb406d1a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.986+0000 7f8cd8404700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd00bc560 0x7f8cd014afd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.986+0000 7f8cd8404700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cd006d780 0x7f8cd006a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.986+0000 7f8cd8404700 1 --2- 172.21.15.6:0/3176438743 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8cd0071ef0 0x7f8cd01497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.986+0000 7f8cd8404700 1 -- 172.21.15.6:0/3176438743 >> 172.21.15.6:0/3176438743 conn(0x7f8cd00c4f70 msgr2=0x7f8cd014eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.986+0000 7f8cd8404700 1 -- 172.21.15.6:0/3176438743 shutdown_connections 2023-07-21T07:34:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:38.986+0000 7f8cd8404700 1 -- 172.21.15.6:0/3176438743 wait complete. 2023-07-21T07:34:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T07:34:39.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T07:34:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.180+0000 7fb3bf0bc700 1 Processor -- start 2023-07-21T07:34:39.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.180+0000 7fb3bf0bc700 1 -- start start 2023-07-21T07:34:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.181+0000 7fb3bf0bc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb3b80c1860 0x7fb3b8151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.181+0000 7fb3bf0bc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b81517c0 con 0x7fb3b80c5260 2023-07-21T07:34:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.181+0000 7fb3bf0bc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b80c4e50 con 0x7fb3b80c3f80 2023-07-21T07:34:39.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.181+0000 7fb3bf0bc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b81519f0 con 0x7fb3b80c1860 2023-07-21T07:34:39.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.181+0000 7fb3b7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb3b80c5260 0x7fb3b806dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40332/0 (socket says 172.21.15.6:40332) 2023-07-21T07:34:39.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.181+0000 7fb3b7fff700 1 -- 172.21.15.6:0/2815051013 learned_addr learned my addr 172.21.15.6:0/2815051013 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:39.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.181+0000 7fb3bce58700 1 --2- 172.21.15.6:0/2815051013 >> v2:172.21.15.86:3300/0 conn(0x7fb3b80c1860 0x7fb3b8151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:39.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.181+0000 7fb3b77fe700 1 -- 172.21.15.6:0/2815051013 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257069155 0 0) 0x7fb3b81517c0 con 0x7fb3b80c5260 2023-07-21T07:34:39.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.181+0000 7fb3b77fe700 1 -- 172.21.15.6:0/2815051013 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3a80035b0 con 0x7fb3b80c5260 2023-07-21T07:34:39.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.182+0000 7fb3b77fe700 1 -- 172.21.15.6:0/2815051013 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2694227401 0 0) 0x7fb3a80035b0 con 0x7fb3b80c5260 2023-07-21T07:34:39.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.182+0000 7fb3bce58700 1 -- 172.21.15.6:0/2815051013 >> v1:172.21.15.86:6789/0 conn(0x7fb3b80c3f80 legacy=0x7fb3b80c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:39.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.182+0000 7fb3bce58700 1 -- 172.21.15.6:0/2815051013 >> v1:172.21.15.6:6789/0 conn(0x7fb3b80c5260 legacy=0x7fb3b806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.182+0000 7fb3bce58700 1 -- 172.21.15.6:0/2815051013 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b8151cd0 con 0x7fb3b80c1860 2023-07-21T07:34:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.182+0000 7fb3bce58700 1 --2- 172.21.15.6:0/2815051013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3b80c1860 0x7fb3b8151280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009840 tx=0x7fb3ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d59765063691d2e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.182+0000 7fb3b77fe700 1 -- 172.21.15.6:0/2815051013 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4001670 con 0x7fb3b80c1860 2023-07-21T07:34:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.182+0000 7fb3b77fe700 1 -- 172.21.15.6:0/2815051013 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac004030 con 0x7fb3b80c1860 2023-07-21T07:34:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.182+0000 7fb3b77fe700 1 -- 172.21.15.6:0/2815051013 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac0043a0 con 0x7fb3b80c1860 2023-07-21T07:34:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.183+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/2815051013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3b80c1860 msgr2=0x7fb3b8151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.183+0000 7fb3bf0bc700 1 --2- 172.21.15.6:0/2815051013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3b80c1860 0x7fb3b8151280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009840 tx=0x7fb3ac009b50 comp rx=0 tx=0).stop 2023-07-21T07:34:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.183+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/2815051013 shutdown_connections 2023-07-21T07:34:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.183+0000 7fb3bf0bc700 1 --2- 172.21.15.6:0/2815051013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3b80c1860 0x7fb3b8151280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.183+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/2815051013 >> 172.21.15.6:0/2815051013 conn(0x7fb3b80a8660 msgr2=0x7fb3b80a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.183+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/2815051013 shutdown_connections 2023-07-21T07:34:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.183+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/2815051013 wait complete. 2023-07-21T07:34:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.184+0000 7fb3bf0bc700 1 Processor -- start 2023-07-21T07:34:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.184+0000 7fb3bf0bc700 1 -- start start 2023-07-21T07:34:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bf0bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3b80c1860 0x7fb3b80bd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bf0bc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3b80c3f80 0x7fb3b8152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bf0bc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3b80c5260 0x7fb3b8153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bf0bc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80bc110 con 0x7fb3b80c1860 2023-07-21T07:34:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bf0bc700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80a7390 con 0x7fb3b80c5260 2023-07-21T07:34:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bf0bc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80bc380 con 0x7fb3b80c3f80 2023-07-21T07:34:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bce58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3b80c1860 0x7fb3b80bd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bce58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3b80c1860 0x7fb3b80bd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60550/0 (socket says 172.21.15.6:60550) 2023-07-21T07:34:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bce58700 1 -- 172.21.15.6:0/836770337 learned_addr learned my addr 172.21.15.6:0/836770337 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3b7fff700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3b80c3f80 0x7fb3b8152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bd659700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3b80c5260 0x7fb3b8153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bce58700 1 -- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3b80c3f80 msgr2=0x7fb3b8152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bce58700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3b80c3f80 0x7fb3b8152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bce58700 1 -- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3b80c5260 msgr2=0x7fb3b8153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bce58700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3b80c5260 0x7fb3b8153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bce58700 1 -- 172.21.15.6:0/836770337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac0094a0 con 0x7fb3b80c1860 2023-07-21T07:34:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bd659700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3b80c5260 0x7fb3b8153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bce58700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3b80c1860 0x7fb3b80bd140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009b90 tx=0x7fb3ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3b57fa700 1 -- 172.21.15.6:0/836770337 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac003e80 con 0x7fb3b80c1860 2023-07-21T07:34:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3b57fa700 1 -- 172.21.15.6:0/836770337 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac010590 con 0x7fb3b80c1860 2023-07-21T07:34:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/836770337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b80bc660 con 0x7fb3b80c1860 2023-07-21T07:34:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.185+0000 7fb3b57fa700 1 -- 172.21.15.6:0/836770337 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac010920 con 0x7fb3b80c1860 2023-07-21T07:34:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.186+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/836770337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b80bcc20 con 0x7fb3b80c1860 2023-07-21T07:34:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.186+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/836770337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b8074500 con 0x7fb3b80c1860 2023-07-21T07:34:39.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.187+0000 7fb3b57fa700 1 -- 172.21.15.6:0/836770337 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb3ac010a80 con 0x7fb3b80c1860 2023-07-21T07:34:39.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.187+0000 7fb3b57fa700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb39c06ad10 0x7fb39c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:39.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.187+0000 7fb3b57fa700 1 -- 172.21.15.6:0/836770337 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb3ac08aa90 con 0x7fb3b80c1860 2023-07-21T07:34:39.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.187+0000 7fb3b7fff700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb39c06ad10 0x7fb39c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:39.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.188+0000 7fb3b7fff700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb39c06ad10 0x7fb39c06d1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3b81558a0 tx=0x7fb3a4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:39.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.192+0000 7fb3b57fa700 1 -- 172.21.15.6:0/836770337 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb3ac055db0 con 0x7fb3b80c1860 2023-07-21T07:34:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.393+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/836770337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb3b80c49b0 con 0x7fb3b80c1860 2023-07-21T07:34:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:39.988+0000 7fb3b57fa700 1 -- 172.21.15.6:0/836770337 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb3ac0593d0 con 0x7fb3b80c1860 2023-07-21T07:34:40.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.002+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb39c06ad10 msgr2=0x7fb39c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:40.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.002+0000 7fb3bf0bc700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb39c06ad10 0x7fb39c06d1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3b81558a0 tx=0x7fb3a4009040 comp rx=0 tx=0).stop 2023-07-21T07:34:40.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.002+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/836770337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3b80c1860 msgr2=0x7fb3b80bd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:40.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.002+0000 7fb3bf0bc700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3b80c1860 0x7fb3b80bd140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009b90 tx=0x7fb3ac004750 comp rx=0 tx=0).stop 2023-07-21T07:34:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.007+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/836770337 shutdown_connections 2023-07-21T07:34:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.007+0000 7fb3bf0bc700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb39c06ad10 0x7fb39c06d1d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.007+0000 7fb3bf0bc700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3b80c5260 0x7fb3b8153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.007+0000 7fb3bf0bc700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3b80c1860 0x7fb3b80bd140 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.007+0000 7fb3bf0bc700 1 --2- 172.21.15.6:0/836770337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3b80c3f80 0x7fb3b8152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.007+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/836770337 >> 172.21.15.6:0/836770337 conn(0x7fb3b80a8660 msgr2=0x7fb3b80a7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:40.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.007+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/836770337 shutdown_connections 2023-07-21T07:34:40.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.008+0000 7fb3bf0bc700 1 -- 172.21.15.6:0/836770337 wait complete. 2023-07-21T07:34:40.059 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T07:34:40.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T07:34:40.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.156+0000 7fcc83754700 1 Processor -- start 2023-07-21T07:34:40.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.156+0000 7fcc83754700 1 -- start start 2023-07-21T07:34:40.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.157+0000 7fcc83754700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc7c06a300 0x7fcc7c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:40.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.157+0000 7fcc83754700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc7c155530 con 0x7fcc7c06d8a0 2023-07-21T07:34:40.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.157+0000 7fcc83754700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc7c154920 con 0x7fcc7c0ba140 2023-07-21T07:34:40.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.157+0000 7fcc83754700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c0c1a30 con 0x7fcc7c06a300 2023-07-21T07:34:40.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.157+0000 7fcc81cf1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcc7c06d8a0 0x7fcc7c0c5150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40350/0 (socket says 172.21.15.6:40350) 2023-07-21T07:34:40.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.157+0000 7fcc81cf1700 1 -- 172.21.15.6:0/2611288782 learned_addr learned my addr 172.21.15.6:0/2611288782 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:40.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.157+0000 7fcc814f0700 1 --2- 172.21.15.6:0/2611288782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc7c06a300 0x7fcc7c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:40.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.158+0000 7fcc73fff700 1 -- 172.21.15.6:0/2611288782 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215440566 0 0) 0x7fcc7c155530 con 0x7fcc7c06d8a0 2023-07-21T07:34:40.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.158+0000 7fcc73fff700 1 -- 172.21.15.6:0/2611288782 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc680035b0 con 0x7fcc7c06d8a0 2023-07-21T07:34:40.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.158+0000 7fcc73fff700 1 -- 172.21.15.6:0/2611288782 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581314430 0 0) 0x7fcc7c154920 con 0x7fcc7c0ba140 2023-07-21T07:34:40.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.158+0000 7fcc73fff700 1 -- 172.21.15.6:0/2611288782 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc7c155530 con 0x7fcc7c0ba140 2023-07-21T07:34:40.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.158+0000 7fcc814f0700 1 -- 172.21.15.6:0/2611288782 >> v1:172.21.15.86:6789/0 conn(0x7fcc7c0ba140 legacy=0x7fcc7c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:40.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.158+0000 7fcc814f0700 1 -- 172.21.15.6:0/2611288782 >> v1:172.21.15.6:6789/0 conn(0x7fcc7c06d8a0 legacy=0x7fcc7c0c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:40.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.158+0000 7fcc814f0700 1 -- 172.21.15.6:0/2611288782 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c154c00 con 0x7fcc7c06a300 2023-07-21T07:34:40.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.158+0000 7fcc814f0700 1 --2- 172.21.15.6:0/2611288782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc7c06a300 0x7fcc7c1519b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009870 tx=0x7fcc6c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41a5fe2c6b0d46a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:40.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.158+0000 7fcc73fff700 1 -- 172.21.15.6:0/2611288782 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c011830 con 0x7fcc7c06a300 2023-07-21T07:34:40.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.158+0000 7fcc73fff700 1 -- 172.21.15.6:0/2611288782 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c011990 con 0x7fcc7c06a300 2023-07-21T07:34:40.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.158+0000 7fcc73fff700 1 -- 172.21.15.6:0/2611288782 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c011d20 con 0x7fcc7c06a300 2023-07-21T07:34:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.159+0000 7fcc83754700 1 -- 172.21.15.6:0/2611288782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc7c06a300 msgr2=0x7fcc7c1519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.159+0000 7fcc83754700 1 --2- 172.21.15.6:0/2611288782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc7c06a300 0x7fcc7c1519b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009870 tx=0x7fcc6c009b80 comp rx=0 tx=0).stop 2023-07-21T07:34:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.159+0000 7fcc83754700 1 -- 172.21.15.6:0/2611288782 shutdown_connections 2023-07-21T07:34:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.159+0000 7fcc83754700 1 --2- 172.21.15.6:0/2611288782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc7c06a300 0x7fcc7c1519b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.159+0000 7fcc83754700 1 -- 172.21.15.6:0/2611288782 >> 172.21.15.6:0/2611288782 conn(0x7fcc7c0a8660 msgr2=0x7fcc7c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.159+0000 7fcc83754700 1 -- 172.21.15.6:0/2611288782 shutdown_connections 2023-07-21T07:34:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.159+0000 7fcc83754700 1 -- 172.21.15.6:0/2611288782 wait complete. 2023-07-21T07:34:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.160+0000 7fcc83754700 1 Processor -- start 2023-07-21T07:34:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.160+0000 7fcc83754700 1 -- start start 2023-07-21T07:34:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc83754700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc7c06a300 0x7fcc7c155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc83754700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc7c06d8a0 0x7fcc7c14dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc83754700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc7c0ba140 0x7fcc7c156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc83754700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c156290 con 0x7fcc7c06a300 2023-07-21T07:34:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc83754700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c14e120 con 0x7fcc7c0ba140 2023-07-21T07:34:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc83754700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c1ed0d0 con 0x7fcc7c06d8a0 2023-07-21T07:34:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc814f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc7c06a300 0x7fcc7c155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc814f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc7c06a300 0x7fcc7c155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60564/0 (socket says 172.21.15.6:60564) 2023-07-21T07:34:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc814f0700 1 -- 172.21.15.6:0/2053370702 learned_addr learned my addr 172.21.15.6:0/2053370702 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc81cf1700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc7c0ba140 0x7fcc7c156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc80cef700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc7c06d8a0 0x7fcc7c14dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc814f0700 1 -- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc7c06d8a0 msgr2=0x7fcc7c14dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc814f0700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc7c06d8a0 0x7fcc7c14dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc814f0700 1 -- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc7c0ba140 msgr2=0x7fcc7c156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc814f0700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc7c0ba140 0x7fcc7c156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc814f0700 1 -- 172.21.15.6:0/2053370702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c0094a0 con 0x7fcc7c06a300 2023-07-21T07:34:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc814f0700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc7c06a300 0x7fcc7c155d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0090b0 tx=0x7fcc6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc71ffb700 1 -- 172.21.15.6:0/2053370702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c01a760 con 0x7fcc7c06a300 2023-07-21T07:34:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc71ffb700 1 -- 172.21.15.6:0/2053370702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c01a8c0 con 0x7fcc7c06a300 2023-07-21T07:34:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc83754700 1 -- 172.21.15.6:0/2053370702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7c0c0ad0 con 0x7fcc7c06a300 2023-07-21T07:34:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.161+0000 7fcc71ffb700 1 -- 172.21.15.6:0/2053370702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c01ac70 con 0x7fcc7c06a300 2023-07-21T07:34:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.162+0000 7fcc83754700 1 -- 172.21.15.6:0/2053370702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7c1ece60 con 0x7fcc7c06a300 2023-07-21T07:34:40.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.162+0000 7fcc83754700 1 -- 172.21.15.6:0/2053370702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7c074500 con 0x7fcc7c06a300 2023-07-21T07:34:40.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.163+0000 7fcc71ffb700 1 -- 172.21.15.6:0/2053370702 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc6c022070 con 0x7fcc7c06a300 2023-07-21T07:34:40.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.164+0000 7fcc71ffb700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcc6006ace0 0x7fcc6006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:40.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.164+0000 7fcc71ffb700 1 -- 172.21.15.6:0/2053370702 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fcc6c08a580 con 0x7fcc7c06a300 2023-07-21T07:34:40.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.164+0000 7fcc80cef700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcc6006ace0 0x7fcc6006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:40.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.164+0000 7fcc80cef700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcc6006ace0 0x7fcc6006d1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0c5330 tx=0x7fcc78009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:40.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.168+0000 7fcc71ffb700 1 -- 172.21.15.6:0/2053370702 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc6c055800 con 0x7fcc7c06a300 2023-07-21T07:34:40.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:40.417+0000 7fcc83754700 1 -- 172.21.15.6:0/2053370702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcc7c154eb0 con 0x7fcc7c06a300 2023-07-21T07:34:41.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.003+0000 7fcc71ffb700 1 -- 172.21.15.6:0/2053370702 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcc6c058e20 con 0x7fcc7c06a300 2023-07-21T07:34:41.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.010+0000 7fcc83754700 1 -- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcc6006ace0 msgr2=0x7fcc6006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.010+0000 7fcc83754700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcc6006ace0 0x7fcc6006d1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0c5330 tx=0x7fcc78009040 comp rx=0 tx=0).stop 2023-07-21T07:34:41.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.010+0000 7fcc83754700 1 -- 172.21.15.6:0/2053370702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc7c06a300 msgr2=0x7fcc7c155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.010+0000 7fcc83754700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc7c06a300 0x7fcc7c155d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0090b0 tx=0x7fcc6c004750 comp rx=0 tx=0).stop 2023-07-21T07:34:41.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.012+0000 7fcc83754700 1 -- 172.21.15.6:0/2053370702 shutdown_connections 2023-07-21T07:34:41.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.012+0000 7fcc83754700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcc6006ace0 0x7fcc6006d1a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.012+0000 7fcc83754700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc7c0ba140 0x7fcc7c156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.012+0000 7fcc83754700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc7c06a300 0x7fcc7c155d50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.012+0000 7fcc83754700 1 --2- 172.21.15.6:0/2053370702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc7c06d8a0 0x7fcc7c14dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.012+0000 7fcc83754700 1 -- 172.21.15.6:0/2053370702 >> 172.21.15.6:0/2053370702 conn(0x7fcc7c0a8660 msgr2=0x7fcc7c153d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:41.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.013+0000 7fcc83754700 1 -- 172.21.15.6:0/2053370702 shutdown_connections 2023-07-21T07:34:41.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.014+0000 7fcc83754700 1 -- 172.21.15.6:0/2053370702 wait complete. 2023-07-21T07:34:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 3 and data pool 4 2023-07-21T07:34:41.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:41.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.162+0000 7fcee8dfd700 1 Processor -- start 2023-07-21T07:34:41.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.162+0000 7fcee8dfd700 1 -- start start 2023-07-21T07:34:41.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee8dfd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcee414f9a0 0x7fcee41523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee8dfd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcee406f620 0x7fcee4156240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee8dfd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcee414fd80 0x7fcee40c8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee8dfd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee41528f0 con 0x7fcee414f9a0 2023-07-21T07:34:41.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee8dfd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee40c2a10 con 0x7fcee414fd80 2023-07-21T07:34:41.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee8dfd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee4155db0 con 0x7fcee406f620 2023-07-21T07:34:41.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcee414f9a0 0x7fcee41523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcee414f9a0 0x7fcee41523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60572/0 (socket says 172.21.15.6:60572) 2023-07-21T07:34:41.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee259c700 1 -- 172.21.15.6:0/1493068382 learned_addr learned my addr 172.21.15.6:0/1493068382 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:41.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee2d9d700 1 --2- 172.21.15.6:0/1493068382 >> v2:172.21.15.86:3300/0 conn(0x7fcee414fd80 0x7fcee40c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee1d9b700 1 --2- 172.21.15.6:0/1493068382 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcee406f620 0x7fcee4156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee259c700 1 -- 172.21.15.6:0/1493068382 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcee406f620 msgr2=0x7fcee4156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:41.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee259c700 1 --2- 172.21.15.6:0/1493068382 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcee406f620 0x7fcee4156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee259c700 1 -- 172.21.15.6:0/1493068382 >> v2:172.21.15.86:3300/0 conn(0x7fcee414fd80 msgr2=0x7fcee40c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee259c700 1 --2- 172.21.15.6:0/1493068382 >> v2:172.21.15.86:3300/0 conn(0x7fcee414fd80 0x7fcee40c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee259c700 1 -- 172.21.15.6:0/1493068382 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee406e8c0 con 0x7fcee414f9a0 2023-07-21T07:34:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.163+0000 7fcee259c700 1 --2- 172.21.15.6:0/1493068382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcee414f9a0 0x7fcee41523b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcee4071e90 tx=0x7fced8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48490e68485e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.164+0000 7fcee159a700 1 -- 172.21.15.6:0/1493068382 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8011830 con 0x7fcee414f9a0 2023-07-21T07:34:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.164+0000 7fcee159a700 1 -- 172.21.15.6:0/1493068382 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced8011990 con 0x7fcee414f9a0 2023-07-21T07:34:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.164+0000 7fcee159a700 1 -- 172.21.15.6:0/1493068382 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8011d20 con 0x7fcee414f9a0 2023-07-21T07:34:41.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.164+0000 7fcee8dfd700 1 -- 172.21.15.6:0/1493068382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcee414f9a0 msgr2=0x7fcee41523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.164+0000 7fcee8dfd700 1 --2- 172.21.15.6:0/1493068382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcee414f9a0 0x7fcee41523b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcee4071e90 tx=0x7fced8009bd0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.164+0000 7fcee8dfd700 1 -- 172.21.15.6:0/1493068382 shutdown_connections 2023-07-21T07:34:41.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.164+0000 7fcee8dfd700 1 --2- 172.21.15.6:0/1493068382 >> v2:172.21.15.86:3300/0 conn(0x7fcee414fd80 0x7fcee40c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.164+0000 7fcee8dfd700 1 --2- 172.21.15.6:0/1493068382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcee414f9a0 0x7fcee41523b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.164+0000 7fcee8dfd700 1 --2- 172.21.15.6:0/1493068382 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcee406f620 0x7fcee4156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.164+0000 7fcee8dfd700 1 -- 172.21.15.6:0/1493068382 >> 172.21.15.6:0/1493068382 conn(0x7fcee406a480 msgr2=0x7fcee406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:41.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.164+0000 7fcee8dfd700 1 -- 172.21.15.6:0/1493068382 shutdown_connections 2023-07-21T07:34:41.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.164+0000 7fcee8dfd700 1 -- 172.21.15.6:0/1493068382 wait complete. 2023-07-21T07:34:41.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.166+0000 7fcee8dfd700 1 Processor -- start 2023-07-21T07:34:41.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.166+0000 7fcee8dfd700 1 -- start start 2023-07-21T07:34:41.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.166+0000 7fcee8dfd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcee406f620 0x7fcee4150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.166+0000 7fcee8dfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcee414f9a0 0x7fcee414e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.166+0000 7fcee8dfd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcee414fd80 0x7fcee414e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.166+0000 7fcee8dfd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40acb10 con 0x7fcee414f9a0 2023-07-21T07:34:41.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.166+0000 7fcee8dfd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40a9390 con 0x7fcee406f620 2023-07-21T07:34:41.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.166+0000 7fcee8dfd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40a9600 con 0x7fcee414fd80 2023-07-21T07:34:41.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.166+0000 7fcee1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcee414f9a0 0x7fcee414e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fcee1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcee414f9a0 0x7fcee414e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60578/0 (socket says 172.21.15.6:60578) 2023-07-21T07:34:41.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fcee1d9b700 1 -- 172.21.15.6:0/2233123268 learned_addr learned my addr 172.21.15.6:0/2233123268 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:41.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fcee259c700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcee406f620 0x7fcee4150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fcee2d9d700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcee414fd80 0x7fcee414e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fcee1d9b700 1 -- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcee414fd80 msgr2=0x7fcee414e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fcee1d9b700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcee414fd80 0x7fcee414e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fcee1d9b700 1 -- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcee406f620 msgr2=0x7fcee4150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fcee1d9b700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcee406f620 0x7fcee4150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fcee1d9b700 1 -- 172.21.15.6:0/2233123268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced8009550 con 0x7fcee414f9a0 2023-07-21T07:34:41.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fcee1d9b700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcee414f9a0 0x7fcee414e340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fced400e960 tx=0x7fced400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:41.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fced2ffd700 1 -- 172.21.15.6:0/2233123268 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4013680 con 0x7fcee414f9a0 2023-07-21T07:34:41.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fced2ffd700 1 -- 172.21.15.6:0/2233123268 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced40137e0 con 0x7fcee414f9a0 2023-07-21T07:34:41.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fced2ffd700 1 -- 172.21.15.6:0/2233123268 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4013b70 con 0x7fcee414f9a0 2023-07-21T07:34:41.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fcee8dfd700 1 -- 172.21.15.6:0/2233123268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee414d860 con 0x7fcee414f9a0 2023-07-21T07:34:41.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.167+0000 7fcee8dfd700 1 -- 172.21.15.6:0/2233123268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee414de20 con 0x7fcee414f9a0 2023-07-21T07:34:41.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.168+0000 7fcee8dfd700 1 -- 172.21.15.6:0/2233123268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee414e190 con 0x7fcee414f9a0 2023-07-21T07:34:41.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.169+0000 7fced2ffd700 1 -- 172.21.15.6:0/2233123268 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fced4013cd0 con 0x7fcee414f9a0 2023-07-21T07:34:41.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.169+0000 7fced2ffd700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcec406ace0 0x7fcec406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.169+0000 7fced2ffd700 1 -- 172.21.15.6:0/2233123268 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fced40896e0 con 0x7fcee414f9a0 2023-07-21T07:34:41.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.169+0000 7fcee259c700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcec406ace0 0x7fcec406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.170+0000 7fcee259c700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcec406ace0 0x7fcec406d1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fced8009c10 tx=0x7fced8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:41.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.173+0000 7fced2ffd700 1 -- 172.21.15.6:0/2233123268 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fced4054820 con 0x7fcee414f9a0 2023-07-21T07:34:41.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.372+0000 7fcee8dfd700 1 -- 172.21.15.6:0/2233123268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcee404e470 con 0x7fcee414f9a0 2023-07-21T07:34:41.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.373+0000 7fced2ffd700 1 -- 172.21.15.6:0/2233123268 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18184 (secure 0 0 0) 0x7fced4057e40 con 0x7fcee414f9a0 2023-07-21T07:34:41.423 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:41.424 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":23,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:40.418636+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:41.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.375+0000 7fcee8dfd700 1 -- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcec406ace0 msgr2=0x7fcec406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.375+0000 7fcee8dfd700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcec406ace0 0x7fcec406d1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fced8009c10 tx=0x7fced8008030 comp rx=0 tx=0).stop 2023-07-21T07:34:41.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.375+0000 7fcee8dfd700 1 -- 172.21.15.6:0/2233123268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcee414f9a0 msgr2=0x7fcee414e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.375+0000 7fcee8dfd700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcee414f9a0 0x7fcee414e340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fced400e960 tx=0x7fced400ec70 comp rx=0 tx=0).stop 2023-07-21T07:34:41.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.375+0000 7fcee8dfd700 1 -- 172.21.15.6:0/2233123268 shutdown_connections 2023-07-21T07:34:41.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.375+0000 7fcee8dfd700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcec406ace0 0x7fcec406d1a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.375+0000 7fcee8dfd700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcee414fd80 0x7fcee414e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.375+0000 7fcee8dfd700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcee406f620 0x7fcee4150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.375+0000 7fcee8dfd700 1 --2- 172.21.15.6:0/2233123268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcee414f9a0 0x7fcee414e340 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.375+0000 7fcee8dfd700 1 -- 172.21.15.6:0/2233123268 >> 172.21.15.6:0/2233123268 conn(0x7fcee406a480 msgr2=0x7fcee40c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:41.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.375+0000 7fcee8dfd700 1 -- 172.21.15.6:0/2233123268 shutdown_connections 2023-07-21T07:34:41.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.375+0000 7fcee8dfd700 1 -- 172.21.15.6:0/2233123268 wait complete. 2023-07-21T07:34:41.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:41.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.512+0000 7f1010731700 1 Processor -- start 2023-07-21T07:34:41.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.512+0000 7f1010731700 1 -- start start 2023-07-21T07:34:41.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f1010731700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f10080c3750 0x7f10080c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f1010731700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f100814ed60 0x7f1008154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f1010731700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10080ba440 con 0x7f10080c6170 2023-07-21T07:34:41.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f1010731700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100814f140 con 0x7f100814ed60 2023-07-21T07:34:41.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f1010731700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10080c15d0 con 0x7f10080c3750 2023-07-21T07:34:41.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f100ecce700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f100814ed60 0x7f1008154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f100dccc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f10080c6170 0x7f100814e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40374/0 (socket says 172.21.15.6:40374) 2023-07-21T07:34:41.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f100dccc700 1 -- 172.21.15.6:0/3758064379 learned_addr learned my addr 172.21.15.6:0/3758064379 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:41.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f100e4cd700 1 --2- 172.21.15.6:0/3758064379 >> v2:172.21.15.86:3300/0 conn(0x7f10080c3750 0x7f10080c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f100ecce700 1 -- 172.21.15.6:0/3758064379 >> v2:172.21.15.86:3300/0 conn(0x7f10080c3750 msgr2=0x7f10080c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:41.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f100ecce700 1 --2- 172.21.15.6:0/3758064379 >> v2:172.21.15.86:3300/0 conn(0x7f10080c3750 0x7f10080c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f100ecce700 1 -- 172.21.15.6:0/3758064379 >> v1:172.21.15.6:6789/0 conn(0x7f10080c6170 legacy=0x7f100814e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f100d4cb700 1 -- 172.21.15.6:0/3758064379 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214341349 0 0) 0x7f10080ba440 con 0x7f10080c6170 2023-07-21T07:34:41.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f100ecce700 1 -- 172.21.15.6:0/3758064379 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080c18b0 con 0x7f100814ed60 2023-07-21T07:34:41.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f100ecce700 1 --2- 172.21.15.6:0/3758064379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f100814ed60 0x7f1008154c80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f10080c44c0 tx=0x7f100000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf65963a4f402ded server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:41.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f100d4cb700 1 -- 172.21.15.6:0/3758064379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100000e070 con 0x7f100814ed60 2023-07-21T07:34:41.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.513+0000 7f100d4cb700 1 -- 172.21.15.6:0/3758064379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100000bb20 con 0x7f100814ed60 2023-07-21T07:34:41.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.514+0000 7f100d4cb700 1 -- 172.21.15.6:0/3758064379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000012430 con 0x7f100814ed60 2023-07-21T07:34:41.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.514+0000 7f1010731700 1 -- 172.21.15.6:0/3758064379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f100814ed60 msgr2=0x7f1008154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.514+0000 7f1010731700 1 --2- 172.21.15.6:0/3758064379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f100814ed60 0x7f1008154c80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f10080c44c0 tx=0x7f100000b330 comp rx=0 tx=0).stop 2023-07-21T07:34:41.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.514+0000 7f1010731700 1 -- 172.21.15.6:0/3758064379 shutdown_connections 2023-07-21T07:34:41.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.514+0000 7f1010731700 1 --2- 172.21.15.6:0/3758064379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f100814ed60 0x7f1008154c80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.514+0000 7f1010731700 1 --2- 172.21.15.6:0/3758064379 >> v2:172.21.15.86:3300/0 conn(0x7f10080c3750 0x7f10080c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.514+0000 7f1010731700 1 -- 172.21.15.6:0/3758064379 >> 172.21.15.6:0/3758064379 conn(0x7f10080a8c90 msgr2=0x7f100806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:41.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.514+0000 7f1010731700 1 -- 172.21.15.6:0/3758064379 shutdown_connections 2023-07-21T07:34:41.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.514+0000 7f1010731700 1 -- 172.21.15.6:0/3758064379 wait complete. 2023-07-21T07:34:41.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.516+0000 7f1010731700 1 Processor -- start 2023-07-21T07:34:41.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.516+0000 7f1010731700 1 -- start start 2023-07-21T07:34:41.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f1010731700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10080c3750 0x7f10080ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f1010731700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10080c6170 0x7f10080abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f1010731700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f100814ed60 0x7f10081e75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f1010731700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10080bc410 con 0x7f10080c6170 2023-07-21T07:34:41.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f1010731700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10080bc6f0 con 0x7f10080c3750 2023-07-21T07:34:41.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f1010731700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10080bc9d0 con 0x7f100814ed60 2023-07-21T07:34:41.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f100dccc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10080c6170 0x7f10080abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f100dccc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10080c6170 0x7f10080abde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60592/0 (socket says 172.21.15.6:60592) 2023-07-21T07:34:41.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f100dccc700 1 -- 172.21.15.6:0/3634902753 learned_addr learned my addr 172.21.15.6:0/3634902753 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:41.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f100e4cd700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10080c3750 0x7f10080ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f100ecce700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f100814ed60 0x7f10081e75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f100dccc700 1 -- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f100814ed60 msgr2=0x7f10081e75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f100dccc700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f100814ed60 0x7f10081e75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f100dccc700 1 -- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10080c3750 msgr2=0x7f10080ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f100dccc700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10080c3750 0x7f10080ac6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f100dccc700 1 -- 172.21.15.6:0/3634902753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1000009a70 con 0x7f10080c6170 2023-07-21T07:34:41.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f100dccc700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10080c6170 0x7f10080abde0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80011e0 tx=0x7f0ff800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:41.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f0ffeffd700 1 -- 172.21.15.6:0/3634902753 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8004c80 con 0x7f10080c6170 2023-07-21T07:34:41.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f0ffeffd700 1 -- 172.21.15.6:0/3634902753 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff8004e00 con 0x7f10080c6170 2023-07-21T07:34:41.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f1010731700 1 -- 172.21.15.6:0/3634902753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10080bccb0 con 0x7f10080c6170 2023-07-21T07:34:41.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f0ffeffd700 1 -- 172.21.15.6:0/3634902753 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8007310 con 0x7f10080c6170 2023-07-21T07:34:41.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.517+0000 7f1010731700 1 -- 172.21.15.6:0/3634902753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10080ac320 con 0x7f10080c6170 2023-07-21T07:34:41.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.518+0000 7f1010731700 1 -- 172.21.15.6:0/3634902753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10081e7280 con 0x7f10080c6170 2023-07-21T07:34:41.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.519+0000 7f0ffeffd700 1 -- 172.21.15.6:0/3634902753 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ff8007470 con 0x7f10080c6170 2023-07-21T07:34:41.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.519+0000 7f0ffeffd700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0fec06ace0 0x7f0fec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.519+0000 7f0ffeffd700 1 -- 172.21.15.6:0/3634902753 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ff8089020 con 0x7f10080c6170 2023-07-21T07:34:41.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.519+0000 7f100e4cd700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0fec06ace0 0x7f0fec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.520+0000 7f100e4cd700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0fec06ace0 0x7f0fec06d1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1004009be0 tx=0x7f1004009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:41.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.523+0000 7f0ffeffd700 1 -- 172.21.15.6:0/3634902753 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0ff8054160 con 0x7f10080c6170 2023-07-21T07:34:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.722+0000 7f1010731700 1 -- 172.21.15.6:0/3634902753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1008074500 con 0x7f10080c6170 2023-07-21T07:34:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.724+0000 7f0ffeffd700 1 -- 172.21.15.6:0/3634902753 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18184 (secure 0 0 0) 0x7f0ff8057780 con 0x7f10080c6170 2023-07-21T07:34:41.774 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:41.774 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":23,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:40.418636+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.725+0000 7f1010731700 1 -- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0fec06ace0 msgr2=0x7f0fec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.725+0000 7f1010731700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0fec06ace0 0x7f0fec06d1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1004009be0 tx=0x7f1004009210 comp rx=0 tx=0).stop 2023-07-21T07:34:41.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.725+0000 7f1010731700 1 -- 172.21.15.6:0/3634902753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10080c6170 msgr2=0x7f10080abde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.725+0000 7f1010731700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10080c6170 0x7f10080abde0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80011e0 tx=0x7f0ff800ca30 comp rx=0 tx=0).stop 2023-07-21T07:34:41.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.726+0000 7f1010731700 1 -- 172.21.15.6:0/3634902753 shutdown_connections 2023-07-21T07:34:41.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.726+0000 7f1010731700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0fec06ace0 0x7f0fec06d1a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.726+0000 7f1010731700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f100814ed60 0x7f10081e75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.726+0000 7f1010731700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10080c3750 0x7f10080ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.726+0000 7f1010731700 1 --2- 172.21.15.6:0/3634902753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10080c6170 0x7f10080abde0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.726+0000 7f1010731700 1 -- 172.21.15.6:0/3634902753 >> 172.21.15.6:0/3634902753 conn(0x7f10080a8c90 msgr2=0x7f100806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.726+0000 7f1010731700 1 -- 172.21.15.6:0/3634902753 shutdown_connections 2023-07-21T07:34:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.726+0000 7f1010731700 1 -- 172.21.15.6:0/3634902753 wait complete. 2023-07-21T07:34:41.788 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T07:34:41.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.865+0000 7efdb767d700 1 Processor -- start 2023-07-21T07:34:41.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.865+0000 7efdb767d700 1 -- start start 2023-07-21T07:34:41.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb767d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdb00703f0 0x7efdb00c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb767d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdb00c18c0 0x7efdb014dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb767d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb00c0b20 con 0x7efdb0072130 2023-07-21T07:34:41.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb767d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb0151820 con 0x7efdb00703f0 2023-07-21T07:34:41.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb767d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00c0de0 con 0x7efdb00c18c0 2023-07-21T07:34:41.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb5419700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdb00703f0 0x7efdb00c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb5419700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdb00703f0 0x7efdb00c25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60598/0 (socket says 172.21.15.6:60598) 2023-07-21T07:34:41.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb5419700 1 -- 172.21.15.6:0/157155266 learned_addr learned my addr 172.21.15.6:0/157155266 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:41.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb4c18700 1 --2- 172.21.15.6:0/157155266 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdb00c18c0 0x7efdb014dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb5419700 1 -- 172.21.15.6:0/157155266 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdb00c18c0 msgr2=0x7efdb014dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:41.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb5419700 1 --2- 172.21.15.6:0/157155266 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdb00c18c0 0x7efdb014dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb5419700 1 -- 172.21.15.6:0/157155266 >> v1:172.21.15.86:6789/0 conn(0x7efdb0072130 legacy=0x7efdb006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:41.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb5419700 1 -- 172.21.15.6:0/157155266 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb00c10c0 con 0x7efdb00703f0 2023-07-21T07:34:41.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efdb5419700 1 --2- 172.21.15.6:0/157155266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb00703f0 0x7efdb00c25f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efdac0098f0 tx=0x7efdac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5301697dbb3c01 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:41.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efda7fff700 1 -- 172.21.15.6:0/157155266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac004230 con 0x7efdb00703f0 2023-07-21T07:34:41.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efda7fff700 1 -- 172.21.15.6:0/157155266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac004390 con 0x7efdb00703f0 2023-07-21T07:34:41.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.866+0000 7efda7fff700 1 -- 172.21.15.6:0/157155266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac0036a0 con 0x7efdb00703f0 2023-07-21T07:34:41.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.867+0000 7efdb767d700 1 -- 172.21.15.6:0/157155266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb00703f0 msgr2=0x7efdb00c25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.867+0000 7efdb767d700 1 --2- 172.21.15.6:0/157155266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb00703f0 0x7efdb00c25f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efdac0098f0 tx=0x7efdac009c00 comp rx=0 tx=0).stop 2023-07-21T07:34:41.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.867+0000 7efdb767d700 1 -- 172.21.15.6:0/157155266 shutdown_connections 2023-07-21T07:34:41.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.867+0000 7efdb767d700 1 --2- 172.21.15.6:0/157155266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb00703f0 0x7efdb00c25f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.867+0000 7efdb767d700 1 --2- 172.21.15.6:0/157155266 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdb00c18c0 0x7efdb014dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.867+0000 7efdb767d700 1 -- 172.21.15.6:0/157155266 >> 172.21.15.6:0/157155266 conn(0x7efdb00c2c20 msgr2=0x7efdb00c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:41.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.867+0000 7efdb767d700 1 -- 172.21.15.6:0/157155266 shutdown_connections 2023-07-21T07:34:41.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.867+0000 7efdb767d700 1 -- 172.21.15.6:0/157155266 wait complete. 2023-07-21T07:34:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.868+0000 7efdb767d700 1 Processor -- start 2023-07-21T07:34:41.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.868+0000 7efdb767d700 1 -- start start 2023-07-21T07:34:41.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb767d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdb00703f0 0x7efdb013f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb767d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb0072130 0x7efdb013fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb767d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdb00c18c0 0x7efdb01e9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb767d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01e7c50 con 0x7efdb0072130 2023-07-21T07:34:41.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb767d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01ea980 con 0x7efdb00c18c0 2023-07-21T07:34:41.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb767d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00ab5d0 con 0x7efdb00703f0 2023-07-21T07:34:41.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb4c18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb0072130 0x7efdb013fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb4c18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb0072130 0x7efdb013fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60606/0 (socket says 172.21.15.6:60606) 2023-07-21T07:34:41.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb4c18700 1 -- 172.21.15.6:0/3912933486 learned_addr learned my addr 172.21.15.6:0/3912933486 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:41.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb5419700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdb00703f0 0x7efdb013f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb5c1a700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdb00c18c0 0x7efdb01e9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb4c18700 1 -- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdb00703f0 msgr2=0x7efdb013f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb4c18700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdb00703f0 0x7efdb013f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb4c18700 1 -- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdb00c18c0 msgr2=0x7efdb01e9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb4c18700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdb00c18c0 0x7efdb01e9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb4c18700 1 -- 172.21.15.6:0/3912933486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac009550 con 0x7efdb0072130 2023-07-21T07:34:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.869+0000 7efdb4c18700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb0072130 0x7efdb013fac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efda000eb40 tx=0x7efda000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.870+0000 7efda5ffb700 1 -- 172.21.15.6:0/3912933486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda0004220 con 0x7efdb0072130 2023-07-21T07:34:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.870+0000 7efda5ffb700 1 -- 172.21.15.6:0/3912933486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda0004380 con 0x7efdb0072130 2023-07-21T07:34:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.870+0000 7efda5ffb700 1 -- 172.21.15.6:0/3912933486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda0007780 con 0x7efdb0072130 2023-07-21T07:34:41.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.870+0000 7efdb767d700 1 -- 172.21.15.6:0/3912933486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb00ab8b0 con 0x7efdb0072130 2023-07-21T07:34:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.870+0000 7efdb767d700 1 -- 172.21.15.6:0/3912933486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb00aabc0 con 0x7efdb0072130 2023-07-21T07:34:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.871+0000 7efdb767d700 1 -- 172.21.15.6:0/3912933486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb01e7e00 con 0x7efdb0072130 2023-07-21T07:34:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.871+0000 7efda5ffb700 1 -- 172.21.15.6:0/3912933486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efda00078e0 con 0x7efdb0072130 2023-07-21T07:34:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.872+0000 7efda5ffb700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7efd9406ace0 0x7efd9406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.872+0000 7efda5ffb700 1 -- 172.21.15.6:0/3912933486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efda0014070 con 0x7efdb0072130 2023-07-21T07:34:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.872+0000 7efdb5419700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7efd9406ace0 0x7efd9406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:41.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.873+0000 7efdb5419700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7efd9406ace0 0x7efd9406d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efdac009130 tx=0x7efdac008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:41.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:41.876+0000 7efda5ffb700 1 -- 172.21.15.6:0/3912933486 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efdb01e7e00 con 0x7efdb0072130 2023-07-21T07:34:42.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:42.121+0000 7efdb767d700 1 -- 172.21.15.6:0/3912933486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efdb00aae40 con 0x7efdb0072130 2023-07-21T07:34:43.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.014+0000 7efda5ffb700 1 -- 172.21.15.6:0/3912933486 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7efda0056870 con 0x7efdb0072130 2023-07-21T07:34:43.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.017+0000 7efdb767d700 1 -- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7efd9406ace0 msgr2=0x7efd9406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:43.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.017+0000 7efdb767d700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7efd9406ace0 0x7efd9406d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efdac009130 tx=0x7efdac008030 comp rx=0 tx=0).stop 2023-07-21T07:34:43.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.017+0000 7efdb767d700 1 -- 172.21.15.6:0/3912933486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb0072130 msgr2=0x7efdb013fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:43.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.017+0000 7efdb767d700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb0072130 0x7efdb013fac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efda000eb40 tx=0x7efda000ee50 comp rx=0 tx=0).stop 2023-07-21T07:34:43.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.017+0000 7efdb767d700 1 -- 172.21.15.6:0/3912933486 shutdown_connections 2023-07-21T07:34:43.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.018+0000 7efdb767d700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7efd9406ace0 0x7efd9406d1a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:43.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.018+0000 7efdb767d700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdb00c18c0 0x7efdb01e9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:43.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.018+0000 7efdb767d700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdb00703f0 0x7efdb013f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:43.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.018+0000 7efdb767d700 1 --2- 172.21.15.6:0/3912933486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb0072130 0x7efdb013fac0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.018+0000 7efdb767d700 1 -- 172.21.15.6:0/3912933486 >> 172.21.15.6:0/3912933486 conn(0x7efdb00c2c20 msgr2=0x7efdb01407a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.018+0000 7efdb767d700 1 -- 172.21.15.6:0/3912933486 shutdown_connections 2023-07-21T07:34:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.018+0000 7efdb767d700 1 -- 172.21.15.6:0/3912933486 wait complete. 2023-07-21T07:34:43.084 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T07:34:43.085 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T07:34:43.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.168+0000 7f717209a700 1 Processor -- start 2023-07-21T07:34:43.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.168+0000 7f717209a700 1 -- start start 2023-07-21T07:34:43.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f717209a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f716c0ba140 0x7f716c0c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:43.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f717209a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f716c06d8a0 0x7f716c0c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:43.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f717209a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716c155530 con 0x7f716c06a300 2023-07-21T07:34:43.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f717209a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c0c1a30 con 0x7f716c06d8a0 2023-07-21T07:34:43.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f717209a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c154920 con 0x7f716c0ba140 2023-07-21T07:34:43.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f716bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f716c06d8a0 0x7f716c0c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:43.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f716bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f716c06d8a0 0x7f716c0c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60616/0 (socket says 172.21.15.6:60616) 2023-07-21T07:34:43.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f716bfff700 1 -- 172.21.15.6:0/2873758169 learned_addr learned my addr 172.21.15.6:0/2873758169 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:43.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f716affd700 1 --2- 172.21.15.6:0/2873758169 >> v2:172.21.15.86:3300/0 conn(0x7f716c0ba140 0x7f716c0c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:43.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f716bfff700 1 -- 172.21.15.6:0/2873758169 >> v2:172.21.15.86:3300/0 conn(0x7f716c0ba140 msgr2=0x7f716c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:43.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f716bfff700 1 --2- 172.21.15.6:0/2873758169 >> v2:172.21.15.86:3300/0 conn(0x7f716c0ba140 0x7f716c0c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:43.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f716bfff700 1 -- 172.21.15.6:0/2873758169 >> v1:172.21.15.86:6789/0 conn(0x7f716c06a300 legacy=0x7f716c1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:43.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f716bfff700 1 -- 172.21.15.6:0/2873758169 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c154c00 con 0x7f716c06d8a0 2023-07-21T07:34:43.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.169+0000 7f716affd700 1 --2- 172.21.15.6:0/2873758169 >> v2:172.21.15.86:3300/0 conn(0x7f716c0ba140 0x7f716c0c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:43.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.170+0000 7f716bfff700 1 --2- 172.21.15.6:0/2873758169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c06d8a0 0x7f716c0c4f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f716c06c510 tx=0x7f716400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4316ed7420796f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:43.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.170+0000 7f716a7fc700 1 -- 172.21.15.6:0/2873758169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716400e070 con 0x7f716c06d8a0 2023-07-21T07:34:43.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.170+0000 7f716a7fc700 1 -- 172.21.15.6:0/2873758169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7164003a20 con 0x7f716c06d8a0 2023-07-21T07:34:43.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.170+0000 7f716a7fc700 1 -- 172.21.15.6:0/2873758169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164003dd0 con 0x7f716c06d8a0 2023-07-21T07:34:43.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.170+0000 7f717209a700 1 -- 172.21.15.6:0/2873758169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c06d8a0 msgr2=0x7f716c0c4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:43.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.170+0000 7f717209a700 1 --2- 172.21.15.6:0/2873758169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c06d8a0 0x7f716c0c4f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f716c06c510 tx=0x7f716400b330 comp rx=0 tx=0).stop 2023-07-21T07:34:43.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.170+0000 7f717209a700 1 -- 172.21.15.6:0/2873758169 shutdown_connections 2023-07-21T07:34:43.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.170+0000 7f717209a700 1 --2- 172.21.15.6:0/2873758169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c06d8a0 0x7f716c0c4f80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:43.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.170+0000 7f717209a700 1 --2- 172.21.15.6:0/2873758169 >> v2:172.21.15.86:3300/0 conn(0x7f716c0ba140 0x7f716c0c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:43.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.170+0000 7f717209a700 1 -- 172.21.15.6:0/2873758169 >> 172.21.15.6:0/2873758169 conn(0x7f716c0a8660 msgr2=0x7f716c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:43.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.170+0000 7f717209a700 1 -- 172.21.15.6:0/2873758169 shutdown_connections 2023-07-21T07:34:43.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.170+0000 7f717209a700 1 -- 172.21.15.6:0/2873758169 wait complete. 2023-07-21T07:34:43.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.172+0000 7f717209a700 1 Processor -- start 2023-07-21T07:34:43.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.172+0000 7f717209a700 1 -- start start 2023-07-21T07:34:43.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.172+0000 7f717209a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f716c06a300 0x7f716c0be160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:43.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.172+0000 7f717209a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f716c06d8a0 0x7f716c153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:43.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.172+0000 7f717209a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0ba140 0x7f716c1ea8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:43.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.172+0000 7f717209a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0bf5a0 con 0x7f716c0ba140 2023-07-21T07:34:43.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.172+0000 7f717209a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c1ea460 con 0x7f716c06d8a0 2023-07-21T07:34:43.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.172+0000 7f717209a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c1eded0 con 0x7f716c06a300 2023-07-21T07:34:43.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f716bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0ba140 0x7f716c1ea8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:43.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f716bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0ba140 0x7f716c1ea8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60622/0 (socket says 172.21.15.6:60622) 2023-07-21T07:34:43.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f716bfff700 1 -- 172.21.15.6:0/1854940367 learned_addr learned my addr 172.21.15.6:0/1854940367 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:43.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f716affd700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f716c06d8a0 0x7f716c153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:43.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f716b7fe700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f716c06a300 0x7f716c0be160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:43.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f716bfff700 1 -- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f716c06a300 msgr2=0x7f716c0be160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:43.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f716bfff700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f716c06a300 0x7f716c0be160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f716bfff700 1 -- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f716c06d8a0 msgr2=0x7f716c153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f716bfff700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f716c06d8a0 0x7f716c153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f716bfff700 1 -- 172.21.15.6:0/1854940367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7164009b30 con 0x7f716c0ba140 2023-07-21T07:34:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f716b7fe700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f716c06a300 0x7f716c0be160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f716bfff700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0ba140 0x7f716c1ea8f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7164015040 tx=0x7f7164004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f7153fff700 1 -- 172.21.15.6:0/1854940367 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164004440 con 0x7f716c0ba140 2023-07-21T07:34:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f7153fff700 1 -- 172.21.15.6:0/1854940367 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71640045a0 con 0x7f716c0ba140 2023-07-21T07:34:43.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f717209a700 1 -- 172.21.15.6:0/1854940367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c1ee400 con 0x7f716c0ba140 2023-07-21T07:34:43.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f7153fff700 1 -- 172.21.15.6:0/1854940367 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164004950 con 0x7f716c0ba140 2023-07-21T07:34:43.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.173+0000 7f717209a700 1 -- 172.21.15.6:0/1854940367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c0be6a0 con 0x7f716c0ba140 2023-07-21T07:34:43.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.174+0000 7f717209a700 1 -- 172.21.15.6:0/1854940367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716c1ea610 con 0x7f716c0ba140 2023-07-21T07:34:43.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.175+0000 7f7153fff700 1 -- 172.21.15.6:0/1854940367 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7164012430 con 0x7f716c0ba140 2023-07-21T07:34:43.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.175+0000 7f7153fff700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f715806ace0 0x7f715806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:43.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.175+0000 7f7153fff700 1 -- 172.21.15.6:0/1854940367 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f716408a980 con 0x7f716c0ba140 2023-07-21T07:34:43.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.175+0000 7f716b7fe700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f715806ace0 0x7f715806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:43.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.176+0000 7f716b7fe700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f715806ace0 0x7f715806d1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f715c009930 tx=0x7f715c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:43.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.179+0000 7f7153fff700 1 -- 172.21.15.6:0/1854940367 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f716c1ea610 con 0x7f716c0ba140 2023-07-21T07:34:43.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:43.424+0000 7f717209a700 1 -- 172.21.15.6:0/1854940367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f716c1ea610 con 0x7f716c0ba140 2023-07-21T07:34:44.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.016+0000 7f7153fff700 1 -- 172.21.15.6:0/1854940367 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f716c1ea610 con 0x7f716c0ba140 2023-07-21T07:34:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.019+0000 7f717209a700 1 -- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f715806ace0 msgr2=0x7f715806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.019+0000 7f717209a700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f715806ace0 0x7f715806d1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f715c009930 tx=0x7f715c008040 comp rx=0 tx=0).stop 2023-07-21T07:34:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.019+0000 7f717209a700 1 -- 172.21.15.6:0/1854940367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0ba140 msgr2=0x7f716c1ea8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.019+0000 7f717209a700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0ba140 0x7f716c1ea8f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7164015040 tx=0x7f7164004ad0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.019+0000 7f717209a700 1 -- 172.21.15.6:0/1854940367 shutdown_connections 2023-07-21T07:34:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.019+0000 7f717209a700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f715806ace0 0x7f715806d1a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.019+0000 7f717209a700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0ba140 0x7f716c1ea8f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.019+0000 7f717209a700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f716c06a300 0x7f716c0be160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.019+0000 7f717209a700 1 --2- 172.21.15.6:0/1854940367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f716c06d8a0 0x7f716c153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.019+0000 7f717209a700 1 -- 172.21.15.6:0/1854940367 >> 172.21.15.6:0/1854940367 conn(0x7f716c0a8660 msgr2=0x7f716c0c2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.019+0000 7f717209a700 1 -- 172.21.15.6:0/1854940367 shutdown_connections 2023-07-21T07:34:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.019+0000 7f717209a700 1 -- 172.21.15.6:0/1854940367 wait complete. 2023-07-21T07:34:44.084 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T07:34:44.084 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:34:44.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.161+0000 7f595f3d4700 1 Processor -- start 2023-07-21T07:34:44.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.161+0000 7f595f3d4700 1 -- start start 2023-07-21T07:34:44.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595f3d4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5958151b50 0x7f59581550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595f3d4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59580c0f60 0x7f59580c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595f3d4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59580664d0 con 0x7f59580c19f0 2023-07-21T07:34:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595f3d4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5958155600 con 0x7f5958151b50 2023-07-21T07:34:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595f3d4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59580bf550 con 0x7f59580c0f60 2023-07-21T07:34:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595d170700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5958151b50 0x7f59581550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595d170700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5958151b50 0x7f59581550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60626/0 (socket says 172.21.15.6:60626) 2023-07-21T07:34:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595d170700 1 -- 172.21.15.6:0/982338355 learned_addr learned my addr 172.21.15.6:0/982338355 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595c96f700 1 --2- 172.21.15.6:0/982338355 >> v2:172.21.15.86:3300/0 conn(0x7f59580c0f60 0x7f59580c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595d170700 1 -- 172.21.15.6:0/982338355 >> v2:172.21.15.86:3300/0 conn(0x7f59580c0f60 msgr2=0x7f59580c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595d170700 1 --2- 172.21.15.6:0/982338355 >> v2:172.21.15.86:3300/0 conn(0x7f59580c0f60 0x7f59580c14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595d170700 1 -- 172.21.15.6:0/982338355 >> v1:172.21.15.86:6789/0 conn(0x7f59580c19f0 legacy=0x7f595806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595d170700 1 -- 172.21.15.6:0/982338355 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59580bf830 con 0x7f5958151b50 2023-07-21T07:34:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f595d170700 1 --2- 172.21.15.6:0/982338355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5958151b50 0x7f59581550c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f59580c2b70 tx=0x7f5954009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ae52f38ed7e1ef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f594ffff700 1 -- 172.21.15.6:0/982338355 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954004230 con 0x7f5958151b50 2023-07-21T07:34:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f594ffff700 1 -- 172.21.15.6:0/982338355 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5954004390 con 0x7f5958151b50 2023-07-21T07:34:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.162+0000 7f594ffff700 1 -- 172.21.15.6:0/982338355 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540036a0 con 0x7f5958151b50 2023-07-21T07:34:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.163+0000 7f595f3d4700 1 -- 172.21.15.6:0/982338355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5958151b50 msgr2=0x7f59581550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.163+0000 7f595f3d4700 1 --2- 172.21.15.6:0/982338355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5958151b50 0x7f59581550c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f59580c2b70 tx=0x7f5954009bd0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.163+0000 7f595f3d4700 1 -- 172.21.15.6:0/982338355 shutdown_connections 2023-07-21T07:34:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.163+0000 7f595f3d4700 1 --2- 172.21.15.6:0/982338355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5958151b50 0x7f59581550c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.163+0000 7f595f3d4700 1 --2- 172.21.15.6:0/982338355 >> v2:172.21.15.86:3300/0 conn(0x7f59580c0f60 0x7f59580c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.163+0000 7f595f3d4700 1 -- 172.21.15.6:0/982338355 >> 172.21.15.6:0/982338355 conn(0x7f59580c6140 msgr2=0x7f59580c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.163+0000 7f595f3d4700 1 -- 172.21.15.6:0/982338355 shutdown_connections 2023-07-21T07:34:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.163+0000 7f595f3d4700 1 -- 172.21.15.6:0/982338355 wait complete. 2023-07-21T07:34:44.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.164+0000 7f595f3d4700 1 Processor -- start 2023-07-21T07:34:44.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.164+0000 7f595f3d4700 1 -- start start 2023-07-21T07:34:44.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595f3d4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59580c0f60 0x7f5958153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595f3d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59580c19f0 0x7f595814c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595f3d4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5958151b50 0x7f595814c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595f3d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59581578f0 con 0x7f59580c19f0 2023-07-21T07:34:44.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595f3d4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958155990 con 0x7f5958151b50 2023-07-21T07:34:44.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595f3d4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59580aa820 con 0x7f59580c0f60 2023-07-21T07:34:44.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595c96f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59580c19f0 0x7f595814c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595c96f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59580c19f0 0x7f595814c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60634/0 (socket says 172.21.15.6:60634) 2023-07-21T07:34:44.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595c96f700 1 -- 172.21.15.6:0/3700336143 learned_addr learned my addr 172.21.15.6:0/3700336143 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:44.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595d971700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5958151b50 0x7f595814c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595d170700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59580c0f60 0x7f5958153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595c96f700 1 -- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59580c0f60 msgr2=0x7f5958153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595c96f700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59580c0f60 0x7f5958153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595c96f700 1 -- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5958151b50 msgr2=0x7f595814c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595c96f700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5958151b50 0x7f595814c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595c96f700 1 -- 172.21.15.6:0/3700336143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954009550 con 0x7f59580c19f0 2023-07-21T07:34:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595d971700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5958151b50 0x7f595814c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.165+0000 7f595c96f700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59580c19f0 0x7f595814c160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f594800d800 tx=0x7f594800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.166+0000 7f594dffb700 1 -- 172.21.15.6:0/3700336143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59480125f0 con 0x7f59580c19f0 2023-07-21T07:34:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.166+0000 7f594dffb700 1 -- 172.21.15.6:0/3700336143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5948012750 con 0x7f59580c19f0 2023-07-21T07:34:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.166+0000 7f595f3d4700 1 -- 172.21.15.6:0/3700336143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59581ea5b0 con 0x7f59580c19f0 2023-07-21T07:34:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.166+0000 7f594dffb700 1 -- 172.21.15.6:0/3700336143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948012b00 con 0x7f59580c19f0 2023-07-21T07:34:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.166+0000 7f595f3d4700 1 -- 172.21.15.6:0/3700336143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59581ea850 con 0x7f59580c19f0 2023-07-21T07:34:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.167+0000 7f595f3d4700 1 -- 172.21.15.6:0/3700336143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59580aa990 con 0x7f59580c19f0 2023-07-21T07:34:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.167+0000 7f594dffb700 1 -- 172.21.15.6:0/3700336143 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5948012c60 con 0x7f59580c19f0 2023-07-21T07:34:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.168+0000 7f594dffb700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f593c06ace0 0x7f593c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.168+0000 7f594dffb700 1 -- 172.21.15.6:0/3700336143 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5948089780 con 0x7f59580c19f0 2023-07-21T07:34:44.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.168+0000 7f595d170700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f593c06ace0 0x7f593c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.168+0000 7f595d170700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f593c06ace0 0x7f593c06d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5954000c00 tx=0x7f5954008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:44.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.172+0000 7f594dffb700 1 -- 172.21.15.6:0/3700336143 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59480548c0 con 0x7f59580c19f0 2023-07-21T07:34:44.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.417+0000 7f595f3d4700 1 -- 172.21.15.6:0/3700336143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5958074500 con 0x7f59580c19f0 2023-07-21T07:34:44.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.418+0000 7f594dffb700 1 -- 172.21.15.6:0/3700336143 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f5948057ee0 con 0x7f59580c19f0 2023-07-21T07:34:44.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:44.469 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3052758988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3052758988},{"type":"v1","addr":"172.21.15.6:6833","nonce":3052758988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3514948644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3514948644},{"type":"v1","addr":"172.21.15.6:6835","nonce":3514948644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/3188395603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3188395603},{"type":"v1","addr":"172.21.15.86:6836","nonce":3188395603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:34:40.418961+0000","modified":"2023-07-21T07:34:44.014954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6837/815488925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":815488925},{"type":"v1","addr":"172.21.15.86:6837","nonce":815488925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T07:34:44.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.420+0000 7f595f3d4700 1 -- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f593c06ace0 msgr2=0x7f593c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.420+0000 7f595f3d4700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f593c06ace0 0x7f593c06d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5954000c00 tx=0x7f5954008030 comp rx=0 tx=0).stop 2023-07-21T07:34:44.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.420+0000 7f595f3d4700 1 -- 172.21.15.6:0/3700336143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59580c19f0 msgr2=0x7f595814c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.420+0000 7f595f3d4700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59580c19f0 0x7f595814c160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f594800d800 tx=0x7f594800dbc0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.420+0000 7f595f3d4700 1 -- 172.21.15.6:0/3700336143 shutdown_connections 2023-07-21T07:34:44.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.420+0000 7f595f3d4700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f593c06ace0 0x7f593c06d1a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.420+0000 7f595f3d4700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5958151b50 0x7f595814c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.420+0000 7f595f3d4700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59580c0f60 0x7f5958153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.420+0000 7f595f3d4700 1 --2- 172.21.15.6:0/3700336143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59580c19f0 0x7f595814c160 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.420+0000 7f595f3d4700 1 -- 172.21.15.6:0/3700336143 >> 172.21.15.6:0/3700336143 conn(0x7f59580c6140 msgr2=0x7f5958151170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:44.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.420+0000 7f595f3d4700 1 -- 172.21.15.6:0/3700336143 shutdown_connections 2023-07-21T07:34:44.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.420+0000 7f595f3d4700 1 -- 172.21.15.6:0/3700336143 wait complete. 2023-07-21T07:34:44.473 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T07:34:44.483 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:44.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.556+0000 7ff2b65d0700 1 Processor -- start 2023-07-21T07:34:44.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.557+0000 7ff2b65d0700 1 -- start start 2023-07-21T07:34:44.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.557+0000 7ff2b65d0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff2b014eb40 0x7ff2b0065fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.557+0000 7ff2b65d0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff2b006b1a0 0x7ff2b00aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.557+0000 7ff2b65d0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b014ef20 con 0x7ff2b00abf50 2023-07-21T07:34:44.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.557+0000 7ff2b65d0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b006bbf0 con 0x7ff2b014eb40 2023-07-21T07:34:44.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.557+0000 7ff2b65d0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b0066520 con 0x7ff2b006b1a0 2023-07-21T07:34:44.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.557+0000 7ff2affff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff2b014eb40 0x7ff2b0065fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.557+0000 7ff2affff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff2b014eb40 0x7ff2b0065fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60640/0 (socket says 172.21.15.6:60640) 2023-07-21T07:34:44.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.557+0000 7ff2affff700 1 -- 172.21.15.6:0/3098336848 learned_addr learned my addr 172.21.15.6:0/3098336848 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:44.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.558+0000 7ff2af7fe700 1 --2- 172.21.15.6:0/3098336848 >> v2:172.21.15.86:3300/0 conn(0x7ff2b006b1a0 0x7ff2b00aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.558+0000 7ff2affff700 1 -- 172.21.15.6:0/3098336848 >> v2:172.21.15.86:3300/0 conn(0x7ff2b006b1a0 msgr2=0x7ff2b00aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:44.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.558+0000 7ff2affff700 1 --2- 172.21.15.6:0/3098336848 >> v2:172.21.15.86:3300/0 conn(0x7ff2b006b1a0 0x7ff2b00aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.558+0000 7ff2affff700 1 -- 172.21.15.6:0/3098336848 >> v1:172.21.15.86:6789/0 conn(0x7ff2b00abf50 legacy=0x7ff2b0151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:44.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.558+0000 7ff2affff700 1 -- 172.21.15.6:0/3098336848 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b0070310 con 0x7ff2b014eb40 2023-07-21T07:34:44.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.558+0000 7ff2af7fe700 1 --2- 172.21.15.6:0/3098336848 >> v2:172.21.15.86:3300/0 conn(0x7ff2b006b1a0 0x7ff2b00aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:44.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.558+0000 7ff2affff700 1 --2- 172.21.15.6:0/3098336848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b014eb40 0x7ff2b0065fe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff2b006fdb0 tx=0x7ff29800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6f47d9c7f11dfa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:44.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.558+0000 7ff2aeffd700 1 -- 172.21.15.6:0/3098336848 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29800dcf0 con 0x7ff2b014eb40 2023-07-21T07:34:44.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.558+0000 7ff2aeffd700 1 -- 172.21.15.6:0/3098336848 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29800de50 con 0x7ff2b014eb40 2023-07-21T07:34:44.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.558+0000 7ff2aeffd700 1 -- 172.21.15.6:0/3098336848 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298004250 con 0x7ff2b014eb40 2023-07-21T07:34:44.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.559+0000 7ff2b65d0700 1 -- 172.21.15.6:0/3098336848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b014eb40 msgr2=0x7ff2b0065fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.559+0000 7ff2b65d0700 1 --2- 172.21.15.6:0/3098336848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b014eb40 0x7ff2b0065fe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff2b006fdb0 tx=0x7ff29800be70 comp rx=0 tx=0).stop 2023-07-21T07:34:44.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.559+0000 7ff2b65d0700 1 -- 172.21.15.6:0/3098336848 shutdown_connections 2023-07-21T07:34:44.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.559+0000 7ff2b65d0700 1 --2- 172.21.15.6:0/3098336848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b014eb40 0x7ff2b0065fe0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.559+0000 7ff2b65d0700 1 --2- 172.21.15.6:0/3098336848 >> v2:172.21.15.86:3300/0 conn(0x7ff2b006b1a0 0x7ff2b00aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.559+0000 7ff2b65d0700 1 -- 172.21.15.6:0/3098336848 >> 172.21.15.6:0/3098336848 conn(0x7ff2b00c6140 msgr2=0x7ff2b00c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:44.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.559+0000 7ff2b65d0700 1 -- 172.21.15.6:0/3098336848 shutdown_connections 2023-07-21T07:34:44.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.559+0000 7ff2b65d0700 1 -- 172.21.15.6:0/3098336848 wait complete. 2023-07-21T07:34:44.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.560+0000 7ff2b65d0700 1 Processor -- start 2023-07-21T07:34:44.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.560+0000 7ff2b65d0700 1 -- start start 2023-07-21T07:34:44.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2b65d0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b00abf50 0x7ff2b00c00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2b65d0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2b014eb40 0x7ff2b0070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2b65d0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0144fa0 0x7ff2b0144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2b65d0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b01e74d0 con 0x7ff2b00abf50 2023-07-21T07:34:44.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2b65d0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0148ec0 con 0x7ff2b0144fa0 2023-07-21T07:34:44.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2b65d0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0149110 con 0x7ff2b014eb40 2023-07-21T07:34:44.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2affff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b00abf50 0x7ff2b00c00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2affff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b00abf50 0x7ff2b00c00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60646/0 (socket says 172.21.15.6:60646) 2023-07-21T07:34:44.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2affff700 1 -- 172.21.15.6:0/4273761219 learned_addr learned my addr 172.21.15.6:0/4273761219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:44.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2b4b6d700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0144fa0 0x7ff2b0144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2af7fe700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2b014eb40 0x7ff2b0070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2affff700 1 -- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2b014eb40 msgr2=0x7ff2b0070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2affff700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2b014eb40 0x7ff2b0070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2affff700 1 -- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0144fa0 msgr2=0x7ff2b0144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2affff700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0144fa0 0x7ff2b0144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2affff700 1 -- 172.21.15.6:0/4273761219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29800b7f0 con 0x7ff2b00abf50 2023-07-21T07:34:44.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2af7fe700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2b014eb40 0x7ff2b0070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:44.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2affff700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b00abf50 0x7ff2b00c00f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff29800beb0 tx=0x7ff298004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:44.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2acff9700 1 -- 172.21.15.6:0/4273761219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298004230 con 0x7ff2b00abf50 2023-07-21T07:34:44.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2acff9700 1 -- 172.21.15.6:0/4273761219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff298010470 con 0x7ff2b00abf50 2023-07-21T07:34:44.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2b65d0700 1 -- 172.21.15.6:0/4273761219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b01ed980 con 0x7ff2b00abf50 2023-07-21T07:34:44.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.561+0000 7ff2acff9700 1 -- 172.21.15.6:0/4273761219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298010800 con 0x7ff2b00abf50 2023-07-21T07:34:44.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.562+0000 7ff2b65d0700 1 -- 172.21.15.6:0/4273761219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b0150010 con 0x7ff2b00abf50 2023-07-21T07:34:44.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.562+0000 7ff2b65d0700 1 -- 172.21.15.6:0/4273761219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b01ed7e0 con 0x7ff2b00abf50 2023-07-21T07:34:44.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.563+0000 7ff2acff9700 1 -- 172.21.15.6:0/4273761219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff2980193f0 con 0x7ff2b00abf50 2023-07-21T07:34:44.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.563+0000 7ff2acff9700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff29006ad10 0x7ff29006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.563+0000 7ff2acff9700 1 -- 172.21.15.6:0/4273761219 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff29808b2d0 con 0x7ff2b00abf50 2023-07-21T07:34:44.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.564+0000 7ff2af7fe700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff29006ad10 0x7ff29006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.564+0000 7ff2af7fe700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff29006ad10 0x7ff29006d1d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0071760 tx=0x7ff2a0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:44.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.568+0000 7ff2acff9700 1 -- 172.21.15.6:0/4273761219 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff2b01ed7e0 con 0x7ff2b00abf50 2023-07-21T07:34:44.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.769+0000 7ff2b65d0700 1 -- 172.21.15.6:0/4273761219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2b014ef20 con 0x7ff2b00abf50 2023-07-21T07:34:44.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.770+0000 7ff2acff9700 1 -- 172.21.15.6:0/4273761219 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7ff2b014ef20 con 0x7ff2b00abf50 2023-07-21T07:34:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:44.822 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:44.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.772+0000 7ff2b65d0700 1 -- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff29006ad10 msgr2=0x7ff29006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.772+0000 7ff2b65d0700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff29006ad10 0x7ff29006d1d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0071760 tx=0x7ff2a0008040 comp rx=0 tx=0).stop 2023-07-21T07:34:44.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.772+0000 7ff2b65d0700 1 -- 172.21.15.6:0/4273761219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b00abf50 msgr2=0x7ff2b00c00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.772+0000 7ff2b65d0700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b00abf50 0x7ff2b00c00f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff29800beb0 tx=0x7ff298004750 comp rx=0 tx=0).stop 2023-07-21T07:34:44.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.772+0000 7ff2b65d0700 1 -- 172.21.15.6:0/4273761219 shutdown_connections 2023-07-21T07:34:44.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.772+0000 7ff2b65d0700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff29006ad10 0x7ff29006d1d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.772+0000 7ff2b65d0700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2b0144fa0 0x7ff2b0144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.772+0000 7ff2b65d0700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2b00abf50 0x7ff2b00c00f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.772+0000 7ff2b65d0700 1 --2- 172.21.15.6:0/4273761219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2b014eb40 0x7ff2b0070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.772+0000 7ff2b65d0700 1 -- 172.21.15.6:0/4273761219 >> 172.21.15.6:0/4273761219 conn(0x7ff2b00c6140 msgr2=0x7ff2b01dae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:44.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.773+0000 7ff2b65d0700 1 -- 172.21.15.6:0/4273761219 shutdown_connections 2023-07-21T07:34:44.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.773+0000 7ff2b65d0700 1 -- 172.21.15.6:0/4273761219 wait complete. 2023-07-21T07:34:44.836 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T07:34:44.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:34:44.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.912+0000 7f44b9ebe700 1 Processor -- start 2023-07-21T07:34:44.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.912+0000 7f44b9ebe700 1 -- start start 2023-07-21T07:34:44.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b9ebe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44b406f620 0x7f44b41523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b9ebe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44b414fd80 0x7f44b40c8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b9ebe700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b41528f0 con 0x7f44b414f9a0 2023-07-21T07:34:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b9ebe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b40c2a10 con 0x7f44b414fd80 2023-07-21T07:34:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b9ebe700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4156950 con 0x7f44b406f620 2023-07-21T07:34:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b2ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44b406f620 0x7f44b41523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44b414fd80 0x7f44b40c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44b414fd80 0x7f44b40c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54230/0 (socket says 172.21.15.6:54230) 2023-07-21T07:34:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b3fff700 1 -- 172.21.15.6:0/2290130452 learned_addr learned my addr 172.21.15.6:0/2290130452 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b2ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44b406f620 0x7f44b41523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:58050/0 (socket says 172.21.15.6:58050) 2023-07-21T07:34:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b37fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f44b414f9a0 0x7f44b4156240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:43684/0 (socket says 172.21.15.6:43684) 2023-07-21T07:34:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b3fff700 1 -- 172.21.15.6:0/2290130452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44b406f620 msgr2=0x7f44b41523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b3fff700 1 --2- 172.21.15.6:0/2290130452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44b406f620 0x7f44b41523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b3fff700 1 -- 172.21.15.6:0/2290130452 >> v1:172.21.15.86:6789/0 conn(0x7f44b414f9a0 legacy=0x7f44b4156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.913+0000 7f44b3fff700 1 -- 172.21.15.6:0/2290130452 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4155db0 con 0x7f44b414fd80 2023-07-21T07:34:44.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.914+0000 7f44b3fff700 1 --2- 172.21.15.6:0/2290130452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b414fd80 0x7f44b40c8080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44ac009e50 tx=0x7f44ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11a51da917e8619a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:44.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.914+0000 7f44b27fc700 1 -- 172.21.15.6:0/2290130452 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac00e070 con 0x7f44b414fd80 2023-07-21T07:34:44.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.914+0000 7f44b27fc700 1 -- 172.21.15.6:0/2290130452 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac00b910 con 0x7f44b414fd80 2023-07-21T07:34:44.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.914+0000 7f44b27fc700 1 -- 172.21.15.6:0/2290130452 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac00bcc0 con 0x7f44b414fd80 2023-07-21T07:34:44.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.914+0000 7f44b9ebe700 1 -- 172.21.15.6:0/2290130452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b414fd80 msgr2=0x7f44b40c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.914+0000 7f44b9ebe700 1 --2- 172.21.15.6:0/2290130452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b414fd80 0x7f44b40c8080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44ac009e50 tx=0x7f44ac00b330 comp rx=0 tx=0).stop 2023-07-21T07:34:44.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.914+0000 7f44b9ebe700 1 -- 172.21.15.6:0/2290130452 shutdown_connections 2023-07-21T07:34:44.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.914+0000 7f44b9ebe700 1 --2- 172.21.15.6:0/2290130452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b414fd80 0x7f44b40c8080 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.914+0000 7f44b9ebe700 1 --2- 172.21.15.6:0/2290130452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44b406f620 0x7f44b41523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.914+0000 7f44b9ebe700 1 -- 172.21.15.6:0/2290130452 >> 172.21.15.6:0/2290130452 conn(0x7f44b406a480 msgr2=0x7f44b406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:44.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.914+0000 7f44b9ebe700 1 -- 172.21.15.6:0/2290130452 shutdown_connections 2023-07-21T07:34:44.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.914+0000 7f44b9ebe700 1 -- 172.21.15.6:0/2290130452 wait complete. 2023-07-21T07:34:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.916+0000 7f44b9ebe700 1 Processor -- start 2023-07-21T07:34:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.916+0000 7f44b9ebe700 1 -- start start 2023-07-21T07:34:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b9ebe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b406f620 0x7f44b41e77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b9ebe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b414f9a0 0x7f44b4151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b9ebe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44b414fd80 0x7f44b40c16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b9ebe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b41e8280 con 0x7f44b406f620 2023-07-21T07:34:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b9ebe700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4150cd0 con 0x7f44b414f9a0 2023-07-21T07:34:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b9ebe700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40aad30 con 0x7f44b414fd80 2023-07-21T07:34:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b406f620 0x7f44b41e77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b406f620 0x7f44b41e77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60660/0 (socket says 172.21.15.6:60660) 2023-07-21T07:34:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b37fe700 1 -- 172.21.15.6:0/1541973249 learned_addr learned my addr 172.21.15.6:0/1541973249 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b2ffd700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b414f9a0 0x7f44b4151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b3fff700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44b414fd80 0x7f44b40c16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b37fe700 1 -- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44b414fd80 msgr2=0x7f44b40c16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b37fe700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44b414fd80 0x7f44b40c16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b37fe700 1 -- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b414f9a0 msgr2=0x7f44b4151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:44.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b37fe700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b414f9a0 0x7f44b4151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:44.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.917+0000 7f44b37fe700 1 -- 172.21.15.6:0/1541973249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac009b30 con 0x7f44b406f620 2023-07-21T07:34:44.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.918+0000 7f44b37fe700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b406f620 0x7f44b41e77b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f44a400c520 tx=0x7f44a400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:44.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.918+0000 7f449bfff700 1 -- 172.21.15.6:0/1541973249 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4005cb0 con 0x7f44b406f620 2023-07-21T07:34:44.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.918+0000 7f449bfff700 1 -- 172.21.15.6:0/1541973249 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a4005e10 con 0x7f44b406f620 2023-07-21T07:34:44.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.918+0000 7f44b9ebe700 1 -- 172.21.15.6:0/1541973249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b40ab010 con 0x7f44b406f620 2023-07-21T07:34:44.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.918+0000 7f449bfff700 1 -- 172.21.15.6:0/1541973249 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a40072d0 con 0x7f44b406f620 2023-07-21T07:34:44.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.918+0000 7f44b9ebe700 1 -- 172.21.15.6:0/1541973249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b40bfb30 con 0x7f44b406f620 2023-07-21T07:34:44.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.919+0000 7f44b9ebe700 1 -- 172.21.15.6:0/1541973249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b4150ea0 con 0x7f44b406f620 2023-07-21T07:34:44.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.919+0000 7f449bfff700 1 -- 172.21.15.6:0/1541973249 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f44a4007430 con 0x7f44b406f620 2023-07-21T07:34:44.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.920+0000 7f449bfff700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f44a006ace0 0x7f44a006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:44.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.920+0000 7f449bfff700 1 -- 172.21.15.6:0/1541973249 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44a4088680 con 0x7f44b406f620 2023-07-21T07:34:44.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.920+0000 7f44b2ffd700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f44a006ace0 0x7f44a006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:44.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.920+0000 7f44b2ffd700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f44a006ace0 0x7f44a006d1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f44b41553b0 tx=0x7f44a8009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:44.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:44.924+0000 7f449bfff700 1 -- 172.21.15.6:0/1541973249 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f44b4150ea0 con 0x7f44b406f620 2023-07-21T07:34:45.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.122+0000 7f44b9ebe700 1 -- 172.21.15.6:0/1541973249 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44b406eb60 con 0x7f44a006ace0 2023-07-21T07:34:45.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.131+0000 7f449bfff700 1 -- 172.21.15.6:0/1541973249 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286724 (secure 0 0 0) 0x7f44a8011830 con 0x7f44a006ace0 2023-07-21T07:34:45.183 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.134+0000 7f44b9ebe700 1 -- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f44a006ace0 msgr2=0x7f44a006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.134+0000 7f44b9ebe700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f44a006ace0 0x7f44a006d1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f44b41553b0 tx=0x7f44a8009210 comp rx=0 tx=0).stop 2023-07-21T07:34:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.134+0000 7f44b9ebe700 1 -- 172.21.15.6:0/1541973249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b406f620 msgr2=0x7f44b41e77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.134+0000 7f44b9ebe700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b406f620 0x7f44b41e77b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f44a400c520 tx=0x7f44a400c830 comp rx=0 tx=0).stop 2023-07-21T07:34:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.134+0000 7f44b9ebe700 1 -- 172.21.15.6:0/1541973249 shutdown_connections 2023-07-21T07:34:45.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.134+0000 7f44b9ebe700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f44a006ace0 0x7f44a006d1a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.134+0000 7f44b9ebe700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44b414fd80 0x7f44b40c16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.134+0000 7f44b9ebe700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b406f620 0x7f44b41e77b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.134+0000 7f44b9ebe700 1 --2- 172.21.15.6:0/1541973249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44b414f9a0 0x7f44b4151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.134+0000 7f44b9ebe700 1 -- 172.21.15.6:0/1541973249 >> 172.21.15.6:0/1541973249 conn(0x7f44b406a480 msgr2=0x7f44b414ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:45.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.134+0000 7f44b9ebe700 1 -- 172.21.15.6:0/1541973249 shutdown_connections 2023-07-21T07:34:45.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.134+0000 7f44b9ebe700 1 -- 172.21.15.6:0/1541973249 wait complete. 2023-07-21T07:34:45.189 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:34:45.198 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T07:34:44.691879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219296,"kb_used_data":3112,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755424,"statfs":{"total":773094113280,"available":772869554176,"internally_reserved":0,"allocated":3186688,"data_stored":1886396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.713040"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988299+0000","last_change":"2023-07-21T07:34:41.013800+0000","last_active":"2023-07-21T07:34:41.988299+0000","last_peered":"2023-07-21T07:34:41.988299+0000","last_clean":"2023-07-21T07:34:41.988299+0000","last_became_active":"2023-07-21T07:34:41.013492+0000","last_became_peered":"2023-07-21T07:34:41.013492+0000","last_unstale":"2023-07-21T07:34:41.988299+0000","last_undegraded":"2023-07-21T07:34:41.988299+0000","last_fullsized":"2023-07-21T07:34:41.988299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:38.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.997405+0000","last_change":"2023-07-21T07:34:40.994156+0000","last_active":"2023-07-21T07:34:40.997405+0000","last_peered":"2023-07-21T07:34:40.997405+0000","last_clean":"2023-07-21T07:34:40.997405+0000","last_became_active":"2023-07-21T07:34:40.993889+0000","last_became_peered":"2023-07-21T07:34:40.993889+0000","last_unstale":"2023-07-21T07:34:40.997405+0000","last_undegraded":"2023-07-21T07:34:40.997405+0000","last_fullsized":"2023-07-21T07:34:40.997405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:10.865023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992392+0000","last_change":"2023-07-21T07:34:41.003522+0000","last_active":"2023-07-21T07:34:41.992392+0000","last_peered":"2023-07-21T07:34:41.992392+0000","last_clean":"2023-07-21T07:34:41.992392+0000","last_became_active":"2023-07-21T07:34:41.003041+0000","last_became_peered":"2023-07-21T07:34:41.003041+0000","last_unstale":"2023-07-21T07:34:41.992392+0000","last_undegraded":"2023-07-21T07:34:41.992392+0000","last_fullsized":"2023-07-21T07:34:41.992392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:49.798268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991796+0000","last_change":"2023-07-21T07:34:41.005174+0000","last_active":"2023-07-21T07:34:41.991796+0000","last_peered":"2023-07-21T07:34:41.991796+0000","last_clean":"2023-07-21T07:34:41.991796+0000","last_became_active":"2023-07-21T07:34:41.004832+0000","last_became_peered":"2023-07-21T07:34:41.004832+0000","last_unstale":"2023-07-21T07:34:41.991796+0000","last_undegraded":"2023-07-21T07:34:41.991796+0000","last_fullsized":"2023-07-21T07:34:41.991796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:58:16.705923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252251+0000","last_change":"2023-07-21T07:34:41.011222+0000","last_active":"2023-07-21T07:34:42.252251+0000","last_peered":"2023-07-21T07:34:42.252251+0000","last_clean":"2023-07-21T07:34:42.252251+0000","last_became_active":"2023-07-21T07:34:41.010950+0000","last_became_peered":"2023-07-21T07:34:41.010950+0000","last_unstale":"2023-07-21T07:34:42.252251+0000","last_undegraded":"2023-07-21T07:34:42.252251+0000","last_fullsized":"2023-07-21T07:34:42.252251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:54:20.793513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992212+0000","last_change":"2023-07-21T07:34:41.004797+0000","last_active":"2023-07-21T07:34:41.992212+0000","last_peered":"2023-07-21T07:34:41.992212+0000","last_clean":"2023-07-21T07:34:41.992212+0000","last_became_active":"2023-07-21T07:34:41.004547+0000","last_became_peered":"2023-07-21T07:34:41.004547+0000","last_unstale":"2023-07-21T07:34:41.992212+0000","last_undegraded":"2023-07-21T07:34:41.992212+0000","last_fullsized":"2023-07-21T07:34:41.992212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017290+0000","last_change":"2023-07-21T07:34:41.010978+0000","last_active":"2023-07-21T07:34:41.017290+0000","last_peered":"2023-07-21T07:34:41.017290+0000","last_clean":"2023-07-21T07:34:41.017290+0000","last_became_active":"2023-07-21T07:34:41.010756+0000","last_became_peered":"2023-07-21T07:34:41.010756+0000","last_unstale":"2023-07-21T07:34:41.017290+0000","last_undegraded":"2023-07-21T07:34:41.017290+0000","last_fullsized":"2023-07-21T07:34:41.017290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:54:20.793513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.998024+0000","last_change":"2023-07-21T07:34:40.995907+0000","last_active":"2023-07-21T07:34:40.998024+0000","last_peered":"2023-07-21T07:34:40.998024+0000","last_clean":"2023-07-21T07:34:40.998024+0000","last_became_active":"2023-07-21T07:34:40.995624+0000","last_became_peered":"2023-07-21T07:34:40.995624+0000","last_unstale":"2023-07-21T07:34:40.998024+0000","last_undegraded":"2023-07-21T07:34:40.998024+0000","last_fullsized":"2023-07-21T07:34:40.998024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:49:24.373411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252562+0000","last_change":"2023-07-21T07:34:41.014976+0000","last_active":"2023-07-21T07:34:42.252562+0000","last_peered":"2023-07-21T07:34:42.252562+0000","last_clean":"2023-07-21T07:34:42.252562+0000","last_became_active":"2023-07-21T07:34:41.014683+0000","last_became_peered":"2023-07-21T07:34:41.014683+0000","last_unstale":"2023-07-21T07:34:42.252562+0000","last_undegraded":"2023-07-21T07:34:42.252562+0000","last_fullsized":"2023-07-21T07:34:42.252562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:53.769501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017261+0000","last_change":"2023-07-21T07:34:41.007114+0000","last_active":"2023-07-21T07:34:41.017261+0000","last_peered":"2023-07-21T07:34:41.017261+0000","last_clean":"2023-07-21T07:34:41.017261+0000","last_became_active":"2023-07-21T07:34:41.006839+0000","last_became_peered":"2023-07-21T07:34:41.006839+0000","last_unstale":"2023-07-21T07:34:41.017261+0000","last_undegraded":"2023-07-21T07:34:41.017261+0000","last_fullsized":"2023-07-21T07:34:41.017261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:05:54.994289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992571+0000","last_change":"2023-07-21T07:34:40.995650+0000","last_active":"2023-07-21T07:34:41.992571+0000","last_peered":"2023-07-21T07:34:41.992571+0000","last_clean":"2023-07-21T07:34:41.992571+0000","last_became_active":"2023-07-21T07:34:40.995387+0000","last_became_peered":"2023-07-21T07:34:40.995387+0000","last_unstale":"2023-07-21T07:34:41.992571+0000","last_undegraded":"2023-07-21T07:34:41.992571+0000","last_fullsized":"2023-07-21T07:34:41.992571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:25.315536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988206+0000","last_change":"2023-07-21T07:34:40.998318+0000","last_active":"2023-07-21T07:34:41.988206+0000","last_peered":"2023-07-21T07:34:41.988206+0000","last_clean":"2023-07-21T07:34:41.988206+0000","last_became_active":"2023-07-21T07:34:40.997993+0000","last_became_peered":"2023-07-21T07:34:40.997993+0000","last_unstale":"2023-07-21T07:34:41.988206+0000","last_undegraded":"2023-07-21T07:34:41.988206+0000","last_fullsized":"2023-07-21T07:34:41.988206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:16.791514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988109+0000","last_change":"2023-07-21T07:34:41.009290+0000","last_active":"2023-07-21T07:34:41.988109+0000","last_peered":"2023-07-21T07:34:41.988109+0000","last_clean":"2023-07-21T07:34:41.988109+0000","last_became_active":"2023-07-21T07:34:41.008979+0000","last_became_peered":"2023-07-21T07:34:41.008979+0000","last_unstale":"2023-07-21T07:34:41.988109+0000","last_undegraded":"2023-07-21T07:34:41.988109+0000","last_fullsized":"2023-07-21T07:34:41.988109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:28:11.312982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.995941+0000","last_change":"2023-07-21T07:34:40.993283+0000","last_active":"2023-07-21T07:34:40.995941+0000","last_peered":"2023-07-21T07:34:40.995941+0000","last_clean":"2023-07-21T07:34:40.995941+0000","last_became_active":"2023-07-21T07:34:40.993023+0000","last_became_peered":"2023-07-21T07:34:40.993023+0000","last_unstale":"2023-07-21T07:34:40.995941+0000","last_undegraded":"2023-07-21T07:34:40.995941+0000","last_fullsized":"2023-07-21T07:34:40.995941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:23:45.330390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.018279+0000","last_change":"2023-07-21T07:34:41.013555+0000","last_active":"2023-07-21T07:34:41.018279+0000","last_peered":"2023-07-21T07:34:41.018279+0000","last_clean":"2023-07-21T07:34:41.018279+0000","last_became_active":"2023-07-21T07:34:41.013237+0000","last_became_peered":"2023-07-21T07:34:41.013237+0000","last_unstale":"2023-07-21T07:34:41.018279+0000","last_undegraded":"2023-07-21T07:34:41.018279+0000","last_fullsized":"2023-07-21T07:34:41.018279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:13.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992133+0000","last_change":"2023-07-21T07:34:41.004335+0000","last_active":"2023-07-21T07:34:41.992133+0000","last_peered":"2023-07-21T07:34:41.992133+0000","last_clean":"2023-07-21T07:34:41.992133+0000","last_became_active":"2023-07-21T07:34:41.004051+0000","last_became_peered":"2023-07-21T07:34:41.004051+0000","last_unstale":"2023-07-21T07:34:41.992133+0000","last_undegraded":"2023-07-21T07:34:41.992133+0000","last_fullsized":"2023-07-21T07:34:41.992133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:13.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252673+0000","last_change":"2023-07-21T07:34:41.015026+0000","last_active":"2023-07-21T07:34:42.252673+0000","last_peered":"2023-07-21T07:34:42.252673+0000","last_clean":"2023-07-21T07:34:42.252673+0000","last_became_active":"2023-07-21T07:34:41.014710+0000","last_became_peered":"2023-07-21T07:34:41.014710+0000","last_unstale":"2023-07-21T07:34:42.252673+0000","last_undegraded":"2023-07-21T07:34:42.252673+0000","last_fullsized":"2023-07-21T07:34:42.252673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:22.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992073+0000","last_change":"2023-07-21T07:34:41.011628+0000","last_active":"2023-07-21T07:34:41.992073+0000","last_peered":"2023-07-21T07:34:41.992073+0000","last_clean":"2023-07-21T07:34:41.992073+0000","last_became_active":"2023-07-21T07:34:41.009074+0000","last_became_peered":"2023-07-21T07:34:41.009074+0000","last_unstale":"2023-07-21T07:34:41.992073+0000","last_undegraded":"2023-07-21T07:34:41.992073+0000","last_fullsized":"2023-07-21T07:34:41.992073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:06.735540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988155+0000","last_change":"2023-07-21T07:34:41.004665+0000","last_active":"2023-07-21T07:34:41.988155+0000","last_peered":"2023-07-21T07:34:41.988155+0000","last_clean":"2023-07-21T07:34:41.988155+0000","last_became_active":"2023-07-21T07:34:41.004361+0000","last_became_peered":"2023-07-21T07:34:41.004361+0000","last_unstale":"2023-07-21T07:34:41.988155+0000","last_undegraded":"2023-07-21T07:34:41.988155+0000","last_fullsized":"2023-07-21T07:34:41.988155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:10:00.672282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992656+0000","last_change":"2023-07-21T07:34:41.001444+0000","last_active":"2023-07-21T07:34:41.992656+0000","last_peered":"2023-07-21T07:34:41.992656+0000","last_clean":"2023-07-21T07:34:41.992656+0000","last_became_active":"2023-07-21T07:34:41.001171+0000","last_became_peered":"2023-07-21T07:34:41.001171+0000","last_unstale":"2023-07-21T07:34:41.992656+0000","last_undegraded":"2023-07-21T07:34:41.992656+0000","last_fullsized":"2023-07-21T07:34:41.992656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:11:14.968095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.018246+0000","last_change":"2023-07-21T07:34:41.013317+0000","last_active":"2023-07-21T07:34:41.018246+0000","last_peered":"2023-07-21T07:34:41.018246+0000","last_clean":"2023-07-21T07:34:41.018246+0000","last_became_active":"2023-07-21T07:34:41.012800+0000","last_became_peered":"2023-07-21T07:34:41.012800+0000","last_unstale":"2023-07-21T07:34:41.018246+0000","last_undegraded":"2023-07-21T07:34:41.018246+0000","last_fullsized":"2023-07-21T07:34:41.018246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:11.308795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252426+0000","last_change":"2023-07-21T07:34:41.002953+0000","last_active":"2023-07-21T07:34:42.252426+0000","last_peered":"2023-07-21T07:34:42.252426+0000","last_clean":"2023-07-21T07:34:42.252426+0000","last_became_active":"2023-07-21T07:34:41.002569+0000","last_became_peered":"2023-07-21T07:34:41.002569+0000","last_unstale":"2023-07-21T07:34:42.252426+0000","last_undegraded":"2023-07-21T07:34:42.252426+0000","last_fullsized":"2023-07-21T07:34:42.252426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:37.840825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177317+0000","last_change":"2023-07-21T07:34:41.007432+0000","last_active":"2023-07-21T07:34:42.177317+0000","last_peered":"2023-07-21T07:34:42.177317+0000","last_clean":"2023-07-21T07:34:42.177317+0000","last_became_active":"2023-07-21T07:34:41.006964+0000","last_became_peered":"2023-07-21T07:34:41.006964+0000","last_unstale":"2023-07-21T07:34:42.177317+0000","last_undegraded":"2023-07-21T07:34:42.177317+0000","last_fullsized":"2023-07-21T07:34:42.177317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:22.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.018208+0000","last_change":"2023-07-21T07:34:41.012722+0000","last_active":"2023-07-21T07:34:41.018208+0000","last_peered":"2023-07-21T07:34:41.018208+0000","last_clean":"2023-07-21T07:34:41.018208+0000","last_became_active":"2023-07-21T07:34:41.012304+0000","last_became_peered":"2023-07-21T07:34:41.012304+0000","last_unstale":"2023-07-21T07:34:41.018208+0000","last_undegraded":"2023-07-21T07:34:41.018208+0000","last_fullsized":"2023-07-21T07:34:41.018208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:37.210979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.005410+0000","last_change":"2023-07-21T07:34:41.000784+0000","last_active":"2023-07-21T07:34:41.005410+0000","last_peered":"2023-07-21T07:34:41.005410+0000","last_clean":"2023-07-21T07:34:41.005410+0000","last_became_active":"2023-07-21T07:34:41.000488+0000","last_became_peered":"2023-07-21T07:34:41.000488+0000","last_unstale":"2023-07-21T07:34:41.005410+0000","last_undegraded":"2023-07-21T07:34:41.005410+0000","last_fullsized":"2023-07-21T07:34:41.005410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:49:24.373411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017280+0000","last_change":"2023-07-21T07:34:41.006271+0000","last_active":"2023-07-21T07:34:41.017280+0000","last_peered":"2023-07-21T07:34:41.017280+0000","last_clean":"2023-07-21T07:34:41.017280+0000","last_became_active":"2023-07-21T07:34:41.005911+0000","last_became_peered":"2023-07-21T07:34:41.005911+0000","last_unstale":"2023-07-21T07:34:41.017280+0000","last_undegraded":"2023-07-21T07:34:41.017280+0000","last_fullsized":"2023-07-21T07:34:41.017280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:23:03.521561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017945+0000","last_change":"2023-07-21T07:34:41.014321+0000","last_active":"2023-07-21T07:34:41.017945+0000","last_peered":"2023-07-21T07:34:41.017945+0000","last_clean":"2023-07-21T07:34:41.017945+0000","last_became_active":"2023-07-21T07:34:41.013913+0000","last_became_peered":"2023-07-21T07:34:41.013913+0000","last_unstale":"2023-07-21T07:34:41.017945+0000","last_undegraded":"2023-07-21T07:34:41.017945+0000","last_fullsized":"2023-07-21T07:34:41.017945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:54:20.793513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992369+0000","last_change":"2023-07-21T07:34:40.006035+0000","last_active":"2023-07-21T07:34:41.992369+0000","last_peered":"2023-07-21T07:34:41.992369+0000","last_clean":"2023-07-21T07:34:41.992369+0000","last_became_active":"2023-07-21T07:34:40.005799+0000","last_became_peered":"2023-07-21T07:34:40.005799+0000","last_unstale":"2023-07-21T07:34:41.992369+0000","last_undegraded":"2023-07-21T07:34:41.992369+0000","last_fullsized":"2023-07-21T07:34:41.992369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:21.178454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177216+0000","last_change":"2023-07-21T07:34:41.007625+0000","last_active":"2023-07-21T07:34:42.177216+0000","last_peered":"2023-07-21T07:34:42.177216+0000","last_clean":"2023-07-21T07:34:42.177216+0000","last_became_active":"2023-07-21T07:34:41.006954+0000","last_became_peered":"2023-07-21T07:34:41.006954+0000","last_unstale":"2023-07-21T07:34:42.177216+0000","last_undegraded":"2023-07-21T07:34:42.177216+0000","last_fullsized":"2023-07-21T07:34:42.177216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:53.769501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.986920+0000","last_change":"2023-07-21T07:34:40.006702+0000","last_active":"2023-07-21T07:34:40.986920+0000","last_peered":"2023-07-21T07:34:40.986920+0000","last_clean":"2023-07-21T07:34:40.986920+0000","last_became_active":"2023-07-21T07:34:40.006334+0000","last_became_peered":"2023-07-21T07:34:40.006334+0000","last_unstale":"2023-07-21T07:34:40.986920+0000","last_undegraded":"2023-07-21T07:34:40.986920+0000","last_fullsized":"2023-07-21T07:34:40.986920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:13:49.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252562+0000","last_change":"2023-07-21T07:34:41.013575+0000","last_active":"2023-07-21T07:34:42.252562+0000","last_peered":"2023-07-21T07:34:42.252562+0000","last_clean":"2023-07-21T07:34:42.252562+0000","last_became_active":"2023-07-21T07:34:41.013276+0000","last_became_peered":"2023-07-21T07:34:41.013276+0000","last_unstale":"2023-07-21T07:34:42.252562+0000","last_undegraded":"2023-07-21T07:34:42.252562+0000","last_fullsized":"2023-07-21T07:34:42.252562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177314+0000","last_change":"2023-07-21T07:34:40.004005+0000","last_active":"2023-07-21T07:34:42.177314+0000","last_peered":"2023-07-21T07:34:42.177314+0000","last_clean":"2023-07-21T07:34:42.177314+0000","last_became_active":"2023-07-21T07:34:40.003505+0000","last_became_peered":"2023-07-21T07:34:40.003505+0000","last_unstale":"2023-07-21T07:34:42.177314+0000","last_undegraded":"2023-07-21T07:34:42.177314+0000","last_fullsized":"2023-07-21T07:34:42.177314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:48.791489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992924+0000","last_change":"2023-07-21T07:34:41.004220+0000","last_active":"2023-07-21T07:34:41.992924+0000","last_peered":"2023-07-21T07:34:41.992924+0000","last_clean":"2023-07-21T07:34:41.992924+0000","last_became_active":"2023-07-21T07:34:41.003943+0000","last_became_peered":"2023-07-21T07:34:41.003943+0000","last_unstale":"2023-07-21T07:34:41.992924+0000","last_undegraded":"2023-07-21T07:34:41.992924+0000","last_fullsized":"2023-07-21T07:34:41.992924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:49:24.373411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252659+0000","last_change":"2023-07-21T07:34:40.000884+0000","last_active":"2023-07-21T07:34:42.252659+0000","last_peered":"2023-07-21T07:34:42.252659+0000","last_clean":"2023-07-21T07:34:42.252659+0000","last_became_active":"2023-07-21T07:34:40.000548+0000","last_became_peered":"2023-07-21T07:34:40.000548+0000","last_unstale":"2023-07-21T07:34:42.252659+0000","last_undegraded":"2023-07-21T07:34:42.252659+0000","last_fullsized":"2023-07-21T07:34:42.252659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:41.600204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177198+0000","last_change":"2023-07-21T07:34:41.008668+0000","last_active":"2023-07-21T07:34:42.177198+0000","last_peered":"2023-07-21T07:34:42.177198+0000","last_clean":"2023-07-21T07:34:42.177198+0000","last_became_active":"2023-07-21T07:34:41.008309+0000","last_became_peered":"2023-07-21T07:34:41.008309+0000","last_unstale":"2023-07-21T07:34:42.177198+0000","last_undegraded":"2023-07-21T07:34:42.177198+0000","last_fullsized":"2023-07-21T07:34:42.177198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.991359+0000","last_change":"2023-07-21T07:34:40.000039+0000","last_active":"2023-07-21T07:34:40.991359+0000","last_peered":"2023-07-21T07:34:40.991359+0000","last_clean":"2023-07-21T07:34:40.991359+0000","last_became_active":"2023-07-21T07:34:39.999675+0000","last_became_peered":"2023-07-21T07:34:39.999675+0000","last_unstale":"2023-07-21T07:34:40.991359+0000","last_undegraded":"2023-07-21T07:34:40.991359+0000","last_fullsized":"2023-07-21T07:34:40.991359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:05.728761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177225+0000","last_change":"2023-07-21T07:34:41.015126+0000","last_active":"2023-07-21T07:34:42.177225+0000","last_peered":"2023-07-21T07:34:42.177225+0000","last_clean":"2023-07-21T07:34:42.177225+0000","last_became_active":"2023-07-21T07:34:41.014280+0000","last_became_peered":"2023-07-21T07:34:41.014280+0000","last_unstale":"2023-07-21T07:34:42.177225+0000","last_undegraded":"2023-07-21T07:34:42.177225+0000","last_fullsized":"2023-07-21T07:34:42.177225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:06.140274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017314+0000","last_change":"2023-07-21T07:34:40.006892+0000","last_active":"2023-07-21T07:34:41.017314+0000","last_peered":"2023-07-21T07:34:41.017314+0000","last_clean":"2023-07-21T07:34:41.017314+0000","last_became_active":"2023-07-21T07:34:40.006547+0000","last_became_peered":"2023-07-21T07:34:40.006547+0000","last_unstale":"2023-07-21T07:34:41.017314+0000","last_undegraded":"2023-07-21T07:34:41.017314+0000","last_fullsized":"2023-07-21T07:34:41.017314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:44.605221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.016721+0000","last_change":"2023-07-21T07:34:41.005138+0000","last_active":"2023-07-21T07:34:41.016721+0000","last_peered":"2023-07-21T07:34:41.016721+0000","last_clean":"2023-07-21T07:34:41.016721+0000","last_became_active":"2023-07-21T07:34:41.004836+0000","last_became_peered":"2023-07-21T07:34:41.004836+0000","last_unstale":"2023-07-21T07:34:41.016721+0000","last_undegraded":"2023-07-21T07:34:41.016721+0000","last_fullsized":"2023-07-21T07:34:41.016721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:28:11.312982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992847+0000","last_change":"2023-07-21T07:34:40.001177+0000","last_active":"2023-07-21T07:34:41.992847+0000","last_peered":"2023-07-21T07:34:41.992847+0000","last_clean":"2023-07-21T07:34:41.992847+0000","last_became_active":"2023-07-21T07:34:40.000899+0000","last_became_peered":"2023-07-21T07:34:40.000899+0000","last_unstale":"2023-07-21T07:34:41.992847+0000","last_undegraded":"2023-07-21T07:34:41.992847+0000","last_fullsized":"2023-07-21T07:34:41.992847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:47:27.200017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992726+0000","last_change":"2023-07-21T07:34:41.003585+0000","last_active":"2023-07-21T07:34:41.992726+0000","last_peered":"2023-07-21T07:34:41.992726+0000","last_clean":"2023-07-21T07:34:41.992726+0000","last_became_active":"2023-07-21T07:34:41.003302+0000","last_became_peered":"2023-07-21T07:34:41.003302+0000","last_unstale":"2023-07-21T07:34:41.992726+0000","last_undegraded":"2023-07-21T07:34:41.992726+0000","last_fullsized":"2023-07-21T07:34:41.992726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:12:07.511312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.016078+0000","last_change":"2023-07-21T07:34:40.003432+0000","last_active":"2023-07-21T07:34:41.016078+0000","last_peered":"2023-07-21T07:34:41.016078+0000","last_clean":"2023-07-21T07:34:41.016078+0000","last_became_active":"2023-07-21T07:34:40.003161+0000","last_became_peered":"2023-07-21T07:34:40.003161+0000","last_unstale":"2023-07-21T07:34:41.016078+0000","last_undegraded":"2023-07-21T07:34:41.016078+0000","last_fullsized":"2023-07-21T07:34:41.016078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:05:53.987510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177120+0000","last_change":"2023-07-21T07:34:41.009600+0000","last_active":"2023-07-21T07:34:42.177120+0000","last_peered":"2023-07-21T07:34:42.177120+0000","last_clean":"2023-07-21T07:34:42.177120+0000","last_became_active":"2023-07-21T07:34:41.008310+0000","last_became_peered":"2023-07-21T07:34:41.008310+0000","last_unstale":"2023-07-21T07:34:42.177120+0000","last_undegraded":"2023-07-21T07:34:42.177120+0000","last_fullsized":"2023-07-21T07:34:42.177120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:06.735540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252286+0000","last_change":"2023-07-21T07:34:40.002086+0000","last_active":"2023-07-21T07:34:42.252286+0000","last_peered":"2023-07-21T07:34:42.252286+0000","last_clean":"2023-07-21T07:34:42.252286+0000","last_became_active":"2023-07-21T07:34:40.001728+0000","last_became_peered":"2023-07-21T07:34:40.001728+0000","last_unstale":"2023-07-21T07:34:42.252286+0000","last_undegraded":"2023-07-21T07:34:42.252286+0000","last_fullsized":"2023-07-21T07:34:42.252286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:10.302016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017925+0000","last_change":"2023-07-21T07:34:41.014135+0000","last_active":"2023-07-21T07:34:41.017925+0000","last_peered":"2023-07-21T07:34:41.017925+0000","last_clean":"2023-07-21T07:34:41.017925+0000","last_became_active":"2023-07-21T07:34:41.013571+0000","last_became_peered":"2023-07-21T07:34:41.013571+0000","last_unstale":"2023-07-21T07:34:41.017925+0000","last_undegraded":"2023-07-21T07:34:41.017925+0000","last_fullsized":"2023-07-21T07:34:41.017925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:58:16.705923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.995139+0000","last_change":"2023-07-21T07:34:40.005154+0000","last_active":"2023-07-21T07:34:40.995139+0000","last_peered":"2023-07-21T07:34:40.995139+0000","last_clean":"2023-07-21T07:34:40.995139+0000","last_became_active":"2023-07-21T07:34:40.004855+0000","last_became_peered":"2023-07-21T07:34:40.004855+0000","last_unstale":"2023-07-21T07:34:40.995139+0000","last_undegraded":"2023-07-21T07:34:40.995139+0000","last_fullsized":"2023-07-21T07:34:40.995139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:09.858244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252521+0000","last_change":"2023-07-21T07:34:41.010402+0000","last_active":"2023-07-21T07:34:42.252521+0000","last_peered":"2023-07-21T07:34:42.252521+0000","last_clean":"2023-07-21T07:34:42.252521+0000","last_became_active":"2023-07-21T07:34:41.010083+0000","last_became_peered":"2023-07-21T07:34:41.010083+0000","last_unstale":"2023-07-21T07:34:42.252521+0000","last_undegraded":"2023-07-21T07:34:42.252521+0000","last_fullsized":"2023-07-21T07:34:42.252521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:13.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991555+0000","last_change":"2023-07-21T07:34:40.001486+0000","last_active":"2023-07-21T07:34:41.991555+0000","last_peered":"2023-07-21T07:34:41.991555+0000","last_clean":"2023-07-21T07:34:41.991555+0000","last_became_active":"2023-07-21T07:34:40.001171+0000","last_became_peered":"2023-07-21T07:34:40.001171+0000","last_unstale":"2023-07-21T07:34:41.991555+0000","last_undegraded":"2023-07-21T07:34:41.991555+0000","last_fullsized":"2023-07-21T07:34:41.991555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:15.784735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177469+0000","last_change":"2023-07-21T07:34:41.015334+0000","last_active":"2023-07-21T07:34:42.177469+0000","last_peered":"2023-07-21T07:34:42.177469+0000","last_clean":"2023-07-21T07:34:42.177469+0000","last_became_active":"2023-07-21T07:34:41.014579+0000","last_became_peered":"2023-07-21T07:34:41.014579+0000","last_unstale":"2023-07-21T07:34:42.177469+0000","last_undegraded":"2023-07-21T07:34:42.177469+0000","last_fullsized":"2023-07-21T07:34:42.177469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:36.154510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.015826+0000","last_change":"2023-07-21T07:34:40.002994+0000","last_active":"2023-07-21T07:34:41.015826+0000","last_peered":"2023-07-21T07:34:41.015826+0000","last_clean":"2023-07-21T07:34:41.015826+0000","last_became_active":"2023-07-21T07:34:40.002626+0000","last_became_peered":"2023-07-21T07:34:40.002626+0000","last_unstale":"2023-07-21T07:34:41.015826+0000","last_undegraded":"2023-07-21T07:34:41.015826+0000","last_fullsized":"2023-07-21T07:34:41.015826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:21.178454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017431+0000","last_change":"2023-07-21T07:34:41.011397+0000","last_active":"2023-07-21T07:34:41.017431+0000","last_peered":"2023-07-21T07:34:41.017431+0000","last_clean":"2023-07-21T07:34:41.017431+0000","last_became_active":"2023-07-21T07:34:41.011074+0000","last_became_peered":"2023-07-21T07:34:41.011074+0000","last_unstale":"2023-07-21T07:34:41.017431+0000","last_undegraded":"2023-07-21T07:34:41.017431+0000","last_fullsized":"2023-07-21T07:34:41.017431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:23:03.521561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.016680+0000","last_change":"2023-07-21T07:34:40.002951+0000","last_active":"2023-07-21T07:34:41.016680+0000","last_peered":"2023-07-21T07:34:41.016680+0000","last_clean":"2023-07-21T07:34:41.016680+0000","last_became_active":"2023-07-21T07:34:40.002644+0000","last_became_peered":"2023-07-21T07:34:40.002644+0000","last_unstale":"2023-07-21T07:34:41.016680+0000","last_undegraded":"2023-07-21T07:34:41.016680+0000","last_fullsized":"2023-07-21T07:34:41.016680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:05.133495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991994+0000","last_change":"2023-07-21T07:34:40.999968+0000","last_active":"2023-07-21T07:34:41.991994+0000","last_peered":"2023-07-21T07:34:41.991994+0000","last_clean":"2023-07-21T07:34:41.991994+0000","last_became_active":"2023-07-21T07:34:40.999426+0000","last_became_peered":"2023-07-21T07:34:40.999426+0000","last_unstale":"2023-07-21T07:34:41.991994+0000","last_undegraded":"2023-07-21T07:34:41.991994+0000","last_fullsized":"2023-07-21T07:34:41.991994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:37.840825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017740+0000","last_change":"2023-07-21T07:34:40.001121+0000","last_active":"2023-07-21T07:34:41.017740+0000","last_peered":"2023-07-21T07:34:41.017740+0000","last_clean":"2023-07-21T07:34:41.017740+0000","last_became_active":"2023-07-21T07:34:40.000781+0000","last_became_peered":"2023-07-21T07:34:40.000781+0000","last_unstale":"2023-07-21T07:34:41.017740+0000","last_undegraded":"2023-07-21T07:34:41.017740+0000","last_fullsized":"2023-07-21T07:34:41.017740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:41.600204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992005+0000","last_change":"2023-07-21T07:34:41.005148+0000","last_active":"2023-07-21T07:34:41.992005+0000","last_peered":"2023-07-21T07:34:41.992005+0000","last_clean":"2023-07-21T07:34:41.992005+0000","last_became_active":"2023-07-21T07:34:41.004857+0000","last_became_peered":"2023-07-21T07:34:41.004857+0000","last_unstale":"2023-07-21T07:34:41.992005+0000","last_undegraded":"2023-07-21T07:34:41.992005+0000","last_fullsized":"2023-07-21T07:34:41.992005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:23:03.521561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.988850+0000","last_change":"2023-07-21T07:34:40.001134+0000","last_active":"2023-07-21T07:34:40.988850+0000","last_peered":"2023-07-21T07:34:40.988850+0000","last_clean":"2023-07-21T07:34:40.988850+0000","last_became_active":"2023-07-21T07:34:40.000862+0000","last_became_peered":"2023-07-21T07:34:40.000862+0000","last_unstale":"2023-07-21T07:34:40.988850+0000","last_undegraded":"2023-07-21T07:34:40.988850+0000","last_fullsized":"2023-07-21T07:34:40.988850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:19:38.757728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252524+0000","last_change":"2023-07-21T07:34:41.004129+0000","last_active":"2023-07-21T07:34:42.252524+0000","last_peered":"2023-07-21T07:34:42.252524+0000","last_clean":"2023-07-21T07:34:42.252524+0000","last_became_active":"2023-07-21T07:34:41.003528+0000","last_became_peered":"2023-07-21T07:34:41.003528+0000","last_unstale":"2023-07-21T07:34:42.252524+0000","last_undegraded":"2023-07-21T07:34:42.252524+0000","last_fullsized":"2023-07-21T07:34:42.252524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:37.210979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177185+0000","last_change":"2023-07-21T07:34:40.001941+0000","last_active":"2023-07-21T07:34:42.177185+0000","last_peered":"2023-07-21T07:34:42.177185+0000","last_clean":"2023-07-21T07:34:42.177185+0000","last_became_active":"2023-07-21T07:34:40.001558+0000","last_became_peered":"2023-07-21T07:34:40.001558+0000","last_unstale":"2023-07-21T07:34:42.177185+0000","last_undegraded":"2023-07-21T07:34:42.177185+0000","last_fullsized":"2023-07-21T07:34:42.177185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:36.204200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992762+0000","last_change":"2023-07-21T07:34:41.013224+0000","last_active":"2023-07-21T07:34:41.992762+0000","last_peered":"2023-07-21T07:34:41.992762+0000","last_clean":"2023-07-21T07:34:41.992762+0000","last_became_active":"2023-07-21T07:34:41.012940+0000","last_became_peered":"2023-07-21T07:34:41.012940+0000","last_unstale":"2023-07-21T07:34:41.992762+0000","last_undegraded":"2023-07-21T07:34:41.992762+0000","last_fullsized":"2023-07-21T07:34:41.992762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:04:46.304259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991852+0000","last_change":"2023-07-21T07:34:39.998058+0000","last_active":"2023-07-21T07:34:41.991852+0000","last_peered":"2023-07-21T07:34:41.991852+0000","last_clean":"2023-07-21T07:34:41.991852+0000","last_became_active":"2023-07-21T07:34:39.997803+0000","last_became_peered":"2023-07-21T07:34:39.997803+0000","last_unstale":"2023-07-21T07:34:41.991852+0000","last_undegraded":"2023-07-21T07:34:41.991852+0000","last_fullsized":"2023-07-21T07:34:41.991852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:13:39.091695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992732+0000","last_change":"2023-07-21T07:34:41.009229+0000","last_active":"2023-07-21T07:34:41.992732+0000","last_peered":"2023-07-21T07:34:41.992732+0000","last_clean":"2023-07-21T07:34:41.992732+0000","last_became_active":"2023-07-21T07:34:41.004241+0000","last_became_peered":"2023-07-21T07:34:41.004241+0000","last_unstale":"2023-07-21T07:34:41.992732+0000","last_undegraded":"2023-07-21T07:34:41.992732+0000","last_fullsized":"2023-07-21T07:34:41.992732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:01:35.460233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992269+0000","last_change":"2023-07-21T07:34:39.997085+0000","last_active":"2023-07-21T07:34:41.992269+0000","last_peered":"2023-07-21T07:34:41.992269+0000","last_clean":"2023-07-21T07:34:41.992269+0000","last_became_active":"2023-07-21T07:34:39.996276+0000","last_became_peered":"2023-07-21T07:34:39.996276+0000","last_unstale":"2023-07-21T07:34:41.992269+0000","last_undegraded":"2023-07-21T07:34:41.992269+0000","last_fullsized":"2023-07-21T07:34:41.992269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:52.762722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992364+0000","last_change":"2023-07-21T07:34:41.008766+0000","last_active":"2023-07-21T07:34:41.992364+0000","last_peered":"2023-07-21T07:34:41.992364+0000","last_clean":"2023-07-21T07:34:41.992364+0000","last_became_active":"2023-07-21T07:34:41.005525+0000","last_became_peered":"2023-07-21T07:34:41.005525+0000","last_unstale":"2023-07-21T07:34:41.992364+0000","last_undegraded":"2023-07-21T07:34:41.992364+0000","last_fullsized":"2023-07-21T07:34:41.992364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:42.606983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177142+0000","last_change":"2023-07-21T07:34:40.000981+0000","last_active":"2023-07-21T07:34:42.177142+0000","last_peered":"2023-07-21T07:34:42.177142+0000","last_clean":"2023-07-21T07:34:42.177142+0000","last_became_active":"2023-07-21T07:34:40.000659+0000","last_became_peered":"2023-07-21T07:34:40.000659+0000","last_unstale":"2023-07-21T07:34:42.177142+0000","last_undegraded":"2023-07-21T07:34:42.177142+0000","last_fullsized":"2023-07-21T07:34:42.177142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:12.395122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.018763+0000","last_change":"2023-07-21T07:34:41.014435+0000","last_active":"2023-07-21T07:34:41.018763+0000","last_peered":"2023-07-21T07:34:41.018763+0000","last_clean":"2023-07-21T07:34:41.018763+0000","last_became_active":"2023-07-21T07:34:41.014124+0000","last_became_peered":"2023-07-21T07:34:41.014124+0000","last_unstale":"2023-07-21T07:34:41.018763+0000","last_undegraded":"2023-07-21T07:34:41.018763+0000","last_fullsized":"2023-07-21T07:34:41.018763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:05:54.994289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.987180+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:34:40.987180+0000","last_peered":"2023-07-21T07:34:40.987180+0000","last_clean":"2023-07-21T07:34:40.987180+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:34:40.987180+0000","last_undegraded":"2023-07-21T07:34:40.987180+0000","last_fullsized":"2023-07-21T07:34:40.987180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:10.652598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.991707+0000","last_change":"2023-07-21T07:34:40.002419+0000","last_active":"2023-07-21T07:34:40.991707+0000","last_peered":"2023-07-21T07:34:40.991707+0000","last_clean":"2023-07-21T07:34:40.991707+0000","last_became_active":"2023-07-21T07:34:40.001968+0000","last_became_peered":"2023-07-21T07:34:40.001968+0000","last_unstale":"2023-07-21T07:34:40.991707+0000","last_undegraded":"2023-07-21T07:34:40.991707+0000","last_fullsized":"2023-07-21T07:34:40.991707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:12.395122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.999783+0000","last_change":"2023-07-21T07:34:40.993474+0000","last_active":"2023-07-21T07:34:40.999783+0000","last_peered":"2023-07-21T07:34:40.999783+0000","last_clean":"2023-07-21T07:34:40.999783+0000","last_became_active":"2023-07-21T07:34:40.993127+0000","last_became_peered":"2023-07-21T07:34:40.993127+0000","last_unstale":"2023-07-21T07:34:40.999783+0000","last_undegraded":"2023-07-21T07:34:40.999783+0000","last_fullsized":"2023-07-21T07:34:40.999783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:38.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.989541+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:34:40.989541+0000","last_peered":"2023-07-21T07:34:40.989541+0000","last_clean":"2023-07-21T07:34:40.989541+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:34:40.989541+0000","last_undegraded":"2023-07-21T07:34:40.989541+0000","last_fullsized":"2023-07-21T07:34:40.989541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:05.169880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992570+0000","last_change":"2023-07-21T07:34:40.002541+0000","last_active":"2023-07-21T07:34:41.992570+0000","last_peered":"2023-07-21T07:34:41.992570+0000","last_clean":"2023-07-21T07:34:41.992570+0000","last_became_active":"2023-07-21T07:34:40.002244+0000","last_became_peered":"2023-07-21T07:34:40.002244+0000","last_unstale":"2023-07-21T07:34:41.992570+0000","last_undegraded":"2023-07-21T07:34:41.992570+0000","last_fullsized":"2023-07-21T07:34:41.992570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:35.147731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.999817+0000","last_change":"2023-07-21T07:34:40.993583+0000","last_active":"2023-07-21T07:34:40.999817+0000","last_peered":"2023-07-21T07:34:40.999817+0000","last_clean":"2023-07-21T07:34:40.999817+0000","last_became_active":"2023-07-21T07:34:40.992984+0000","last_became_peered":"2023-07-21T07:34:40.992984+0000","last_unstale":"2023-07-21T07:34:40.999817+0000","last_undegraded":"2023-07-21T07:34:40.999817+0000","last_fullsized":"2023-07-21T07:34:40.999817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:58:16.705923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.987877+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:34:41.987877+0000","last_peered":"2023-07-21T07:34:41.987877+0000","last_clean":"2023-07-21T07:34:41.987877+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:34:41.987877+0000","last_undegraded":"2023-07-21T07:34:41.987877+0000","last_fullsized":"2023-07-21T07:34:41.987877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:52:05.194684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.986864+0000","last_change":"2023-07-21T07:34:40.002203+0000","last_active":"2023-07-21T07:34:40.986864+0000","last_peered":"2023-07-21T07:34:40.986864+0000","last_clean":"2023-07-21T07:34:40.986864+0000","last_became_active":"2023-07-21T07:34:40.001222+0000","last_became_peered":"2023-07-21T07:34:40.001222+0000","last_unstale":"2023-07-21T07:34:40.986864+0000","last_undegraded":"2023-07-21T07:34:40.986864+0000","last_fullsized":"2023-07-21T07:34:40.986864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:52:10.326821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.001970+0000","last_change":"2023-07-21T07:34:40.994556+0000","last_active":"2023-07-21T07:34:41.001970+0000","last_peered":"2023-07-21T07:34:41.001970+0000","last_clean":"2023-07-21T07:34:41.001970+0000","last_became_active":"2023-07-21T07:34:40.994093+0000","last_became_peered":"2023-07-21T07:34:40.994093+0000","last_unstale":"2023-07-21T07:34:41.001970+0000","last_undegraded":"2023-07-21T07:34:41.001970+0000","last_fullsized":"2023-07-21T07:34:41.001970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:23:45.330390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.988544+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:34:40.988544+0000","last_peered":"2023-07-21T07:34:40.988544+0000","last_clean":"2023-07-21T07:34:40.988544+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:34:40.988544+0000","last_undegraded":"2023-07-21T07:34:40.988544+0000","last_fullsized":"2023-07-21T07:34:40.988544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:32.591696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.995517+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:34:40.995517+0000","last_peered":"2023-07-21T07:34:40.995517+0000","last_clean":"2023-07-21T07:34:40.995517+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:34:40.995517+0000","last_undegraded":"2023-07-21T07:34:40.995517+0000","last_fullsized":"2023-07-21T07:34:40.995517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:26.663006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.176949+0000","last_change":"2023-07-21T07:34:39.999821+0000","last_active":"2023-07-21T07:34:42.176949+0000","last_peered":"2023-07-21T07:34:42.176949+0000","last_clean":"2023-07-21T07:34:42.176949+0000","last_became_active":"2023-07-21T07:34:39.999465+0000","last_became_peered":"2023-07-21T07:34:39.999465+0000","last_unstale":"2023-07-21T07:34:42.176949+0000","last_undegraded":"2023-07-21T07:34:42.176949+0000","last_fullsized":"2023-07-21T07:34:42.176949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:09.858244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992699+0000","last_change":"2023-07-21T07:34:41.002207+0000","last_active":"2023-07-21T07:34:41.992699+0000","last_peered":"2023-07-21T07:34:41.992699+0000","last_clean":"2023-07-21T07:34:41.992699+0000","last_became_active":"2023-07-21T07:34:41.001868+0000","last_became_peered":"2023-07-21T07:34:41.001868+0000","last_unstale":"2023-07-21T07:34:41.992699+0000","last_undegraded":"2023-07-21T07:34:41.992699+0000","last_fullsized":"2023-07-21T07:34:41.992699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:23:45.330390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.995653+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:34:40.995653+0000","last_peered":"2023-07-21T07:34:40.995653+0000","last_clean":"2023-07-21T07:34:40.995653+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:34:40.995653+0000","last_undegraded":"2023-07-21T07:34:40.995653+0000","last_fullsized":"2023-07-21T07:34:40.995653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:00.596624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252218+0000","last_change":"2023-07-21T07:34:40.001692+0000","last_active":"2023-07-21T07:34:42.252218+0000","last_peered":"2023-07-21T07:34:42.252218+0000","last_clean":"2023-07-21T07:34:42.252218+0000","last_became_active":"2023-07-21T07:34:40.001345+0000","last_became_peered":"2023-07-21T07:34:40.001345+0000","last_unstale":"2023-07-21T07:34:42.252218+0000","last_undegraded":"2023-07-21T07:34:42.252218+0000","last_fullsized":"2023-07-21T07:34:42.252218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:05:53.987510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252678+0000","last_change":"2023-07-21T07:34:41.005653+0000","last_active":"2023-07-21T07:34:42.252678+0000","last_peered":"2023-07-21T07:34:42.252678+0000","last_clean":"2023-07-21T07:34:42.252678+0000","last_became_active":"2023-07-21T07:34:41.005291+0000","last_became_peered":"2023-07-21T07:34:41.005291+0000","last_unstale":"2023-07-21T07:34:42.252678+0000","last_undegraded":"2023-07-21T07:34:42.252678+0000","last_fullsized":"2023-07-21T07:34:42.252678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:49.798268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.001233+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:34:41.001233+0000","last_peered":"2023-07-21T07:34:41.001233+0000","last_clean":"2023-07-21T07:34:41.001233+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:34:41.001233+0000","last_undegraded":"2023-07-21T07:34:41.001233+0000","last_fullsized":"2023-07-21T07:34:41.001233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:47.630585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.988821+0000","last_change":"2023-07-21T07:34:40.005160+0000","last_active":"2023-07-21T07:34:40.988821+0000","last_peered":"2023-07-21T07:34:40.988821+0000","last_clean":"2023-07-21T07:34:40.988821+0000","last_became_active":"2023-07-21T07:34:40.004876+0000","last_became_peered":"2023-07-21T07:34:40.004876+0000","last_unstale":"2023-07-21T07:34:40.988821+0000","last_undegraded":"2023-07-21T07:34:40.988821+0000","last_fullsized":"2023-07-21T07:34:40.988821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:13:39.091695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252272+0000","last_change":"2023-07-21T07:34:41.004325+0000","last_active":"2023-07-21T07:34:42.252272+0000","last_peered":"2023-07-21T07:34:42.252272+0000","last_clean":"2023-07-21T07:34:42.252272+0000","last_became_active":"2023-07-21T07:34:41.003810+0000","last_became_peered":"2023-07-21T07:34:41.003810+0000","last_unstale":"2023-07-21T07:34:42.252272+0000","last_undegraded":"2023-07-21T07:34:42.252272+0000","last_fullsized":"2023-07-21T07:34:42.252272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:10.865023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177420+0000","last_change":"2023-07-21T07:34:40.003127+0000","last_active":"2023-07-21T07:34:42.177420+0000","last_peered":"2023-07-21T07:34:42.177420+0000","last_clean":"2023-07-21T07:34:42.177420+0000","last_became_active":"2023-07-21T07:34:40.002749+0000","last_became_peered":"2023-07-21T07:34:40.002749+0000","last_unstale":"2023-07-21T07:34:42.177420+0000","last_undegraded":"2023-07-21T07:34:42.177420+0000","last_fullsized":"2023-07-21T07:34:42.177420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:51.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.987843+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:34:40.987843+0000","last_peered":"2023-07-21T07:34:40.987843+0000","last_clean":"2023-07-21T07:34:40.987843+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:34:40.987843+0000","last_undegraded":"2023-07-21T07:34:40.987843+0000","last_fullsized":"2023-07-21T07:34:40.987843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:19:33.625591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177019+0000","last_change":"2023-07-21T07:34:41.013799+0000","last_active":"2023-07-21T07:34:42.177019+0000","last_peered":"2023-07-21T07:34:42.177019+0000","last_clean":"2023-07-21T07:34:42.177019+0000","last_became_active":"2023-07-21T07:34:41.013507+0000","last_became_peered":"2023-07-21T07:34:41.013507+0000","last_unstale":"2023-07-21T07:34:42.177019+0000","last_undegraded":"2023-07-21T07:34:42.177019+0000","last_fullsized":"2023-07-21T07:34:42.177019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:37.840825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992790+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:34:41.992790+0000","last_peered":"2023-07-21T07:34:41.992790+0000","last_clean":"2023-07-21T07:34:41.992790+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:34:41.992790+0000","last_undegraded":"2023-07-21T07:34:41.992790+0000","last_fullsized":"2023-07-21T07:34:41.992790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:19:33.625591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252628+0000","last_change":"2023-07-21T07:34:40.008949+0000","last_active":"2023-07-21T07:34:42.252628+0000","last_peered":"2023-07-21T07:34:42.252628+0000","last_clean":"2023-07-21T07:34:42.252628+0000","last_became_active":"2023-07-21T07:34:40.008673+0000","last_became_peered":"2023-07-21T07:34:40.008673+0000","last_unstale":"2023-07-21T07:34:42.252628+0000","last_undegraded":"2023-07-21T07:34:42.252628+0000","last_fullsized":"2023-07-21T07:34:42.252628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:05.133495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992135+0000","last_change":"2023-07-21T07:34:41.000146+0000","last_active":"2023-07-21T07:34:41.992135+0000","last_peered":"2023-07-21T07:34:41.992135+0000","last_clean":"2023-07-21T07:34:41.992135+0000","last_became_active":"2023-07-21T07:34:40.999714+0000","last_became_peered":"2023-07-21T07:34:40.999714+0000","last_unstale":"2023-07-21T07:34:41.992135+0000","last_undegraded":"2023-07-21T07:34:41.992135+0000","last_fullsized":"2023-07-21T07:34:41.992135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:37.210979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252474+0000","last_change":"2023-07-21T07:34:40.008365+0000","last_active":"2023-07-21T07:34:42.252474+0000","last_peered":"2023-07-21T07:34:42.252474+0000","last_clean":"2023-07-21T07:34:42.252474+0000","last_became_active":"2023-07-21T07:34:40.007918+0000","last_became_peered":"2023-07-21T07:34:40.007918+0000","last_unstale":"2023-07-21T07:34:42.252474+0000","last_undegraded":"2023-07-21T07:34:42.252474+0000","last_fullsized":"2023-07-21T07:34:42.252474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:05.728761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988078+0000","last_change":"2023-07-21T07:34:41.004151+0000","last_active":"2023-07-21T07:34:41.988078+0000","last_peered":"2023-07-21T07:34:41.988078+0000","last_clean":"2023-07-21T07:34:41.988078+0000","last_became_active":"2023-07-21T07:34:41.003809+0000","last_became_peered":"2023-07-21T07:34:41.003809+0000","last_unstale":"2023-07-21T07:34:41.988078+0000","last_undegraded":"2023-07-21T07:34:41.988078+0000","last_fullsized":"2023-07-21T07:34:41.988078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:13:50.121515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.015517+0000","last_change":"2023-07-21T07:34:39.999418+0000","last_active":"2023-07-21T07:34:41.015517+0000","last_peered":"2023-07-21T07:34:41.015517+0000","last_clean":"2023-07-21T07:34:41.015517+0000","last_became_active":"2023-07-21T07:34:39.999189+0000","last_became_peered":"2023-07-21T07:34:39.999189+0000","last_unstale":"2023-07-21T07:34:41.015517+0000","last_undegraded":"2023-07-21T07:34:41.015517+0000","last_fullsized":"2023-07-21T07:34:41.015517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:13:39.091695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992547+0000","last_change":"2023-07-21T07:34:41.012402+0000","last_active":"2023-07-21T07:34:41.992547+0000","last_peered":"2023-07-21T07:34:41.992547+0000","last_clean":"2023-07-21T07:34:41.992547+0000","last_became_active":"2023-07-21T07:34:41.012138+0000","last_became_peered":"2023-07-21T07:34:41.012138+0000","last_unstale":"2023-07-21T07:34:41.992547+0000","last_undegraded":"2023-07-21T07:34:41.992547+0000","last_fullsized":"2023-07-21T07:34:41.992547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:22.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.015355+0000","last_change":"2023-07-21T07:34:39.999316+0000","last_active":"2023-07-21T07:34:41.015355+0000","last_peered":"2023-07-21T07:34:41.015355+0000","last_clean":"2023-07-21T07:34:41.015355+0000","last_became_active":"2023-07-21T07:34:39.999072+0000","last_became_peered":"2023-07-21T07:34:39.999072+0000","last_unstale":"2023-07-21T07:34:41.015355+0000","last_undegraded":"2023-07-21T07:34:41.015355+0000","last_fullsized":"2023-07-21T07:34:41.015355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:36.834046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992553+0000","last_change":"2023-07-21T07:34:41.012360+0000","last_active":"2023-07-21T07:34:41.992553+0000","last_peered":"2023-07-21T07:34:41.992553+0000","last_clean":"2023-07-21T07:34:41.992553+0000","last_became_active":"2023-07-21T07:34:41.011969+0000","last_became_peered":"2023-07-21T07:34:41.011969+0000","last_unstale":"2023-07-21T07:34:41.992553+0000","last_undegraded":"2023-07-21T07:34:41.992553+0000","last_fullsized":"2023-07-21T07:34:41.992553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:52.703957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177280+0000","last_change":"2023-07-21T07:34:40.000613+0000","last_active":"2023-07-21T07:34:42.177280+0000","last_peered":"2023-07-21T07:34:42.177280+0000","last_clean":"2023-07-21T07:34:42.177280+0000","last_became_active":"2023-07-21T07:34:40.000306+0000","last_became_peered":"2023-07-21T07:34:40.000306+0000","last_unstale":"2023-07-21T07:34:42.177280+0000","last_undegraded":"2023-07-21T07:34:42.177280+0000","last_fullsized":"2023-07-21T07:34:42.177280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:41.600204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.176982+0000","last_change":"2023-07-21T07:34:41.011382+0000","last_active":"2023-07-21T07:34:42.176982+0000","last_peered":"2023-07-21T07:34:42.176982+0000","last_clean":"2023-07-21T07:34:42.176982+0000","last_became_active":"2023-07-21T07:34:41.010734+0000","last_became_peered":"2023-07-21T07:34:41.010734+0000","last_unstale":"2023-07-21T07:34:42.176982+0000","last_undegraded":"2023-07-21T07:34:42.176982+0000","last_fullsized":"2023-07-21T07:34:42.176982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:11.308795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252733+0000","last_change":"2023-07-21T07:34:40.000848+0000","last_active":"2023-07-21T07:34:42.252733+0000","last_peered":"2023-07-21T07:34:42.252733+0000","last_clean":"2023-07-21T07:34:42.252733+0000","last_became_active":"2023-07-21T07:34:40.000505+0000","last_became_peered":"2023-07-21T07:34:40.000505+0000","last_unstale":"2023-07-21T07:34:42.252733+0000","last_undegraded":"2023-07-21T07:34:42.252733+0000","last_fullsized":"2023-07-21T07:34:42.252733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:21.952698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992223+0000","last_change":"2023-07-21T07:34:41.000904+0000","last_active":"2023-07-21T07:34:41.992223+0000","last_peered":"2023-07-21T07:34:41.992223+0000","last_clean":"2023-07-21T07:34:41.992223+0000","last_became_active":"2023-07-21T07:34:41.000652+0000","last_became_peered":"2023-07-21T07:34:41.000652+0000","last_unstale":"2023-07-21T07:34:41.992223+0000","last_undegraded":"2023-07-21T07:34:41.992223+0000","last_fullsized":"2023-07-21T07:34:41.992223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:11.308795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991630+0000","last_change":"2023-07-21T07:34:41.007386+0000","last_active":"2023-07-21T07:34:41.991630+0000","last_peered":"2023-07-21T07:34:41.991630+0000","last_clean":"2023-07-21T07:34:41.991630+0000","last_became_active":"2023-07-21T07:34:41.007132+0000","last_became_peered":"2023-07-21T07:34:41.007132+0000","last_unstale":"2023-07-21T07:34:41.991630+0000","last_undegraded":"2023-07-21T07:34:41.991630+0000","last_fullsized":"2023-07-21T07:34:41.991630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:38.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.176926+0000","last_change":"2023-07-21T07:34:41.011588+0000","last_active":"2023-07-21T07:34:42.176926+0000","last_peered":"2023-07-21T07:34:42.176926+0000","last_clean":"2023-07-21T07:34:42.176926+0000","last_became_active":"2023-07-21T07:34:41.011068+0000","last_became_peered":"2023-07-21T07:34:41.011068+0000","last_unstale":"2023-07-21T07:34:42.176926+0000","last_undegraded":"2023-07-21T07:34:42.176926+0000","last_fullsized":"2023-07-21T07:34:42.176926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:54:20.793513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992299+0000","last_change":"2023-07-21T07:34:41.009302+0000","last_active":"2023-07-21T07:34:41.992299+0000","last_peered":"2023-07-21T07:34:41.992299+0000","last_clean":"2023-07-21T07:34:41.992299+0000","last_became_active":"2023-07-21T07:34:41.008833+0000","last_became_peered":"2023-07-21T07:34:41.008833+0000","last_unstale":"2023-07-21T07:34:41.992299+0000","last_undegraded":"2023-07-21T07:34:41.992299+0000","last_fullsized":"2023-07-21T07:34:41.992299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:06.140274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177335+0000","last_change":"2023-07-21T07:34:41.016235+0000","last_active":"2023-07-21T07:34:42.177335+0000","last_peered":"2023-07-21T07:34:42.177335+0000","last_clean":"2023-07-21T07:34:42.177335+0000","last_became_active":"2023-07-21T07:34:41.015889+0000","last_became_peered":"2023-07-21T07:34:41.015889+0000","last_unstale":"2023-07-21T07:34:42.177335+0000","last_undegraded":"2023-07-21T07:34:42.177335+0000","last_fullsized":"2023-07-21T07:34:42.177335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:22.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.005523+0000","last_change":"2023-07-21T07:34:40.999714+0000","last_active":"2023-07-21T07:34:41.005523+0000","last_peered":"2023-07-21T07:34:41.005523+0000","last_clean":"2023-07-21T07:34:41.005523+0000","last_became_active":"2023-07-21T07:34:40.999382+0000","last_became_peered":"2023-07-21T07:34:40.999382+0000","last_unstale":"2023-07-21T07:34:41.005523+0000","last_undegraded":"2023-07-21T07:34:41.005523+0000","last_fullsized":"2023-07-21T07:34:41.005523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:10:00.672282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":679765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":678567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":87707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":89237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":88269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:34:45.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:34:45.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.312+0000 7f0a130bd700 1 Processor -- start 2023-07-21T07:34:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.312+0000 7f0a130bd700 1 -- start start 2023-07-21T07:34:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.312+0000 7f0a130bd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0a0c0c3750 0x7f0a0c0c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.312+0000 7f0a130bd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a0c14ed60 0x7f0a0c154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.312+0000 7f0a130bd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c0ba440 con 0x7f0a0c0c6170 2023-07-21T07:34:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.312+0000 7f0a130bd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c14f140 con 0x7f0a0c14ed60 2023-07-21T07:34:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.312+0000 7f0a130bd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c0c15d0 con 0x7f0a0c0c3750 2023-07-21T07:34:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.312+0000 7f0a1165a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a0c14ed60 0x7f0a0c154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.313+0000 7f0a0bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0a0c0c6170 0x7f0a0c14e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40456/0 (socket says 172.21.15.6:40456) 2023-07-21T07:34:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.313+0000 7f0a0bfff700 1 -- 172.21.15.6:0/2896094581 learned_addr learned my addr 172.21.15.6:0/2896094581 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.313+0000 7f0a10e59700 1 --2- 172.21.15.6:0/2896094581 >> v2:172.21.15.86:3300/0 conn(0x7f0a0c0c3750 0x7f0a0c0c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.313+0000 7f0a1165a700 1 -- 172.21.15.6:0/2896094581 >> v2:172.21.15.86:3300/0 conn(0x7f0a0c0c3750 msgr2=0x7f0a0c0c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:45.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.313+0000 7f0a1165a700 1 --2- 172.21.15.6:0/2896094581 >> v2:172.21.15.86:3300/0 conn(0x7f0a0c0c3750 0x7f0a0c0c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.313+0000 7f0a1165a700 1 -- 172.21.15.6:0/2896094581 >> v1:172.21.15.6:6789/0 conn(0x7f0a0c0c6170 legacy=0x7f0a0c14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:45.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.313+0000 7f0a1165a700 1 -- 172.21.15.6:0/2896094581 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c0c18b0 con 0x7f0a0c14ed60 2023-07-21T07:34:45.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.313+0000 7f0a0b7fe700 1 -- 172.21.15.6:0/2896094581 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462663898 0 0) 0x7f0a0c0ba440 con 0x7f0a0c0c6170 2023-07-21T07:34:45.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.313+0000 7f0a1165a700 1 --2- 172.21.15.6:0/2896094581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0c14ed60 0x7f0a0c154c80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0c44c0 tx=0x7f0a0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512772eba537146a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:45.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.313+0000 7f0a0b7fe700 1 -- 172.21.15.6:0/2896094581 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0400e070 con 0x7f0a0c14ed60 2023-07-21T07:34:45.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.313+0000 7f0a0b7fe700 1 -- 172.21.15.6:0/2896094581 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0400bbd0 con 0x7f0a0c14ed60 2023-07-21T07:34:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.313+0000 7f0a0b7fe700 1 -- 172.21.15.6:0/2896094581 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04012430 con 0x7f0a0c14ed60 2023-07-21T07:34:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.314+0000 7f0a130bd700 1 -- 172.21.15.6:0/2896094581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0c14ed60 msgr2=0x7f0a0c154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.314+0000 7f0a130bd700 1 --2- 172.21.15.6:0/2896094581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0c14ed60 0x7f0a0c154c80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0c44c0 tx=0x7f0a0400b330 comp rx=0 tx=0).stop 2023-07-21T07:34:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.314+0000 7f0a130bd700 1 -- 172.21.15.6:0/2896094581 shutdown_connections 2023-07-21T07:34:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.314+0000 7f0a130bd700 1 --2- 172.21.15.6:0/2896094581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0c14ed60 0x7f0a0c154c80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.314+0000 7f0a130bd700 1 --2- 172.21.15.6:0/2896094581 >> v2:172.21.15.86:3300/0 conn(0x7f0a0c0c3750 0x7f0a0c0c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.314+0000 7f0a130bd700 1 -- 172.21.15.6:0/2896094581 >> 172.21.15.6:0/2896094581 conn(0x7f0a0c0a8c90 msgr2=0x7f0a0c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.314+0000 7f0a130bd700 1 -- 172.21.15.6:0/2896094581 shutdown_connections 2023-07-21T07:34:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.314+0000 7f0a130bd700 1 -- 172.21.15.6:0/2896094581 wait complete. 2023-07-21T07:34:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.315+0000 7f0a130bd700 1 Processor -- start 2023-07-21T07:34:45.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.315+0000 7f0a130bd700 1 -- start start 2023-07-21T07:34:45.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.316+0000 7f0a130bd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a0c0c3750 0x7f0a0c070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:45.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.316+0000 7f0a130bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0c0c6170 0x7f0a0c0abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:45.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.316+0000 7f0a130bd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a0c14ed60 0x7f0a0c0ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:45.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.316+0000 7f0a130bd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c1e9610 con 0x7f0a0c0c6170 2023-07-21T07:34:45.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.316+0000 7f0a130bd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0bdba0 con 0x7f0a0c0c3750 2023-07-21T07:34:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.316+0000 7f0a130bd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0bde80 con 0x7f0a0c14ed60 2023-07-21T07:34:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.316+0000 7f0a0bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0c0c6170 0x7f0a0c0abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.316+0000 7f0a0bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0c0c6170 0x7f0a0c0abd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60676/0 (socket says 172.21.15.6:60676) 2023-07-21T07:34:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a0bfff700 1 -- 172.21.15.6:0/156024994 learned_addr learned my addr 172.21.15.6:0/156024994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a10e59700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a0c0c3750 0x7f0a0c070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a1165a700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a0c14ed60 0x7f0a0c0ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a0bfff700 1 -- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a0c14ed60 msgr2=0x7f0a0c0ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a0bfff700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a0c14ed60 0x7f0a0c0ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a0bfff700 1 -- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a0c0c3750 msgr2=0x7f0a0c070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a0bfff700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a0c0c3750 0x7f0a0c070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a0bfff700 1 -- 172.21.15.6:0/156024994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04009a70 con 0x7f0a0c0c6170 2023-07-21T07:34:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a10e59700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a0c0c3750 0x7f0a0c070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a0bfff700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0c0c6170 0x7f0a0c0abd90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f09f80011e0 tx=0x7f09f800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a097fa700 1 -- 172.21.15.6:0/156024994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f800ee10 con 0x7f0a0c0c6170 2023-07-21T07:34:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a097fa700 1 -- 172.21.15.6:0/156024994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f8004a80 con 0x7f0a0c0c6170 2023-07-21T07:34:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a130bd700 1 -- 172.21.15.6:0/156024994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c0be160 con 0x7f0a0c0c6170 2023-07-21T07:34:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a097fa700 1 -- 172.21.15.6:0/156024994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8004e30 con 0x7f0a0c0c6170 2023-07-21T07:34:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.317+0000 7f0a130bd700 1 -- 172.21.15.6:0/156024994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c0be7b0 con 0x7f0a0c0c6170 2023-07-21T07:34:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.318+0000 7f0a130bd700 1 -- 172.21.15.6:0/156024994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c0abab0 con 0x7f0a0c0c6170 2023-07-21T07:34:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.319+0000 7f0a097fa700 1 -- 172.21.15.6:0/156024994 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09f80070d0 con 0x7f0a0c0c6170 2023-07-21T07:34:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.319+0000 7f0a097fa700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09f006ace0 0x7f09f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.319+0000 7f0a097fa700 1 -- 172.21.15.6:0/156024994 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09f808b770 con 0x7f0a0c0c6170 2023-07-21T07:34:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.319+0000 7f0a10e59700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09f006ace0 0x7f09f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.320+0000 7f0a10e59700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09f006ace0 0x7f09f006d1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0714d0 tx=0x7f0a00008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.323+0000 7f0a097fa700 1 -- 172.21.15.6:0/156024994 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0a0c0abab0 con 0x7f0a0c0c6170 2023-07-21T07:34:45.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.517+0000 7f0a130bd700 1 -- 172.21.15.6:0/156024994 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a0c0c1e70 con 0x7f09f006ace0 2023-07-21T07:34:45.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.525+0000 7f0a097fa700 1 -- 172.21.15.6:0/156024994 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286724 (secure 0 0 0) 0x7f0a00009680 con 0x7f09f006ace0 2023-07-21T07:34:45.580 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:45.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.528+0000 7f0a130bd700 1 -- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09f006ace0 msgr2=0x7f09f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:45.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.528+0000 7f0a130bd700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09f006ace0 0x7f09f006d1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0714d0 tx=0x7f0a00008040 comp rx=0 tx=0).stop 2023-07-21T07:34:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.528+0000 7f0a130bd700 1 -- 172.21.15.6:0/156024994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0c0c6170 msgr2=0x7f0a0c0abd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.528+0000 7f0a130bd700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0c0c6170 0x7f0a0c0abd90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f09f80011e0 tx=0x7f09f800ecf0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.528+0000 7f0a130bd700 1 -- 172.21.15.6:0/156024994 shutdown_connections 2023-07-21T07:34:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.528+0000 7f0a130bd700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09f006ace0 0x7f09f006d1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.528+0000 7f0a130bd700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a0c14ed60 0x7f0a0c0ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.528+0000 7f0a130bd700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a0c0c3750 0x7f0a0c070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.528+0000 7f0a130bd700 1 --2- 172.21.15.6:0/156024994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0c0c6170 0x7f0a0c0abd90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.528+0000 7f0a130bd700 1 -- 172.21.15.6:0/156024994 >> 172.21.15.6:0/156024994 conn(0x7f0a0c0a8c90 msgr2=0x7f0a0c14da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:45.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.528+0000 7f0a130bd700 1 -- 172.21.15.6:0/156024994 shutdown_connections 2023-07-21T07:34:45.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.529+0000 7f0a130bd700 1 -- 172.21.15.6:0/156024994 wait complete. 2023-07-21T07:34:45.583 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:34:45.592 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T07:34:44.691879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219296,"kb_used_data":3112,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755424,"statfs":{"total":773094113280,"available":772869554176,"internally_reserved":0,"allocated":3186688,"data_stored":1886396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.713040"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988299+0000","last_change":"2023-07-21T07:34:41.013800+0000","last_active":"2023-07-21T07:34:41.988299+0000","last_peered":"2023-07-21T07:34:41.988299+0000","last_clean":"2023-07-21T07:34:41.988299+0000","last_became_active":"2023-07-21T07:34:41.013492+0000","last_became_peered":"2023-07-21T07:34:41.013492+0000","last_unstale":"2023-07-21T07:34:41.988299+0000","last_undegraded":"2023-07-21T07:34:41.988299+0000","last_fullsized":"2023-07-21T07:34:41.988299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:38.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.997405+0000","last_change":"2023-07-21T07:34:40.994156+0000","last_active":"2023-07-21T07:34:40.997405+0000","last_peered":"2023-07-21T07:34:40.997405+0000","last_clean":"2023-07-21T07:34:40.997405+0000","last_became_active":"2023-07-21T07:34:40.993889+0000","last_became_peered":"2023-07-21T07:34:40.993889+0000","last_unstale":"2023-07-21T07:34:40.997405+0000","last_undegraded":"2023-07-21T07:34:40.997405+0000","last_fullsized":"2023-07-21T07:34:40.997405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:10.865023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992392+0000","last_change":"2023-07-21T07:34:41.003522+0000","last_active":"2023-07-21T07:34:41.992392+0000","last_peered":"2023-07-21T07:34:41.992392+0000","last_clean":"2023-07-21T07:34:41.992392+0000","last_became_active":"2023-07-21T07:34:41.003041+0000","last_became_peered":"2023-07-21T07:34:41.003041+0000","last_unstale":"2023-07-21T07:34:41.992392+0000","last_undegraded":"2023-07-21T07:34:41.992392+0000","last_fullsized":"2023-07-21T07:34:41.992392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:49.798268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991796+0000","last_change":"2023-07-21T07:34:41.005174+0000","last_active":"2023-07-21T07:34:41.991796+0000","last_peered":"2023-07-21T07:34:41.991796+0000","last_clean":"2023-07-21T07:34:41.991796+0000","last_became_active":"2023-07-21T07:34:41.004832+0000","last_became_peered":"2023-07-21T07:34:41.004832+0000","last_unstale":"2023-07-21T07:34:41.991796+0000","last_undegraded":"2023-07-21T07:34:41.991796+0000","last_fullsized":"2023-07-21T07:34:41.991796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:58:16.705923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252251+0000","last_change":"2023-07-21T07:34:41.011222+0000","last_active":"2023-07-21T07:34:42.252251+0000","last_peered":"2023-07-21T07:34:42.252251+0000","last_clean":"2023-07-21T07:34:42.252251+0000","last_became_active":"2023-07-21T07:34:41.010950+0000","last_became_peered":"2023-07-21T07:34:41.010950+0000","last_unstale":"2023-07-21T07:34:42.252251+0000","last_undegraded":"2023-07-21T07:34:42.252251+0000","last_fullsized":"2023-07-21T07:34:42.252251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:54:20.793513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992212+0000","last_change":"2023-07-21T07:34:41.004797+0000","last_active":"2023-07-21T07:34:41.992212+0000","last_peered":"2023-07-21T07:34:41.992212+0000","last_clean":"2023-07-21T07:34:41.992212+0000","last_became_active":"2023-07-21T07:34:41.004547+0000","last_became_peered":"2023-07-21T07:34:41.004547+0000","last_unstale":"2023-07-21T07:34:41.992212+0000","last_undegraded":"2023-07-21T07:34:41.992212+0000","last_fullsized":"2023-07-21T07:34:41.992212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017290+0000","last_change":"2023-07-21T07:34:41.010978+0000","last_active":"2023-07-21T07:34:41.017290+0000","last_peered":"2023-07-21T07:34:41.017290+0000","last_clean":"2023-07-21T07:34:41.017290+0000","last_became_active":"2023-07-21T07:34:41.010756+0000","last_became_peered":"2023-07-21T07:34:41.010756+0000","last_unstale":"2023-07-21T07:34:41.017290+0000","last_undegraded":"2023-07-21T07:34:41.017290+0000","last_fullsized":"2023-07-21T07:34:41.017290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:54:20.793513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.998024+0000","last_change":"2023-07-21T07:34:40.995907+0000","last_active":"2023-07-21T07:34:40.998024+0000","last_peered":"2023-07-21T07:34:40.998024+0000","last_clean":"2023-07-21T07:34:40.998024+0000","last_became_active":"2023-07-21T07:34:40.995624+0000","last_became_peered":"2023-07-21T07:34:40.995624+0000","last_unstale":"2023-07-21T07:34:40.998024+0000","last_undegraded":"2023-07-21T07:34:40.998024+0000","last_fullsized":"2023-07-21T07:34:40.998024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:49:24.373411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252562+0000","last_change":"2023-07-21T07:34:41.014976+0000","last_active":"2023-07-21T07:34:42.252562+0000","last_peered":"2023-07-21T07:34:42.252562+0000","last_clean":"2023-07-21T07:34:42.252562+0000","last_became_active":"2023-07-21T07:34:41.014683+0000","last_became_peered":"2023-07-21T07:34:41.014683+0000","last_unstale":"2023-07-21T07:34:42.252562+0000","last_undegraded":"2023-07-21T07:34:42.252562+0000","last_fullsized":"2023-07-21T07:34:42.252562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:53.769501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017261+0000","last_change":"2023-07-21T07:34:41.007114+0000","last_active":"2023-07-21T07:34:41.017261+0000","last_peered":"2023-07-21T07:34:41.017261+0000","last_clean":"2023-07-21T07:34:41.017261+0000","last_became_active":"2023-07-21T07:34:41.006839+0000","last_became_peered":"2023-07-21T07:34:41.006839+0000","last_unstale":"2023-07-21T07:34:41.017261+0000","last_undegraded":"2023-07-21T07:34:41.017261+0000","last_fullsized":"2023-07-21T07:34:41.017261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:05:54.994289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992571+0000","last_change":"2023-07-21T07:34:40.995650+0000","last_active":"2023-07-21T07:34:41.992571+0000","last_peered":"2023-07-21T07:34:41.992571+0000","last_clean":"2023-07-21T07:34:41.992571+0000","last_became_active":"2023-07-21T07:34:40.995387+0000","last_became_peered":"2023-07-21T07:34:40.995387+0000","last_unstale":"2023-07-21T07:34:41.992571+0000","last_undegraded":"2023-07-21T07:34:41.992571+0000","last_fullsized":"2023-07-21T07:34:41.992571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:25.315536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988206+0000","last_change":"2023-07-21T07:34:40.998318+0000","last_active":"2023-07-21T07:34:41.988206+0000","last_peered":"2023-07-21T07:34:41.988206+0000","last_clean":"2023-07-21T07:34:41.988206+0000","last_became_active":"2023-07-21T07:34:40.997993+0000","last_became_peered":"2023-07-21T07:34:40.997993+0000","last_unstale":"2023-07-21T07:34:41.988206+0000","last_undegraded":"2023-07-21T07:34:41.988206+0000","last_fullsized":"2023-07-21T07:34:41.988206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:16.791514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988109+0000","last_change":"2023-07-21T07:34:41.009290+0000","last_active":"2023-07-21T07:34:41.988109+0000","last_peered":"2023-07-21T07:34:41.988109+0000","last_clean":"2023-07-21T07:34:41.988109+0000","last_became_active":"2023-07-21T07:34:41.008979+0000","last_became_peered":"2023-07-21T07:34:41.008979+0000","last_unstale":"2023-07-21T07:34:41.988109+0000","last_undegraded":"2023-07-21T07:34:41.988109+0000","last_fullsized":"2023-07-21T07:34:41.988109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:28:11.312982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.995941+0000","last_change":"2023-07-21T07:34:40.993283+0000","last_active":"2023-07-21T07:34:40.995941+0000","last_peered":"2023-07-21T07:34:40.995941+0000","last_clean":"2023-07-21T07:34:40.995941+0000","last_became_active":"2023-07-21T07:34:40.993023+0000","last_became_peered":"2023-07-21T07:34:40.993023+0000","last_unstale":"2023-07-21T07:34:40.995941+0000","last_undegraded":"2023-07-21T07:34:40.995941+0000","last_fullsized":"2023-07-21T07:34:40.995941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:23:45.330390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.018279+0000","last_change":"2023-07-21T07:34:41.013555+0000","last_active":"2023-07-21T07:34:41.018279+0000","last_peered":"2023-07-21T07:34:41.018279+0000","last_clean":"2023-07-21T07:34:41.018279+0000","last_became_active":"2023-07-21T07:34:41.013237+0000","last_became_peered":"2023-07-21T07:34:41.013237+0000","last_unstale":"2023-07-21T07:34:41.018279+0000","last_undegraded":"2023-07-21T07:34:41.018279+0000","last_fullsized":"2023-07-21T07:34:41.018279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:13.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992133+0000","last_change":"2023-07-21T07:34:41.004335+0000","last_active":"2023-07-21T07:34:41.992133+0000","last_peered":"2023-07-21T07:34:41.992133+0000","last_clean":"2023-07-21T07:34:41.992133+0000","last_became_active":"2023-07-21T07:34:41.004051+0000","last_became_peered":"2023-07-21T07:34:41.004051+0000","last_unstale":"2023-07-21T07:34:41.992133+0000","last_undegraded":"2023-07-21T07:34:41.992133+0000","last_fullsized":"2023-07-21T07:34:41.992133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:13.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252673+0000","last_change":"2023-07-21T07:34:41.015026+0000","last_active":"2023-07-21T07:34:42.252673+0000","last_peered":"2023-07-21T07:34:42.252673+0000","last_clean":"2023-07-21T07:34:42.252673+0000","last_became_active":"2023-07-21T07:34:41.014710+0000","last_became_peered":"2023-07-21T07:34:41.014710+0000","last_unstale":"2023-07-21T07:34:42.252673+0000","last_undegraded":"2023-07-21T07:34:42.252673+0000","last_fullsized":"2023-07-21T07:34:42.252673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:22.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992073+0000","last_change":"2023-07-21T07:34:41.011628+0000","last_active":"2023-07-21T07:34:41.992073+0000","last_peered":"2023-07-21T07:34:41.992073+0000","last_clean":"2023-07-21T07:34:41.992073+0000","last_became_active":"2023-07-21T07:34:41.009074+0000","last_became_peered":"2023-07-21T07:34:41.009074+0000","last_unstale":"2023-07-21T07:34:41.992073+0000","last_undegraded":"2023-07-21T07:34:41.992073+0000","last_fullsized":"2023-07-21T07:34:41.992073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:06.735540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988155+0000","last_change":"2023-07-21T07:34:41.004665+0000","last_active":"2023-07-21T07:34:41.988155+0000","last_peered":"2023-07-21T07:34:41.988155+0000","last_clean":"2023-07-21T07:34:41.988155+0000","last_became_active":"2023-07-21T07:34:41.004361+0000","last_became_peered":"2023-07-21T07:34:41.004361+0000","last_unstale":"2023-07-21T07:34:41.988155+0000","last_undegraded":"2023-07-21T07:34:41.988155+0000","last_fullsized":"2023-07-21T07:34:41.988155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:10:00.672282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992656+0000","last_change":"2023-07-21T07:34:41.001444+0000","last_active":"2023-07-21T07:34:41.992656+0000","last_peered":"2023-07-21T07:34:41.992656+0000","last_clean":"2023-07-21T07:34:41.992656+0000","last_became_active":"2023-07-21T07:34:41.001171+0000","last_became_peered":"2023-07-21T07:34:41.001171+0000","last_unstale":"2023-07-21T07:34:41.992656+0000","last_undegraded":"2023-07-21T07:34:41.992656+0000","last_fullsized":"2023-07-21T07:34:41.992656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:11:14.968095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.018246+0000","last_change":"2023-07-21T07:34:41.013317+0000","last_active":"2023-07-21T07:34:41.018246+0000","last_peered":"2023-07-21T07:34:41.018246+0000","last_clean":"2023-07-21T07:34:41.018246+0000","last_became_active":"2023-07-21T07:34:41.012800+0000","last_became_peered":"2023-07-21T07:34:41.012800+0000","last_unstale":"2023-07-21T07:34:41.018246+0000","last_undegraded":"2023-07-21T07:34:41.018246+0000","last_fullsized":"2023-07-21T07:34:41.018246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:11.308795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252426+0000","last_change":"2023-07-21T07:34:41.002953+0000","last_active":"2023-07-21T07:34:42.252426+0000","last_peered":"2023-07-21T07:34:42.252426+0000","last_clean":"2023-07-21T07:34:42.252426+0000","last_became_active":"2023-07-21T07:34:41.002569+0000","last_became_peered":"2023-07-21T07:34:41.002569+0000","last_unstale":"2023-07-21T07:34:42.252426+0000","last_undegraded":"2023-07-21T07:34:42.252426+0000","last_fullsized":"2023-07-21T07:34:42.252426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:37.840825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177317+0000","last_change":"2023-07-21T07:34:41.007432+0000","last_active":"2023-07-21T07:34:42.177317+0000","last_peered":"2023-07-21T07:34:42.177317+0000","last_clean":"2023-07-21T07:34:42.177317+0000","last_became_active":"2023-07-21T07:34:41.006964+0000","last_became_peered":"2023-07-21T07:34:41.006964+0000","last_unstale":"2023-07-21T07:34:42.177317+0000","last_undegraded":"2023-07-21T07:34:42.177317+0000","last_fullsized":"2023-07-21T07:34:42.177317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:22.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.018208+0000","last_change":"2023-07-21T07:34:41.012722+0000","last_active":"2023-07-21T07:34:41.018208+0000","last_peered":"2023-07-21T07:34:41.018208+0000","last_clean":"2023-07-21T07:34:41.018208+0000","last_became_active":"2023-07-21T07:34:41.012304+0000","last_became_peered":"2023-07-21T07:34:41.012304+0000","last_unstale":"2023-07-21T07:34:41.018208+0000","last_undegraded":"2023-07-21T07:34:41.018208+0000","last_fullsized":"2023-07-21T07:34:41.018208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:37.210979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.005410+0000","last_change":"2023-07-21T07:34:41.000784+0000","last_active":"2023-07-21T07:34:41.005410+0000","last_peered":"2023-07-21T07:34:41.005410+0000","last_clean":"2023-07-21T07:34:41.005410+0000","last_became_active":"2023-07-21T07:34:41.000488+0000","last_became_peered":"2023-07-21T07:34:41.000488+0000","last_unstale":"2023-07-21T07:34:41.005410+0000","last_undegraded":"2023-07-21T07:34:41.005410+0000","last_fullsized":"2023-07-21T07:34:41.005410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:49:24.373411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017280+0000","last_change":"2023-07-21T07:34:41.006271+0000","last_active":"2023-07-21T07:34:41.017280+0000","last_peered":"2023-07-21T07:34:41.017280+0000","last_clean":"2023-07-21T07:34:41.017280+0000","last_became_active":"2023-07-21T07:34:41.005911+0000","last_became_peered":"2023-07-21T07:34:41.005911+0000","last_unstale":"2023-07-21T07:34:41.017280+0000","last_undegraded":"2023-07-21T07:34:41.017280+0000","last_fullsized":"2023-07-21T07:34:41.017280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:23:03.521561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017945+0000","last_change":"2023-07-21T07:34:41.014321+0000","last_active":"2023-07-21T07:34:41.017945+0000","last_peered":"2023-07-21T07:34:41.017945+0000","last_clean":"2023-07-21T07:34:41.017945+0000","last_became_active":"2023-07-21T07:34:41.013913+0000","last_became_peered":"2023-07-21T07:34:41.013913+0000","last_unstale":"2023-07-21T07:34:41.017945+0000","last_undegraded":"2023-07-21T07:34:41.017945+0000","last_fullsized":"2023-07-21T07:34:41.017945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:54:20.793513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992369+0000","last_change":"2023-07-21T07:34:40.006035+0000","last_active":"2023-07-21T07:34:41.992369+0000","last_peered":"2023-07-21T07:34:41.992369+0000","last_clean":"2023-07-21T07:34:41.992369+0000","last_became_active":"2023-07-21T07:34:40.005799+0000","last_became_peered":"2023-07-21T07:34:40.005799+0000","last_unstale":"2023-07-21T07:34:41.992369+0000","last_undegraded":"2023-07-21T07:34:41.992369+0000","last_fullsized":"2023-07-21T07:34:41.992369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:21.178454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177216+0000","last_change":"2023-07-21T07:34:41.007625+0000","last_active":"2023-07-21T07:34:42.177216+0000","last_peered":"2023-07-21T07:34:42.177216+0000","last_clean":"2023-07-21T07:34:42.177216+0000","last_became_active":"2023-07-21T07:34:41.006954+0000","last_became_peered":"2023-07-21T07:34:41.006954+0000","last_unstale":"2023-07-21T07:34:42.177216+0000","last_undegraded":"2023-07-21T07:34:42.177216+0000","last_fullsized":"2023-07-21T07:34:42.177216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:53.769501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.986920+0000","last_change":"2023-07-21T07:34:40.006702+0000","last_active":"2023-07-21T07:34:40.986920+0000","last_peered":"2023-07-21T07:34:40.986920+0000","last_clean":"2023-07-21T07:34:40.986920+0000","last_became_active":"2023-07-21T07:34:40.006334+0000","last_became_peered":"2023-07-21T07:34:40.006334+0000","last_unstale":"2023-07-21T07:34:40.986920+0000","last_undegraded":"2023-07-21T07:34:40.986920+0000","last_fullsized":"2023-07-21T07:34:40.986920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:13:49.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252562+0000","last_change":"2023-07-21T07:34:41.013575+0000","last_active":"2023-07-21T07:34:42.252562+0000","last_peered":"2023-07-21T07:34:42.252562+0000","last_clean":"2023-07-21T07:34:42.252562+0000","last_became_active":"2023-07-21T07:34:41.013276+0000","last_became_peered":"2023-07-21T07:34:41.013276+0000","last_unstale":"2023-07-21T07:34:42.252562+0000","last_undegraded":"2023-07-21T07:34:42.252562+0000","last_fullsized":"2023-07-21T07:34:42.252562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177314+0000","last_change":"2023-07-21T07:34:40.004005+0000","last_active":"2023-07-21T07:34:42.177314+0000","last_peered":"2023-07-21T07:34:42.177314+0000","last_clean":"2023-07-21T07:34:42.177314+0000","last_became_active":"2023-07-21T07:34:40.003505+0000","last_became_peered":"2023-07-21T07:34:40.003505+0000","last_unstale":"2023-07-21T07:34:42.177314+0000","last_undegraded":"2023-07-21T07:34:42.177314+0000","last_fullsized":"2023-07-21T07:34:42.177314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:48.791489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992924+0000","last_change":"2023-07-21T07:34:41.004220+0000","last_active":"2023-07-21T07:34:41.992924+0000","last_peered":"2023-07-21T07:34:41.992924+0000","last_clean":"2023-07-21T07:34:41.992924+0000","last_became_active":"2023-07-21T07:34:41.003943+0000","last_became_peered":"2023-07-21T07:34:41.003943+0000","last_unstale":"2023-07-21T07:34:41.992924+0000","last_undegraded":"2023-07-21T07:34:41.992924+0000","last_fullsized":"2023-07-21T07:34:41.992924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:49:24.373411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252659+0000","last_change":"2023-07-21T07:34:40.000884+0000","last_active":"2023-07-21T07:34:42.252659+0000","last_peered":"2023-07-21T07:34:42.252659+0000","last_clean":"2023-07-21T07:34:42.252659+0000","last_became_active":"2023-07-21T07:34:40.000548+0000","last_became_peered":"2023-07-21T07:34:40.000548+0000","last_unstale":"2023-07-21T07:34:42.252659+0000","last_undegraded":"2023-07-21T07:34:42.252659+0000","last_fullsized":"2023-07-21T07:34:42.252659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:41.600204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177198+0000","last_change":"2023-07-21T07:34:41.008668+0000","last_active":"2023-07-21T07:34:42.177198+0000","last_peered":"2023-07-21T07:34:42.177198+0000","last_clean":"2023-07-21T07:34:42.177198+0000","last_became_active":"2023-07-21T07:34:41.008309+0000","last_became_peered":"2023-07-21T07:34:41.008309+0000","last_unstale":"2023-07-21T07:34:42.177198+0000","last_undegraded":"2023-07-21T07:34:42.177198+0000","last_fullsized":"2023-07-21T07:34:42.177198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.991359+0000","last_change":"2023-07-21T07:34:40.000039+0000","last_active":"2023-07-21T07:34:40.991359+0000","last_peered":"2023-07-21T07:34:40.991359+0000","last_clean":"2023-07-21T07:34:40.991359+0000","last_became_active":"2023-07-21T07:34:39.999675+0000","last_became_peered":"2023-07-21T07:34:39.999675+0000","last_unstale":"2023-07-21T07:34:40.991359+0000","last_undegraded":"2023-07-21T07:34:40.991359+0000","last_fullsized":"2023-07-21T07:34:40.991359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:05.728761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177225+0000","last_change":"2023-07-21T07:34:41.015126+0000","last_active":"2023-07-21T07:34:42.177225+0000","last_peered":"2023-07-21T07:34:42.177225+0000","last_clean":"2023-07-21T07:34:42.177225+0000","last_became_active":"2023-07-21T07:34:41.014280+0000","last_became_peered":"2023-07-21T07:34:41.014280+0000","last_unstale":"2023-07-21T07:34:42.177225+0000","last_undegraded":"2023-07-21T07:34:42.177225+0000","last_fullsized":"2023-07-21T07:34:42.177225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:06.140274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017314+0000","last_change":"2023-07-21T07:34:40.006892+0000","last_active":"2023-07-21T07:34:41.017314+0000","last_peered":"2023-07-21T07:34:41.017314+0000","last_clean":"2023-07-21T07:34:41.017314+0000","last_became_active":"2023-07-21T07:34:40.006547+0000","last_became_peered":"2023-07-21T07:34:40.006547+0000","last_unstale":"2023-07-21T07:34:41.017314+0000","last_undegraded":"2023-07-21T07:34:41.017314+0000","last_fullsized":"2023-07-21T07:34:41.017314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:44.605221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.016721+0000","last_change":"2023-07-21T07:34:41.005138+0000","last_active":"2023-07-21T07:34:41.016721+0000","last_peered":"2023-07-21T07:34:41.016721+0000","last_clean":"2023-07-21T07:34:41.016721+0000","last_became_active":"2023-07-21T07:34:41.004836+0000","last_became_peered":"2023-07-21T07:34:41.004836+0000","last_unstale":"2023-07-21T07:34:41.016721+0000","last_undegraded":"2023-07-21T07:34:41.016721+0000","last_fullsized":"2023-07-21T07:34:41.016721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:28:11.312982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992847+0000","last_change":"2023-07-21T07:34:40.001177+0000","last_active":"2023-07-21T07:34:41.992847+0000","last_peered":"2023-07-21T07:34:41.992847+0000","last_clean":"2023-07-21T07:34:41.992847+0000","last_became_active":"2023-07-21T07:34:40.000899+0000","last_became_peered":"2023-07-21T07:34:40.000899+0000","last_unstale":"2023-07-21T07:34:41.992847+0000","last_undegraded":"2023-07-21T07:34:41.992847+0000","last_fullsized":"2023-07-21T07:34:41.992847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:47:27.200017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992726+0000","last_change":"2023-07-21T07:34:41.003585+0000","last_active":"2023-07-21T07:34:41.992726+0000","last_peered":"2023-07-21T07:34:41.992726+0000","last_clean":"2023-07-21T07:34:41.992726+0000","last_became_active":"2023-07-21T07:34:41.003302+0000","last_became_peered":"2023-07-21T07:34:41.003302+0000","last_unstale":"2023-07-21T07:34:41.992726+0000","last_undegraded":"2023-07-21T07:34:41.992726+0000","last_fullsized":"2023-07-21T07:34:41.992726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:12:07.511312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.016078+0000","last_change":"2023-07-21T07:34:40.003432+0000","last_active":"2023-07-21T07:34:41.016078+0000","last_peered":"2023-07-21T07:34:41.016078+0000","last_clean":"2023-07-21T07:34:41.016078+0000","last_became_active":"2023-07-21T07:34:40.003161+0000","last_became_peered":"2023-07-21T07:34:40.003161+0000","last_unstale":"2023-07-21T07:34:41.016078+0000","last_undegraded":"2023-07-21T07:34:41.016078+0000","last_fullsized":"2023-07-21T07:34:41.016078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:05:53.987510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177120+0000","last_change":"2023-07-21T07:34:41.009600+0000","last_active":"2023-07-21T07:34:42.177120+0000","last_peered":"2023-07-21T07:34:42.177120+0000","last_clean":"2023-07-21T07:34:42.177120+0000","last_became_active":"2023-07-21T07:34:41.008310+0000","last_became_peered":"2023-07-21T07:34:41.008310+0000","last_unstale":"2023-07-21T07:34:42.177120+0000","last_undegraded":"2023-07-21T07:34:42.177120+0000","last_fullsized":"2023-07-21T07:34:42.177120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:06.735540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252286+0000","last_change":"2023-07-21T07:34:40.002086+0000","last_active":"2023-07-21T07:34:42.252286+0000","last_peered":"2023-07-21T07:34:42.252286+0000","last_clean":"2023-07-21T07:34:42.252286+0000","last_became_active":"2023-07-21T07:34:40.001728+0000","last_became_peered":"2023-07-21T07:34:40.001728+0000","last_unstale":"2023-07-21T07:34:42.252286+0000","last_undegraded":"2023-07-21T07:34:42.252286+0000","last_fullsized":"2023-07-21T07:34:42.252286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:10.302016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017925+0000","last_change":"2023-07-21T07:34:41.014135+0000","last_active":"2023-07-21T07:34:41.017925+0000","last_peered":"2023-07-21T07:34:41.017925+0000","last_clean":"2023-07-21T07:34:41.017925+0000","last_became_active":"2023-07-21T07:34:41.013571+0000","last_became_peered":"2023-07-21T07:34:41.013571+0000","last_unstale":"2023-07-21T07:34:41.017925+0000","last_undegraded":"2023-07-21T07:34:41.017925+0000","last_fullsized":"2023-07-21T07:34:41.017925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:58:16.705923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.995139+0000","last_change":"2023-07-21T07:34:40.005154+0000","last_active":"2023-07-21T07:34:40.995139+0000","last_peered":"2023-07-21T07:34:40.995139+0000","last_clean":"2023-07-21T07:34:40.995139+0000","last_became_active":"2023-07-21T07:34:40.004855+0000","last_became_peered":"2023-07-21T07:34:40.004855+0000","last_unstale":"2023-07-21T07:34:40.995139+0000","last_undegraded":"2023-07-21T07:34:40.995139+0000","last_fullsized":"2023-07-21T07:34:40.995139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:09.858244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252521+0000","last_change":"2023-07-21T07:34:41.010402+0000","last_active":"2023-07-21T07:34:42.252521+0000","last_peered":"2023-07-21T07:34:42.252521+0000","last_clean":"2023-07-21T07:34:42.252521+0000","last_became_active":"2023-07-21T07:34:41.010083+0000","last_became_peered":"2023-07-21T07:34:41.010083+0000","last_unstale":"2023-07-21T07:34:42.252521+0000","last_undegraded":"2023-07-21T07:34:42.252521+0000","last_fullsized":"2023-07-21T07:34:42.252521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:13.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991555+0000","last_change":"2023-07-21T07:34:40.001486+0000","last_active":"2023-07-21T07:34:41.991555+0000","last_peered":"2023-07-21T07:34:41.991555+0000","last_clean":"2023-07-21T07:34:41.991555+0000","last_became_active":"2023-07-21T07:34:40.001171+0000","last_became_peered":"2023-07-21T07:34:40.001171+0000","last_unstale":"2023-07-21T07:34:41.991555+0000","last_undegraded":"2023-07-21T07:34:41.991555+0000","last_fullsized":"2023-07-21T07:34:41.991555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:15.784735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177469+0000","last_change":"2023-07-21T07:34:41.015334+0000","last_active":"2023-07-21T07:34:42.177469+0000","last_peered":"2023-07-21T07:34:42.177469+0000","last_clean":"2023-07-21T07:34:42.177469+0000","last_became_active":"2023-07-21T07:34:41.014579+0000","last_became_peered":"2023-07-21T07:34:41.014579+0000","last_unstale":"2023-07-21T07:34:42.177469+0000","last_undegraded":"2023-07-21T07:34:42.177469+0000","last_fullsized":"2023-07-21T07:34:42.177469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:36.154510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.015826+0000","last_change":"2023-07-21T07:34:40.002994+0000","last_active":"2023-07-21T07:34:41.015826+0000","last_peered":"2023-07-21T07:34:41.015826+0000","last_clean":"2023-07-21T07:34:41.015826+0000","last_became_active":"2023-07-21T07:34:40.002626+0000","last_became_peered":"2023-07-21T07:34:40.002626+0000","last_unstale":"2023-07-21T07:34:41.015826+0000","last_undegraded":"2023-07-21T07:34:41.015826+0000","last_fullsized":"2023-07-21T07:34:41.015826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:21.178454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017431+0000","last_change":"2023-07-21T07:34:41.011397+0000","last_active":"2023-07-21T07:34:41.017431+0000","last_peered":"2023-07-21T07:34:41.017431+0000","last_clean":"2023-07-21T07:34:41.017431+0000","last_became_active":"2023-07-21T07:34:41.011074+0000","last_became_peered":"2023-07-21T07:34:41.011074+0000","last_unstale":"2023-07-21T07:34:41.017431+0000","last_undegraded":"2023-07-21T07:34:41.017431+0000","last_fullsized":"2023-07-21T07:34:41.017431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:23:03.521561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.016680+0000","last_change":"2023-07-21T07:34:40.002951+0000","last_active":"2023-07-21T07:34:41.016680+0000","last_peered":"2023-07-21T07:34:41.016680+0000","last_clean":"2023-07-21T07:34:41.016680+0000","last_became_active":"2023-07-21T07:34:40.002644+0000","last_became_peered":"2023-07-21T07:34:40.002644+0000","last_unstale":"2023-07-21T07:34:41.016680+0000","last_undegraded":"2023-07-21T07:34:41.016680+0000","last_fullsized":"2023-07-21T07:34:41.016680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:05.133495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991994+0000","last_change":"2023-07-21T07:34:40.999968+0000","last_active":"2023-07-21T07:34:41.991994+0000","last_peered":"2023-07-21T07:34:41.991994+0000","last_clean":"2023-07-21T07:34:41.991994+0000","last_became_active":"2023-07-21T07:34:40.999426+0000","last_became_peered":"2023-07-21T07:34:40.999426+0000","last_unstale":"2023-07-21T07:34:41.991994+0000","last_undegraded":"2023-07-21T07:34:41.991994+0000","last_fullsized":"2023-07-21T07:34:41.991994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:37.840825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.017740+0000","last_change":"2023-07-21T07:34:40.001121+0000","last_active":"2023-07-21T07:34:41.017740+0000","last_peered":"2023-07-21T07:34:41.017740+0000","last_clean":"2023-07-21T07:34:41.017740+0000","last_became_active":"2023-07-21T07:34:40.000781+0000","last_became_peered":"2023-07-21T07:34:40.000781+0000","last_unstale":"2023-07-21T07:34:41.017740+0000","last_undegraded":"2023-07-21T07:34:41.017740+0000","last_fullsized":"2023-07-21T07:34:41.017740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:41.600204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992005+0000","last_change":"2023-07-21T07:34:41.005148+0000","last_active":"2023-07-21T07:34:41.992005+0000","last_peered":"2023-07-21T07:34:41.992005+0000","last_clean":"2023-07-21T07:34:41.992005+0000","last_became_active":"2023-07-21T07:34:41.004857+0000","last_became_peered":"2023-07-21T07:34:41.004857+0000","last_unstale":"2023-07-21T07:34:41.992005+0000","last_undegraded":"2023-07-21T07:34:41.992005+0000","last_fullsized":"2023-07-21T07:34:41.992005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:23:03.521561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.988850+0000","last_change":"2023-07-21T07:34:40.001134+0000","last_active":"2023-07-21T07:34:40.988850+0000","last_peered":"2023-07-21T07:34:40.988850+0000","last_clean":"2023-07-21T07:34:40.988850+0000","last_became_active":"2023-07-21T07:34:40.000862+0000","last_became_peered":"2023-07-21T07:34:40.000862+0000","last_unstale":"2023-07-21T07:34:40.988850+0000","last_undegraded":"2023-07-21T07:34:40.988850+0000","last_fullsized":"2023-07-21T07:34:40.988850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:19:38.757728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252524+0000","last_change":"2023-07-21T07:34:41.004129+0000","last_active":"2023-07-21T07:34:42.252524+0000","last_peered":"2023-07-21T07:34:42.252524+0000","last_clean":"2023-07-21T07:34:42.252524+0000","last_became_active":"2023-07-21T07:34:41.003528+0000","last_became_peered":"2023-07-21T07:34:41.003528+0000","last_unstale":"2023-07-21T07:34:42.252524+0000","last_undegraded":"2023-07-21T07:34:42.252524+0000","last_fullsized":"2023-07-21T07:34:42.252524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:37.210979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177185+0000","last_change":"2023-07-21T07:34:40.001941+0000","last_active":"2023-07-21T07:34:42.177185+0000","last_peered":"2023-07-21T07:34:42.177185+0000","last_clean":"2023-07-21T07:34:42.177185+0000","last_became_active":"2023-07-21T07:34:40.001558+0000","last_became_peered":"2023-07-21T07:34:40.001558+0000","last_unstale":"2023-07-21T07:34:42.177185+0000","last_undegraded":"2023-07-21T07:34:42.177185+0000","last_fullsized":"2023-07-21T07:34:42.177185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:36.204200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992762+0000","last_change":"2023-07-21T07:34:41.013224+0000","last_active":"2023-07-21T07:34:41.992762+0000","last_peered":"2023-07-21T07:34:41.992762+0000","last_clean":"2023-07-21T07:34:41.992762+0000","last_became_active":"2023-07-21T07:34:41.012940+0000","last_became_peered":"2023-07-21T07:34:41.012940+0000","last_unstale":"2023-07-21T07:34:41.992762+0000","last_undegraded":"2023-07-21T07:34:41.992762+0000","last_fullsized":"2023-07-21T07:34:41.992762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:04:46.304259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991852+0000","last_change":"2023-07-21T07:34:39.998058+0000","last_active":"2023-07-21T07:34:41.991852+0000","last_peered":"2023-07-21T07:34:41.991852+0000","last_clean":"2023-07-21T07:34:41.991852+0000","last_became_active":"2023-07-21T07:34:39.997803+0000","last_became_peered":"2023-07-21T07:34:39.997803+0000","last_unstale":"2023-07-21T07:34:41.991852+0000","last_undegraded":"2023-07-21T07:34:41.991852+0000","last_fullsized":"2023-07-21T07:34:41.991852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:13:39.091695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992732+0000","last_change":"2023-07-21T07:34:41.009229+0000","last_active":"2023-07-21T07:34:41.992732+0000","last_peered":"2023-07-21T07:34:41.992732+0000","last_clean":"2023-07-21T07:34:41.992732+0000","last_became_active":"2023-07-21T07:34:41.004241+0000","last_became_peered":"2023-07-21T07:34:41.004241+0000","last_unstale":"2023-07-21T07:34:41.992732+0000","last_undegraded":"2023-07-21T07:34:41.992732+0000","last_fullsized":"2023-07-21T07:34:41.992732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:01:35.460233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992269+0000","last_change":"2023-07-21T07:34:39.997085+0000","last_active":"2023-07-21T07:34:41.992269+0000","last_peered":"2023-07-21T07:34:41.992269+0000","last_clean":"2023-07-21T07:34:41.992269+0000","last_became_active":"2023-07-21T07:34:39.996276+0000","last_became_peered":"2023-07-21T07:34:39.996276+0000","last_unstale":"2023-07-21T07:34:41.992269+0000","last_undegraded":"2023-07-21T07:34:41.992269+0000","last_fullsized":"2023-07-21T07:34:41.992269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:52.762722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992364+0000","last_change":"2023-07-21T07:34:41.008766+0000","last_active":"2023-07-21T07:34:41.992364+0000","last_peered":"2023-07-21T07:34:41.992364+0000","last_clean":"2023-07-21T07:34:41.992364+0000","last_became_active":"2023-07-21T07:34:41.005525+0000","last_became_peered":"2023-07-21T07:34:41.005525+0000","last_unstale":"2023-07-21T07:34:41.992364+0000","last_undegraded":"2023-07-21T07:34:41.992364+0000","last_fullsized":"2023-07-21T07:34:41.992364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:42.606983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177142+0000","last_change":"2023-07-21T07:34:40.000981+0000","last_active":"2023-07-21T07:34:42.177142+0000","last_peered":"2023-07-21T07:34:42.177142+0000","last_clean":"2023-07-21T07:34:42.177142+0000","last_became_active":"2023-07-21T07:34:40.000659+0000","last_became_peered":"2023-07-21T07:34:40.000659+0000","last_unstale":"2023-07-21T07:34:42.177142+0000","last_undegraded":"2023-07-21T07:34:42.177142+0000","last_fullsized":"2023-07-21T07:34:42.177142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:12.395122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.018763+0000","last_change":"2023-07-21T07:34:41.014435+0000","last_active":"2023-07-21T07:34:41.018763+0000","last_peered":"2023-07-21T07:34:41.018763+0000","last_clean":"2023-07-21T07:34:41.018763+0000","last_became_active":"2023-07-21T07:34:41.014124+0000","last_became_peered":"2023-07-21T07:34:41.014124+0000","last_unstale":"2023-07-21T07:34:41.018763+0000","last_undegraded":"2023-07-21T07:34:41.018763+0000","last_fullsized":"2023-07-21T07:34:41.018763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:05:54.994289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.987180+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:34:40.987180+0000","last_peered":"2023-07-21T07:34:40.987180+0000","last_clean":"2023-07-21T07:34:40.987180+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:34:40.987180+0000","last_undegraded":"2023-07-21T07:34:40.987180+0000","last_fullsized":"2023-07-21T07:34:40.987180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:10.652598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.991707+0000","last_change":"2023-07-21T07:34:40.002419+0000","last_active":"2023-07-21T07:34:40.991707+0000","last_peered":"2023-07-21T07:34:40.991707+0000","last_clean":"2023-07-21T07:34:40.991707+0000","last_became_active":"2023-07-21T07:34:40.001968+0000","last_became_peered":"2023-07-21T07:34:40.001968+0000","last_unstale":"2023-07-21T07:34:40.991707+0000","last_undegraded":"2023-07-21T07:34:40.991707+0000","last_fullsized":"2023-07-21T07:34:40.991707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:12.395122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.999783+0000","last_change":"2023-07-21T07:34:40.993474+0000","last_active":"2023-07-21T07:34:40.999783+0000","last_peered":"2023-07-21T07:34:40.999783+0000","last_clean":"2023-07-21T07:34:40.999783+0000","last_became_active":"2023-07-21T07:34:40.993127+0000","last_became_peered":"2023-07-21T07:34:40.993127+0000","last_unstale":"2023-07-21T07:34:40.999783+0000","last_undegraded":"2023-07-21T07:34:40.999783+0000","last_fullsized":"2023-07-21T07:34:40.999783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:38.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.989541+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:34:40.989541+0000","last_peered":"2023-07-21T07:34:40.989541+0000","last_clean":"2023-07-21T07:34:40.989541+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:34:40.989541+0000","last_undegraded":"2023-07-21T07:34:40.989541+0000","last_fullsized":"2023-07-21T07:34:40.989541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:05.169880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992570+0000","last_change":"2023-07-21T07:34:40.002541+0000","last_active":"2023-07-21T07:34:41.992570+0000","last_peered":"2023-07-21T07:34:41.992570+0000","last_clean":"2023-07-21T07:34:41.992570+0000","last_became_active":"2023-07-21T07:34:40.002244+0000","last_became_peered":"2023-07-21T07:34:40.002244+0000","last_unstale":"2023-07-21T07:34:41.992570+0000","last_undegraded":"2023-07-21T07:34:41.992570+0000","last_fullsized":"2023-07-21T07:34:41.992570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:35.147731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.999817+0000","last_change":"2023-07-21T07:34:40.993583+0000","last_active":"2023-07-21T07:34:40.999817+0000","last_peered":"2023-07-21T07:34:40.999817+0000","last_clean":"2023-07-21T07:34:40.999817+0000","last_became_active":"2023-07-21T07:34:40.992984+0000","last_became_peered":"2023-07-21T07:34:40.992984+0000","last_unstale":"2023-07-21T07:34:40.999817+0000","last_undegraded":"2023-07-21T07:34:40.999817+0000","last_fullsized":"2023-07-21T07:34:40.999817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:58:16.705923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.987877+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:34:41.987877+0000","last_peered":"2023-07-21T07:34:41.987877+0000","last_clean":"2023-07-21T07:34:41.987877+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:34:41.987877+0000","last_undegraded":"2023-07-21T07:34:41.987877+0000","last_fullsized":"2023-07-21T07:34:41.987877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:52:05.194684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.986864+0000","last_change":"2023-07-21T07:34:40.002203+0000","last_active":"2023-07-21T07:34:40.986864+0000","last_peered":"2023-07-21T07:34:40.986864+0000","last_clean":"2023-07-21T07:34:40.986864+0000","last_became_active":"2023-07-21T07:34:40.001222+0000","last_became_peered":"2023-07-21T07:34:40.001222+0000","last_unstale":"2023-07-21T07:34:40.986864+0000","last_undegraded":"2023-07-21T07:34:40.986864+0000","last_fullsized":"2023-07-21T07:34:40.986864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:52:10.326821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.001970+0000","last_change":"2023-07-21T07:34:40.994556+0000","last_active":"2023-07-21T07:34:41.001970+0000","last_peered":"2023-07-21T07:34:41.001970+0000","last_clean":"2023-07-21T07:34:41.001970+0000","last_became_active":"2023-07-21T07:34:40.994093+0000","last_became_peered":"2023-07-21T07:34:40.994093+0000","last_unstale":"2023-07-21T07:34:41.001970+0000","last_undegraded":"2023-07-21T07:34:41.001970+0000","last_fullsized":"2023-07-21T07:34:41.001970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:23:45.330390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.988544+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:34:40.988544+0000","last_peered":"2023-07-21T07:34:40.988544+0000","last_clean":"2023-07-21T07:34:40.988544+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:34:40.988544+0000","last_undegraded":"2023-07-21T07:34:40.988544+0000","last_fullsized":"2023-07-21T07:34:40.988544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:32.591696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.995517+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:34:40.995517+0000","last_peered":"2023-07-21T07:34:40.995517+0000","last_clean":"2023-07-21T07:34:40.995517+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:34:40.995517+0000","last_undegraded":"2023-07-21T07:34:40.995517+0000","last_fullsized":"2023-07-21T07:34:40.995517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:26.663006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.176949+0000","last_change":"2023-07-21T07:34:39.999821+0000","last_active":"2023-07-21T07:34:42.176949+0000","last_peered":"2023-07-21T07:34:42.176949+0000","last_clean":"2023-07-21T07:34:42.176949+0000","last_became_active":"2023-07-21T07:34:39.999465+0000","last_became_peered":"2023-07-21T07:34:39.999465+0000","last_unstale":"2023-07-21T07:34:42.176949+0000","last_undegraded":"2023-07-21T07:34:42.176949+0000","last_fullsized":"2023-07-21T07:34:42.176949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:09.858244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992699+0000","last_change":"2023-07-21T07:34:41.002207+0000","last_active":"2023-07-21T07:34:41.992699+0000","last_peered":"2023-07-21T07:34:41.992699+0000","last_clean":"2023-07-21T07:34:41.992699+0000","last_became_active":"2023-07-21T07:34:41.001868+0000","last_became_peered":"2023-07-21T07:34:41.001868+0000","last_unstale":"2023-07-21T07:34:41.992699+0000","last_undegraded":"2023-07-21T07:34:41.992699+0000","last_fullsized":"2023-07-21T07:34:41.992699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:23:45.330390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.995653+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:34:40.995653+0000","last_peered":"2023-07-21T07:34:40.995653+0000","last_clean":"2023-07-21T07:34:40.995653+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:34:40.995653+0000","last_undegraded":"2023-07-21T07:34:40.995653+0000","last_fullsized":"2023-07-21T07:34:40.995653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:00.596624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252218+0000","last_change":"2023-07-21T07:34:40.001692+0000","last_active":"2023-07-21T07:34:42.252218+0000","last_peered":"2023-07-21T07:34:42.252218+0000","last_clean":"2023-07-21T07:34:42.252218+0000","last_became_active":"2023-07-21T07:34:40.001345+0000","last_became_peered":"2023-07-21T07:34:40.001345+0000","last_unstale":"2023-07-21T07:34:42.252218+0000","last_undegraded":"2023-07-21T07:34:42.252218+0000","last_fullsized":"2023-07-21T07:34:42.252218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:05:53.987510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252678+0000","last_change":"2023-07-21T07:34:41.005653+0000","last_active":"2023-07-21T07:34:42.252678+0000","last_peered":"2023-07-21T07:34:42.252678+0000","last_clean":"2023-07-21T07:34:42.252678+0000","last_became_active":"2023-07-21T07:34:41.005291+0000","last_became_peered":"2023-07-21T07:34:41.005291+0000","last_unstale":"2023-07-21T07:34:42.252678+0000","last_undegraded":"2023-07-21T07:34:42.252678+0000","last_fullsized":"2023-07-21T07:34:42.252678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:49.798268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.001233+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:34:41.001233+0000","last_peered":"2023-07-21T07:34:41.001233+0000","last_clean":"2023-07-21T07:34:41.001233+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:34:41.001233+0000","last_undegraded":"2023-07-21T07:34:41.001233+0000","last_fullsized":"2023-07-21T07:34:41.001233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:47.630585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.988821+0000","last_change":"2023-07-21T07:34:40.005160+0000","last_active":"2023-07-21T07:34:40.988821+0000","last_peered":"2023-07-21T07:34:40.988821+0000","last_clean":"2023-07-21T07:34:40.988821+0000","last_became_active":"2023-07-21T07:34:40.004876+0000","last_became_peered":"2023-07-21T07:34:40.004876+0000","last_unstale":"2023-07-21T07:34:40.988821+0000","last_undegraded":"2023-07-21T07:34:40.988821+0000","last_fullsized":"2023-07-21T07:34:40.988821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:13:39.091695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252272+0000","last_change":"2023-07-21T07:34:41.004325+0000","last_active":"2023-07-21T07:34:42.252272+0000","last_peered":"2023-07-21T07:34:42.252272+0000","last_clean":"2023-07-21T07:34:42.252272+0000","last_became_active":"2023-07-21T07:34:41.003810+0000","last_became_peered":"2023-07-21T07:34:41.003810+0000","last_unstale":"2023-07-21T07:34:42.252272+0000","last_undegraded":"2023-07-21T07:34:42.252272+0000","last_fullsized":"2023-07-21T07:34:42.252272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:10.865023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177420+0000","last_change":"2023-07-21T07:34:40.003127+0000","last_active":"2023-07-21T07:34:42.177420+0000","last_peered":"2023-07-21T07:34:42.177420+0000","last_clean":"2023-07-21T07:34:42.177420+0000","last_became_active":"2023-07-21T07:34:40.002749+0000","last_became_peered":"2023-07-21T07:34:40.002749+0000","last_unstale":"2023-07-21T07:34:42.177420+0000","last_undegraded":"2023-07-21T07:34:42.177420+0000","last_fullsized":"2023-07-21T07:34:42.177420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:51.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:40.987843+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:34:40.987843+0000","last_peered":"2023-07-21T07:34:40.987843+0000","last_clean":"2023-07-21T07:34:40.987843+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:34:40.987843+0000","last_undegraded":"2023-07-21T07:34:40.987843+0000","last_fullsized":"2023-07-21T07:34:40.987843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:19:33.625591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177019+0000","last_change":"2023-07-21T07:34:41.013799+0000","last_active":"2023-07-21T07:34:42.177019+0000","last_peered":"2023-07-21T07:34:42.177019+0000","last_clean":"2023-07-21T07:34:42.177019+0000","last_became_active":"2023-07-21T07:34:41.013507+0000","last_became_peered":"2023-07-21T07:34:41.013507+0000","last_unstale":"2023-07-21T07:34:42.177019+0000","last_undegraded":"2023-07-21T07:34:42.177019+0000","last_fullsized":"2023-07-21T07:34:42.177019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:37.840825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992790+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:34:41.992790+0000","last_peered":"2023-07-21T07:34:41.992790+0000","last_clean":"2023-07-21T07:34:41.992790+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:34:41.992790+0000","last_undegraded":"2023-07-21T07:34:41.992790+0000","last_fullsized":"2023-07-21T07:34:41.992790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:19:33.625591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252628+0000","last_change":"2023-07-21T07:34:40.008949+0000","last_active":"2023-07-21T07:34:42.252628+0000","last_peered":"2023-07-21T07:34:42.252628+0000","last_clean":"2023-07-21T07:34:42.252628+0000","last_became_active":"2023-07-21T07:34:40.008673+0000","last_became_peered":"2023-07-21T07:34:40.008673+0000","last_unstale":"2023-07-21T07:34:42.252628+0000","last_undegraded":"2023-07-21T07:34:42.252628+0000","last_fullsized":"2023-07-21T07:34:42.252628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:05.133495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992135+0000","last_change":"2023-07-21T07:34:41.000146+0000","last_active":"2023-07-21T07:34:41.992135+0000","last_peered":"2023-07-21T07:34:41.992135+0000","last_clean":"2023-07-21T07:34:41.992135+0000","last_became_active":"2023-07-21T07:34:40.999714+0000","last_became_peered":"2023-07-21T07:34:40.999714+0000","last_unstale":"2023-07-21T07:34:41.992135+0000","last_undegraded":"2023-07-21T07:34:41.992135+0000","last_fullsized":"2023-07-21T07:34:41.992135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:37.210979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252474+0000","last_change":"2023-07-21T07:34:40.008365+0000","last_active":"2023-07-21T07:34:42.252474+0000","last_peered":"2023-07-21T07:34:42.252474+0000","last_clean":"2023-07-21T07:34:42.252474+0000","last_became_active":"2023-07-21T07:34:40.007918+0000","last_became_peered":"2023-07-21T07:34:40.007918+0000","last_unstale":"2023-07-21T07:34:42.252474+0000","last_undegraded":"2023-07-21T07:34:42.252474+0000","last_fullsized":"2023-07-21T07:34:42.252474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:05.728761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988078+0000","last_change":"2023-07-21T07:34:41.004151+0000","last_active":"2023-07-21T07:34:41.988078+0000","last_peered":"2023-07-21T07:34:41.988078+0000","last_clean":"2023-07-21T07:34:41.988078+0000","last_became_active":"2023-07-21T07:34:41.003809+0000","last_became_peered":"2023-07-21T07:34:41.003809+0000","last_unstale":"2023-07-21T07:34:41.988078+0000","last_undegraded":"2023-07-21T07:34:41.988078+0000","last_fullsized":"2023-07-21T07:34:41.988078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:13:50.121515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.015517+0000","last_change":"2023-07-21T07:34:39.999418+0000","last_active":"2023-07-21T07:34:41.015517+0000","last_peered":"2023-07-21T07:34:41.015517+0000","last_clean":"2023-07-21T07:34:41.015517+0000","last_became_active":"2023-07-21T07:34:39.999189+0000","last_became_peered":"2023-07-21T07:34:39.999189+0000","last_unstale":"2023-07-21T07:34:41.015517+0000","last_undegraded":"2023-07-21T07:34:41.015517+0000","last_fullsized":"2023-07-21T07:34:41.015517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:13:39.091695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992547+0000","last_change":"2023-07-21T07:34:41.012402+0000","last_active":"2023-07-21T07:34:41.992547+0000","last_peered":"2023-07-21T07:34:41.992547+0000","last_clean":"2023-07-21T07:34:41.992547+0000","last_became_active":"2023-07-21T07:34:41.012138+0000","last_became_peered":"2023-07-21T07:34:41.012138+0000","last_unstale":"2023-07-21T07:34:41.992547+0000","last_undegraded":"2023-07-21T07:34:41.992547+0000","last_fullsized":"2023-07-21T07:34:41.992547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:22.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.015355+0000","last_change":"2023-07-21T07:34:39.999316+0000","last_active":"2023-07-21T07:34:41.015355+0000","last_peered":"2023-07-21T07:34:41.015355+0000","last_clean":"2023-07-21T07:34:41.015355+0000","last_became_active":"2023-07-21T07:34:39.999072+0000","last_became_peered":"2023-07-21T07:34:39.999072+0000","last_unstale":"2023-07-21T07:34:41.015355+0000","last_undegraded":"2023-07-21T07:34:41.015355+0000","last_fullsized":"2023-07-21T07:34:41.015355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:36.834046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992553+0000","last_change":"2023-07-21T07:34:41.012360+0000","last_active":"2023-07-21T07:34:41.992553+0000","last_peered":"2023-07-21T07:34:41.992553+0000","last_clean":"2023-07-21T07:34:41.992553+0000","last_became_active":"2023-07-21T07:34:41.011969+0000","last_became_peered":"2023-07-21T07:34:41.011969+0000","last_unstale":"2023-07-21T07:34:41.992553+0000","last_undegraded":"2023-07-21T07:34:41.992553+0000","last_fullsized":"2023-07-21T07:34:41.992553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:52.703957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177280+0000","last_change":"2023-07-21T07:34:40.000613+0000","last_active":"2023-07-21T07:34:42.177280+0000","last_peered":"2023-07-21T07:34:42.177280+0000","last_clean":"2023-07-21T07:34:42.177280+0000","last_became_active":"2023-07-21T07:34:40.000306+0000","last_became_peered":"2023-07-21T07:34:40.000306+0000","last_unstale":"2023-07-21T07:34:42.177280+0000","last_undegraded":"2023-07-21T07:34:42.177280+0000","last_fullsized":"2023-07-21T07:34:42.177280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:41.600204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.176982+0000","last_change":"2023-07-21T07:34:41.011382+0000","last_active":"2023-07-21T07:34:42.176982+0000","last_peered":"2023-07-21T07:34:42.176982+0000","last_clean":"2023-07-21T07:34:42.176982+0000","last_became_active":"2023-07-21T07:34:41.010734+0000","last_became_peered":"2023-07-21T07:34:41.010734+0000","last_unstale":"2023-07-21T07:34:42.176982+0000","last_undegraded":"2023-07-21T07:34:42.176982+0000","last_fullsized":"2023-07-21T07:34:42.176982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:11.308795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252733+0000","last_change":"2023-07-21T07:34:40.000848+0000","last_active":"2023-07-21T07:34:42.252733+0000","last_peered":"2023-07-21T07:34:42.252733+0000","last_clean":"2023-07-21T07:34:42.252733+0000","last_became_active":"2023-07-21T07:34:40.000505+0000","last_became_peered":"2023-07-21T07:34:40.000505+0000","last_unstale":"2023-07-21T07:34:42.252733+0000","last_undegraded":"2023-07-21T07:34:42.252733+0000","last_fullsized":"2023-07-21T07:34:42.252733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:21.952698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992223+0000","last_change":"2023-07-21T07:34:41.000904+0000","last_active":"2023-07-21T07:34:41.992223+0000","last_peered":"2023-07-21T07:34:41.992223+0000","last_clean":"2023-07-21T07:34:41.992223+0000","last_became_active":"2023-07-21T07:34:41.000652+0000","last_became_peered":"2023-07-21T07:34:41.000652+0000","last_unstale":"2023-07-21T07:34:41.992223+0000","last_undegraded":"2023-07-21T07:34:41.992223+0000","last_fullsized":"2023-07-21T07:34:41.992223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:11.308795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991630+0000","last_change":"2023-07-21T07:34:41.007386+0000","last_active":"2023-07-21T07:34:41.991630+0000","last_peered":"2023-07-21T07:34:41.991630+0000","last_clean":"2023-07-21T07:34:41.991630+0000","last_became_active":"2023-07-21T07:34:41.007132+0000","last_became_peered":"2023-07-21T07:34:41.007132+0000","last_unstale":"2023-07-21T07:34:41.991630+0000","last_undegraded":"2023-07-21T07:34:41.991630+0000","last_fullsized":"2023-07-21T07:34:41.991630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:38.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.176926+0000","last_change":"2023-07-21T07:34:41.011588+0000","last_active":"2023-07-21T07:34:42.176926+0000","last_peered":"2023-07-21T07:34:42.176926+0000","last_clean":"2023-07-21T07:34:42.176926+0000","last_became_active":"2023-07-21T07:34:41.011068+0000","last_became_peered":"2023-07-21T07:34:41.011068+0000","last_unstale":"2023-07-21T07:34:42.176926+0000","last_undegraded":"2023-07-21T07:34:42.176926+0000","last_fullsized":"2023-07-21T07:34:42.176926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:54:20.793513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992299+0000","last_change":"2023-07-21T07:34:41.009302+0000","last_active":"2023-07-21T07:34:41.992299+0000","last_peered":"2023-07-21T07:34:41.992299+0000","last_clean":"2023-07-21T07:34:41.992299+0000","last_became_active":"2023-07-21T07:34:41.008833+0000","last_became_peered":"2023-07-21T07:34:41.008833+0000","last_unstale":"2023-07-21T07:34:41.992299+0000","last_undegraded":"2023-07-21T07:34:41.992299+0000","last_fullsized":"2023-07-21T07:34:41.992299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:06.140274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177335+0000","last_change":"2023-07-21T07:34:41.016235+0000","last_active":"2023-07-21T07:34:42.177335+0000","last_peered":"2023-07-21T07:34:42.177335+0000","last_clean":"2023-07-21T07:34:42.177335+0000","last_became_active":"2023-07-21T07:34:41.015889+0000","last_became_peered":"2023-07-21T07:34:41.015889+0000","last_unstale":"2023-07-21T07:34:42.177335+0000","last_undegraded":"2023-07-21T07:34:42.177335+0000","last_fullsized":"2023-07-21T07:34:42.177335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:22.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.005523+0000","last_change":"2023-07-21T07:34:40.999714+0000","last_active":"2023-07-21T07:34:41.005523+0000","last_peered":"2023-07-21T07:34:41.005523+0000","last_clean":"2023-07-21T07:34:41.005523+0000","last_became_active":"2023-07-21T07:34:40.999382+0000","last_became_peered":"2023-07-21T07:34:40.999382+0000","last_unstale":"2023-07-21T07:34:41.005523+0000","last_undegraded":"2023-07-21T07:34:41.005523+0000","last_fullsized":"2023-07-21T07:34:41.005523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:10:00.672282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":679765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":678567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":87707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":89237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":88269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:34:45.600 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T07:34:45.600 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-21T07:34:45.600 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-21T07:34:45.601 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-21T07:34:45.601 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-21T07:34:45.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.705+0000 7fba0bc3e700 1 Processor -- start 2023-07-21T07:34:45.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.706+0000 7fba0bc3e700 1 -- start start 2023-07-21T07:34:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.706+0000 7fba0bc3e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fba0414eb40 0x7fba04065fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.706+0000 7fba0bc3e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba0406b1a0 0x7fba040aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.706+0000 7fba0bc3e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba040abf50 0x7fba04151250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.706+0000 7fba0bc3e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0414ef20 con 0x7fba040abf50 2023-07-21T07:34:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.706+0000 7fba0bc3e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0406bbf0 con 0x7fba0414eb40 2023-07-21T07:34:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.706+0000 7fba0bc3e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba04066520 con 0x7fba0406b1a0 2023-07-21T07:34:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba0a1db700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba040abf50 0x7fba04151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba0a1db700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba040abf50 0x7fba04151250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60684/0 (socket says 172.21.15.6:60684) 2023-07-21T07:34:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba0a1db700 1 -- 172.21.15.6:0/2611542775 learned_addr learned my addr 172.21.15.6:0/2611542775 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba099da700 1 --2- 172.21.15.6:0/2611542775 >> v2:172.21.15.86:3300/0 conn(0x7fba0414eb40 0x7fba04065fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba091d9700 1 --2- 172.21.15.6:0/2611542775 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba0406b1a0 0x7fba040aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba0a1db700 1 -- 172.21.15.6:0/2611542775 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba0406b1a0 msgr2=0x7fba040aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba0a1db700 1 --2- 172.21.15.6:0/2611542775 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba0406b1a0 0x7fba040aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba0a1db700 1 -- 172.21.15.6:0/2611542775 >> v2:172.21.15.86:3300/0 conn(0x7fba0414eb40 msgr2=0x7fba04065fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba0a1db700 1 --2- 172.21.15.6:0/2611542775 >> v2:172.21.15.86:3300/0 conn(0x7fba0414eb40 0x7fba04065fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba0a1db700 1 -- 172.21.15.6:0/2611542775 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04070310 con 0x7fba040abf50 2023-07-21T07:34:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba0a1db700 1 --2- 172.21.15.6:0/2611542775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba040abf50 0x7fba04151250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fba04073dd0 tx=0x7fb9fc00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631d96ec4aca1221 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba089d8700 1 -- 172.21.15.6:0/2611542775 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc010070 con 0x7fba040abf50 2023-07-21T07:34:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba089d8700 1 -- 172.21.15.6:0/2611542775 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00dd90 con 0x7fba040abf50 2023-07-21T07:34:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.707+0000 7fba089d8700 1 -- 172.21.15.6:0/2611542775 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00b310 con 0x7fba040abf50 2023-07-21T07:34:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.708+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2611542775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba040abf50 msgr2=0x7fba04151250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.708+0000 7fba0bc3e700 1 --2- 172.21.15.6:0/2611542775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba040abf50 0x7fba04151250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fba04073dd0 tx=0x7fb9fc00d430 comp rx=0 tx=0).stop 2023-07-21T07:34:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.708+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2611542775 shutdown_connections 2023-07-21T07:34:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.708+0000 7fba0bc3e700 1 --2- 172.21.15.6:0/2611542775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba040abf50 0x7fba04151250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.708+0000 7fba0bc3e700 1 --2- 172.21.15.6:0/2611542775 >> v2:172.21.15.86:3300/0 conn(0x7fba0414eb40 0x7fba04065fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.708+0000 7fba0bc3e700 1 --2- 172.21.15.6:0/2611542775 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba0406b1a0 0x7fba040aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.708+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2611542775 >> 172.21.15.6:0/2611542775 conn(0x7fba040c6140 msgr2=0x7fba040c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.708+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2611542775 shutdown_connections 2023-07-21T07:34:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.708+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2611542775 wait complete. 2023-07-21T07:34:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.709+0000 7fba0bc3e700 1 Processor -- start 2023-07-21T07:34:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.709+0000 7fba0bc3e700 1 -- start start 2023-07-21T07:34:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba0bc3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba040abf50 0x7fba04151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba0bc3e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba0414eb40 0x7fba0414c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba0bc3e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba04149b70 0x7fba0414c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba0bc3e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0414bf20 con 0x7fba040abf50 2023-07-21T07:34:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba0bc3e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba04149920 con 0x7fba0414eb40 2023-07-21T07:34:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba0bc3e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba04151870 con 0x7fba04149b70 2023-07-21T07:34:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba099da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba040abf50 0x7fba04151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba099da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba040abf50 0x7fba04151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60686/0 (socket says 172.21.15.6:60686) 2023-07-21T07:34:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba099da700 1 -- 172.21.15.6:0/2902349187 learned_addr learned my addr 172.21.15.6:0/2902349187 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba091d9700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba0414eb40 0x7fba0414c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba0a1db700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba04149b70 0x7fba0414c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba099da700 1 -- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba04149b70 msgr2=0x7fba0414c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba099da700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba04149b70 0x7fba0414c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba099da700 1 -- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba0414eb40 msgr2=0x7fba0414c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba099da700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba0414eb40 0x7fba0414c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.710+0000 7fba099da700 1 -- 172.21.15.6:0/2902349187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc00bd40 con 0x7fba040abf50 2023-07-21T07:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.711+0000 7fba099da700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba040abf50 0x7fba04151030 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400d800 tx=0x7fb9f400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.711+0000 7fb9fa7fc700 1 -- 172.21.15.6:0/2902349187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f40125f0 con 0x7fba040abf50 2023-07-21T07:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.711+0000 7fb9fa7fc700 1 -- 172.21.15.6:0/2902349187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f4012750 con 0x7fba040abf50 2023-07-21T07:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.711+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2902349187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba041e96f0 con 0x7fba040abf50 2023-07-21T07:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.711+0000 7fb9fa7fc700 1 -- 172.21.15.6:0/2902349187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4012b00 con 0x7fba040abf50 2023-07-21T07:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.711+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2902349187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0414f0c0 con 0x7fba040abf50 2023-07-21T07:34:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.712+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2902349187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0414f430 con 0x7fba040abf50 2023-07-21T07:34:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.712+0000 7fb9fa7fc700 1 -- 172.21.15.6:0/2902349187 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb9f4012c60 con 0x7fba040abf50 2023-07-21T07:34:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.712+0000 7fb9fa7fc700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb9e806ace0 0x7fb9e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.713+0000 7fb9fa7fc700 1 -- 172.21.15.6:0/2902349187 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9f4089400 con 0x7fba040abf50 2023-07-21T07:34:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.713+0000 7fba091d9700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb9e806ace0 0x7fb9e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.713+0000 7fba091d9700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb9e806ace0 0x7fb9e806d1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba0406ae40 tx=0x7fba00008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.717+0000 7fb9fa7fc700 1 -- 172.21.15.6:0/2902349187 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb9f40545f0 con 0x7fba040abf50 2023-07-21T07:34:46.024 INFO:tasks.ceph.mds.d.smithi086.stderr:2023-07-21T07:34:45.974+0000 7fb0d1499700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T07:34:46.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.977+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2902349187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fba04074500 con 0x7fba040abf50 2023-07-21T07:34:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.980+0000 7fb9fa7fc700 1 -- 172.21.15.6:0/2902349187 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170837 (secure 0 0 0) 0x7fb9f4057c10 con 0x7fba040abf50 2023-07-21T07:34:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.983+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb9e806ace0 msgr2=0x7fb9e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.983+0000 7fba0bc3e700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb9e806ace0 0x7fb9e806d1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba0406ae40 tx=0x7fba00008040 comp rx=0 tx=0).stop 2023-07-21T07:34:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.983+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2902349187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba040abf50 msgr2=0x7fba04151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.983+0000 7fba0bc3e700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba040abf50 0x7fba04151030 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400d800 tx=0x7fb9f400db10 comp rx=0 tx=0).stop 2023-07-21T07:34:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.983+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2902349187 shutdown_connections 2023-07-21T07:34:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.983+0000 7fba0bc3e700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb9e806ace0 0x7fb9e806d1a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.983+0000 7fba0bc3e700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba04149b70 0x7fba0414c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.983+0000 7fba0bc3e700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba040abf50 0x7fba04151030 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.983+0000 7fba0bc3e700 1 --2- 172.21.15.6:0/2902349187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba0414eb40 0x7fba0414c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.983+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2902349187 >> 172.21.15.6:0/2902349187 conn(0x7fba040c6140 msgr2=0x7fba040aa740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.983+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2902349187 shutdown_connections 2023-07-21T07:34:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:45.983+0000 7fba0bc3e700 1 -- 172.21.15.6:0/2902349187 wait complete. 2023-07-21T07:34:46.046 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":462616725},{"type":"v1","addr":"172.21.15.86:6833","nonce":462616725}]},"active_addr":"172.21.15.86:6833/462616725","active_change":"2023-07-21T07:34:20.682911+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2389310359}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":536543563}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":1316792623}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":323393670}]}]} 2023-07-21T07:34:46.050 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-21T07:34:46.050 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-21T07:34:46.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:46.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.124+0000 7f0da719f700 1 Processor -- start 2023-07-21T07:34:46.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.124+0000 7f0da719f700 1 -- start start 2023-07-21T07:34:46.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.124+0000 7f0da719f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da006a300 0x7f0da006da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.124+0000 7f0da719f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0da0155050 0x7f0da0151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.124+0000 7f0da719f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0da0151c50 0x7f0da00c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0da719f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da00c2ab0 con 0x7f0da0151c50 2023-07-21T07:34:46.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0da719f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da006e000 con 0x7f0da0155050 2023-07-21T07:34:46.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0da719f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da006e2e0 con 0x7f0da006a300 2023-07-21T07:34:46.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0da573c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0da0151c50 0x7f0da00c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0da573c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0da0151c50 0x7f0da00c2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60698/0 (socket says 172.21.15.6:60698) 2023-07-21T07:34:46.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0da573c700 1 -- 172.21.15.6:0/1142426219 learned_addr learned my addr 172.21.15.6:0/1142426219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0d9ffff700 1 --2- 172.21.15.6:0/1142426219 >> v2:172.21.15.86:3300/0 conn(0x7f0da0155050 0x7f0da0151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0da4f3b700 1 --2- 172.21.15.6:0/1142426219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da006a300 0x7f0da006da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0da573c700 1 -- 172.21.15.6:0/1142426219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da006a300 msgr2=0x7f0da006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0da573c700 1 --2- 172.21.15.6:0/1142426219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da006a300 0x7f0da006da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0da573c700 1 -- 172.21.15.6:0/1142426219 >> v2:172.21.15.86:3300/0 conn(0x7f0da0155050 msgr2=0x7f0da0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0da573c700 1 --2- 172.21.15.6:0/1142426219 >> v2:172.21.15.86:3300/0 conn(0x7f0da0155050 0x7f0da0151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0da573c700 1 -- 172.21.15.6:0/1142426219 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da006e5c0 con 0x7f0da0151c50 2023-07-21T07:34:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0da573c700 1 --2- 172.21.15.6:0/1142426219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da0151c50 0x7f0da00c2f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0da006b170 tx=0x7f0d9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8758fc8ca8f73c7d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0d9f7fe700 1 -- 172.21.15.6:0/1142426219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800e070 con 0x7f0da0151c50 2023-07-21T07:34:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0d9f7fe700 1 -- 172.21.15.6:0/1142426219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9800b910 con 0x7f0da0151c50 2023-07-21T07:34:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.125+0000 7f0d9f7fe700 1 -- 172.21.15.6:0/1142426219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800bcc0 con 0x7f0da0151c50 2023-07-21T07:34:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.126+0000 7f0da719f700 1 -- 172.21.15.6:0/1142426219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da0151c50 msgr2=0x7f0da00c2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.126+0000 7f0da719f700 1 --2- 172.21.15.6:0/1142426219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da0151c50 0x7f0da00c2f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0da006b170 tx=0x7f0d9800b330 comp rx=0 tx=0).stop 2023-07-21T07:34:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.126+0000 7f0da719f700 1 -- 172.21.15.6:0/1142426219 shutdown_connections 2023-07-21T07:34:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.126+0000 7f0da719f700 1 --2- 172.21.15.6:0/1142426219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da0151c50 0x7f0da00c2f40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.126+0000 7f0da719f700 1 --2- 172.21.15.6:0/1142426219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da006a300 0x7f0da006da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.126+0000 7f0da719f700 1 --2- 172.21.15.6:0/1142426219 >> v2:172.21.15.86:3300/0 conn(0x7f0da0155050 0x7f0da0151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.126+0000 7f0da719f700 1 -- 172.21.15.6:0/1142426219 >> 172.21.15.6:0/1142426219 conn(0x7f0da00a8c90 msgr2=0x7f0da006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.126+0000 7f0da719f700 1 -- 172.21.15.6:0/1142426219 shutdown_connections 2023-07-21T07:34:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.126+0000 7f0da719f700 1 -- 172.21.15.6:0/1142426219 wait complete. 2023-07-21T07:34:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.127+0000 7f0da719f700 1 Processor -- start 2023-07-21T07:34:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.127+0000 7f0da719f700 1 -- start start 2023-07-21T07:34:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da719f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da006a300 0x7f0da00b9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da719f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da0151c50 0x7f0da0070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da719f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da0155050 0x7f0da01e9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da719f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da014eea0 con 0x7f0da0155050 2023-07-21T07:34:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da719f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da0072040 con 0x7f0da006a300 2023-07-21T07:34:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da719f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da01ed630 con 0x7f0da0151c50 2023-07-21T07:34:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da573c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da0155050 0x7f0da01e9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da573c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da0155050 0x7f0da01e9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60704/0 (socket says 172.21.15.6:60704) 2023-07-21T07:34:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da573c700 1 -- 172.21.15.6:0/4251781501 learned_addr learned my addr 172.21.15.6:0/4251781501 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da4f3b700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da006a300 0x7f0da00b9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0d9ffff700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da0151c50 0x7f0da0070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da573c700 1 -- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da0151c50 msgr2=0x7f0da0070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da573c700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da0151c50 0x7f0da0070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da573c700 1 -- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da006a300 msgr2=0x7f0da00b9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da573c700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da006a300 0x7f0da00b9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.128+0000 7f0da573c700 1 -- 172.21.15.6:0/4251781501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d98009b30 con 0x7f0da0155050 2023-07-21T07:34:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.129+0000 7f0da573c700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da0155050 0x7f0da01e9960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0da00c4650 tx=0x7f0d98004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.129+0000 7f0d9d7fa700 1 -- 172.21.15.6:0/4251781501 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d980092e0 con 0x7f0da0155050 2023-07-21T07:34:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.129+0000 7f0d9d7fa700 1 -- 172.21.15.6:0/4251781501 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9800ce80 con 0x7f0da0155050 2023-07-21T07:34:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.129+0000 7f0da719f700 1 -- 172.21.15.6:0/4251781501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da01ed910 con 0x7f0da0155050 2023-07-21T07:34:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.129+0000 7f0d9d7fa700 1 -- 172.21.15.6:0/4251781501 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d980044b0 con 0x7f0da0155050 2023-07-21T07:34:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.129+0000 7f0da719f700 1 -- 172.21.15.6:0/4251781501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da014f3d0 con 0x7f0da0155050 2023-07-21T07:34:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.130+0000 7f0da719f700 1 -- 172.21.15.6:0/4251781501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da0074500 con 0x7f0da0155050 2023-07-21T07:34:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.130+0000 7f0d9d7fa700 1 -- 172.21.15.6:0/4251781501 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d98004610 con 0x7f0da0155050 2023-07-21T07:34:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.131+0000 7f0d9d7fa700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d8406ad10 0x7f0d8406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.131+0000 7f0d9d7fa700 1 -- 172.21.15.6:0/4251781501 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d9808a780 con 0x7f0da0155050 2023-07-21T07:34:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.131+0000 7f0da4f3b700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d8406ad10 0x7f0d8406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.132+0000 7f0da4f3b700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d8406ad10 0x7f0d8406d1d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009b60 tx=0x7f0d94009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:46.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.135+0000 7f0d9d7fa700 1 -- 172.21.15.6:0/4251781501 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0d98059350 con 0x7f0da0155050 2023-07-21T07:34:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.334+0000 7f0da719f700 1 -- 172.21.15.6:0/4251781501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0da01e9610 con 0x7f0da0155050 2023-07-21T07:34:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.335+0000 7f0d9d7fa700 1 -- 172.21.15.6:0/4251781501 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f0d98058ee0 con 0x7f0da0155050 2023-07-21T07:34:46.387 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:46.387 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.337+0000 7f0da719f700 1 -- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d8406ad10 msgr2=0x7f0d8406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.337+0000 7f0da719f700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d8406ad10 0x7f0d8406d1d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009b60 tx=0x7f0d94009210 comp rx=0 tx=0).stop 2023-07-21T07:34:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.337+0000 7f0da719f700 1 -- 172.21.15.6:0/4251781501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da0155050 msgr2=0x7f0da01e9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.337+0000 7f0da719f700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da0155050 0x7f0da01e9960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0da00c4650 tx=0x7f0d98004ad0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.338+0000 7f0da719f700 1 -- 172.21.15.6:0/4251781501 shutdown_connections 2023-07-21T07:34:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.338+0000 7f0da719f700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d8406ad10 0x7f0d8406d1d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.338+0000 7f0da719f700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da0155050 0x7f0da01e9960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.338+0000 7f0da719f700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da006a300 0x7f0da00b9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.338+0000 7f0da719f700 1 --2- 172.21.15.6:0/4251781501 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da0151c50 0x7f0da0070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.338+0000 7f0da719f700 1 -- 172.21.15.6:0/4251781501 >> 172.21.15.6:0/4251781501 conn(0x7f0da00a8c90 msgr2=0x7f0da00a7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.338+0000 7f0da719f700 1 -- 172.21.15.6:0/4251781501 shutdown_connections 2023-07-21T07:34:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.338+0000 7f0da719f700 1 -- 172.21.15.6:0/4251781501 wait complete. 2023-07-21T07:34:46.401 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-21T07:34:46.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:46.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.474+0000 7f10ad5f7700 1 Processor -- start 2023-07-21T07:34:46.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.474+0000 7f10ad5f7700 1 -- start start 2023-07-21T07:34:46.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.475+0000 7f10ad5f7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f10a814dd80 0x7f10a814e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.475+0000 7f10ad5f7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a80c2990 con 0x7f10a8070810 2023-07-21T07:34:46.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.475+0000 7f10ad5f7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a80c1b20 con 0x7f10a80c25b0 2023-07-21T07:34:46.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.475+0000 7f10ad5f7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a8066540 con 0x7f10a814dd80 2023-07-21T07:34:46.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.475+0000 7f10a67fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f10a8070810 0x7f10a8065e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40496/0 (socket says 172.21.15.6:40496) 2023-07-21T07:34:46.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.475+0000 7f10a67fc700 1 -- 172.21.15.6:0/2904904513 learned_addr learned my addr 172.21.15.6:0/2904904513 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:46.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.475+0000 7f10a77fe700 1 --2- 172.21.15.6:0/2904904513 >> v2:172.21.15.86:3300/0 conn(0x7f10a814dd80 0x7f10a814e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.476+0000 7f10a5ffb700 1 -- 172.21.15.6:0/2904904513 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904582836 0 0) 0x7f10a80c2990 con 0x7f10a8070810 2023-07-21T07:34:46.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.476+0000 7f10a5ffb700 1 -- 172.21.15.6:0/2904904513 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10900035b0 con 0x7f10a8070810 2023-07-21T07:34:46.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.476+0000 7f10a5ffb700 1 -- 172.21.15.6:0/2904904513 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53272055 0 0) 0x7f10a80c1b20 con 0x7f10a80c25b0 2023-07-21T07:34:46.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.476+0000 7f10a5ffb700 1 -- 172.21.15.6:0/2904904513 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a80c2990 con 0x7f10a80c25b0 2023-07-21T07:34:46.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.476+0000 7f10a5ffb700 1 -- 172.21.15.6:0/2904904513 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2976078735 0 0) 0x7f10900035b0 con 0x7f10a8070810 2023-07-21T07:34:46.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.476+0000 7f10a77fe700 1 -- 172.21.15.6:0/2904904513 >> v1:172.21.15.86:6789/0 conn(0x7f10a80c25b0 legacy=0x7f10a81542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.476+0000 7f10a77fe700 1 -- 172.21.15.6:0/2904904513 >> v1:172.21.15.6:6789/0 conn(0x7f10a8070810 legacy=0x7f10a8065e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.476+0000 7f10a77fe700 1 -- 172.21.15.6:0/2904904513 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a814e750 con 0x7f10a814dd80 2023-07-21T07:34:46.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.476+0000 7f10a77fe700 1 --2- 172.21.15.6:0/2904904513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a814dd80 0x7f10a814e210 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009dc0 tx=0x7f10a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fd9ab9317b87576 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:46.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.476+0000 7f10a5ffb700 1 -- 172.21.15.6:0/2904904513 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a000e070 con 0x7f10a814dd80 2023-07-21T07:34:46.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.476+0000 7f10a5ffb700 1 -- 172.21.15.6:0/2904904513 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a0003a20 con 0x7f10a814dd80 2023-07-21T07:34:46.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.476+0000 7f10a5ffb700 1 -- 172.21.15.6:0/2904904513 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098001670 con 0x7f10a814dd80 2023-07-21T07:34:46.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.477+0000 7f10ad5f7700 1 -- 172.21.15.6:0/2904904513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a814dd80 msgr2=0x7f10a814e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.477+0000 7f10ad5f7700 1 --2- 172.21.15.6:0/2904904513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a814dd80 0x7f10a814e210 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009dc0 tx=0x7f10a000b330 comp rx=0 tx=0).stop 2023-07-21T07:34:46.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.477+0000 7f10ad5f7700 1 -- 172.21.15.6:0/2904904513 shutdown_connections 2023-07-21T07:34:46.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.477+0000 7f10ad5f7700 1 --2- 172.21.15.6:0/2904904513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a814dd80 0x7f10a814e210 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.477+0000 7f10ad5f7700 1 -- 172.21.15.6:0/2904904513 >> 172.21.15.6:0/2904904513 conn(0x7f10a80c6140 msgr2=0x7f10a80c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:46.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.477+0000 7f10ad5f7700 1 -- 172.21.15.6:0/2904904513 shutdown_connections 2023-07-21T07:34:46.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.477+0000 7f10ad5f7700 1 -- 172.21.15.6:0/2904904513 wait complete. 2023-07-21T07:34:46.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.478+0000 7f10ad5f7700 1 Processor -- start 2023-07-21T07:34:46.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.478+0000 7f10ad5f7700 1 -- start start 2023-07-21T07:34:46.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10ad5f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10a8070810 0x7f10a8145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10ad5f7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10a80c25b0 0x7f10a80c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10ad5f7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a814dd80 0x7f10a814fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10ad5f7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a81460c0 con 0x7f10a8070810 2023-07-21T07:34:46.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10ad5f7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a81db5a0 con 0x7f10a814dd80 2023-07-21T07:34:46.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10ad5f7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a81ea570 con 0x7f10a80c25b0 2023-07-21T07:34:46.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10a8070810 0x7f10a8145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10a8070810 0x7f10a8145b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60714/0 (socket says 172.21.15.6:60714) 2023-07-21T07:34:46.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10a6ffd700 1 -- 172.21.15.6:0/936996398 learned_addr learned my addr 172.21.15.6:0/936996398 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:46.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10a67fc700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10a80c25b0 0x7f10a80c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10a77fe700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a814dd80 0x7f10a814fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10a6ffd700 1 -- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10a80c25b0 msgr2=0x7f10a80c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10a6ffd700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10a80c25b0 0x7f10a80c2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10a6ffd700 1 -- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a814dd80 msgr2=0x7f10a814fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10a6ffd700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a814dd80 0x7f10a814fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10a6ffd700 1 -- 172.21.15.6:0/936996398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a0009a70 con 0x7f10a8070810 2023-07-21T07:34:46.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.479+0000 7f10a6ffd700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10a8070810 0x7f10a8145b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f109c00e970 tx=0x7f109c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:46.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.480+0000 7f108f7fe700 1 -- 172.21.15.6:0/936996398 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c0052d0 con 0x7f10a8070810 2023-07-21T07:34:46.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.480+0000 7f108f7fe700 1 -- 172.21.15.6:0/936996398 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c005470 con 0x7f10a8070810 2023-07-21T07:34:46.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.480+0000 7f10ad5f7700 1 -- 172.21.15.6:0/936996398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a81ea850 con 0x7f10a8070810 2023-07-21T07:34:46.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.480+0000 7f108f7fe700 1 -- 172.21.15.6:0/936996398 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c0108e0 con 0x7f10a8070810 2023-07-21T07:34:46.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.480+0000 7f10ad5f7700 1 -- 172.21.15.6:0/936996398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a814f720 con 0x7f10a8070810 2023-07-21T07:34:46.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.481+0000 7f10ad5f7700 1 -- 172.21.15.6:0/936996398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a8070c60 con 0x7f10a8070810 2023-07-21T07:34:46.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.481+0000 7f108f7fe700 1 -- 172.21.15.6:0/936996398 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f109c010a40 con 0x7f10a8070810 2023-07-21T07:34:46.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.481+0000 7f108f7fe700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f109406ace0 0x7f109406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.482+0000 7f108f7fe700 1 -- 172.21.15.6:0/936996398 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f109c08b450 con 0x7f10a8070810 2023-07-21T07:34:46.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.482+0000 7f10a67fc700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f109406ace0 0x7f109406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.482+0000 7f10a67fc700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f109406ace0 0x7f109406d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f10a81464b0 tx=0x7f1098000ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:46.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.486+0000 7f108f7fe700 1 -- 172.21.15.6:0/936996398 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f109c056500 con 0x7f10a8070810 2023-07-21T07:34:46.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.684+0000 7f10ad5f7700 1 -- 172.21.15.6:0/936996398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10a8074500 con 0x7f10a8070810 2023-07-21T07:34:46.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.685+0000 7f108f7fe700 1 -- 172.21.15.6:0/936996398 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f109c059b20 con 0x7f10a8070810 2023-07-21T07:34:46.736 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:46.737 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:46.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.687+0000 7f10ad5f7700 1 -- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f109406ace0 msgr2=0x7f109406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.687+0000 7f10ad5f7700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f109406ace0 0x7f109406d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f10a81464b0 tx=0x7f1098000ed0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.687+0000 7f10ad5f7700 1 -- 172.21.15.6:0/936996398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10a8070810 msgr2=0x7f10a8145b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.687+0000 7f10ad5f7700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10a8070810 0x7f10a8145b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f109c00e970 tx=0x7f109c00ec80 comp rx=0 tx=0).stop 2023-07-21T07:34:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.687+0000 7f10ad5f7700 1 -- 172.21.15.6:0/936996398 shutdown_connections 2023-07-21T07:34:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.687+0000 7f10ad5f7700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f109406ace0 0x7f109406d1a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.687+0000 7f10ad5f7700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a814dd80 0x7f10a814fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.687+0000 7f10ad5f7700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10a8070810 0x7f10a8145b80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.687+0000 7f10ad5f7700 1 --2- 172.21.15.6:0/936996398 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10a80c25b0 0x7f10a80c2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.687+0000 7f10ad5f7700 1 -- 172.21.15.6:0/936996398 >> 172.21.15.6:0/936996398 conn(0x7f10a80c6140 msgr2=0x7f10a8065e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:46.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.687+0000 7f10ad5f7700 1 -- 172.21.15.6:0/936996398 shutdown_connections 2023-07-21T07:34:46.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.687+0000 7f10ad5f7700 1 -- 172.21.15.6:0/936996398 wait complete. 2023-07-21T07:34:46.751 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-21T07:34:46.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-21T07:34:46.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-21T07:34:46.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-21T07:34:46.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-21T07:34:46.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-21T07:34:46.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-21T07:34:46.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-21T07:34:46.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f484b023700 1 Processor -- start 2023-07-21T07:34:46.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f484b023700 1 -- start start 2023-07-21T07:34:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.920+0000 7f1d6d5b9700 1 Processor -- start 2023-07-21T07:34:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.920+0000 7f1d6d5b9700 1 -- start start 2023-07-21T07:34:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.921+0000 7f1d6d5b9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d681532e0 0x7f1d680c4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.921+0000 7f1d6d5b9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d680aae80 0x7f1d680c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.921+0000 7f1d6d5b9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d680c0380 con 0x7f1d681559e0 2023-07-21T07:34:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.921+0000 7f1d6d5b9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d680a5390 con 0x7f1d680aae80 2023-07-21T07:34:46.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.921+0000 7f1d6d5b9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680a50b0 con 0x7f1d681532e0 2023-07-21T07:34:46.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.921+0000 7f1d66ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d681532e0 0x7f1d680c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.921+0000 7f1d66ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d681532e0 0x7f1d680c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:58116/0 (socket says 172.21.15.6:58116) 2023-07-21T07:34:46.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.921+0000 7f1d66ffd700 1 -- 172.21.15.6:0/4144378496 learned_addr learned my addr 172.21.15.6:0/4144378496 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:46.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.922+0000 7f1d66ffd700 1 -- 172.21.15.6:0/4144378496 >> v2:172.21.15.6:3300/0 conn(0x7f1d680aae80 msgr2=0x7f1d680c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:46.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.922+0000 7f1d66ffd700 1 --2- 172.21.15.6:0/4144378496 >> v2:172.21.15.6:3300/0 conn(0x7f1d680aae80 0x7f1d680c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.922+0000 7f1d65ffb700 1 -- 172.21.15.6:0/4144378496 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733677924 0 0) 0x7f1d680c0380 con 0x7f1d681559e0 2023-07-21T07:34:46.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.922+0000 7f1d66ffd700 1 -- 172.21.15.6:0/4144378496 >> v1:172.21.15.86:6789/0 conn(0x7f1d681559e0 legacy=0x7f1d680c0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.922+0000 7f1d66ffd700 1 -- 172.21.15.6:0/4144378496 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d680c53b0 con 0x7f1d681532e0 2023-07-21T07:34:46.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.922+0000 7f1d66ffd700 1 --2- 172.21.15.6:0/4144378496 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d681532e0 0x7f1d680c4250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0098f0 tx=0x7f1d5c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5cfb82d594d4d56 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:46.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.922+0000 7f1d65ffb700 1 -- 172.21.15.6:0/4144378496 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00b8a0 con 0x7f1d681532e0 2023-07-21T07:34:46.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.922+0000 7f1d65ffb700 1 -- 172.21.15.6:0/4144378496 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c00ba00 con 0x7f1d681532e0 2023-07-21T07:34:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.922+0000 7f1d65ffb700 1 -- 172.21.15.6:0/4144378496 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00bd90 con 0x7f1d681532e0 2023-07-21T07:34:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.923+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/4144378496 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d681532e0 msgr2=0x7f1d680c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.923+0000 7f1d6d5b9700 1 --2- 172.21.15.6:0/4144378496 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d681532e0 0x7f1d680c4250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0098f0 tx=0x7f1d5c009c00 comp rx=0 tx=0).stop 2023-07-21T07:34:46.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.923+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/4144378496 shutdown_connections 2023-07-21T07:34:46.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.923+0000 7f1d6d5b9700 1 --2- 172.21.15.6:0/4144378496 >> v2:172.21.15.6:3300/0 conn(0x7f1d680aae80 0x7f1d680c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.923+0000 7f1d6d5b9700 1 --2- 172.21.15.6:0/4144378496 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d681532e0 0x7f1d680c4250 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.923+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/4144378496 >> 172.21.15.6:0/4144378496 conn(0x7f1d6806a6c0 msgr2=0x7f1d680a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/4144378496 shutdown_connections 2023-07-21T07:34:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/4144378496 wait complete. 2023-07-21T07:34:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.922+0000 7f76e7a6d700 1 Processor -- start 2023-07-21T07:34:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.922+0000 7f76e7a6d700 1 -- start start 2023-07-21T07:34:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e7a6d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f76e01510a0 0x7f76e00c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e7a6d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76e0153f90 0x7f76e0154420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e7a6d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e00c09f0 con 0x7f76e00c5370 2023-07-21T07:34:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e7a6d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e00baff0 con 0x7f76e0153f90 2023-07-21T07:34:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e7a6d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e00c0cd0 con 0x7f76e01510a0 2023-07-21T07:34:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e5008700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f76e00c5370 0x7f76e00c3f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40518/0 (socket says 172.21.15.6:40518) 2023-07-21T07:34:46.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e5008700 1 -- 172.21.15.6:0/427746791 learned_addr learned my addr 172.21.15.6:0/427746791 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:46.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e5809700 1 --2- 172.21.15.6:0/427746791 >> v2:172.21.15.86:3300/0 conn(0x7f76e01510a0 0x7f76e00c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e4807700 1 -- 172.21.15.6:0/427746791 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832076278 0 0) 0x7f76e00c09f0 con 0x7f76e00c5370 2023-07-21T07:34:46.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e4807700 1 -- 172.21.15.6:0/427746791 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76cc0035b0 con 0x7f76e00c5370 2023-07-21T07:34:46.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.925+0000 7f484b023700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48441510a0 0x7f48440c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.925+0000 7f484b023700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48440c5370 0x7f48440c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.925+0000 7f484b023700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48440c4440 0x7f4844153f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.925+0000 7f484b023700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48440baff0 con 0x7f48441510a0 2023-07-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.925+0000 7f484b023700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48440c09f0 con 0x7f48440c4440 2023-07-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.925+0000 7f484b023700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48440c0cd0 con 0x7f48440c5370 2023-07-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f4843fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48440c5370 0x7f48440c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f4843fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48440c5370 0x7f48440c3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:58128/0 (socket says 172.21.15.6:58128) 2023-07-21T07:34:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f4843fff700 1 -- 172.21.15.6:0/4019123438 learned_addr learned my addr 172.21.15.6:0/4019123438 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f48495c0700 1 --2- 172.21.15.6:0/4019123438 >> v2:172.21.15.86:3300/0 conn(0x7f48440c4440 0x7f4844153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f48495c0700 1 -- 172.21.15.6:0/4019123438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48440c5370 msgr2=0x7f48440c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f48495c0700 1 --2- 172.21.15.6:0/4019123438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48440c5370 0x7f48440c3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f48495c0700 1 -- 172.21.15.6:0/4019123438 >> v2:172.21.15.6:3300/0 conn(0x7f48441510a0 msgr2=0x7f48440c4e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T07:34:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f48495c0700 1 --2- 172.21.15.6:0/4019123438 >> v2:172.21.15.6:3300/0 conn(0x7f48441510a0 0x7f48440c4e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f48495c0700 1 -- 172.21.15.6:0/4019123438 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48440c0fb0 con 0x7f48440c4440 2023-07-21T07:34:46.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f48495c0700 1 --2- 172.21.15.6:0/4019123438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48440c4440 0x7f4844153f90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48440a4d70 tx=0x7f4838009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be8c0adebe0e121b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f48437fe700 1 -- 172.21.15.6:0/4019123438 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838011830 con 0x7f48440c4440 2023-07-21T07:34:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.929+0000 7f48437fe700 1 -- 172.21.15.6:0/4019123438 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4838011990 con 0x7f48440c4440 2023-07-21T07:34:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.929+0000 7f48437fe700 1 -- 172.21.15.6:0/4019123438 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838011d20 con 0x7f48440c4440 2023-07-21T07:34:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.929+0000 7f484b023700 1 -- 172.21.15.6:0/4019123438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48440c4440 msgr2=0x7f4844153f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.929+0000 7f484b023700 1 --2- 172.21.15.6:0/4019123438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48440c4440 0x7f4844153f90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48440a4d70 tx=0x7f4838009b20 comp rx=0 tx=0).stop 2023-07-21T07:34:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.926+0000 7f1d6d5b9700 1 Processor -- start 2023-07-21T07:34:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.926+0000 7f1d6d5b9700 1 -- start start 2023-07-21T07:34:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d6d5b9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d680aae80 0x7f1d680aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d6d5b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d681532e0 0x7f1d680bbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d6d5b9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d681559e0 0x7f1d68147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d6d5b9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68147850 con 0x7f1d681532e0 2023-07-21T07:34:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d6d5b9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68146f20 con 0x7f1d681559e0 2023-07-21T07:34:46.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d6d5b9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68147200 con 0x7f1d680aae80 2023-07-21T07:34:46.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d677fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d681559e0 0x7f1d68147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d677fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d681559e0 0x7f1d68147ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54314/0 (socket says 172.21.15.6:54314) 2023-07-21T07:34:46.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d677fe700 1 -- 172.21.15.6:0/3652833949 learned_addr learned my addr 172.21.15.6:0/3652833949 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d667fc700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d681532e0 0x7f1d680bbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d677fe700 1 -- 172.21.15.6:0/3652833949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d680aae80 msgr2=0x7f1d680aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d677fe700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d680aae80 0x7f1d680aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d677fe700 1 -- 172.21.15.6:0/3652833949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d681532e0 msgr2=0x7f1d680bbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d677fe700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d681532e0 0x7f1d680bbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f1d677fe700 1 -- 172.21.15.6:0/3652833949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5c009550 con 0x7f1d681559e0 2023-07-21T07:34:46.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f1d667fc700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d681532e0 0x7f1d680bbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:46.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f1d677fe700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d681559e0 0x7f1d68147ce0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000b970 tx=0x7f1d6000bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:46.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.925+0000 7fcad7556700 1 Processor -- start 2023-07-21T07:34:46.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.925+0000 7fcad7556700 1 -- start start 2023-07-21T07:34:46.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.926+0000 7fcad7556700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcad006d860 0x7fcad01513d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.926+0000 7fcad7556700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcad00bf440 0x7fcad00bd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.926+0000 7fcad7556700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcad00bda30 0x7fcad0071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.926+0000 7fcad7556700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad00be640 con 0x7fcad00bf440 2023-07-21T07:34:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.926+0000 7fcad7556700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad00c0510 con 0x7fcad006d860 2023-07-21T07:34:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.926+0000 7fcad7556700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad006dc40 con 0x7fcad00bda30 2023-07-21T07:34:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7fcad52f2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcad006d860 0x7fcad01513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7fcad52f2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcad006d860 0x7fcad01513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54308/0 (socket says 172.21.15.6:54308) 2023-07-21T07:34:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7fcad52f2700 1 -- 172.21.15.6:0/3529554927 learned_addr learned my addr 172.21.15.6:0/3529554927 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7fcad52f2700 1 -- 172.21.15.6:0/3529554927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcad00bda30 msgr2=0x7fcad0071010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T07:34:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7fcad52f2700 1 --2- 172.21.15.6:0/3529554927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcad00bda30 0x7fcad0071010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7fcad52f2700 1 -- 172.21.15.6:0/3529554927 >> v2:172.21.15.6:3300/0 conn(0x7fcad00bf440 msgr2=0x7fcad00bd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7fcad52f2700 1 --2- 172.21.15.6:0/3529554927 >> v2:172.21.15.6:3300/0 conn(0x7fcad00bf440 0x7fcad00bd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7fcad52f2700 1 -- 172.21.15.6:0/3529554927 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad00bf900 con 0x7fcad006d860 2023-07-21T07:34:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7fcad52f2700 1 --2- 172.21.15.6:0/3529554927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad006d860 0x7fcad01513d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcad006e6a0 tx=0x7fcacc009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89fb024a54bce077 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.930+0000 7fcac7fff700 1 -- 172.21.15.6:0/3529554927 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00b870 con 0x7fcad006d860 2023-07-21T07:34:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.930+0000 7fcac7fff700 1 -- 172.21.15.6:0/3529554927 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc00b9d0 con 0x7fcad006d860 2023-07-21T07:34:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.930+0000 7fcac7fff700 1 -- 172.21.15.6:0/3529554927 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00bd60 con 0x7fcad006d860 2023-07-21T07:34:46.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.931+0000 7fcad7556700 1 -- 172.21.15.6:0/3529554927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad006d860 msgr2=0x7fcad01513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:46.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.931+0000 7fcad7556700 1 --2- 172.21.15.6:0/3529554927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad006d860 0x7fcad01513d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcad006e6a0 tx=0x7fcacc009bd0 comp rx=0 tx=0).stop 2023-07-21T07:34:46.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e5809700 1 -- 172.21.15.6:0/427746791 >> v2:172.21.15.6:3300/0 conn(0x7f76e0153f90 msgr2=0x7f76e0154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:46.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e5809700 1 --2- 172.21.15.6:0/427746791 >> v2:172.21.15.6:3300/0 conn(0x7f76e0153f90 0x7f76e0154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e5809700 1 -- 172.21.15.6:0/427746791 >> v1:172.21.15.6:6789/0 conn(0x7f76e00c5370 legacy=0x7f76e00c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.924+0000 7f76e5809700 1 -- 172.21.15.6:0/427746791 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e00c0fb0 con 0x7f76e01510a0 2023-07-21T07:34:47.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.925+0000 7f76e5809700 1 --2- 172.21.15.6:0/427746791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76e01510a0 0x7f76e00c4e30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76e00c30f0 tx=0x7f76d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cafcfa9a219260 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.926+0000 7f76e4807700 1 -- 172.21.15.6:0/427746791 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d800e070 con 0x7f76e01510a0 2023-07-21T07:34:47.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f76e4807700 1 -- 172.21.15.6:0/427746791 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d800bb20 con 0x7f76e01510a0 2023-07-21T07:34:47.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.927+0000 7f76e4807700 1 -- 172.21.15.6:0/427746791 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d8012430 con 0x7f76e01510a0 2023-07-21T07:34:47.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f76e7a6d700 1 -- 172.21.15.6:0/427746791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76e01510a0 msgr2=0x7f76e00c4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f76e7a6d700 1 --2- 172.21.15.6:0/427746791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76e01510a0 0x7f76e00c4e30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76e00c30f0 tx=0x7f76d800b330 comp rx=0 tx=0).stop 2023-07-21T07:34:47.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f76e7a6d700 1 -- 172.21.15.6:0/427746791 shutdown_connections 2023-07-21T07:34:47.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f76e7a6d700 1 --2- 172.21.15.6:0/427746791 >> v2:172.21.15.6:3300/0 conn(0x7f76e0153f90 0x7f76e0154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f76e7a6d700 1 --2- 172.21.15.6:0/427746791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76e01510a0 0x7f76e00c4e30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f76e7a6d700 1 -- 172.21.15.6:0/427746791 >> 172.21.15.6:0/427746791 conn(0x7f76e006a6c0 msgr2=0x7f76e00a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f76e7a6d700 1 -- 172.21.15.6:0/427746791 shutdown_connections 2023-07-21T07:34:47.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.928+0000 7f76e7a6d700 1 -- 172.21.15.6:0/427746791 wait complete. 2023-07-21T07:34:47.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.930+0000 7f76e7a6d700 1 Processor -- start 2023-07-21T07:34:47.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.930+0000 7f76e7a6d700 1 -- start start 2023-07-21T07:34:47.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.931+0000 7f76e7a6d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76e00c5370 0x7f76e0148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.931+0000 7f76e7a6d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76e01510a0 0x7f76e013b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.931+0000 7f76e7a6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e0153f90 0x7f76e013b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.931+0000 7f76e7a6d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e0137ea0 con 0x7f76e0153f90 2023-07-21T07:34:47.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.931+0000 7f76e7a6d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e0138180 con 0x7f76e01510a0 2023-07-21T07:34:47.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.931+0000 7f76e7a6d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e0138460 con 0x7f76e00c5370 2023-07-21T07:34:47.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.931+0000 7f76e600a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e0153f90 0x7f76e013b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.931+0000 7f76e5809700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76e00c5370 0x7f76e0148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.931+0000 7f76e600a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e0153f90 0x7f76e013b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60752/0 (socket says 172.21.15.6:60752) 2023-07-21T07:34:47.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.931+0000 7f76e600a700 1 -- 172.21.15.6:0/591402647 learned_addr learned my addr 172.21.15.6:0/591402647 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.931+0000 7f76e5008700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76e01510a0 0x7f76e013b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f76e600a700 1 -- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76e00c5370 msgr2=0x7f76e0148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f76e600a700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76e00c5370 0x7f76e0148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f76e600a700 1 -- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76e01510a0 msgr2=0x7f76e013b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f76e600a700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76e01510a0 0x7f76e013b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f76e600a700 1 -- 172.21.15.6:0/591402647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8009a70 con 0x7f76e0153f90 2023-07-21T07:34:47.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f76e5809700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76e00c5370 0x7f76e0148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:47.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f76e5008700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76e01510a0 0x7f76e013b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:47.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f76e600a700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e0153f90 0x7f76e013b930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00b410 tx=0x7f76dc00b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f484b023700 1 -- 172.21.15.6:0/4019123438 shutdown_connections 2023-07-21T07:34:47.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f484b023700 1 --2- 172.21.15.6:0/4019123438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48440c4440 0x7f4844153f90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f484b023700 1 --2- 172.21.15.6:0/4019123438 >> v2:172.21.15.6:3300/0 conn(0x7f48441510a0 0x7f48440c4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f484b023700 1 --2- 172.21.15.6:0/4019123438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48440c5370 0x7f48440c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f484b023700 1 -- 172.21.15.6:0/4019123438 >> 172.21.15.6:0/4019123438 conn(0x7f484406a6c0 msgr2=0x7f48440a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f484b023700 1 -- 172.21.15.6:0/4019123438 shutdown_connections 2023-07-21T07:34:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f1d4f7fe700 1 -- 172.21.15.6:0/3652833949 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000c9b0 con 0x7f1d681559e0 2023-07-21T07:34:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f1d4f7fe700 1 -- 172.21.15.6:0/3652833949 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6000cb30 con 0x7f1d681559e0 2023-07-21T07:34:47.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f1d4f7fe700 1 -- 172.21.15.6:0/3652833949 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60014440 con 0x7f1d681559e0 2023-07-21T07:34:47.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f76d67fc700 1 -- 172.21.15.6:0/591402647 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc011830 con 0x7f76e0153f90 2023-07-21T07:34:47.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f76d67fc700 1 -- 172.21.15.6:0/591402647 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc0119b0 con 0x7f76e0153f90 2023-07-21T07:34:47.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f76d67fc700 1 -- 172.21.15.6:0/591402647 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc011d60 con 0x7f76e0153f90 2023-07-21T07:34:47.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f76e7a6d700 1 -- 172.21.15.6:0/591402647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e0138740 con 0x7f76e0153f90 2023-07-21T07:34:47.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/3652833949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d681474e0 con 0x7f1d681559e0 2023-07-21T07:34:47.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f76e7a6d700 1 -- 172.21.15.6:0/591402647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e00c4c10 con 0x7f76e0153f90 2023-07-21T07:34:47.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.933+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/3652833949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d680c0b10 con 0x7f1d681559e0 2023-07-21T07:34:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.933+0000 7fcad7556700 1 -- 172.21.15.6:0/3529554927 shutdown_connections 2023-07-21T07:34:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.933+0000 7fcad7556700 1 --2- 172.21.15.6:0/3529554927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcad00bda30 0x7fcad0071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.933+0000 7fcad7556700 1 --2- 172.21.15.6:0/3529554927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad006d860 0x7fcad01513d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.933+0000 7fcad7556700 1 --2- 172.21.15.6:0/3529554927 >> v2:172.21.15.6:3300/0 conn(0x7fcad00bf440 0x7fcad00bd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.933+0000 7fcad7556700 1 -- 172.21.15.6:0/3529554927 >> 172.21.15.6:0/3529554927 conn(0x7fcad00c09f0 msgr2=0x7fcad00c0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.933+0000 7f23549d1700 1 Processor -- start 2023-07-21T07:34:47.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.933+0000 7f23549d1700 1 -- start start 2023-07-21T07:34:47.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.932+0000 7f484b023700 1 -- 172.21.15.6:0/4019123438 wait complete. 2023-07-21T07:34:47.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.934+0000 7f484b023700 1 Processor -- start 2023-07-21T07:34:47.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.934+0000 7f484b023700 1 -- start start 2023-07-21T07:34:47.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f484b023700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48440c4440 0x7f48440aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f484b023700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48440c5370 0x7f48440a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f484b023700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48441510a0 0x7f48441e5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f484b023700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48441e59e0 con 0x7f48440c5370 2023-07-21T07:34:47.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f484b023700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48441e56d0 con 0x7f48440c4440 2023-07-21T07:34:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f484b023700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48441db710 con 0x7f48441510a0 2023-07-21T07:34:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f4848dbf700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48440c4440 0x7f48440aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f4848dbf700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48440c4440 0x7f48440aaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54330/0 (socket says 172.21.15.6:54330) 2023-07-21T07:34:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f4848dbf700 1 -- 172.21.15.6:0/1049159442 learned_addr learned my addr 172.21.15.6:0/1049159442 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.935+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/3652833949 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d680c5690 con 0x7f1d681559e0 2023-07-21T07:34:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f1d4f7fe700 1 -- 172.21.15.6:0/3652833949 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d6001d3b0 con 0x7f1d681559e0 2023-07-21T07:34:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.934+0000 7fd7e69db700 1 Processor -- start 2023-07-21T07:34:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.935+0000 7fd7e69db700 1 -- start start 2023-07-21T07:34:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7fd7e69db700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7e00c4260 0x7fd7e00c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7fd7e69db700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7e00c0350 0x7fd7e00c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7fd7e69db700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e00c1140 con 0x7fd7e0156200 2023-07-21T07:34:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7fd7e69db700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e015c9d0 con 0x7fd7e00c4260 2023-07-21T07:34:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7fd7e69db700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e015ccb0 con 0x7fd7e00c0350 2023-07-21T07:34:47.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.933+0000 7f76e7a6d700 1 -- 172.21.15.6:0/591402647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76e01382f0 con 0x7f76e0153f90 2023-07-21T07:34:47.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.935+0000 7f23549d1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23501532e0 0x7f23500c4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.935+0000 7f23549d1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f23500aae80 0x7f23500c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.935+0000 7f23549d1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23500c0380 con 0x7f23501559e0 2023-07-21T07:34:47.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.935+0000 7f23549d1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23500a5390 con 0x7f23500aae80 2023-07-21T07:34:47.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.935+0000 7f23549d1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23500a50b0 con 0x7f23501532e0 2023-07-21T07:34:47.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f234e59c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23501532e0 0x7f23500c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f234e59c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23501532e0 0x7f23500c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:58148/0 (socket says 172.21.15.6:58148) 2023-07-21T07:34:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f234e59c700 1 -- 172.21.15.6:0/2418119324 learned_addr learned my addr 172.21.15.6:0/2418119324 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f234ed9d700 1 --2- 172.21.15.6:0/2418119324 >> v2:172.21.15.6:3300/0 conn(0x7f23500aae80 0x7f23500c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f234e59c700 1 -- 172.21.15.6:0/2418119324 >> v2:172.21.15.6:3300/0 conn(0x7f23500aae80 msgr2=0x7f23500c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f234e59c700 1 --2- 172.21.15.6:0/2418119324 >> v2:172.21.15.6:3300/0 conn(0x7f23500aae80 0x7f23500c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f234e59c700 1 -- 172.21.15.6:0/2418119324 >> v1:172.21.15.86:6789/0 conn(0x7f23501559e0 legacy=0x7f23500c0810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T07:34:47.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f234e59c700 1 -- 172.21.15.6:0/2418119324 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500c53b0 con 0x7f23501532e0 2023-07-21T07:34:47.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f76d67fc700 1 -- 172.21.15.6:0/591402647 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76dc01a400 con 0x7f76e0153f90 2023-07-21T07:34:47.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7fd7df7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7e00c4260 0x7fd7e00c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7fd7dffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd7e0156200 0x7fd7e00c0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40550/0 (socket says 172.21.15.6:40550) 2023-07-21T07:34:47.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7fd7dffff700 1 -- 172.21.15.6:0/3679394328 learned_addr learned my addr 172.21.15.6:0/3679394328 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:47.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7fd7e4f78700 1 --2- 172.21.15.6:0/3679394328 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7e00c0350 0x7fd7e00c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f4843fff700 1 --2- 172.21.15.6:0/1049159442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48440c5370 0x7f48440a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f4848dbf700 1 -- 172.21.15.6:0/1049159442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48441510a0 msgr2=0x7f48441e5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f4848dbf700 1 --2- 172.21.15.6:0/1049159442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48441510a0 0x7f48441e5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f4848dbf700 1 -- 172.21.15.6:0/1049159442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48440c5370 msgr2=0x7f48440a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f4848dbf700 1 --2- 172.21.15.6:0/1049159442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48440c5370 0x7f48440a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f4848dbf700 1 -- 172.21.15.6:0/1049159442 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48380094a0 con 0x7f48440c4440 2023-07-21T07:34:47.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7fd7df7fe700 1 -- 172.21.15.6:0/3679394328 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7e00c0350 msgr2=0x7fd7e00c21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7fd7df7fe700 1 --2- 172.21.15.6:0/3679394328 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7e00c0350 0x7fd7e00c21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7fd7df7fe700 1 -- 172.21.15.6:0/3679394328 >> v1:172.21.15.6:6789/0 conn(0x7fd7e0156200 legacy=0x7fd7e00c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7fd7df7fe700 1 -- 172.21.15.6:0/3679394328 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e00a4ef0 con 0x7fd7e00c4260 2023-07-21T07:34:47.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f4848dbf700 1 --2- 172.21.15.6:0/1049159442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48440c4440 0x7f48440aaf10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f483c00ba50 tx=0x7f483c00bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7fd7df7fe700 1 --2- 172.21.15.6:0/3679394328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e00c4260 0x7fd7e00c53a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009840 tx=0x7fd7d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5aef0be49e9a02 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.936+0000 7f1d4f7fe700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1d5406ad30 0x7f1d5406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f1d4f7fe700 1 -- 172.21.15.6:0/3652833949 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d60006e40 con 0x7f1d681559e0 2023-07-21T07:34:47.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f1d4f7fe700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.6:6802/3429574632,v1:172.21.15.6:6804/3429574632] conn(0x7f1d540735f0 0x7f1d54075a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f1d4f7fe700 1 -- 172.21.15.6:0/3652833949 --> [v2:172.21.15.6:6802/3429574632,v1:172.21.15.6:6804/3429574632] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d540760c0 con 0x7f1d540735f0 2023-07-21T07:34:47.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f1d4f7fe700 1 -- 172.21.15.6:0/3652833949 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d60089ac0 con 0x7f1d681559e0 2023-07-21T07:34:47.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f1d667fc700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.6:6802/3429574632,v1:172.21.15.6:6804/3429574632] conn(0x7f1d540735f0 0x7f1d54075a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7fb749ba8700 1 Processor -- start 2023-07-21T07:34:47.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f48417fa700 1 -- 172.21.15.6:0/1049159442 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00c9e0 con 0x7f48440c4440 2023-07-21T07:34:47.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f48417fa700 1 -- 172.21.15.6:0/1049159442 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c00cb40 con 0x7f48440c4440 2023-07-21T07:34:47.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f48417fa700 1 -- 172.21.15.6:0/1049159442 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c014440 con 0x7f48440c4440 2023-07-21T07:34:47.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7fcad7556700 1 -- 172.21.15.6:0/3529554927 shutdown_connections 2023-07-21T07:34:47.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7fb749ba8700 1 -- start start 2023-07-21T07:34:47.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.938+0000 7f234e59c700 1 --2- 172.21.15.6:0/2418119324 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23501532e0 0x7f23500c4250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f23400131e0 tx=0x7f23400134f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32a7adf7f27ee8f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f484b023700 1 -- 172.21.15.6:0/1049159442 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48440c3fc0 con 0x7f48440c4440 2023-07-21T07:34:47.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f484b023700 1 -- 172.21.15.6:0/1049159442 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48441db150 con 0x7f48440c4440 2023-07-21T07:34:47.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.938+0000 7f484b023700 1 -- 172.21.15.6:0/1049159442 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f48440c1570 con 0x7f48440c4440 2023-07-21T07:34:47.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.938+0000 7f1d66ffd700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1d5406ad30 0x7f1d5406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.938+0000 7f1d667fc700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.6:6802/3429574632,v1:172.21.15.6:6804/3429574632] conn(0x7f1d540735f0 0x7f1d54075a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7fcad7556700 1 -- 172.21.15.6:0/3529554927 wait complete. 2023-07-21T07:34:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.938+0000 7fd7deffd700 1 -- 172.21.15.6:0/3679394328 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4004230 con 0x7fd7e00c4260 2023-07-21T07:34:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.938+0000 7fd7deffd700 1 -- 172.21.15.6:0/3679394328 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d4004390 con 0x7fd7e00c4260 2023-07-21T07:34:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.938+0000 7fd7deffd700 1 -- 172.21.15.6:0/3679394328 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40036a0 con 0x7fd7e00c4260 2023-07-21T07:34:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f76d67fc700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f76c406ace0 0x7f76c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f76d67fc700 1 -- 172.21.15.6:0/591402647 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76dc089380 con 0x7f76e0153f90 2023-07-21T07:34:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f76d67fc700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:6800/141737948,v1:172.21.15.86:6801/141737948] conn(0x7f76c4073520 0x7f76c4075940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f76d67fc700 1 -- 172.21.15.6:0/591402647 --> [v2:172.21.15.86:6800/141737948,v1:172.21.15.86:6801/141737948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76c4075ff0 con 0x7f76c4073520 2023-07-21T07:34:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.937+0000 7f76e5008700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:6800/141737948,v1:172.21.15.86:6801/141737948] conn(0x7f76c4073520 0x7f76c4075940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.938+0000 7f76e5809700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f76c406ace0 0x7f76c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.938+0000 7f76e5008700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:6800/141737948,v1:172.21.15.86:6801/141737948] conn(0x7f76c4073520 0x7f76c4075940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.938+0000 7f234d59a700 1 -- 172.21.15.6:0/2418119324 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340013d30 con 0x7f23501532e0 2023-07-21T07:34:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.938+0000 7f234d59a700 1 -- 172.21.15.6:0/2418119324 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2340013e90 con 0x7f23501532e0 2023-07-21T07:34:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.938+0000 7f234d59a700 1 -- 172.21.15.6:0/2418119324 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340004250 con 0x7f23501532e0 2023-07-21T07:34:47.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.939+0000 7f76d67fc700 1 -- 172.21.15.6:0/591402647 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76dc054390 con 0x7f76e0153f90 2023-07-21T07:34:47.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.939+0000 7f76d67fc700 1 -- 172.21.15.6:0/591402647 <== osd.5 v2:172.21.15.86:6800/141737948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f76c4075ff0 con 0x7f76c4073520 2023-07-21T07:34:47.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.939+0000 7fcad7556700 1 Processor -- start 2023-07-21T07:34:47.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.939+0000 7fd7e69db700 1 -- 172.21.15.6:0/3679394328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e00c4260 msgr2=0x7fd7e00c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.939+0000 7fd7e69db700 1 --2- 172.21.15.6:0/3679394328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e00c4260 0x7fd7e00c53a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009840 tx=0x7fd7d4009b50 comp rx=0 tx=0).stop 2023-07-21T07:34:47.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.940+0000 7f1d66ffd700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1d5406ad30 0x7f1d5406d1f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c000c00 tx=0x7f1d5c010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.940+0000 7f1d4f7fe700 1 -- 172.21.15.6:0/3652833949 <== osd.1 v2:172.21.15.6:6802/3429574632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1d540760c0 con 0x7f1d540735f0 2023-07-21T07:34:47.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.939+0000 7fcad7556700 1 -- start start 2023-07-21T07:34:47.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.940+0000 7fcad7556700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad006d860 0x7fcad006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.940+0000 7fcad7556700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcad00bda30 0x7fcad01ee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.940+0000 7fcad7556700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad00bf440 0x7fcad006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.940+0000 7fcad7556700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad006b180 con 0x7fcad006d860 2023-07-21T07:34:47.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.940+0000 7fcad7556700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad014f8e0 con 0x7fcad00bf440 2023-07-21T07:34:47.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.940+0000 7fcad7556700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad006d070 con 0x7fcad00bda30 2023-07-21T07:34:47.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.940+0000 7fcad52f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad006d860 0x7fcad006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.940+0000 7fcad52f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad006d860 0x7fcad006cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60778/0 (socket says 172.21.15.6:60778) 2023-07-21T07:34:47.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.940+0000 7fcad52f2700 1 -- 172.21.15.6:0/3192926266 learned_addr learned my addr 172.21.15.6:0/3192926266 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.940+0000 7fcad5af3700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad00bf440 0x7fcad006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.940+0000 7fcad4af1700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcad00bda30 0x7fcad01ee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.939+0000 7f23549d1700 1 -- 172.21.15.6:0/2418119324 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23501532e0 msgr2=0x7f23500c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.939+0000 7f23549d1700 1 --2- 172.21.15.6:0/2418119324 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23501532e0 0x7f23500c4250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f23400131e0 tx=0x7f23400134f0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fd7e69db700 1 -- 172.21.15.6:0/3679394328 shutdown_connections 2023-07-21T07:34:47.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fd7e69db700 1 --2- 172.21.15.6:0/3679394328 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7e00c0350 0x7fd7e00c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fd7e69db700 1 --2- 172.21.15.6:0/3679394328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e00c4260 0x7fd7e00c53a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fd7e69db700 1 -- 172.21.15.6:0/3679394328 >> 172.21.15.6:0/3679394328 conn(0x7fd7e006aa10 msgr2=0x7fd7e00a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7f48417fa700 1 -- 172.21.15.6:0/1049159442 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f483c0145a0 con 0x7f48440c4440 2023-07-21T07:34:47.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7f76e5809700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f76c406ace0 0x7f76c406d1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000f80 tx=0x7f76d8011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fd7e69db700 1 -- 172.21.15.6:0/3679394328 shutdown_connections 2023-07-21T07:34:47.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7f48417fa700 1 --2- 172.21.15.6:0/1049159442 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f482806ad00 0x7f482806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7f48417fa700 1 -- 172.21.15.6:0/1049159442 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f483c089b70 con 0x7f48440c4440 2023-07-21T07:34:47.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7f4843fff700 1 --2- 172.21.15.6:0/1049159442 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f482806ad00 0x7f482806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7f48417fa700 1 --2- 172.21.15.6:0/1049159442 >> [v2:172.21.15.6:6816/3132105263,v1:172.21.15.6:6817/3132105263] conn(0x7f48280735c0 0x7f48280759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7f48417fa700 1 -- 172.21.15.6:0/1049159442 --> [v2:172.21.15.6:6816/3132105263,v1:172.21.15.6:6817/3132105263] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4828076090 con 0x7f48280735c0 2023-07-21T07:34:47.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7f48417fa700 1 -- 172.21.15.6:0/1049159442 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f483c08a010 con 0x7f48440c4440 2023-07-21T07:34:47.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.942+0000 7f48495c0700 1 --2- 172.21.15.6:0/1049159442 >> [v2:172.21.15.6:6816/3132105263,v1:172.21.15.6:6817/3132105263] conn(0x7f48280735c0 0x7f48280759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.942+0000 7fb749ba8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb74415be60 0x7fb74406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.942+0000 7fb749ba8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb74415c240 0x7fb7440711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.942+0000 7fb749ba8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7440bd140 con 0x7fb744071700 2023-07-21T07:34:47.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.942+0000 7fb749ba8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7440be0a0 con 0x7fb74415c240 2023-07-21T07:34:47.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.942+0000 7fb749ba8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb744071de0 con 0x7fb74415be60 2023-07-21T07:34:47.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.942+0000 7f48495c0700 1 --2- 172.21.15.6:0/1049159442 >> [v2:172.21.15.6:6816/3132105263,v1:172.21.15.6:6817/3132105263] conn(0x7f48280735c0 0x7f48280759e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.942+0000 7fb743fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb744071700 0x7fb7441588f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:43818/0 (socket says 172.21.15.6:43818) 2023-07-21T07:34:47.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.942+0000 7fb743fff700 1 -- 172.21.15.6:0/372884811 learned_addr learned my addr 172.21.15.6:0/372884811 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:47.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fcad5af3700 1 -- 172.21.15.6:0/3192926266 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcad00bda30 msgr2=0x7fcad01ee8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fcad5af3700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcad00bda30 0x7fcad01ee8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fcad5af3700 1 -- 172.21.15.6:0/3192926266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad006d860 msgr2=0x7fcad006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fcad5af3700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad006d860 0x7fcad006cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fcad5af3700 1 -- 172.21.15.6:0/3192926266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc009550 con 0x7fcad00bf440 2023-07-21T07:34:47.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fcad5af3700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad00bf440 0x7fcad006bda0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcac800be00 tx=0x7fcac8009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fcac5ffb700 1 -- 172.21.15.6:0/3192926266 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac800cb90 con 0x7fcad00bf440 2023-07-21T07:34:47.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fcac5ffb700 1 -- 172.21.15.6:0/3192926266 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac800cd10 con 0x7fcad00bf440 2023-07-21T07:34:47.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fcac5ffb700 1 -- 172.21.15.6:0/3192926266 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8014680 con 0x7fcad00bf440 2023-07-21T07:34:47.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.941+0000 7fd7e69db700 1 -- 172.21.15.6:0/3679394328 wait complete. 2023-07-21T07:34:47.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.942+0000 7fd7e69db700 1 Processor -- start 2023-07-21T07:34:47.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.943+0000 7fd7e69db700 1 -- start start 2023-07-21T07:34:47.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.943+0000 7fcad7556700 1 -- 172.21.15.6:0/3192926266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad01eee10 con 0x7fcad00bf440 2023-07-21T07:34:47.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.943+0000 7fcad7556700 1 -- 172.21.15.6:0/3192926266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad006ab50 con 0x7fcad00bf440 2023-07-21T07:34:47.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.943+0000 7fb7437fe700 1 --2- 172.21.15.6:0/372884811 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb74415be60 0x7fb74406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fb7437fe700 1 -- 172.21.15.6:0/372884811 >> v2:172.21.15.86:3300/0 conn(0x7fb74415c240 msgr2=0x7fb7440711c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T07:34:47.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fb7437fe700 1 --2- 172.21.15.6:0/372884811 >> v2:172.21.15.86:3300/0 conn(0x7fb74415c240 0x7fb7440711c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fb7437fe700 1 -- 172.21.15.6:0/372884811 >> v1:172.21.15.86:6789/0 conn(0x7fb744071700 legacy=0x7fb7441588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fb7437fe700 1 -- 172.21.15.6:0/372884811 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440bcbf0 con 0x7fb74415be60 2023-07-21T07:34:47.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7f48417fa700 1 -- 172.21.15.6:0/1049159442 <== osd.0 v2:172.21.15.6:6816/3132105263 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4828076090 con 0x7f48280735c0 2023-07-21T07:34:47.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7f4843fff700 1 --2- 172.21.15.6:0/1049159442 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f482806ad00 0x7f482806d1c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48440ab9e0 tx=0x7f483400b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7e69db700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7e00c0350 0x7fd7e00bca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7e69db700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7e00c4260 0x7fd7e0145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7e69db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e0156200 0x7fd7e014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7e69db700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00bbec0 con 0x7fd7e0156200 2023-07-21T07:34:47.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7e69db700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00be940 con 0x7fd7e00c4260 2023-07-21T07:34:47.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7e69db700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00bec20 con 0x7fd7e00c0350 2023-07-21T07:34:47.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fb7437fe700 1 --2- 172.21.15.6:0/372884811 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb74415be60 0x7fb74406ff70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb738009840 tx=0x7fb738009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73bfd4179efd1444 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7dffff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7e00c0350 0x7fd7e00bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7dffff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7e00c0350 0x7fd7e00bca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:58186/0 (socket says 172.21.15.6:58186) 2023-07-21T07:34:47.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7dffff700 1 -- 172.21.15.6:0/605507518 learned_addr learned my addr 172.21.15.6:0/605507518 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7e4f78700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e0156200 0x7fd7e014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7df7fe700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7e00c4260 0x7fd7e0145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fb7427fc700 1 -- 172.21.15.6:0/372884811 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738004230 con 0x7fb74415be60 2023-07-21T07:34:47.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fb7427fc700 1 -- 172.21.15.6:0/372884811 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb738004390 con 0x7fb74415be60 2023-07-21T07:34:47.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fb7427fc700 1 -- 172.21.15.6:0/372884811 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7380036a0 con 0x7fb74415be60 2023-07-21T07:34:47.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.945+0000 7fcad7556700 1 -- 172.21.15.6:0/3192926266 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcad00bfec0 con 0x7fcad00bf440 2023-07-21T07:34:47.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7e4f78700 1 -- 172.21.15.6:0/605507518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7e00c0350 msgr2=0x7fd7e00bca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7e4f78700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7e00c0350 0x7fd7e00bca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7e4f78700 1 -- 172.21.15.6:0/605507518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7e00c4260 msgr2=0x7fd7e0145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.944+0000 7fd7e4f78700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7e00c4260 0x7fd7e0145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.945+0000 7fd7e4f78700 1 -- 172.21.15.6:0/605507518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40094a0 con 0x7fd7e0156200 2023-07-21T07:34:47.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.945+0000 7fd7e4f78700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e0156200 0x7fd7e014f330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8007cf0 tx=0x7fd7d800e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.945+0000 7fd7dcff9700 1 -- 172.21.15.6:0/605507518 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8018070 con 0x7fd7e0156200 2023-07-21T07:34:47.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.945+0000 7fd7dcff9700 1 -- 172.21.15.6:0/605507518 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d8003a20 con 0x7fd7e0156200 2023-07-21T07:34:47.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.945+0000 7fd7dcff9700 1 -- 172.21.15.6:0/605507518 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8003db0 con 0x7fd7e0156200 2023-07-21T07:34:47.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.945+0000 7fd7e69db700 1 -- 172.21.15.6:0/605507518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e00bef00 con 0x7fd7e0156200 2023-07-21T07:34:47.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.945+0000 7fd7e69db700 1 -- 172.21.15.6:0/605507518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e00bf4c0 con 0x7fd7e0156200 2023-07-21T07:34:47.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.945+0000 7fb749ba8700 1 -- 172.21.15.6:0/372884811 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb74415be60 msgr2=0x7fb74406ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.945+0000 7fb749ba8700 1 --2- 172.21.15.6:0/372884811 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb74415be60 0x7fb74406ff70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb738009840 tx=0x7fb738009b50 comp rx=0 tx=0).stop 2023-07-21T07:34:47.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.946+0000 7fb749ba8700 1 -- 172.21.15.6:0/372884811 shutdown_connections 2023-07-21T07:34:47.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.946+0000 7fb749ba8700 1 --2- 172.21.15.6:0/372884811 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb74415be60 0x7fb74406ff70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.946+0000 7fb749ba8700 1 --2- 172.21.15.6:0/372884811 >> v2:172.21.15.86:3300/0 conn(0x7fb74415c240 0x7fb7440711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.946+0000 7fb749ba8700 1 -- 172.21.15.6:0/372884811 >> 172.21.15.6:0/372884811 conn(0x7fb7440c09f0 msgr2=0x7fb7440c0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.946+0000 7fcac5ffb700 1 -- 172.21.15.6:0/3192926266 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcac801e440 con 0x7fcad00bf440 2023-07-21T07:34:47.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.946+0000 7fcac5ffb700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcab406acb0 0x7fcab406d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.946+0000 7fcac5ffb700 1 -- 172.21.15.6:0/3192926266 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcac8089190 con 0x7fcad00bf440 2023-07-21T07:34:47.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.947+0000 7fcac5ffb700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.6:6800/4035793919,v1:172.21.15.6:6801/4035793919] conn(0x7fcab4073570 0x7fcab4075990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.947+0000 7fcac5ffb700 1 -- 172.21.15.6:0/3192926266 --> [v2:172.21.15.6:6800/4035793919,v1:172.21.15.6:6801/4035793919] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcab4076040 con 0x7fcab4073570 2023-07-21T07:34:47.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.947+0000 7fcac5ffb700 1 -- 172.21.15.6:0/3192926266 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcac808b7b0 con 0x7fcad00bf440 2023-07-21T07:34:47.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.947+0000 7fcad4af1700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.6:6800/4035793919,v1:172.21.15.6:6801/4035793919] conn(0x7fcab4073570 0x7fcab4075990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.947+0000 7fcad52f2700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcab406acb0 0x7fcab406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.947+0000 7fd7e69db700 1 -- 172.21.15.6:0/605507518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7e00c47b0 con 0x7fd7e0156200 2023-07-21T07:34:47.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.947+0000 7f9e80d6e700 1 Processor -- start 2023-07-21T07:34:47.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.947+0000 7fd7dcff9700 1 -- 172.21.15.6:0/605507518 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7d800e970 con 0x7fd7e0156200 2023-07-21T07:34:47.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.947+0000 7fcad52f2700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcab406acb0 0x7fcab406d170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcacc000c00 tx=0x7fcacc01d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7fcad4af1700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.6:6800/4035793919,v1:172.21.15.6:6801/4035793919] conn(0x7fcab4073570 0x7fcab4075990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.947+0000 7f9e80d6e700 1 -- start start 2023-07-21T07:34:47.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7fd7dcff9700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd7c806af40 0x7fd7c806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7f23549d1700 1 -- 172.21.15.6:0/2418119324 shutdown_connections 2023-07-21T07:34:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7f23549d1700 1 --2- 172.21.15.6:0/2418119324 >> v2:172.21.15.6:3300/0 conn(0x7f23500aae80 0x7f23500c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7f23549d1700 1 --2- 172.21.15.6:0/2418119324 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23501532e0 0x7f23500c4250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7f23549d1700 1 -- 172.21.15.6:0/2418119324 >> 172.21.15.6:0/2418119324 conn(0x7f235006a6c0 msgr2=0x7f23500a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7fb749ba8700 1 -- 172.21.15.6:0/372884811 shutdown_connections 2023-07-21T07:34:47.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7fb749ba8700 1 -- 172.21.15.6:0/372884811 wait complete. 2023-07-21T07:34:47.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7fd7dcff9700 1 -- 172.21.15.6:0/605507518 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7d8089370 con 0x7fd7e0156200 2023-07-21T07:34:47.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7fd7dcff9700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.6:6824/3597608045,v1:172.21.15.6:6825/3597608045] conn(0x7fd7c8073800 0x7fd7c8075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7fd7dcff9700 1 -- 172.21.15.6:0/605507518 --> [v2:172.21.15.6:6824/3597608045,v1:172.21.15.6:6825/3597608045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7c80762d0 con 0x7fd7c8073800 2023-07-21T07:34:47.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7fd7dcff9700 1 -- 172.21.15.6:0/605507518 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7d808b990 con 0x7fd7e0156200 2023-07-21T07:34:47.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7fd7dffff700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd7c806af40 0x7fd7c806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.948+0000 7fd7df7fe700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.6:6824/3597608045,v1:172.21.15.6:6825/3597608045] conn(0x7fd7c8073800 0x7fd7c8075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.949+0000 7fcac5ffb700 1 -- 172.21.15.6:0/3192926266 <== osd.2 v2:172.21.15.6:6800/4035793919 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcab4076040 con 0x7fcab4073570 2023-07-21T07:34:47.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.949+0000 7fd7dffff700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd7c806af40 0x7fd7c806d400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00093f0 tx=0x7fd7d0009380 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.949+0000 7fd7df7fe700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.6:6824/3597608045,v1:172.21.15.6:6825/3597608045] conn(0x7fd7c8073800 0x7fd7c8075c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.949+0000 7f9e80d6e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e7c06aad0 0x7f9e7c1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.949+0000 7f9e80d6e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e7c0c4e30 0x7f9e7c0c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.949+0000 7f9e80d6e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7c0c09f0 con 0x7f9e7c0c3f00 2023-07-21T07:34:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.949+0000 7f9e80d6e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7c0baff0 con 0x7f9e7c0c4e30 2023-07-21T07:34:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.949+0000 7f9e80d6e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0c0cd0 con 0x7f9e7c06aad0 2023-07-21T07:34:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.949+0000 7f9e7a59c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e7c06aad0 0x7f9e7c1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.949+0000 7f9e7a59c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e7c06aad0 0x7f9e7c1510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:58204/0 (socket says 172.21.15.6:58204) 2023-07-21T07:34:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.949+0000 7f9e7a59c700 1 -- 172.21.15.6:0/3112698596 learned_addr learned my addr 172.21.15.6:0/3112698596 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.950+0000 7fd7dcff9700 1 -- 172.21.15.6:0/605507518 <== osd.3 v2:172.21.15.6:6824/3597608045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd7c80762d0 con 0x7fd7c8073800 2023-07-21T07:34:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.950+0000 7fb749ba8700 1 Processor -- start 2023-07-21T07:34:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.950+0000 7f23549d1700 1 -- 172.21.15.6:0/2418119324 shutdown_connections 2023-07-21T07:34:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.950+0000 7f23549d1700 1 -- 172.21.15.6:0/2418119324 wait complete. 2023-07-21T07:34:47.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.950+0000 7fb749ba8700 1 -- start start 2023-07-21T07:34:47.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.951+0000 7fb749ba8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb744071700 0x7fb7440c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.951+0000 7fb749ba8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74415be60 0x7fb7441f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.951+0000 7fb749ba8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb74415c240 0x7fb744150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.951+0000 7fb749ba8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7441f2950 con 0x7fb74415c240 2023-07-21T07:34:47.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.951+0000 7fb749ba8700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7441eeda0 con 0x7fb74415be60 2023-07-21T07:34:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.951+0000 7fb749ba8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7441ee490 con 0x7fb744071700 2023-07-21T07:34:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.952+0000 7f23549d1700 1 Processor -- start 2023-07-21T07:34:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.952+0000 7f23549d1700 1 -- start start 2023-07-21T07:34:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.953+0000 7f23549d1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23500aae80 0x7f23500bbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.953+0000 7f23549d1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23501532e0 0x7f23501446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.953+0000 7f23549d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23501559e0 0x7f2350144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.953+0000 7f23549d1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2350145170 con 0x7f23501559e0 2023-07-21T07:34:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.953+0000 7f23549d1700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23501e63b0 con 0x7f23500aae80 2023-07-21T07:34:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.953+0000 7f23549d1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23501e6690 con 0x7f23501532e0 2023-07-21T07:34:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.953+0000 7f234ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23501559e0 0x7f2350144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.953+0000 7f234ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23501559e0 0x7f2350144c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60820/0 (socket says 172.21.15.6:60820) 2023-07-21T07:34:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.953+0000 7f234ed9d700 1 -- 172.21.15.6:0/3495714016 learned_addr learned my addr 172.21.15.6:0/3495714016 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.953+0000 7f234e59c700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23500aae80 0x7f23500bbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.953+0000 7f234dd9b700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23501532e0 0x7f23501446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.954+0000 7f234dd9b700 1 -- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23500aae80 msgr2=0x7f23500bbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.954+0000 7f234dd9b700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23500aae80 0x7f23500bbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.954+0000 7f234dd9b700 1 -- 172.21.15.6:0/3495714016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23501559e0 msgr2=0x7f2350144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.954+0000 7f234dd9b700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23501559e0 0x7f2350144c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.954+0000 7f234dd9b700 1 -- 172.21.15.6:0/3495714016 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2340011df0 con 0x7f23501532e0 2023-07-21T07:34:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.954+0000 7f234dd9b700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23501532e0 0x7f23501446f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2344009fd0 tx=0x7f234400b6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.954+0000 7f233effd700 1 -- 172.21.15.6:0/3495714016 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2344011620 con 0x7f23501532e0 2023-07-21T07:34:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.954+0000 7f233effd700 1 -- 172.21.15.6:0/3495714016 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23440117a0 con 0x7f23501532e0 2023-07-21T07:34:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.954+0000 7f23549d1700 1 -- 172.21.15.6:0/3495714016 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23501e6970 con 0x7f23501532e0 2023-07-21T07:34:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.954+0000 7f23549d1700 1 -- 172.21.15.6:0/3495714016 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23500bc110 con 0x7f23501532e0 2023-07-21T07:34:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.954+0000 7f233effd700 1 -- 172.21.15.6:0/3495714016 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2344011b50 con 0x7f23501532e0 2023-07-21T07:34:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7fb742ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74415be60 0x7fb7441f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7fb742ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74415be60 0x7fb7441f2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54386/0 (socket says 172.21.15.6:54386) 2023-07-21T07:34:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7fb742ffd700 1 -- 172.21.15.6:0/358804944 learned_addr learned my addr 172.21.15.6:0/358804944 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7fb7437fe700 1 --2- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb744071700 0x7fb7440c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7fb742ffd700 1 -- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb744071700 msgr2=0x7fb7440c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7fb742ffd700 1 --2- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb744071700 0x7fb7440c5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7fb742ffd700 1 -- 172.21.15.6:0/358804944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb74415c240 msgr2=0x7fb744150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7fb742ffd700 1 --2- 172.21.15.6:0/358804944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb74415c240 0x7fb744150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7f9e7a59c700 1 -- 172.21.15.6:0/3112698596 >> v2:172.21.15.6:3300/0 conn(0x7f9e7c0c4e30 msgr2=0x7f9e7c0c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7f9e7a59c700 1 --2- 172.21.15.6:0/3112698596 >> v2:172.21.15.6:3300/0 conn(0x7f9e7c0c4e30 0x7f9e7c0c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7f9e7a59c700 1 -- 172.21.15.6:0/3112698596 >> v1:172.21.15.86:6789/0 conn(0x7f9e7c0c3f00 legacy=0x7f9e7c153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7f9e7a59c700 1 -- 172.21.15.6:0/3112698596 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c0c0fb0 con 0x7f9e7c06aad0 2023-07-21T07:34:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7fb742ffd700 1 -- 172.21.15.6:0/358804944 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7380094a0 con 0x7fb74415be60 2023-07-21T07:34:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7fb742ffd700 1 --2- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74415be60 0x7fb7441f2410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb73400b470 tx=0x7fb73400b830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7fb72bfff700 1 -- 172.21.15.6:0/358804944 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734005be0 con 0x7fb74415be60 2023-07-21T07:34:47.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7fb72bfff700 1 -- 172.21.15.6:0/358804944 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb734005d40 con 0x7fb74415be60 2023-07-21T07:34:47.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.957+0000 7fb72bfff700 1 -- 172.21.15.6:0/358804944 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734011870 con 0x7fb74415be60 2023-07-21T07:34:47.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.957+0000 7fb749ba8700 1 -- 172.21.15.6:0/358804944 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7440c5750 con 0x7fb74415be60 2023-07-21T07:34:47.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.957+0000 7fb749ba8700 1 -- 172.21.15.6:0/358804944 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7441eea30 con 0x7fb74415be60 2023-07-21T07:34:47.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.956+0000 7f23549d1700 1 -- 172.21.15.6:0/3495714016 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2334000fc0 con 0x7f23501532e0 2023-07-21T07:34:47.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.957+0000 7f233effd700 1 -- 172.21.15.6:0/3495714016 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2344011cb0 con 0x7f23501532e0 2023-07-21T07:34:47.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.957+0000 7f233effd700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f233006ace0 0x7f233006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.957+0000 7f233effd700 1 -- 172.21.15.6:0/3495714016 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2344088f90 con 0x7f23501532e0 2023-07-21T07:34:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.957+0000 7f234e59c700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f233006ace0 0x7f233006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.957+0000 7f233effd700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:6813/3554109165,v1:172.21.15.86:6815/3554109165] conn(0x7f2330073520 0x7f2330075940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.957+0000 7f233effd700 1 -- 172.21.15.6:0/3495714016 --> [v2:172.21.15.86:6813/3554109165,v1:172.21.15.86:6815/3554109165] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2330075ff0 con 0x7f2330073520 2023-07-21T07:34:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.958+0000 7f233effd700 1 -- 172.21.15.6:0/3495714016 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2344054030 con 0x7f23501532e0 2023-07-21T07:34:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.958+0000 7f234ed9d700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:6813/3554109165,v1:172.21.15.86:6815/3554109165] conn(0x7f2330073520 0x7f2330075940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.958+0000 7f234e59c700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f233006ace0 0x7f233006d1a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2340008010 tx=0x7f234000d000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.958+0000 7f234ed9d700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:6813/3554109165,v1:172.21.15.86:6815/3554109165] conn(0x7f2330073520 0x7f2330075940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.959+0000 7f9e7a59c700 1 --2- 172.21.15.6:0/3112698596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e7c06aad0 0x7f9e7c1510a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009e50 tx=0x7f9e7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=999da47312bacb5b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.959+0000 7f9e7959a700 1 -- 172.21.15.6:0/3112698596 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7400e070 con 0x7f9e7c06aad0 2023-07-21T07:34:47.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.959+0000 7f9e7959a700 1 -- 172.21.15.6:0/3112698596 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7400b9c0 con 0x7f9e7c06aad0 2023-07-21T07:34:47.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.959+0000 7f9e7959a700 1 -- 172.21.15.6:0/3112698596 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7400bd70 con 0x7f9e7c06aad0 2023-07-21T07:34:47.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.959+0000 7f233effd700 1 -- 172.21.15.6:0/3495714016 <== osd.7 v2:172.21.15.86:6813/3554109165 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2330075ff0 con 0x7f2330073520 2023-07-21T07:34:47.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.961+0000 7f9e80d6e700 1 -- 172.21.15.6:0/3112698596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e7c06aad0 msgr2=0x7f9e7c1510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.961+0000 7f9e80d6e700 1 --2- 172.21.15.6:0/3112698596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e7c06aad0 0x7f9e7c1510a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009e50 tx=0x7f9e7400b330 comp rx=0 tx=0).stop 2023-07-21T07:34:47.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.963+0000 7fb72bfff700 1 -- 172.21.15.6:0/358804944 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb7340119d0 con 0x7fb74415be60 2023-07-21T07:34:47.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.963+0000 7fb72bfff700 1 --2- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb72c06adf0 0x7fb72c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.964+0000 7fb72bfff700 1 -- 172.21.15.6:0/358804944 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb7340893e0 con 0x7fb74415be60 2023-07-21T07:34:47.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.965+0000 7f9e80d6e700 1 -- 172.21.15.6:0/3112698596 shutdown_connections 2023-07-21T07:34:47.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.965+0000 7f9e80d6e700 1 --2- 172.21.15.6:0/3112698596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e7c06aad0 0x7f9e7c1510a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.965+0000 7f9e80d6e700 1 --2- 172.21.15.6:0/3112698596 >> v2:172.21.15.6:3300/0 conn(0x7f9e7c0c4e30 0x7f9e7c0c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.965+0000 7f9e80d6e700 1 -- 172.21.15.6:0/3112698596 >> 172.21.15.6:0/3112698596 conn(0x7f9e7c06a6c0 msgr2=0x7f9e7c0a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.966+0000 7f76e7a6d700 1 -- 172.21.15.6:0/591402647 --> [v2:172.21.15.86:6800/141737948,v1:172.21.15.86:6801/141737948] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76e00c1570 con 0x7f76c4073520 2023-07-21T07:34:47.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.966+0000 7fb749ba8700 1 --2- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:6816/3071121321,v1:172.21.15.86:6819/3071121321] conn(0x7fb7240015e0 0x7fb724003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.966+0000 7fb749ba8700 1 -- 172.21.15.6:0/358804944 --> [v2:172.21.15.86:6816/3071121321,v1:172.21.15.86:6819/3071121321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb724006bd0 con 0x7fb7240015e0 2023-07-21T07:34:47.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.966+0000 7fb743fff700 1 --2- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:6816/3071121321,v1:172.21.15.86:6819/3071121321] conn(0x7fb7240015e0 0x7fb724003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.967+0000 7fb7437fe700 1 --2- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb72c06adf0 0x7fb72c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.967+0000 7f76d67fc700 1 -- 172.21.15.6:0/591402647 <== osd.5 v2:172.21.15.86:6800/141737948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f76d00019b0 con 0x7f76c4073520 2023-07-21T07:34:47.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.967+0000 7fb743fff700 1 --2- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:6816/3071121321,v1:172.21.15.86:6819/3071121321] conn(0x7fb7240015e0 0x7fb724003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.967+0000 7f76e7a6d700 1 -- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:6800/141737948,v1:172.21.15.86:6801/141737948] conn(0x7f76c4073520 msgr2=0x7f76c4075940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.967+0000 7f76e7a6d700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:6800/141737948,v1:172.21.15.86:6801/141737948] conn(0x7f76c4073520 0x7f76c4075940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.967+0000 7f76e7a6d700 1 -- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f76c406ace0 msgr2=0x7f76c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.967+0000 7f76e7a6d700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f76c406ace0 0x7f76c406d1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000f80 tx=0x7f76d8011000 comp rx=0 tx=0).stop 2023-07-21T07:34:47.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.967+0000 7f76e7a6d700 1 -- 172.21.15.6:0/591402647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e0153f90 msgr2=0x7f76e013b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.967+0000 7f76e7a6d700 1 --2- 172.21.15.6:0/591402647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e0153f90 0x7f76e013b930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00b410 tx=0x7f76dc00b720 comp rx=0 tx=0).stop 2023-07-21T07:34:47.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.967+0000 7f76e600a700 1 -- 172.21.15.6:0/591402647 reap_dead start 2023-07-21T07:34:47.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.968+0000 7f76e7a6d700 1 -- 172.21.15.6:0/591402647 shutdown_connections 2023-07-21T07:34:47.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.968+0000 7f76e7a6d700 1 -- 172.21.15.6:0/591402647 >> 172.21.15.6:0/591402647 conn(0x7f76e006a6c0 msgr2=0x7f76e0152590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.968+0000 7fb72bfff700 1 -- 172.21.15.6:0/358804944 <== osd.4 v2:172.21.15.86:6816/3071121321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb724006bd0 con 0x7fb7240015e0 2023-07-21T07:34:47.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.970+0000 7f76e7a6d700 1 -- 172.21.15.6:0/591402647 shutdown_connections 2023-07-21T07:34:47.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.970+0000 7f76e7a6d700 1 -- 172.21.15.6:0/591402647 wait complete. 2023-07-21T07:34:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.971+0000 7f484b023700 1 -- 172.21.15.6:0/1049159442 --> [v2:172.21.15.6:6816/3132105263,v1:172.21.15.6:6817/3132105263] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f48440c1290 con 0x7f48280735c0 2023-07-21T07:34:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.971+0000 7f48417fa700 1 -- 172.21.15.6:0/1049159442 <== osd.0 v2:172.21.15.6:6816/3132105263 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4838006c60 con 0x7f48280735c0 2023-07-21T07:34:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.971+0000 7f484b023700 1 -- 172.21.15.6:0/1049159442 >> [v2:172.21.15.6:6816/3132105263,v1:172.21.15.6:6817/3132105263] conn(0x7f48280735c0 msgr2=0x7f48280759e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.971+0000 7f484b023700 1 --2- 172.21.15.6:0/1049159442 >> [v2:172.21.15.6:6816/3132105263,v1:172.21.15.6:6817/3132105263] conn(0x7f48280735c0 0x7f48280759e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.972+0000 7f484b023700 1 -- 172.21.15.6:0/1049159442 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f482806ad00 msgr2=0x7f482806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.972+0000 7f484b023700 1 --2- 172.21.15.6:0/1049159442 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f482806ad00 0x7f482806d1c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48440ab9e0 tx=0x7f483400b2e0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.972+0000 7f484b023700 1 -- 172.21.15.6:0/1049159442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48440c4440 msgr2=0x7f48440aaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.972+0000 7f484b023700 1 --2- 172.21.15.6:0/1049159442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48440c4440 0x7f48440aaf10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f483c00ba50 tx=0x7f483c00bd60 comp rx=0 tx=0).stop 2023-07-21T07:34:47.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.972+0000 7f48495c0700 1 -- 172.21.15.6:0/1049159442 reap_dead start 2023-07-21T07:34:47.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.972+0000 7f484b023700 1 -- 172.21.15.6:0/1049159442 shutdown_connections 2023-07-21T07:34:47.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.972+0000 7f484b023700 1 -- 172.21.15.6:0/1049159442 >> 172.21.15.6:0/1049159442 conn(0x7f484406a6c0 msgr2=0x7f48440c5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.972+0000 7f484b023700 1 -- 172.21.15.6:0/1049159442 shutdown_connections 2023-07-21T07:34:47.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.972+0000 7f484b023700 1 -- 172.21.15.6:0/1049159442 wait complete. 2023-07-21T07:34:47.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.973+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/3652833949 --> [v2:172.21.15.6:6802/3429574632,v1:172.21.15.6:6804/3429574632] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1d68147370 con 0x7f1d540735f0 2023-07-21T07:34:47.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.973+0000 7f1d4f7fe700 1 -- 172.21.15.6:0/3652833949 <== osd.1 v2:172.21.15.6:6802/3429574632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1d68147370 con 0x7f1d540735f0 2023-07-21T07:34:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.973+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/3652833949 >> [v2:172.21.15.6:6802/3429574632,v1:172.21.15.6:6804/3429574632] conn(0x7f1d540735f0 msgr2=0x7f1d54075a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.973+0000 7f1d6d5b9700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.6:6802/3429574632,v1:172.21.15.6:6804/3429574632] conn(0x7f1d540735f0 0x7f1d54075a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.974+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/3652833949 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1d5406ad30 msgr2=0x7f1d5406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.974+0000 7f1d6d5b9700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1d5406ad30 0x7f1d5406d1f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c000c00 tx=0x7f1d5c010000 comp rx=0 tx=0).stop 2023-07-21T07:34:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.974+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/3652833949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d681559e0 msgr2=0x7f1d68147ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.974+0000 7f1d6d5b9700 1 --2- 172.21.15.6:0/3652833949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d681559e0 0x7f1d68147ce0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000b970 tx=0x7f1d6000bd30 comp rx=0 tx=0).stop 2023-07-21T07:34:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.974+0000 7f1d677fe700 1 -- 172.21.15.6:0/3652833949 reap_dead start 2023-07-21T07:34:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.973+0000 7fb7437fe700 1 --2- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb72c06adf0 0x7fb72c06d2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb738000c00 tx=0x7fb738013040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.978+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/3652833949 shutdown_connections 2023-07-21T07:34:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.978+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/3652833949 >> 172.21.15.6:0/3652833949 conn(0x7f1d6806a6c0 msgr2=0x7f1d680c2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.980+0000 7fd7e69db700 1 -- 172.21.15.6:0/605507518 --> [v2:172.21.15.6:6824/3597608045,v1:172.21.15.6:6825/3597608045] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7e00a51d0 con 0x7fd7c8073800 2023-07-21T07:34:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.980+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/3652833949 shutdown_connections 2023-07-21T07:34:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.980+0000 7f1d6d5b9700 1 -- 172.21.15.6:0/3652833949 wait complete. 2023-07-21T07:34:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.980+0000 7fd7dcff9700 1 -- 172.21.15.6:0/605507518 <== osd.3 v2:172.21.15.6:6824/3597608045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7d4006c60 con 0x7fd7c8073800 2023-07-21T07:34:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.982+0000 7fcad7556700 1 -- 172.21.15.6:0/3192926266 --> [v2:172.21.15.6:6800/4035793919,v1:172.21.15.6:6801/4035793919] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcad00bfbe0 con 0x7fcab4073570 2023-07-21T07:34:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.982+0000 7fcac5ffb700 1 -- 172.21.15.6:0/3192926266 <== osd.2 v2:172.21.15.6:6800/4035793919 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcac00095b0 con 0x7fcab4073570 2023-07-21T07:34:47.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.981+0000 7f9e80d6e700 1 -- 172.21.15.6:0/3112698596 shutdown_connections 2023-07-21T07:34:47.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.984+0000 7f9e80d6e700 1 -- 172.21.15.6:0/3112698596 wait complete. 2023-07-21T07:34:47.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.986+0000 7fcad7556700 1 -- 172.21.15.6:0/3192926266 >> [v2:172.21.15.6:6800/4035793919,v1:172.21.15.6:6801/4035793919] conn(0x7fcab4073570 msgr2=0x7fcab4075990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.986+0000 7fcad7556700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.6:6800/4035793919,v1:172.21.15.6:6801/4035793919] conn(0x7fcab4073570 0x7fcab4075990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.986+0000 7f9e80d6e700 1 Processor -- start 2023-07-21T07:34:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.986+0000 7f9e80d6e700 1 -- start start 2023-07-21T07:34:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.987+0000 7f9e80d6e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e7c06aad0 0x7f9e7c144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.987+0000 7f9e80d6e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e7c0c3f00 0x7f9e7c0bb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.987+0000 7f9e80d6e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e7c0c4e30 0x7f9e7c141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.987+0000 7f9e80d6e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c144c40 con 0x7f9e7c06aad0 2023-07-21T07:34:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.987+0000 7f9e80d6e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0befb0 con 0x7f9e7c0c4e30 2023-07-21T07:34:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.987+0000 7f9e80d6e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0bf250 con 0x7f9e7c0c3f00 2023-07-21T07:34:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.987+0000 7f9e7a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e7c06aad0 0x7f9e7c144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.987+0000 7f9e7a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e7c06aad0 0x7f9e7c144700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60832/0 (socket says 172.21.15.6:60832) 2023-07-21T07:34:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.987+0000 7f9e7a59c700 1 -- 172.21.15.6:0/509748862 learned_addr learned my addr 172.21.15.6:0/509748862 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7f9e79d9b700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e7c0c3f00 0x7f9e7c0bb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7f9e7ad9d700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e7c0c4e30 0x7f9e7c141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7f9e7a59c700 1 -- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e7c0c3f00 msgr2=0x7f9e7c0bb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7fcad7556700 1 -- 172.21.15.6:0/3192926266 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcab406acb0 msgr2=0x7fcab406d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7fcad7556700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcab406acb0 0x7fcab406d170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcacc000c00 tx=0x7fcacc01d040 comp rx=0 tx=0).stop 2023-07-21T07:34:47.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7fcad7556700 1 -- 172.21.15.6:0/3192926266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad00bf440 msgr2=0x7fcad006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7fcad7556700 1 --2- 172.21.15.6:0/3192926266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad00bf440 0x7fcad006bda0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcac800be00 tx=0x7fcac8009ed0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7f9e7a59c700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e7c0c3f00 0x7f9e7c0bb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7f9e7a59c700 1 -- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e7c0c4e30 msgr2=0x7f9e7c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7f9e7a59c700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e7c0c4e30 0x7f9e7c141a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7fcad5af3700 1 -- 172.21.15.6:0/3192926266 reap_dead start 2023-07-21T07:34:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7f9e7a59c700 1 -- 172.21.15.6:0/509748862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e74009b30 con 0x7f9e7c06aad0 2023-07-21T07:34:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7f9e79d9b700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e7c0c3f00 0x7f9e7c0bb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7f9e7a59c700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e7c06aad0 0x7f9e7c144700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e74000f80 tx=0x7f9e74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7f9e6affd700 1 -- 172.21.15.6:0/509748862 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e740092e0 con 0x7f9e7c06aad0 2023-07-21T07:34:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7f9e6affd700 1 -- 172.21.15.6:0/509748862 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e740099b0 con 0x7f9e7c06aad0 2023-07-21T07:34:47.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7f9e80d6e700 1 -- 172.21.15.6:0/509748862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c0bf530 con 0x7f9e7c06aad0 2023-07-21T07:34:47.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.988+0000 7f9e6affd700 1 -- 172.21.15.6:0/509748862 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7401c660 con 0x7f9e7c06aad0 2023-07-21T07:34:47.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.990+0000 7f23549d1700 1 -- 172.21.15.6:0/3495714016 --> [v2:172.21.15.86:6813/3554109165,v1:172.21.15.86:6815/3554109165] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2334002d40 con 0x7f2330073520 2023-07-21T07:34:47.104 INFO:teuthology.orchestra.run.smithi006.stdout:55834574856 2023-07-21T07:34:47.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-21T07:34:47.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.990+0000 7f9e80d6e700 1 -- 172.21.15.6:0/509748862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c0bb910 con 0x7f9e7c06aad0 2023-07-21T07:34:47.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.991+0000 7fcad7556700 1 -- 172.21.15.6:0/3192926266 shutdown_connections 2023-07-21T07:34:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.991+0000 7fcad7556700 1 -- 172.21.15.6:0/3192926266 >> 172.21.15.6:0/3192926266 conn(0x7fcad00c09f0 msgr2=0x7fcad0070420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.991+0000 7f9e68ff9700 1 -- 172.21.15.6:0/509748862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e60000fc0 con 0x7f9e7c06aad0 2023-07-21T07:34:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7f233effd700 1 -- 172.21.15.6:0/3495714016 <== osd.7 v2:172.21.15.86:6813/3554109165 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2334002d40 con 0x7f2330073520 2023-07-21T07:34:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7fd7e69db700 1 -- 172.21.15.6:0/605507518 >> [v2:172.21.15.6:6824/3597608045,v1:172.21.15.6:6825/3597608045] conn(0x7fd7c8073800 msgr2=0x7fd7c8075c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7fd7e69db700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.6:6824/3597608045,v1:172.21.15.6:6825/3597608045] conn(0x7fd7c8073800 0x7fd7c8075c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7fd7e69db700 1 -- 172.21.15.6:0/605507518 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd7c806af40 msgr2=0x7fd7c806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7fd7e69db700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd7c806af40 0x7fd7c806d400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00093f0 tx=0x7fd7d0009380 comp rx=0 tx=0).stop 2023-07-21T07:34:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7fd7e69db700 1 -- 172.21.15.6:0/605507518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e0156200 msgr2=0x7fd7e014f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7fd7e69db700 1 --2- 172.21.15.6:0/605507518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e0156200 0x7fd7e014f330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8007cf0 tx=0x7fd7d800e0e0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7fd7e4f78700 1 -- 172.21.15.6:0/605507518 reap_dead start 2023-07-21T07:34:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7fd7e69db700 1 -- 172.21.15.6:0/605507518 shutdown_connections 2023-07-21T07:34:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7fd7e69db700 1 -- 172.21.15.6:0/605507518 >> 172.21.15.6:0/605507518 conn(0x7fd7e006aa10 msgr2=0x7fd7e00a6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7f23549d1700 1 -- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:6813/3554109165,v1:172.21.15.86:6815/3554109165] conn(0x7f2330073520 msgr2=0x7f2330075940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7f23549d1700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:6813/3554109165,v1:172.21.15.86:6815/3554109165] conn(0x7f2330073520 0x7f2330075940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7f23549d1700 1 -- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f233006ace0 msgr2=0x7f233006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7f23549d1700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f233006ace0 0x7f233006d1a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2340008010 tx=0x7f234000d000 comp rx=0 tx=0).stop 2023-07-21T07:34:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7f23549d1700 1 -- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23501532e0 msgr2=0x7f23501446f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7f23549d1700 1 --2- 172.21.15.6:0/3495714016 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23501532e0 0x7f23501446f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2344009fd0 tx=0x7f234400b6c0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7f234ed9d700 1 -- 172.21.15.6:0/3495714016 reap_dead start 2023-07-21T07:34:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7f23549d1700 1 -- 172.21.15.6:0/3495714016 shutdown_connections 2023-07-21T07:34:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.992+0000 7f23549d1700 1 -- 172.21.15.6:0/3495714016 >> 172.21.15.6:0/3495714016 conn(0x7f235006a6c0 msgr2=0x7f23500a7550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.993+0000 7f23549d1700 1 -- 172.21.15.6:0/3495714016 shutdown_connections 2023-07-21T07:34:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.993+0000 7f23549d1700 1 -- 172.21.15.6:0/3495714016 wait complete. 2023-07-21T07:34:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.993+0000 7f9e6affd700 1 -- 172.21.15.6:0/509748862 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9e7401c7c0 con 0x7f9e7c06aad0 2023-07-21T07:34:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.993+0000 7f9e6affd700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9e5c06ace0 0x7f9e5c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.993+0000 7f9e6affd700 1 -- 172.21.15.6:0/509748862 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e7408ba30 con 0x7f9e7c06aad0 2023-07-21T07:34:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.993+0000 7f9e6affd700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:6808/236253683,v1:172.21.15.86:6809/236253683] conn(0x7f9e5c073330 0x7f9e5c075750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.993+0000 7f9e79d9b700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9e5c06ace0 0x7f9e5c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.993+0000 7f9e6affd700 1 -- 172.21.15.6:0/509748862 --> [v2:172.21.15.86:6808/236253683,v1:172.21.15.86:6809/236253683] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e5c075e00 con 0x7f9e5c073330 2023-07-21T07:34:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.994+0000 7f9e6affd700 1 -- 172.21.15.6:0/509748862 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e7408be80 con 0x7f9e7c06aad0 2023-07-21T07:34:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.994+0000 7f9e7ad9d700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:6808/236253683,v1:172.21.15.86:6809/236253683] conn(0x7f9e5c073330 0x7f9e5c075750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.994+0000 7f9e79d9b700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9e5c06ace0 0x7f9e5c06d1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c006fd0 tx=0x7f9e6c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.994+0000 7f9e7ad9d700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:6808/236253683,v1:172.21.15.86:6809/236253683] conn(0x7f9e5c073330 0x7f9e5c075750 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.995+0000 7fcad7556700 1 -- 172.21.15.6:0/3192926266 shutdown_connections 2023-07-21T07:34:47.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.995+0000 7fcad7556700 1 -- 172.21.15.6:0/3192926266 wait complete. 2023-07-21T07:34:47.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.995+0000 7f9e6affd700 1 -- 172.21.15.6:0/509748862 <== osd.6 v2:172.21.15.86:6808/236253683 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9e5c075e00 con 0x7f9e5c073330 2023-07-21T07:34:47.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.995+0000 7fb749ba8700 1 -- 172.21.15.6:0/358804944 --> [v2:172.21.15.86:6816/3071121321,v1:172.21.15.86:6819/3071121321] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb724005cb0 con 0x7fb7240015e0 2023-07-21T07:34:47.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.996+0000 7fb72bfff700 1 -- 172.21.15.6:0/358804944 <== osd.4 v2:172.21.15.86:6816/3071121321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb724005cb0 con 0x7fb7240015e0 2023-07-21T07:34:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.997+0000 7fb749ba8700 1 -- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:6816/3071121321,v1:172.21.15.86:6819/3071121321] conn(0x7fb7240015e0 msgr2=0x7fb724003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.997+0000 7fb749ba8700 1 --2- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:6816/3071121321,v1:172.21.15.86:6819/3071121321] conn(0x7fb7240015e0 0x7fb724003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.997+0000 7fb749ba8700 1 -- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb72c06adf0 msgr2=0x7fb72c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.997+0000 7fb749ba8700 1 --2- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb72c06adf0 0x7fb72c06d2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb738000c00 tx=0x7fb738013040 comp rx=0 tx=0).stop 2023-07-21T07:34:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.997+0000 7fb749ba8700 1 -- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74415be60 msgr2=0x7fb7441f2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.997+0000 7fb749ba8700 1 --2- 172.21.15.6:0/358804944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74415be60 0x7fb7441f2410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb73400b470 tx=0x7fb73400b830 comp rx=0 tx=0).stop 2023-07-21T07:34:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.997+0000 7fb743fff700 1 -- 172.21.15.6:0/358804944 reap_dead start 2023-07-21T07:34:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.997+0000 7fb749ba8700 1 -- 172.21.15.6:0/358804944 shutdown_connections 2023-07-21T07:34:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:46.997+0000 7fb749ba8700 1 -- 172.21.15.6:0/358804944 >> 172.21.15.6:0/358804944 conn(0x7fb7440c09f0 msgr2=0x7fb74415b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.119 INFO:teuthology.orchestra.run.smithi006.stdout:55834574856 2023-07-21T07:34:47.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-21T07:34:47.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.001+0000 7fd7e69db700 1 -- 172.21.15.6:0/605507518 shutdown_connections 2023-07-21T07:34:47.122 INFO:teuthology.orchestra.run.smithi006.stdout:55834574856 2023-07-21T07:34:47.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-21T07:34:47.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.004+0000 7fb749ba8700 1 -- 172.21.15.6:0/358804944 shutdown_connections 2023-07-21T07:34:47.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.004+0000 7fb749ba8700 1 -- 172.21.15.6:0/358804944 wait complete. 2023-07-21T07:34:47.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.005+0000 7fd7e69db700 1 -- 172.21.15.6:0/605507518 wait complete. 2023-07-21T07:34:47.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.014+0000 7f9e68ff9700 1 -- 172.21.15.6:0/509748862 --> [v2:172.21.15.86:6808/236253683,v1:172.21.15.86:6809/236253683] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e60002d40 con 0x7f9e5c073330 2023-07-21T07:34:47.125 INFO:teuthology.orchestra.run.smithi006.stdout:55834574856 2023-07-21T07:34:47.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-21T07:34:47.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.015+0000 7f9e6affd700 1 -- 172.21.15.6:0/509748862 <== osd.6 v2:172.21.15.86:6808/236253683 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9e60002d40 con 0x7f9e5c073330 2023-07-21T07:34:47.127 INFO:teuthology.orchestra.run.smithi006.stdout:55834574856 2023-07-21T07:34:47.127 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-21T07:34:47.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.015+0000 7f9e68ff9700 1 -- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:6808/236253683,v1:172.21.15.86:6809/236253683] conn(0x7f9e5c073330 msgr2=0x7f9e5c075750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.015+0000 7f9e68ff9700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:6808/236253683,v1:172.21.15.86:6809/236253683] conn(0x7f9e5c073330 0x7f9e5c075750 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.015+0000 7f9e68ff9700 1 -- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9e5c06ace0 msgr2=0x7f9e5c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.015+0000 7f9e68ff9700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9e5c06ace0 0x7f9e5c06d1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c006fd0 tx=0x7f9e6c008040 comp rx=0 tx=0).stop 2023-07-21T07:34:47.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.015+0000 7f9e68ff9700 1 -- 172.21.15.6:0/509748862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e7c06aad0 msgr2=0x7f9e7c144700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.015+0000 7f9e68ff9700 1 --2- 172.21.15.6:0/509748862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e7c06aad0 0x7f9e7c144700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e74000f80 tx=0x7f9e74004ad0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.015+0000 7f9e7ad9d700 1 -- 172.21.15.6:0/509748862 reap_dead start 2023-07-21T07:34:47.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.015+0000 7f9e68ff9700 1 -- 172.21.15.6:0/509748862 shutdown_connections 2023-07-21T07:34:47.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.015+0000 7f9e68ff9700 1 -- 172.21.15.6:0/509748862 >> 172.21.15.6:0/509748862 conn(0x7f9e7c06a6c0 msgr2=0x7f9e7c153e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.015+0000 7f9e68ff9700 1 -- 172.21.15.6:0/509748862 shutdown_connections 2023-07-21T07:34:47.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.015+0000 7f9e68ff9700 1 -- 172.21.15.6:0/509748862 wait complete. 2023-07-21T07:34:47.132 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-07-21T07:34:47.133 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-21T07:34:47.134 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-07-21T07:34:47.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-21T07:34:47.136 INFO:teuthology.orchestra.run.smithi006.stdout:55834574856 2023-07-21T07:34:47.137 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-21T07:34:47.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.327+0000 7fdf8b05c700 1 Processor -- start 2023-07-21T07:34:47.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.327+0000 7fdf8b05c700 1 -- start start 2023-07-21T07:34:47.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.327+0000 7f429cbc4700 1 Processor -- start 2023-07-21T07:34:47.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.327+0000 7f429cbc4700 1 -- start start 2023-07-21T07:34:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.328+0000 7fdf8b05c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdf84150e10 0x7fdf84151290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.328+0000 7fdf8b05c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf840baec0 0x7fdf840bb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.328+0000 7fdf8b05c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf840bb810 con 0x7fdf840c5030 2023-07-21T07:34:47.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.328+0000 7fdf8b05c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf840c1520 con 0x7fdf840baec0 2023-07-21T07:34:47.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.328+0000 7fdf8b05c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf840c1240 con 0x7fdf84150e10 2023-07-21T07:34:47.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.328+0000 7fed68e12700 1 Processor -- start 2023-07-21T07:34:47.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.328+0000 7f429cbc4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4298067120 0x7f42980a5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.328+0000 7f429cbc4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4298151910 0x7f42981541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.328+0000 7f429cbc4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429814deb0 con 0x7f429806cf20 2023-07-21T07:34:47.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7f429cbc4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4298153a10 con 0x7f4298151910 2023-07-21T07:34:47.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7f429cbc4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4298150ce0 con 0x7f4298067120 2023-07-21T07:34:47.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7fdf83fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdf84150e10 0x7fdf84151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7fdf83fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdf84150e10 0x7fdf84151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54416/0 (socket says 172.21.15.6:54416) 2023-07-21T07:34:47.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7fdf83fff700 1 -- 172.21.15.6:0/27933811 learned_addr learned my addr 172.21.15.6:0/27933811 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7f4296d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4298151910 0x7f42981541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7f4296d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4298151910 0x7f42981541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60852/0 (socket says 172.21.15.6:60852) 2023-07-21T07:34:47.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7f4296d9d700 1 -- 172.21.15.6:0/639739037 learned_addr learned my addr 172.21.15.6:0/639739037 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7f429659c700 1 --2- 172.21.15.6:0/639739037 >> v2:172.21.15.86:3300/0 conn(0x7f4298067120 0x7f42980a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7fdf895f9700 1 --2- 172.21.15.6:0/27933811 >> v2:172.21.15.6:3300/0 conn(0x7fdf840baec0 0x7fdf840bb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7fdf83fff700 1 -- 172.21.15.6:0/27933811 >> v2:172.21.15.6:3300/0 conn(0x7fdf840baec0 msgr2=0x7fdf840bb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7fdf83fff700 1 --2- 172.21.15.6:0/27933811 >> v2:172.21.15.6:3300/0 conn(0x7fdf840baec0 0x7fdf840bb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7fdf83fff700 1 -- 172.21.15.6:0/27933811 >> v1:172.21.15.86:6789/0 conn(0x7fdf840c5030 legacy=0x7fdf840c07f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T07:34:47.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.329+0000 7fdf83fff700 1 -- 172.21.15.6:0/27933811 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf840c3f10 con 0x7fdf84150e10 2023-07-21T07:34:47.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7f4296d9d700 1 -- 172.21.15.6:0/639739037 >> v2:172.21.15.86:3300/0 conn(0x7f4298067120 msgr2=0x7f42980a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7f4296d9d700 1 --2- 172.21.15.6:0/639739037 >> v2:172.21.15.86:3300/0 conn(0x7f4298067120 0x7f42980a5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7f4296d9d700 1 -- 172.21.15.6:0/639739037 >> v1:172.21.15.86:6789/0 conn(0x7f429806cf20 legacy=0x7f4298150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7f4296d9d700 1 -- 172.21.15.6:0/639739037 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4298150fc0 con 0x7f4298151910 2023-07-21T07:34:47.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7fdf83fff700 1 --2- 172.21.15.6:0/27933811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf84150e10 0x7fdf84151290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf8406b0f0 tx=0x7fdf7c009eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2a78bb940f0c282 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.328+0000 7fed68e12700 1 -- start start 2023-07-21T07:34:47.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7f94c63ac700 1 Processor -- start 2023-07-21T07:34:47.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7f4296d9d700 1 --2- 172.21.15.6:0/639739037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4298151910 0x7f42981541d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f42980c6c90 tx=0x7f429000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d6ea882224bddb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7fed68e12700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed64151b70 0x7fed640bea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7fed68e12700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed64158660 0x7fed6415ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7fed68e12700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed641581d0 con 0x7fed640c7260 2023-07-21T07:34:47.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7fed68e12700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed640c98e0 con 0x7fed64158660 2023-07-21T07:34:47.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7fed68e12700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed64155360 con 0x7fed64151b70 2023-07-21T07:34:47.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7fed6259c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed64151b70 0x7fed640bea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7fed6259c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed64151b70 0x7fed640bea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:58248/0 (socket says 172.21.15.6:58248) 2023-07-21T07:34:47.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7fed6259c700 1 -- 172.21.15.6:0/3041249319 learned_addr learned my addr 172.21.15.6:0/3041249319 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7fed62d9d700 1 --2- 172.21.15.6:0/3041249319 >> v2:172.21.15.6:3300/0 conn(0x7fed64158660 0x7fed6415ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7fed6259c700 1 -- 172.21.15.6:0/3041249319 >> v2:172.21.15.6:3300/0 conn(0x7fed64158660 msgr2=0x7fed6415ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7fed6259c700 1 --2- 172.21.15.6:0/3041249319 >> v2:172.21.15.6:3300/0 conn(0x7fed64158660 0x7fed6415ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7fed6259c700 1 -- 172.21.15.6:0/3041249319 >> v1:172.21.15.6:6789/0 conn(0x7fed640c7260 legacy=0x7fed640c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7fed6259c700 1 -- 172.21.15.6:0/3041249319 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed64155080 con 0x7fed64151b70 2023-07-21T07:34:47.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7fed62d9d700 1 --2- 172.21.15.6:0/3041249319 >> v2:172.21.15.6:3300/0 conn(0x7fed64158660 0x7fed6415ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:47.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7f5319aa9700 1 Processor -- start 2023-07-21T07:34:47.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7f429559a700 1 -- 172.21.15.6:0/639739037 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429000e070 con 0x7f4298151910 2023-07-21T07:34:47.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7fed6259c700 1 --2- 172.21.15.6:0/3041249319 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed64151b70 0x7fed640bea80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fed540098f0 tx=0x7fed54009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f56a9f2680729f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7fed6159a700 1 -- 172.21.15.6:0/3041249319 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54004230 con 0x7fed64151b70 2023-07-21T07:34:47.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7fed6159a700 1 -- 172.21.15.6:0/3041249319 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed54004390 con 0x7fed64151b70 2023-07-21T07:34:47.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7fed6159a700 1 -- 172.21.15.6:0/3041249319 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540036a0 con 0x7fed64151b70 2023-07-21T07:34:47.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.330+0000 7f94c63ac700 1 -- start start 2023-07-21T07:34:47.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7f94c63ac700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94c0156200 0x7f94c00c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7f94c63ac700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f94c00c0350 0x7f94c00c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7f94c63ac700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c00c1140 con 0x7f94c00c4260 2023-07-21T07:34:47.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7f94c63ac700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c015c9d0 con 0x7f94c0156200 2023-07-21T07:34:47.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7f94c63ac700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c015ccb0 con 0x7f94c00c0350 2023-07-21T07:34:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f5319aa9700 1 -- start start 2023-07-21T07:34:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7f429559a700 1 -- 172.21.15.6:0/639739037 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4290003a20 con 0x7f4298151910 2023-07-21T07:34:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.331+0000 7f429559a700 1 -- 172.21.15.6:0/639739037 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290003dd0 con 0x7f4298151910 2023-07-21T07:34:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f429cbc4700 1 -- 172.21.15.6:0/639739037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4298151910 msgr2=0x7f42981541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f429cbc4700 1 --2- 172.21.15.6:0/639739037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4298151910 0x7f42981541d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f42980c6c90 tx=0x7f429000b330 comp rx=0 tx=0).stop 2023-07-21T07:34:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f429cbc4700 1 -- 172.21.15.6:0/639739037 shutdown_connections 2023-07-21T07:34:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f429cbc4700 1 --2- 172.21.15.6:0/639739037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4298151910 0x7f42981541d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f429cbc4700 1 --2- 172.21.15.6:0/639739037 >> v2:172.21.15.86:3300/0 conn(0x7f4298067120 0x7f42980a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f429cbc4700 1 -- 172.21.15.6:0/639739037 >> 172.21.15.6:0/639739037 conn(0x7f429806a270 msgr2=0x7f429806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7fed68e12700 1 -- 172.21.15.6:0/3041249319 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed64151b70 msgr2=0x7fed640bea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7fed68e12700 1 --2- 172.21.15.6:0/3041249319 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed64151b70 0x7fed640bea80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fed540098f0 tx=0x7fed54009c00 comp rx=0 tx=0).stop 2023-07-21T07:34:47.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f94bffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94c0156200 0x7f94c00c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f94bffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94c0156200 0x7f94c00c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60860/0 (socket says 172.21.15.6:60860) 2023-07-21T07:34:47.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f94bffff700 1 -- 172.21.15.6:0/1425427785 learned_addr learned my addr 172.21.15.6:0/1425427785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f94bffff700 1 -- 172.21.15.6:0/1425427785 >> v2:172.21.15.86:3300/0 conn(0x7f94c00c0350 msgr2=0x7f94c00c21a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T07:34:47.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f94bffff700 1 --2- 172.21.15.6:0/1425427785 >> v2:172.21.15.86:3300/0 conn(0x7f94c00c0350 0x7f94c00c21a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f94bffff700 1 -- 172.21.15.6:0/1425427785 >> v1:172.21.15.6:6789/0 conn(0x7f94c00c4260 legacy=0x7f94c00c0a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T07:34:47.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f94bffff700 1 -- 172.21.15.6:0/1425427785 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c00a4ef0 con 0x7f94c0156200 2023-07-21T07:34:47.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f94bffff700 1 --2- 172.21.15.6:0/1425427785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c0156200 0x7f94c00c53a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f94c0072950 tx=0x7f94b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7208fd2390251aa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7f429cbc4700 1 -- 172.21.15.6:0/639739037 shutdown_connections 2023-07-21T07:34:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7fed68e12700 1 -- 172.21.15.6:0/3041249319 shutdown_connections 2023-07-21T07:34:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7fed68e12700 1 --2- 172.21.15.6:0/3041249319 >> v2:172.21.15.6:3300/0 conn(0x7fed64158660 0x7fed6415ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7fed68e12700 1 --2- 172.21.15.6:0/3041249319 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed64151b70 0x7fed640bea80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7fed68e12700 1 -- 172.21.15.6:0/3041249319 >> 172.21.15.6:0/3041249319 conn(0x7fed640c6620 msgr2=0x7fed640c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.332+0000 7fdf837fe700 1 -- 172.21.15.6:0/27933811 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c003c20 con 0x7fdf84150e10 2023-07-21T07:34:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.333+0000 7fdf837fe700 1 -- 172.21.15.6:0/27933811 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c0092e0 con 0x7fdf84150e10 2023-07-21T07:34:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.333+0000 7fdf837fe700 1 -- 172.21.15.6:0/27933811 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c010700 con 0x7fdf84150e10 2023-07-21T07:34:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.333+0000 7fed68e12700 1 -- 172.21.15.6:0/3041249319 shutdown_connections 2023-07-21T07:34:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.333+0000 7f94beffd700 1 -- 172.21.15.6:0/1425427785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4004230 con 0x7f94c0156200 2023-07-21T07:34:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.333+0000 7f94beffd700 1 -- 172.21.15.6:0/1425427785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4004390 con 0x7f94c0156200 2023-07-21T07:34:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.333+0000 7f94beffd700 1 -- 172.21.15.6:0/1425427785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40036a0 con 0x7f94c0156200 2023-07-21T07:34:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.333+0000 7f5319aa9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f53140c4360 0x7f53141546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.333+0000 7f5319aa9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53140c09f0 con 0x7f53140c3f00 2023-07-21T07:34:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.333+0000 7f5319aa9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53140c0cd0 con 0x7f53141510a0 2023-07-21T07:34:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.333+0000 7f5319aa9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53140c47f0 con 0x7f53140c4360 2023-07-21T07:34:47.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.333+0000 7f429cbc4700 1 -- 172.21.15.6:0/639739037 wait complete. 2023-07-21T07:34:47.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.333+0000 7fed68e12700 1 -- 172.21.15.6:0/3041249319 wait complete. 2023-07-21T07:34:47.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.334+0000 7f5313fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f53140c4360 0x7f53141546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.334+0000 7f53137fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f53141510a0 0x7f53140c4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:43896/0 (socket says 172.21.15.6:43896) 2023-07-21T07:34:47.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.334+0000 7f53137fe700 1 -- 172.21.15.6:0/3136921509 learned_addr learned my addr 172.21.15.6:0/3136921509 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:47.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.334+0000 7fdf8b05c700 1 -- 172.21.15.6:0/27933811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf84150e10 msgr2=0x7fdf84151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.334+0000 7fdf8b05c700 1 --2- 172.21.15.6:0/27933811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf84150e10 0x7fdf84151290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf8406b0f0 tx=0x7fdf7c009eb0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.334+0000 7f5313fff700 1 -- 172.21.15.6:0/3136921509 >> v1:172.21.15.86:6789/0 conn(0x7f53141510a0 legacy=0x7f53140c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.334+0000 7f5313fff700 1 -- 172.21.15.6:0/3136921509 >> v1:172.21.15.6:6789/0 conn(0x7f53140c3f00 legacy=0x7f5314153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.334+0000 7f5313fff700 1 -- 172.21.15.6:0/3136921509 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140c0fb0 con 0x7f53140c4360 2023-07-21T07:34:47.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.334+0000 7f5313fff700 1 --2- 172.21.15.6:0/3136921509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53140c4360 0x7f53141546a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5304009130 tx=0x7f5304009440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fccf43ba2395d8de server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7f429cbc4700 1 Processor -- start 2023-07-21T07:34:47.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7fed68e12700 1 Processor -- start 2023-07-21T07:34:47.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7f94c63ac700 1 -- 172.21.15.6:0/1425427785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c0156200 msgr2=0x7f94c00c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7f94c63ac700 1 --2- 172.21.15.6:0/1425427785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c0156200 0x7f94c00c53a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f94c0072950 tx=0x7f94b4009bd0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7f53127fc700 1 -- 172.21.15.6:0/3136921509 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304004230 con 0x7f53140c4360 2023-07-21T07:34:47.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7f53127fc700 1 -- 172.21.15.6:0/3136921509 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5304004390 con 0x7f53140c4360 2023-07-21T07:34:47.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7f53127fc700 1 -- 172.21.15.6:0/3136921509 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53040036a0 con 0x7f53140c4360 2023-07-21T07:34:47.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7f94c63ac700 1 -- 172.21.15.6:0/1425427785 shutdown_connections 2023-07-21T07:34:47.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7f94c63ac700 1 --2- 172.21.15.6:0/1425427785 >> v2:172.21.15.86:3300/0 conn(0x7f94c00c0350 0x7f94c00c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7f94c63ac700 1 --2- 172.21.15.6:0/1425427785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c0156200 0x7f94c00c53a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7f94c63ac700 1 -- 172.21.15.6:0/1425427785 >> 172.21.15.6:0/1425427785 conn(0x7f94c006aa10 msgr2=0x7f94c00a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7fdf8b05c700 1 -- 172.21.15.6:0/27933811 shutdown_connections 2023-07-21T07:34:47.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7fdf8b05c700 1 --2- 172.21.15.6:0/27933811 >> v2:172.21.15.6:3300/0 conn(0x7fdf840baec0 0x7fdf840bb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7fdf8b05c700 1 --2- 172.21.15.6:0/27933811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf84150e10 0x7fdf84151290 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7fdf8b05c700 1 -- 172.21.15.6:0/27933811 >> 172.21.15.6:0/27933811 conn(0x7fdf8406aa10 msgr2=0x7fdf840a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7f94c63ac700 1 -- 172.21.15.6:0/1425427785 shutdown_connections 2023-07-21T07:34:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7f94c63ac700 1 -- 172.21.15.6:0/1425427785 wait complete. 2023-07-21T07:34:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7fed68e12700 1 -- start start 2023-07-21T07:34:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f5319aa9700 1 -- 172.21.15.6:0/3136921509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53140c4360 msgr2=0x7f53141546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f5319aa9700 1 --2- 172.21.15.6:0/3136921509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53140c4360 0x7f53141546a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5304009130 tx=0x7f5304009440 comp rx=0 tx=0).stop 2023-07-21T07:34:47.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.335+0000 7f429cbc4700 1 -- start start 2023-07-21T07:34:47.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f5319aa9700 1 -- 172.21.15.6:0/3136921509 shutdown_connections 2023-07-21T07:34:47.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f5319aa9700 1 --2- 172.21.15.6:0/3136921509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53140c4360 0x7f53141546a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f5319aa9700 1 -- 172.21.15.6:0/3136921509 >> 172.21.15.6:0/3136921509 conn(0x7f531406a6c0 msgr2=0x7f53140a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f5319aa9700 1 -- 172.21.15.6:0/3136921509 shutdown_connections 2023-07-21T07:34:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7fed68e12700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed640c7260 0x7fed641ef630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7fed68e12700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed64151b70 0x7fed641eebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7fed68e12700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed64158660 0x7fed6406bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7fed68e12700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed640c3e30 con 0x7fed64151b70 2023-07-21T07:34:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7fed68e12700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed64153b40 con 0x7fed640c7260 2023-07-21T07:34:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7fed68e12700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed64154310 con 0x7fed64158660 2023-07-21T07:34:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f429cbc4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4298067120 0x7f4298145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f429cbc4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f429806cf20 0x7f4298144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f429cbc4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4298151910 0x7f42981448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f429cbc4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42981ee600 con 0x7f429806cf20 2023-07-21T07:34:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f429cbc4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42981ee8e0 con 0x7f4298151910 2023-07-21T07:34:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f429cbc4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42981eebc0 con 0x7f4298067120 2023-07-21T07:34:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f4295d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f429806cf20 0x7f4298144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f4295d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f429806cf20 0x7f4298144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60868/0 (socket says 172.21.15.6:60868) 2023-07-21T07:34:47.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f4295d9b700 1 -- 172.21.15.6:0/3472635819 learned_addr learned my addr 172.21.15.6:0/3472635819 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7fed6259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed640c7260 0x7fed641ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7fed6259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed640c7260 0x7fed641ef630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54446/0 (socket says 172.21.15.6:54446) 2023-07-21T07:34:47.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7fed6259c700 1 -- 172.21.15.6:0/626215734 learned_addr learned my addr 172.21.15.6:0/626215734 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7fed62d9d700 1 --2- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed64158660 0x7fed6406bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7f94c63ac700 1 Processor -- start 2023-07-21T07:34:47.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7f4295d9b700 1 -- 172.21.15.6:0/3472635819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4298067120 msgr2=0x7f4298145840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7f4295d9b700 1 --2- 172.21.15.6:0/3472635819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4298067120 0x7f4298145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7f4295d9b700 1 -- 172.21.15.6:0/3472635819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4298151910 msgr2=0x7f42981448a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T07:34:47.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7f4295d9b700 1 --2- 172.21.15.6:0/3472635819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4298151910 0x7f42981448a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7f4295d9b700 1 -- 172.21.15.6:0/3472635819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4290009b30 con 0x7f429806cf20 2023-07-21T07:34:47.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7f4295d9b700 1 --2- 172.21.15.6:0/3472635819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f429806cf20 0x7f4298144360 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f428c00c4d0 tx=0x7f428c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7fdf8b05c700 1 -- 172.21.15.6:0/27933811 shutdown_connections 2023-07-21T07:34:47.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7fdf8b05c700 1 -- 172.21.15.6:0/27933811 wait complete. 2023-07-21T07:34:47.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7fed6259c700 1 -- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed64158660 msgr2=0x7fed6406bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7fed6259c700 1 --2- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed64158660 0x7fed6406bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7fed6259c700 1 -- 172.21.15.6:0/626215734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed64151b70 msgr2=0x7fed641eebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7fed6259c700 1 --2- 172.21.15.6:0/626215734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed64151b70 0x7fed641eebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7fed6259c700 1 -- 172.21.15.6:0/626215734 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed54009550 con 0x7fed640c7260 2023-07-21T07:34:47.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.337+0000 7f94c63ac700 1 -- start start 2023-07-21T07:34:47.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7f0ba2890700 1 Processor -- start 2023-07-21T07:34:47.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7fefdc901700 1 Processor -- start 2023-07-21T07:34:47.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.336+0000 7f5319aa9700 1 -- 172.21.15.6:0/3136921509 wait complete. 2023-07-21T07:34:47.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7f5319aa9700 1 Processor -- start 2023-07-21T07:34:47.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.339+0000 7fdf8b05c700 1 Processor -- start 2023-07-21T07:34:47.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.339+0000 7fdf8b05c700 1 -- start start 2023-07-21T07:34:47.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7f4286ffd700 1 -- 172.21.15.6:0/3472635819 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c011790 con 0x7f429806cf20 2023-07-21T07:34:47.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7f4286ffd700 1 -- 172.21.15.6:0/3472635819 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c011910 con 0x7f429806cf20 2023-07-21T07:34:47.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7f4286ffd700 1 -- 172.21.15.6:0/3472635819 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c011cc0 con 0x7f429806cf20 2023-07-21T07:34:47.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7f429cbc4700 1 -- 172.21.15.6:0/3472635819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42981eeea0 con 0x7f429806cf20 2023-07-21T07:34:47.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7f429cbc4700 1 -- 172.21.15.6:0/3472635819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4298150650 con 0x7f429806cf20 2023-07-21T07:34:47.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7fefdc901700 1 -- start start 2023-07-21T07:34:47.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.339+0000 7fefdc901700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd80b9d00 0x7fefd8070570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.339+0000 7fefdc901700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fefd806d810 0x7fefd80c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.339+0000 7fefdc901700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fefd80c48b0 0x7fefd806a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.339+0000 7fefdc901700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd806dec0 con 0x7fefd806d810 2023-07-21T07:34:47.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.339+0000 7fefdc901700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd8070ab0 con 0x7fefd80c48b0 2023-07-21T07:34:47.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.339+0000 7fefdc901700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80c35a0 con 0x7fefd80b9d00 2023-07-21T07:34:47.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7fed6259c700 1 --2- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed640c7260 0x7fed641ef630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed54009840 tx=0x7fed54004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fefd6d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fefd80c48b0 0x7fefd806a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fefd6d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fefd80c48b0 0x7fefd806a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54456/0 (socket says 172.21.15.6:54456) 2023-07-21T07:34:47.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fefd6d9d700 1 -- 172.21.15.6:0/1782971902 learned_addr learned my addr 172.21.15.6:0/1782971902 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7f94c63ac700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94c00c0350 0x7f94c01418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7f94c63ac700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94c00c4260 0x7f94c00beed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7f94c63ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c0156200 0x7f94c0143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7f94c63ac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c00aa0e0 con 0x7f94c0156200 2023-07-21T07:34:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7f94c63ac700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c0159bb0 con 0x7f94c00c4260 2023-07-21T07:34:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.338+0000 7f94c63ac700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c0141df0 con 0x7f94c00c0350 2023-07-21T07:34:47.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.339+0000 7f94bffff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94c00c0350 0x7f94c01418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f94bffff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94c00c0350 0x7f94c01418b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:58276/0 (socket says 172.21.15.6:58276) 2023-07-21T07:34:47.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f94bffff700 1 -- 172.21.15.6:0/3042120449 learned_addr learned my addr 172.21.15.6:0/3042120449 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f94bf7fe700 1 --2- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94c00c4260 0x7f94c00beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fefd6d9d700 1 -- 172.21.15.6:0/1782971902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd80b9d00 msgr2=0x7fefd8070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fefd659c700 1 --2- 172.21.15.6:0/1782971902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd80b9d00 0x7fefd8070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fdf8b05c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf840baec0 0x7fdf841eb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fdf8b05c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf840c5030 0x7fdf841eb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fdf8b05c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf84150e10 0x7fdf841522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fdf8b05c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf840bda10 con 0x7fdf840baec0 2023-07-21T07:34:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fdf8b05c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf841eea40 con 0x7fdf84150e10 2023-07-21T07:34:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fdf8b05c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf841eed20 con 0x7fdf840c5030 2023-07-21T07:34:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.339+0000 7f5319aa9700 1 -- start start 2023-07-21T07:34:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f5319aa9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140c3f00 0x7f53141ee750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f5319aa9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53140c4360 0x7f5314147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f5319aa9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53141510a0 0x7f531414e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f5319aa9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53140bfd80 con 0x7f53140c3f00 2023-07-21T07:34:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f5319aa9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531414d920 con 0x7f53140c4360 2023-07-21T07:34:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f5319aa9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531414dbe0 con 0x7f53141510a0 2023-07-21T07:34:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f5312ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53140c4360 0x7f5314147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f53137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140c3f00 0x7f53141ee750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f53137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140c3f00 0x7f53141ee750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60896/0 (socket says 172.21.15.6:60896) 2023-07-21T07:34:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f53137fe700 1 -- 172.21.15.6:0/2045309828 learned_addr learned my addr 172.21.15.6:0/2045309828 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f429cbc4700 1 -- 172.21.15.6:0/3472635819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42981ef3c0 con 0x7f429806cf20 2023-07-21T07:34:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f4286ffd700 1 -- 172.21.15.6:0/3472635819 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f428c01c460 con 0x7f429806cf20 2023-07-21T07:34:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.339+0000 7f0ba2890700 1 -- start start 2023-07-21T07:34:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f94bffff700 1 -- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94c00c4260 msgr2=0x7f94c00beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f94bffff700 1 --2- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94c00c4260 0x7f94c00beed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f94bffff700 1 -- 172.21.15.6:0/3042120449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c0156200 msgr2=0x7f94c0143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f94bffff700 1 --2- 172.21.15.6:0/3042120449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c0156200 0x7f94c0143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7f94bffff700 1 -- 172.21.15.6:0/3042120449 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b4009550 con 0x7f94c00c0350 2023-07-21T07:34:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7fdf895f9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf84150e10 0x7fdf841522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7fdf895f9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf84150e10 0x7fdf841522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54472/0 (socket says 172.21.15.6:54472) 2023-07-21T07:34:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7fdf895f9700 1 -- 172.21.15.6:0/1513411067 learned_addr learned my addr 172.21.15.6:0/1513411067 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7fdf83fff700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf840c5030 0x7fdf841eb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f94bffff700 1 --2- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94c00c0350 0x7f94c01418b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009fd0 tx=0x7f94b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7fdf88df8700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf840baec0 0x7fdf841eb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f0ba2890700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0b9c156200 0x7f0b9c0c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f0ba2890700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b9c0c4260 0x7f0b9c0c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f0ba2890700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c15c9d0 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f0ba2890700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9c0c0890 con 0x7f0b9c0c4260 2023-07-21T07:34:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f0ba2890700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9c15ccb0 con 0x7f0b9c156200 2023-07-21T07:34:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f0b9bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0b9c156200 0x7f0b9c0c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f0b9bfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0b9c156200 0x7f0b9c0c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54478/0 (socket says 172.21.15.6:54478) 2023-07-21T07:34:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f0b9bfff700 1 -- 172.21.15.6:0/2036370505 learned_addr learned my addr 172.21.15.6:0/2036370505 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7fdf895f9700 1 -- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf840c5030 msgr2=0x7fdf841eb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7fdf895f9700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf840c5030 0x7fdf841eb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7fdf895f9700 1 -- 172.21.15.6:0/1513411067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf840baec0 msgr2=0x7fdf841eb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7fdf895f9700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf840baec0 0x7fdf841eb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7fdf895f9700 1 -- 172.21.15.6:0/1513411067 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c009830 con 0x7fdf84150e10 2023-07-21T07:34:47.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f53137fe700 1 -- 172.21.15.6:0/2045309828 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53141510a0 msgr2=0x7f531414e5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T07:34:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f53137fe700 1 --2- 172.21.15.6:0/2045309828 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53141510a0 0x7f531414e5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f53137fe700 1 -- 172.21.15.6:0/2045309828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53140c4360 msgr2=0x7f5314147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f53137fe700 1 --2- 172.21.15.6:0/2045309828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53140c4360 0x7f5314147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f53137fe700 1 -- 172.21.15.6:0/2045309828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5304009d30 con 0x7f53140c3f00 2023-07-21T07:34:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f4286ffd700 1 --2- 172.21.15.6:0/3472635819 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f427806ad80 0x7f427806d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f4286ffd700 1 -- 172.21.15.6:0/3472635819 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f428c089240 con 0x7f429806cf20 2023-07-21T07:34:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f429659c700 1 --2- 172.21.15.6:0/3472635819 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f427806ad80 0x7f427806d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f94bcff9700 1 -- 172.21.15.6:0/3042120449 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4011630 con 0x7f94c00c0350 2023-07-21T07:34:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f94bcff9700 1 -- 172.21.15.6:0/3042120449 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4011790 con 0x7f94c00c0350 2023-07-21T07:34:47.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7f94bcff9700 1 -- 172.21.15.6:0/3042120449 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4011b20 con 0x7f94c00c0350 2023-07-21T07:34:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7f94c63ac700 1 -- 172.21.15.6:0/3042120449 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c0159e50 con 0x7f94c00c0350 2023-07-21T07:34:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7fdf895f9700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf84150e10 0x7fdf841522e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800e810 tx=0x7fdf7800eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7f53137fe700 1 --2- 172.21.15.6:0/2045309828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140c3f00 0x7f53141ee750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f530800c780 tx=0x7f530800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7f0b9bfff700 1 -- 172.21.15.6:0/2036370505 >> v2:172.21.15.6:3300/0 conn(0x7f0b9c0c4260 msgr2=0x7f0b9c0c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7f0b9bfff700 1 --2- 172.21.15.6:0/2036370505 >> v2:172.21.15.6:3300/0 conn(0x7f0b9c0c4260 0x7f0b9c0c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7f0b9bfff700 1 -- 172.21.15.6:0/2036370505 >> v1:172.21.15.86:6789/0 conn(0x7f0b9c0c0a30 legacy=0x7f0b9c0c21a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T07:34:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7f0b9bfff700 1 -- 172.21.15.6:0/2036370505 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c0a4ef0 con 0x7f0b9c156200 2023-07-21T07:34:47.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7f94c63ac700 1 -- 172.21.15.6:0/3042120449 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c00ab090 con 0x7f94c00c0350 2023-07-21T07:34:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7fdf817fa700 1 -- 172.21.15.6:0/1513411067 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7800c070 con 0x7fdf84150e10 2023-07-21T07:34:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fefd5d9b700 1 --2- 172.21.15.6:0/1782971902 >> v2:172.21.15.6:3300/0 conn(0x7fefd806d810 0x7fefd80c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fefd6d9d700 1 --2- 172.21.15.6:0/1782971902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd80b9d00 0x7fefd8070570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fefd6d9d700 1 -- 172.21.15.6:0/1782971902 >> v2:172.21.15.6:3300/0 conn(0x7fefd806d810 msgr2=0x7fefd80c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fefd6d9d700 1 --2- 172.21.15.6:0/1782971902 >> v2:172.21.15.6:3300/0 conn(0x7fefd806d810 0x7fefd80c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.340+0000 7fefd6d9d700 1 -- 172.21.15.6:0/1782971902 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80c22a0 con 0x7fefd80c48b0 2023-07-21T07:34:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.341+0000 7fefd5d9b700 1 --2- 172.21.15.6:0/1782971902 >> v2:172.21.15.6:3300/0 conn(0x7fefd806d810 0x7fefd80c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7fefd6d9d700 1 --2- 172.21.15.6:0/1782971902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd80c48b0 0x7fefd806a100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fefd80bd8e0 tx=0x7fefd000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c9966d0a3f5bef0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7f0b9bfff700 1 --2- 172.21.15.6:0/2036370505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9c156200 0x7f0b9c0c53a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c06d800 tx=0x7f0b9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=356a1a833c3dae9a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7f0b9affd700 1 -- 172.21.15.6:0/2036370505 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9400e070 con 0x7f0b9c156200 2023-07-21T07:34:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7f0b9affd700 1 -- 172.21.15.6:0/2036370505 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b94003a20 con 0x7f0b9c156200 2023-07-21T07:34:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.343+0000 7f0b9affd700 1 -- 172.21.15.6:0/2036370505 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94003dd0 con 0x7f0b9c156200 2023-07-21T07:34:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7fdf817fa700 1 -- 172.21.15.6:0/1513411067 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf78013630 con 0x7fdf84150e10 2023-07-21T07:34:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7fdf8b05c700 1 -- 172.21.15.6:0/1513411067 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf840a96b0 con 0x7fdf84150e10 2023-07-21T07:34:47.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7fdf8b05c700 1 -- 172.21.15.6:0/1513411067 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf840a9c70 con 0x7fdf84150e10 2023-07-21T07:34:47.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.343+0000 7fdf817fa700 1 -- 172.21.15.6:0/1513411067 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf780139e0 con 0x7fdf84150e10 2023-07-21T07:34:47.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7fed52ffd700 1 -- 172.21.15.6:0/626215734 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54003d80 con 0x7fed640c7260 2023-07-21T07:34:47.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7fed52ffd700 1 -- 172.21.15.6:0/626215734 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5401f070 con 0x7fed640c7260 2023-07-21T07:34:47.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7fed52ffd700 1 -- 172.21.15.6:0/626215734 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400b8a0 con 0x7fed640c7260 2023-07-21T07:34:47.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7fed68e12700 1 -- 172.21.15.6:0/626215734 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed641ef100 con 0x7fed640c7260 2023-07-21T07:34:47.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.342+0000 7fed68e12700 1 -- 172.21.15.6:0/626215734 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed64154030 con 0x7fed640c7260 2023-07-21T07:34:47.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.343+0000 7fdf8b05c700 1 -- 172.21.15.6:0/1513411067 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf840a9e60 con 0x7fdf84150e10 2023-07-21T07:34:47.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.343+0000 7f94c63ac700 1 -- 172.21.15.6:0/3042120449 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c0066920 con 0x7f94c00c0350 2023-07-21T07:34:47.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.343+0000 7fefd559a700 1 -- 172.21.15.6:0/1782971902 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd000e070 con 0x7fefd80c48b0 2023-07-21T07:34:47.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.343+0000 7fefd559a700 1 -- 172.21.15.6:0/1782971902 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd000b9c0 con 0x7fefd80c48b0 2023-07-21T07:34:47.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.343+0000 7fefd559a700 1 -- 172.21.15.6:0/1782971902 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd000bd70 con 0x7fefd80c48b0 2023-07-21T07:34:47.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.344+0000 7fefdc901700 1 -- 172.21.15.6:0/1782971902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd80c48b0 msgr2=0x7fefd806a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.344+0000 7fefdc901700 1 --2- 172.21.15.6:0/1782971902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd80c48b0 0x7fefd806a100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fefd80bd8e0 tx=0x7fefd000b330 comp rx=0 tx=0).stop 2023-07-21T07:34:47.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.344+0000 7fed68e12700 1 -- 172.21.15.6:0/626215734 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6406cc80 con 0x7fed640c7260 2023-07-21T07:34:47.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.344+0000 7fefdc901700 1 -- 172.21.15.6:0/1782971902 shutdown_connections 2023-07-21T07:34:47.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.344+0000 7fefdc901700 1 --2- 172.21.15.6:0/1782971902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd80c48b0 0x7fefd806a100 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.344+0000 7fefdc901700 1 --2- 172.21.15.6:0/1782971902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd80b9d00 0x7fefd8070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.344+0000 7fefdc901700 1 --2- 172.21.15.6:0/1782971902 >> v2:172.21.15.6:3300/0 conn(0x7fefd806d810 0x7fefd80c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.344+0000 7fefdc901700 1 -- 172.21.15.6:0/1782971902 >> 172.21.15.6:0/1782971902 conn(0x7fefd806b1a0 msgr2=0x7fefd806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.344+0000 7fefdc901700 1 -- 172.21.15.6:0/1782971902 shutdown_connections 2023-07-21T07:34:47.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.344+0000 7f429659c700 1 --2- 172.21.15.6:0/3472635819 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f427806ad80 0x7f427806d240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42980c5560 tx=0x7f4288008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.345+0000 7f94bcff9700 1 -- 172.21.15.6:0/3042120449 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94b4022070 con 0x7f94c00c0350 2023-07-21T07:34:47.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.345+0000 7f94bcff9700 1 --2- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f94a406ad00 0x7f94a406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.345+0000 7f94bcff9700 1 -- 172.21.15.6:0/3042120449 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94b408ac90 con 0x7f94c00c0350 2023-07-21T07:34:47.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.345+0000 7f94bf7fe700 1 --2- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f94a406ad00 0x7f94a406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.345+0000 7f0ba2890700 1 -- 172.21.15.6:0/2036370505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9c156200 msgr2=0x7f0b9c0c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.345+0000 7f0ba2890700 1 --2- 172.21.15.6:0/2036370505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9c156200 0x7f0b9c0c53a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c06d800 tx=0x7f0b9400b330 comp rx=0 tx=0).stop 2023-07-21T07:34:47.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.346+0000 7f0ba2890700 1 -- 172.21.15.6:0/2036370505 shutdown_connections 2023-07-21T07:34:47.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.346+0000 7f0ba2890700 1 --2- 172.21.15.6:0/2036370505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9c156200 0x7f0b9c0c53a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.346+0000 7f0ba2890700 1 --2- 172.21.15.6:0/2036370505 >> v2:172.21.15.6:3300/0 conn(0x7f0b9c0c4260 0x7f0b9c0c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.346+0000 7f0ba2890700 1 -- 172.21.15.6:0/2036370505 >> 172.21.15.6:0/2036370505 conn(0x7f0b9c06aa10 msgr2=0x7f0b9c0a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.346+0000 7f0ba2890700 1 -- 172.21.15.6:0/2036370505 shutdown_connections 2023-07-21T07:34:47.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.346+0000 7f0ba2890700 1 -- 172.21.15.6:0/2036370505 wait complete. 2023-07-21T07:34:47.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.346+0000 7f94bf7fe700 1 --2- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f94a406ad00 0x7f94a406d1c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f94c015c940 tx=0x7f94b8009540 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.345+0000 7fdf817fa700 1 -- 172.21.15.6:0/1513411067 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf78013b40 con 0x7fdf84150e10 2023-07-21T07:34:47.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.346+0000 7fdf817fa700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdf7006ad30 0x7fdf7006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.346+0000 7fdf817fa700 1 -- 172.21.15.6:0/1513411067 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf780898a0 con 0x7fdf84150e10 2023-07-21T07:34:47.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.346+0000 7fdf88df8700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdf7006ad30 0x7fdf7006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.346+0000 7fed52ffd700 1 -- 172.21.15.6:0/626215734 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed54021030 con 0x7fed640c7260 2023-07-21T07:34:47.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.346+0000 7fefdc901700 1 -- 172.21.15.6:0/1782971902 wait complete. 2023-07-21T07:34:47.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.346+0000 7fed52ffd700 1 --2- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fed4406ad30 0x7fed4406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.347+0000 7fed61d9b700 1 --2- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fed4406ad30 0x7fed4406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.347+0000 7fdf88df8700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdf7006ad30 0x7fdf7006d1f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009910 tx=0x7fdf74008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.347+0000 7fed61d9b700 1 --2- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fed4406ad30 0x7fed4406d1f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fed6414daa0 tx=0x7fed58006c30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.348+0000 7f0ba2890700 1 Processor -- start 2023-07-21T07:34:47.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.348+0000 7f0ba2890700 1 -- start start 2023-07-21T07:34:47.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.348+0000 7fefdc901700 1 Processor -- start 2023-07-21T07:34:47.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.348+0000 7fefdc901700 1 -- start start 2023-07-21T07:34:47.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0ba2890700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9c0c0a30 0x7f0b9c0bf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0ba2890700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b9c0c4260 0x7f0b9c154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0ba2890700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b9c156200 0x7f0b9c1ee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0ba2890700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c0bf4e0 con 0x7f0b9c0c4260 2023-07-21T07:34:47.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0ba2890700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c0bda40 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0ba2890700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c0bd4c0 con 0x7f0b9c156200 2023-07-21T07:34:47.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0b9bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9c0c0a30 0x7f0b9c0bf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0b9bfff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9c0c0a30 0x7f0b9c0bf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54490/0 (socket says 172.21.15.6:54490) 2023-07-21T07:34:47.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0b9bfff700 1 -- 172.21.15.6:0/214470284 learned_addr learned my addr 172.21.15.6:0/214470284 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0b9b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b9c0c4260 0x7f0b9c154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0ba0e2d700 1 --2- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b9c156200 0x7f0b9c1ee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0b9bfff700 1 -- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b9c156200 msgr2=0x7f0b9c1ee5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0b9bfff700 1 --2- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b9c156200 0x7f0b9c1ee5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0b9bfff700 1 -- 172.21.15.6:0/214470284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b9c0c4260 msgr2=0x7f0b9c154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0b9bfff700 1 --2- 172.21.15.6:0/214470284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b9c0c4260 0x7f0b9c154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7f0b9bfff700 1 -- 172.21.15.6:0/214470284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b94009b30 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7fed52ffd700 1 -- 172.21.15.6:0/626215734 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed5405db20 con 0x7fed640c7260 2023-07-21T07:34:47.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7fefdc901700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd806d810 0x7fefd80b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7fefdc901700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd80b9d00 0x7fefd80bb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7fefdc901700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd80c48b0 0x7fefd8147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7fefdc901700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd814be20 con 0x7fefd80c48b0 2023-07-21T07:34:47.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7fefdc901700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80bd090 con 0x7fefd806d810 2023-07-21T07:34:47.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7fefdc901700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80bb4b0 con 0x7fefd80b9d00 2023-07-21T07:34:47.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7fefd659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd806d810 0x7fefd80b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.349+0000 7fdf817fa700 1 -- 172.21.15.6:0/1513411067 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf78058450 con 0x7fdf84150e10 2023-07-21T07:34:47.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7fefd659c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd806d810 0x7fefd80b8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54496/0 (socket says 172.21.15.6:54496) 2023-07-21T07:34:47.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7fefd6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd80c48b0 0x7fefd8147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7fefd659c700 1 -- 172.21.15.6:0/2022434120 learned_addr learned my addr 172.21.15.6:0/2022434120 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7fefd5d9b700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd80b9d00 0x7fefd80bb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7f4286ffd700 1 -- 172.21.15.6:0/3472635819 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f42981ef3c0 con 0x7f429806cf20 2023-07-21T07:34:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7f0b9bfff700 1 --2- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9c0c0a30 0x7f0b9c0bf970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c15cdf0 tx=0x7f0b94004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7f52fbfff700 1 -- 172.21.15.6:0/2045309828 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308004c80 con 0x7f53140c3f00 2023-07-21T07:34:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7f52fbfff700 1 -- 172.21.15.6:0/2045309828 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5308004de0 con 0x7f53140c3f00 2023-07-21T07:34:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7f52fbfff700 1 -- 172.21.15.6:0/2045309828 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308007310 con 0x7f53140c3f00 2023-07-21T07:34:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7fefd6d9d700 1 -- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd80b9d00 msgr2=0x7fefd80bb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7fefd6d9d700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd80b9d00 0x7fefd80bb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7fefd6d9d700 1 -- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd806d810 msgr2=0x7fefd80b8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7fefd6d9d700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd806d810 0x7fefd80b8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7fefd6d9d700 1 -- 172.21.15.6:0/2022434120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd0009b30 con 0x7fefd80c48b0 2023-07-21T07:34:47.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7fefd659c700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd806d810 0x7fefd80b8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:47.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7f94bcff9700 1 -- 172.21.15.6:0/3042120449 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f94b4055eb0 con 0x7f94c00c0350 2023-07-21T07:34:47.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.350+0000 7fefd6d9d700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd80c48b0 0x7fefd8147d30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fefd0015000 tx=0x7fefd0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.351+0000 7fefc6ffd700 1 -- 172.21.15.6:0/2022434120 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0004040 con 0x7fefd80c48b0 2023-07-21T07:34:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.351+0000 7fefc6ffd700 1 -- 172.21.15.6:0/2022434120 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd00041a0 con 0x7fefd80c48b0 2023-07-21T07:34:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.351+0000 7fefc6ffd700 1 -- 172.21.15.6:0/2022434120 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0004550 con 0x7fefd80c48b0 2023-07-21T07:34:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.351+0000 7f5319aa9700 1 -- 172.21.15.6:0/2045309828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531414dec0 con 0x7f53140c3f00 2023-07-21T07:34:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.351+0000 7f5319aa9700 1 -- 172.21.15.6:0/2045309828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53140a4cf0 con 0x7f53140c3f00 2023-07-21T07:34:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.351+0000 7fefdc901700 1 -- 172.21.15.6:0/2022434120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd80baef0 con 0x7fefd80c48b0 2023-07-21T07:34:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.351+0000 7fefdc901700 1 -- 172.21.15.6:0/2022434120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd814b760 con 0x7fefd80c48b0 2023-07-21T07:34:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.353+0000 7fefdc901700 1 -- 172.21.15.6:0/2022434120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd806e5e0 con 0x7fefd80c48b0 2023-07-21T07:34:47.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.354+0000 7fed52ffd700 1 -- 172.21.15.6:0/626215734 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fed54055ea0 con 0x7fed640c7260 2023-07-21T07:34:47.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.353+0000 7f52fbfff700 1 -- 172.21.15.6:0/2045309828 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5308007470 con 0x7f53140c3f00 2023-07-21T07:34:47.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.354+0000 7f52fbfff700 1 --2- 172.21.15.6:0/2045309828 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530006ad60 0x7f530006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.354+0000 7f52fbfff700 1 -- 172.21.15.6:0/2045309828 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5308088900 con 0x7f53140c3f00 2023-07-21T07:34:47.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.355+0000 7f5312ffd700 1 --2- 172.21.15.6:0/2045309828 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530006ad60 0x7f530006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.354+0000 7fefc6ffd700 1 -- 172.21.15.6:0/2022434120 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fefd00046b0 con 0x7fefd80c48b0 2023-07-21T07:34:47.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.355+0000 7fefc6ffd700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fefb806ad30 0x7fefb806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.355+0000 7fefc6ffd700 1 -- 172.21.15.6:0/2022434120 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fefd008a7b0 con 0x7fefd80c48b0 2023-07-21T07:34:47.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.355+0000 7fefd659c700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fefb806ad30 0x7fefb806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.356+0000 7f0b98ff9700 1 -- 172.21.15.6:0/214470284 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94004440 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.356+0000 7f0b98ff9700 1 -- 172.21.15.6:0/214470284 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b940045a0 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.356+0000 7f0b98ff9700 1 -- 172.21.15.6:0/214470284 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94004950 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.356+0000 7fefd659c700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fefb806ad30 0x7fefb806d1f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fefd80c6760 tx=0x7fefcc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.357+0000 7f5312ffd700 1 --2- 172.21.15.6:0/2045309828 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530006ad60 0x7f530006d220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f53140c5460 tx=0x7f530c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.357+0000 7f0ba2890700 1 -- 172.21.15.6:0/214470284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9c0bd760 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.357+0000 7f0ba2890700 1 -- 172.21.15.6:0/214470284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9c0aadc0 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.357+0000 7f5319aa9700 1 -- 172.21.15.6:0/2045309828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531406b520 con 0x7f53140c3f00 2023-07-21T07:34:47.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.358+0000 7f0ba2890700 1 -- 172.21.15.6:0/214470284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9c0bf7c0 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.359+0000 7fefc6ffd700 1 -- 172.21.15.6:0/2022434120 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fefd00559d0 con 0x7fefd80c48b0 2023-07-21T07:34:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.359+0000 7fc5bef58700 1 Processor -- start 2023-07-21T07:34:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.359+0000 7fc5bef58700 1 -- start start 2023-07-21T07:34:47.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.360+0000 7fc5bef58700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b80a4f80 0x7fc5b815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.360+0000 7fc5bef58700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5b80c52f0 0x7fc5b815c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.360+0000 7fc5bef58700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b80c5780 con 0x7fc5b8155f90 2023-07-21T07:34:47.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.361+0000 7fc5bef58700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b80c0d90 con 0x7fc5b80c52f0 2023-07-21T07:34:47.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.361+0000 7fc5bef58700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b80c03f0 con 0x7fc5b80a4f80 2023-07-21T07:34:47.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.361+0000 7fc5b7fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b80a4f80 0x7fc5b815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.361+0000 7fc5b7fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b80a4f80 0x7fc5b815bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:58332/0 (socket says 172.21.15.6:58332) 2023-07-21T07:34:47.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.361+0000 7fc5b7fff700 1 -- 172.21.15.6:0/42348615 learned_addr learned my addr 172.21.15.6:0/42348615 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.361+0000 7fc5bd4f5700 1 --2- 172.21.15.6:0/42348615 >> v2:172.21.15.86:3300/0 conn(0x7fc5b80c52f0 0x7fc5b815c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.362+0000 7fc5bd4f5700 1 -- 172.21.15.6:0/42348615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b80a4f80 msgr2=0x7fc5b815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.362+0000 7fc5bd4f5700 1 --2- 172.21.15.6:0/42348615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b80a4f80 0x7fc5b815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.362+0000 7fc5bd4f5700 1 -- 172.21.15.6:0/42348615 >> v1:172.21.15.86:6789/0 conn(0x7fc5b8155f90 legacy=0x7fc5b80c3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.362+0000 7fc5bd4f5700 1 -- 172.21.15.6:0/42348615 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b80c06d0 con 0x7fc5b80c52f0 2023-07-21T07:34:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.362+0000 7fc5bd4f5700 1 --2- 172.21.15.6:0/42348615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b80c52f0 0x7fc5b815c470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009d90 tx=0x7fc5b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46cfa46f392ba451 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.363+0000 7fc5b77fe700 1 -- 172.21.15.6:0/42348615 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b000e070 con 0x7fc5b80c52f0 2023-07-21T07:34:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.363+0000 7fc5b77fe700 1 -- 172.21.15.6:0/42348615 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b000bae0 con 0x7fc5b80c52f0 2023-07-21T07:34:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.363+0000 7fc5b77fe700 1 -- 172.21.15.6:0/42348615 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b000be90 con 0x7fc5b80c52f0 2023-07-21T07:34:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.364+0000 7fc5bef58700 1 -- 172.21.15.6:0/42348615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b80c52f0 msgr2=0x7fc5b815c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.364+0000 7fc5bef58700 1 --2- 172.21.15.6:0/42348615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b80c52f0 0x7fc5b815c470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009d90 tx=0x7fc5b000b330 comp rx=0 tx=0).stop 2023-07-21T07:34:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.364+0000 7fc5bef58700 1 -- 172.21.15.6:0/42348615 shutdown_connections 2023-07-21T07:34:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.364+0000 7fc5bef58700 1 --2- 172.21.15.6:0/42348615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b80c52f0 0x7fc5b815c470 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.364+0000 7fc5bef58700 1 --2- 172.21.15.6:0/42348615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b80a4f80 0x7fc5b815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.364+0000 7fc5bef58700 1 -- 172.21.15.6:0/42348615 >> 172.21.15.6:0/42348615 conn(0x7fc5b806a6c0 msgr2=0x7fc5b80a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.364+0000 7fc5bef58700 1 -- 172.21.15.6:0/42348615 shutdown_connections 2023-07-21T07:34:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.364+0000 7fc5bef58700 1 -- 172.21.15.6:0/42348615 wait complete. 2023-07-21T07:34:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.366+0000 7fc5bef58700 1 Processor -- start 2023-07-21T07:34:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.366+0000 7fc5bef58700 1 -- start start 2023-07-21T07:34:47.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.367+0000 7f52fbfff700 1 -- 172.21.15.6:0/2045309828 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5308053b20 con 0x7f53140c3f00 2023-07-21T07:34:47.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.367+0000 7fc5bef58700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b80a4f80 0x7fc5b8157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.367+0000 7fc5bef58700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b8155f90 0x7fc5b815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.367+0000 7fc5bef58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b815bf80 0x7fc5b815a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.367+0000 7fc5bef58700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b80aafb0 con 0x7fc5b815bf80 2023-07-21T07:34:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.367+0000 7fc5bef58700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b81594b0 con 0x7fc5b8155f90 2023-07-21T07:34:47.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.367+0000 7fc5bef58700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b8146470 con 0x7fc5b80a4f80 2023-07-21T07:34:47.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.368+0000 7fc5bccf4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b80a4f80 0x7fc5b8157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.368+0000 7fc5bd4f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b815bf80 0x7fc5b815a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.368+0000 7fc5b7fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b8155f90 0x7fc5b815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.368+0000 7fc5bd4f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b815bf80 0x7fc5b815a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60944/0 (socket says 172.21.15.6:60944) 2023-07-21T07:34:47.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.368+0000 7fc5bd4f5700 1 -- 172.21.15.6:0/3923187239 learned_addr learned my addr 172.21.15.6:0/3923187239 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:47.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.368+0000 7fc5b7fff700 1 -- 172.21.15.6:0/3923187239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b80a4f80 msgr2=0x7fc5b8157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.368+0000 7fc5b7fff700 1 --2- 172.21.15.6:0/3923187239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b80a4f80 0x7fc5b8157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.368+0000 7fc5b7fff700 1 -- 172.21.15.6:0/3923187239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b815bf80 msgr2=0x7fc5b815a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.368+0000 7fc5b7fff700 1 --2- 172.21.15.6:0/3923187239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b815bf80 0x7fc5b815a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.368+0000 7fc5b7fff700 1 -- 172.21.15.6:0/3923187239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b0009a70 con 0x7fc5b8155f90 2023-07-21T07:34:47.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.368+0000 7fc5b7fff700 1 --2- 172.21.15.6:0/3923187239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b8155f90 0x7fc5b815ba40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00e8a0 tx=0x7fc5ac00ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.369+0000 7fc5b57fa700 1 -- 172.21.15.6:0/3923187239 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac013680 con 0x7fc5b8155f90 2023-07-21T07:34:47.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.369+0000 7fc5b57fa700 1 -- 172.21.15.6:0/3923187239 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac0137e0 con 0x7fc5b8155f90 2023-07-21T07:34:47.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.370+0000 7fc5bef58700 1 -- 172.21.15.6:0/3923187239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b80ab790 con 0x7fc5b8155f90 2023-07-21T07:34:47.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.370+0000 7fc5bef58700 1 -- 172.21.15.6:0/3923187239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b81596c0 con 0x7fc5b8155f90 2023-07-21T07:34:47.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.370+0000 7f0b98ff9700 1 -- 172.21.15.6:0/214470284 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b94012430 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.370+0000 7f0b98ff9700 1 --2- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b8806ad80 0x7f0b8806d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.370+0000 7f0b98ff9700 1 -- 172.21.15.6:0/214470284 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b9408abf0 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.370+0000 7f0b9b7fe700 1 --2- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b8806ad80 0x7f0b8806d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.370+0000 7f0b98ff9700 1 -- 172.21.15.6:0/214470284 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0b9408e2a0 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.371+0000 7fc5b57fa700 1 -- 172.21.15.6:0/3923187239 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac013b50 con 0x7fc5b8155f90 2023-07-21T07:34:47.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.372+0000 7f0b9b7fe700 1 --2- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b8806ad80 0x7f0b8806d240 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0bbff0 tx=0x7f0b90009110 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.371+0000 7fc5b57fa700 1 -- 172.21.15.6:0/3923187239 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc5ac013cf0 con 0x7fc5b8155f90 2023-07-21T07:34:47.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.372+0000 7fc5bef58700 1 -- 172.21.15.6:0/3923187239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5980052f0 con 0x7fc5b8155f90 2023-07-21T07:34:47.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.372+0000 7fc5b57fa700 1 --2- 172.21.15.6:0/3923187239 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc5a406ace0 0x7fc5a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:47.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.372+0000 7fc5b57fa700 1 -- 172.21.15.6:0/3923187239 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5ac089340 con 0x7fc5b8155f90 2023-07-21T07:34:47.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.374+0000 7fc5bccf4700 1 --2- 172.21.15.6:0/3923187239 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc5a406ace0 0x7fc5a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:47.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.374+0000 7fc5bccf4700 1 --2- 172.21.15.6:0/3923187239 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc5a406ace0 0x7fc5a406d1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8003e60 tx=0x7fc5a8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:47.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.377+0000 7fc5b57fa700 1 -- 172.21.15.6:0/3923187239 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc5ac054400 con 0x7fc5b8155f90 2023-07-21T07:34:47.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.756+0000 7f94c63ac700 1 -- 172.21.15.6:0/3042120449 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f94c0066920 con 0x7f94c00c0350 2023-07-21T07:34:47.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.756+0000 7f94bcff9700 1 -- 172.21.15.6:0/3042120449 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94b40594d0 con 0x7f94c00c0350 2023-07-21T07:34:47.810 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-07-21T07:34:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.760+0000 7f94c63ac700 1 -- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f94a406ad00 msgr2=0x7f94a406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.760+0000 7f94c63ac700 1 --2- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f94a406ad00 0x7f94a406d1c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f94c015c940 tx=0x7f94b8009540 comp rx=0 tx=0).stop 2023-07-21T07:34:47.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.760+0000 7f94c63ac700 1 -- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94c00c0350 msgr2=0x7f94c01418b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.760+0000 7f94c63ac700 1 --2- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94c00c0350 0x7f94c01418b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009fd0 tx=0x7f94b4004750 comp rx=0 tx=0).stop 2023-07-21T07:34:47.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.760+0000 7f94c63ac700 1 -- 172.21.15.6:0/3042120449 shutdown_connections 2023-07-21T07:34:47.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.760+0000 7f94c63ac700 1 --2- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f94a406ad00 0x7f94a406d1c0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f94c015c940 tx=0x7f94b8009540 comp rx=0 tx=0).stop 2023-07-21T07:34:47.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.760+0000 7f94c63ac700 1 --2- 172.21.15.6:0/3042120449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c0156200 0x7f94c0143740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.760+0000 7f94c63ac700 1 --2- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94c00c0350 0x7f94c01418b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.760+0000 7f94c63ac700 1 --2- 172.21.15.6:0/3042120449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94c00c4260 0x7f94c00beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.760+0000 7f94c63ac700 1 -- 172.21.15.6:0/3042120449 >> 172.21.15.6:0/3042120449 conn(0x7f94c006aa10 msgr2=0x7f94c00a7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.761+0000 7f94c63ac700 1 -- 172.21.15.6:0/3042120449 shutdown_connections 2023-07-21T07:34:47.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.761+0000 7f94c63ac700 1 -- 172.21.15.6:0/3042120449 wait complete. 2023-07-21T07:34:47.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.767+0000 7f429cbc4700 1 -- 172.21.15.6:0/3472635819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f42981ef3c0 con 0x7f429806cf20 2023-07-21T07:34:47.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.767+0000 7fdf8b05c700 1 -- 172.21.15.6:0/1513411067 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf8404ecc0 con 0x7fdf84150e10 2023-07-21T07:34:47.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.767+0000 7f4286ffd700 1 -- 172.21.15.6:0/3472635819 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42981ef3c0 con 0x7f429806cf20 2023-07-21T07:34:47.819 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-07-21T07:34:47.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.771+0000 7fed68e12700 1 -- 172.21.15.6:0/626215734 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fed6406cc80 con 0x7fed640c7260 2023-07-21T07:34:47.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.772+0000 7fed52ffd700 1 -- 172.21.15.6:0/626215734 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed540594c0 con 0x7fed640c7260 2023-07-21T07:34:47.824 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-07-21T07:34:47.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.774+0000 7fefdc901700 1 -- 172.21.15.6:0/2022434120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fefd814bf60 con 0x7fefd80c48b0 2023-07-21T07:34:47.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.774+0000 7fdf817fa700 1 -- 172.21.15.6:0/1513411067 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf78057fe0 con 0x7fdf84150e10 2023-07-21T07:34:47.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.774+0000 7f429cbc4700 1 -- 172.21.15.6:0/3472635819 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f427806ad80 msgr2=0x7f427806d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.774+0000 7f429cbc4700 1 --2- 172.21.15.6:0/3472635819 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f427806ad80 0x7f427806d240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42980c5560 tx=0x7f4288008040 comp rx=0 tx=0).stop 2023-07-21T07:34:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.774+0000 7f429cbc4700 1 -- 172.21.15.6:0/3472635819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f429806cf20 msgr2=0x7f4298144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.774+0000 7f429cbc4700 1 --2- 172.21.15.6:0/3472635819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f429806cf20 0x7f4298144360 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f428c00c4d0 tx=0x7f428c00c890 comp rx=0 tx=0).stop 2023-07-21T07:34:47.826 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-07-21T07:34:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.774+0000 7fefc6ffd700 1 -- 172.21.15.6:0/2022434120 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fefd0029020 con 0x7fefd80c48b0 2023-07-21T07:34:47.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.775+0000 7f429cbc4700 1 -- 172.21.15.6:0/3472635819 shutdown_connections 2023-07-21T07:34:47.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.775+0000 7f429cbc4700 1 --2- 172.21.15.6:0/3472635819 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f427806ad80 0x7f427806d240 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.775+0000 7f429cbc4700 1 --2- 172.21.15.6:0/3472635819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4298151910 0x7f42981448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.775+0000 7f429cbc4700 1 --2- 172.21.15.6:0/3472635819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4298067120 0x7f4298145840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.775+0000 7f429cbc4700 1 --2- 172.21.15.6:0/3472635819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f429806cf20 0x7f4298144360 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.775+0000 7f429cbc4700 1 -- 172.21.15.6:0/3472635819 >> 172.21.15.6:0/3472635819 conn(0x7f429806a270 msgr2=0x7f429806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.775+0000 7f429cbc4700 1 -- 172.21.15.6:0/3472635819 shutdown_connections 2023-07-21T07:34:47.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.775+0000 7f429cbc4700 1 -- 172.21.15.6:0/3472635819 wait complete. 2023-07-21T07:34:47.828 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-07-21T07:34:47.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.777+0000 7fdf8b05c700 1 -- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdf7006ad30 msgr2=0x7fdf7006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.777+0000 7fdf8b05c700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdf7006ad30 0x7fdf7006d1f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009910 tx=0x7fdf74008040 comp rx=0 tx=0).stop 2023-07-21T07:34:47.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.777+0000 7fdf8b05c700 1 -- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf84150e10 msgr2=0x7fdf841522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.777+0000 7fdf8b05c700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf84150e10 0x7fdf841522e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800e810 tx=0x7fdf7800eb20 comp rx=0 tx=0).stop 2023-07-21T07:34:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.778+0000 7fdf8b05c700 1 -- 172.21.15.6:0/1513411067 shutdown_connections 2023-07-21T07:34:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.778+0000 7fdf8b05c700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdf7006ad30 0x7fdf7006d1f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.778+0000 7fdf8b05c700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf84150e10 0x7fdf841522e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.778+0000 7fdf8b05c700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf840baec0 0x7fdf841eb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.778+0000 7fdf8b05c700 1 --2- 172.21.15.6:0/1513411067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf840c5030 0x7fdf841eb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.778+0000 7fdf8b05c700 1 -- 172.21.15.6:0/1513411067 >> 172.21.15.6:0/1513411067 conn(0x7fdf8406aa10 msgr2=0x7fdf8414ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.778+0000 7f5319aa9700 1 -- 172.21.15.6:0/2045309828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f531404ecc0 con 0x7f53140c3f00 2023-07-21T07:34:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.778+0000 7fed68e12700 1 -- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fed4406ad30 msgr2=0x7fed4406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.778+0000 7fed68e12700 1 --2- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fed4406ad30 0x7fed4406d1f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fed6414daa0 tx=0x7fed58006c30 comp rx=0 tx=0).stop 2023-07-21T07:34:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.778+0000 7fed68e12700 1 -- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed640c7260 msgr2=0x7fed641ef630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.778+0000 7fed68e12700 1 --2- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed640c7260 0x7fed641ef630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed54009840 tx=0x7fed54004750 comp rx=0 tx=0).stop 2023-07-21T07:34:47.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.778+0000 7f52fbfff700 1 -- 172.21.15.6:0/2045309828 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5308018020 con 0x7f53140c3f00 2023-07-21T07:34:47.832 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-07-21T07:34:47.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fed68e12700 1 -- 172.21.15.6:0/626215734 shutdown_connections 2023-07-21T07:34:47.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fed68e12700 1 --2- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fed4406ad30 0x7fed4406d1f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fed68e12700 1 --2- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed64158660 0x7fed6406bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fed68e12700 1 --2- 172.21.15.6:0/626215734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed640c7260 0x7fed641ef630 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fed68e12700 1 --2- 172.21.15.6:0/626215734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed64151b70 0x7fed641eebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fed68e12700 1 -- 172.21.15.6:0/626215734 >> 172.21.15.6:0/626215734 conn(0x7fed640c6620 msgr2=0x7fed64155790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fefdc901700 1 -- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fefb806ad30 msgr2=0x7fefb806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fefdc901700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fefb806ad30 0x7fefb806d1f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fefd80c6760 tx=0x7fefcc008040 comp rx=0 tx=0).stop 2023-07-21T07:34:47.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fefdc901700 1 -- 172.21.15.6:0/2022434120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd80c48b0 msgr2=0x7fefd8147d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fefdc901700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd80c48b0 0x7fefd8147d30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fefd0015000 tx=0x7fefd0004ad0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fefdc901700 1 -- 172.21.15.6:0/2022434120 shutdown_connections 2023-07-21T07:34:47.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fefdc901700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fefb806ad30 0x7fefb806d1f0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fefd80c6760 tx=0x7fefcc008040 comp rx=0 tx=0).stop 2023-07-21T07:34:47.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fefdc901700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd80c48b0 0x7fefd8147d30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fefdc901700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd806d810 0x7fefd80b8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fefdc901700 1 --2- 172.21.15.6:0/2022434120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd80b9d00 0x7fefd80bb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fefdc901700 1 -- 172.21.15.6:0/2022434120 >> 172.21.15.6:0/2022434120 conn(0x7fefd806b1a0 msgr2=0x7fefd80a64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fdf8b05c700 1 -- 172.21.15.6:0/1513411067 shutdown_connections 2023-07-21T07:34:47.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.779+0000 7fdf8b05c700 1 -- 172.21.15.6:0/1513411067 wait complete. 2023-07-21T07:34:47.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.780+0000 7fed68e12700 1 -- 172.21.15.6:0/626215734 shutdown_connections 2023-07-21T07:34:47.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.780+0000 7fed68e12700 1 -- 172.21.15.6:0/626215734 wait complete. 2023-07-21T07:34:47.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-07-21T07:34:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.781+0000 7fefdc901700 1 -- 172.21.15.6:0/2022434120 shutdown_connections 2023-07-21T07:34:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.781+0000 7fefdc901700 1 -- 172.21.15.6:0/2022434120 wait complete. 2023-07-21T07:34:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.781+0000 7f5319aa9700 1 -- 172.21.15.6:0/2045309828 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530006ad60 msgr2=0x7f530006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.781+0000 7f5319aa9700 1 --2- 172.21.15.6:0/2045309828 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530006ad60 0x7f530006d220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f53140c5460 tx=0x7f530c009040 comp rx=0 tx=0).stop 2023-07-21T07:34:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.781+0000 7f5319aa9700 1 -- 172.21.15.6:0/2045309828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140c3f00 msgr2=0x7f53141ee750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.781+0000 7f5319aa9700 1 --2- 172.21.15.6:0/2045309828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140c3f00 0x7f53141ee750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f530800c780 tx=0x7f530800cb40 comp rx=0 tx=0).stop 2023-07-21T07:34:47.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.782+0000 7f5319aa9700 1 -- 172.21.15.6:0/2045309828 shutdown_connections 2023-07-21T07:34:47.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.782+0000 7f5319aa9700 1 --2- 172.21.15.6:0/2045309828 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530006ad60 0x7f530006d220 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.782+0000 7f5319aa9700 1 --2- 172.21.15.6:0/2045309828 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53141510a0 0x7f531414e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.782+0000 7f5319aa9700 1 --2- 172.21.15.6:0/2045309828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140c3f00 0x7f53141ee750 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.782+0000 7f5319aa9700 1 --2- 172.21.15.6:0/2045309828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53140c4360 0x7f5314147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.782+0000 7f5319aa9700 1 -- 172.21.15.6:0/2045309828 >> 172.21.15.6:0/2045309828 conn(0x7f531406a6c0 msgr2=0x7f5314153f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.786+0000 7f5319aa9700 1 -- 172.21.15.6:0/2045309828 shutdown_connections 2023-07-21T07:34:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.786+0000 7f5319aa9700 1 -- 172.21.15.6:0/2045309828 wait complete. 2023-07-21T07:34:47.845 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-07-21T07:34:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.787+0000 7f0ba2890700 1 -- 172.21.15.6:0/214470284 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0b9c0befb0 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.788+0000 7f0b98ff9700 1 -- 172.21.15.6:0/214470284 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0b94055d10 con 0x7f0b9c0c0a30 2023-07-21T07:34:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.794+0000 7fc5bef58700 1 -- 172.21.15.6:0/3923187239 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc598005870 con 0x7fc5b8155f90 2023-07-21T07:34:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.795+0000 7fc5b57fa700 1 -- 172.21.15.6:0/3923187239 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5ac057a20 con 0x7fc5b8155f90 2023-07-21T07:34:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.796+0000 7f0ba2890700 1 -- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b8806ad80 msgr2=0x7f0b8806d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.796+0000 7f0ba2890700 1 --2- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b8806ad80 0x7f0b8806d240 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0bbff0 tx=0x7f0b90009110 comp rx=0 tx=0).stop 2023-07-21T07:34:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.796+0000 7f0ba2890700 1 -- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9c0c0a30 msgr2=0x7f0b9c0bf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.796+0000 7f0ba2890700 1 --2- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9c0c0a30 0x7f0b9c0bf970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c15cdf0 tx=0x7f0b94004ad0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.797+0000 7f0ba2890700 1 -- 172.21.15.6:0/214470284 shutdown_connections 2023-07-21T07:34:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.797+0000 7f0ba2890700 1 --2- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b8806ad80 0x7f0b8806d240 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.797+0000 7f0ba2890700 1 --2- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b9c156200 0x7f0b9c1ee5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.797+0000 7f0ba2890700 1 --2- 172.21.15.6:0/214470284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b9c0c0a30 0x7f0b9c0bf970 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.797+0000 7f0ba2890700 1 --2- 172.21.15.6:0/214470284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b9c0c4260 0x7f0b9c154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.797+0000 7f0ba2890700 1 -- 172.21.15.6:0/214470284 >> 172.21.15.6:0/214470284 conn(0x7f0b9c06aa10 msgr2=0x7f0b9c0c2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.849 INFO:teuthology.orchestra.run.smithi006.stdout:55834574855 2023-07-21T07:34:47.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.801+0000 7fc5bef58700 1 -- 172.21.15.6:0/3923187239 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc5a406ace0 msgr2=0x7fc5a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.801+0000 7fc5bef58700 1 --2- 172.21.15.6:0/3923187239 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc5a406ace0 0x7fc5a406d1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8003e60 tx=0x7fc5a8009040 comp rx=0 tx=0).stop 2023-07-21T07:34:47.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.801+0000 7fc5bef58700 1 -- 172.21.15.6:0/3923187239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b8155f90 msgr2=0x7fc5b815ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:47.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.801+0000 7fc5bef58700 1 --2- 172.21.15.6:0/3923187239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b8155f90 0x7fc5b815ba40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00e8a0 tx=0x7fc5ac00ebb0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.801+0000 7fc5bef58700 1 -- 172.21.15.6:0/3923187239 shutdown_connections 2023-07-21T07:34:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.801+0000 7fc5bef58700 1 --2- 172.21.15.6:0/3923187239 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc5a406ace0 0x7fc5a406d1a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.801+0000 7fc5bef58700 1 --2- 172.21.15.6:0/3923187239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5b815bf80 0x7fc5b815a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.801+0000 7fc5bef58700 1 --2- 172.21.15.6:0/3923187239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b80a4f80 0x7fc5b8157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.801+0000 7fc5bef58700 1 --2- 172.21.15.6:0/3923187239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b8155f90 0x7fc5b815ba40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.801+0000 7fc5bef58700 1 -- 172.21.15.6:0/3923187239 >> 172.21.15.6:0/3923187239 conn(0x7fc5b806a6c0 msgr2=0x7fc5b8163980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:47.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-07-21T07:34:47.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.800+0000 7f0ba2890700 1 -- 172.21.15.6:0/214470284 shutdown_connections 2023-07-21T07:34:47.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.802+0000 7f0ba2890700 1 -- 172.21.15.6:0/214470284 wait complete. 2023-07-21T07:34:47.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.805+0000 7fc5bef58700 1 -- 172.21.15.6:0/3923187239 shutdown_connections 2023-07-21T07:34:47.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:47.805+0000 7fc5bef58700 1 -- 172.21.15.6:0/3923187239 wait complete. 2023-07-21T07:34:47.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-07-21T07:34:47.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-07-21T07:34:47.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2023-07-21T07:34:47.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2023-07-21T07:34:47.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-07-21T07:34:47.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-07-21T07:34:48.838 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-21T07:34:48.856 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-21T07:34:48.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-21T07:34:48.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-21T07:34:48.860 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-21T07:34:48.860 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-21T07:34:48.869 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-21T07:34:48.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-21T07:34:49.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:48.997+0000 7fb068b88700 1 Processor -- start 2023-07-21T07:34:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:48.997+0000 7fb068b88700 1 -- start start 2023-07-21T07:34:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:48.999+0000 7fb068b88700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0641510a0 0x7fb0640c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:48.999+0000 7fb068b88700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0640c09f0 con 0x7fb06406aad0 2023-07-21T07:34:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:48.999+0000 7fb068b88700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0640c0cd0 con 0x7fb0640c5370 2023-07-21T07:34:49.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:48.999+0000 7fb068b88700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640baff0 con 0x7fb0641510a0 2023-07-21T07:34:49.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:48.999+0000 7fb061d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb06406aad0 0x7fb0640c3f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40738/0 (socket says 172.21.15.6:40738) 2023-07-21T07:34:49.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:48.999+0000 7fb061d9b700 1 -- 172.21.15.6:0/3299908015 learned_addr learned my addr 172.21.15.6:0/3299908015 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:49.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.000+0000 7fb06259c700 1 --2- 172.21.15.6:0/3299908015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0641510a0 0x7fb0640c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.000+0000 7fb06259c700 1 -- 172.21.15.6:0/3299908015 >> v1:172.21.15.86:6789/0 conn(0x7fb0640c5370 legacy=0x7fb064153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.000+0000 7fb06259c700 1 -- 172.21.15.6:0/3299908015 >> v1:172.21.15.6:6789/0 conn(0x7fb06406aad0 legacy=0x7fb0640c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.000+0000 7fb06259c700 1 -- 172.21.15.6:0/3299908015 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0640c0fb0 con 0x7fb0641510a0 2023-07-21T07:34:49.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.000+0000 7fb06259c700 1 --2- 172.21.15.6:0/3299908015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0641510a0 0x7fb0640c4e30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb0580097f0 tx=0x7fb058009b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc0fc0a62c2655d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.011+0000 7fb06159a700 1 -- 172.21.15.6:0/3299908015 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058004230 con 0x7fb0641510a0 2023-07-21T07:34:49.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.011+0000 7fb06159a700 1 -- 172.21.15.6:0/3299908015 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058004390 con 0x7fb0641510a0 2023-07-21T07:34:49.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.011+0000 7fb06159a700 1 -- 172.21.15.6:0/3299908015 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0580036a0 con 0x7fb0641510a0 2023-07-21T07:34:49.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.015+0000 7fb068b88700 1 -- 172.21.15.6:0/3299908015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0641510a0 msgr2=0x7fb0640c4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.015+0000 7fb068b88700 1 --2- 172.21.15.6:0/3299908015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0641510a0 0x7fb0640c4e30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb0580097f0 tx=0x7fb058009b00 comp rx=0 tx=0).stop 2023-07-21T07:34:49.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.015+0000 7fb068b88700 1 -- 172.21.15.6:0/3299908015 shutdown_connections 2023-07-21T07:34:49.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.015+0000 7fb068b88700 1 --2- 172.21.15.6:0/3299908015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0641510a0 0x7fb0640c4e30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.015+0000 7fb068b88700 1 -- 172.21.15.6:0/3299908015 >> 172.21.15.6:0/3299908015 conn(0x7fb06406a6c0 msgr2=0x7fb0640a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.016+0000 7fb068b88700 1 -- 172.21.15.6:0/3299908015 shutdown_connections 2023-07-21T07:34:49.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.016+0000 7fb068b88700 1 -- 172.21.15.6:0/3299908015 wait complete. 2023-07-21T07:34:49.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.018+0000 7fb068b88700 1 Processor -- start 2023-07-21T07:34:49.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.018+0000 7fb068b88700 1 -- start start 2023-07-21T07:34:49.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.019+0000 7fb068b88700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06406aad0 0x7fb064145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.019+0000 7fb068b88700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0640c5370 0x7fb0640befd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.019+0000 7fb068b88700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0641510a0 0x7fb0640a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.019+0000 7fb068b88700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640bfde0 con 0x7fb06406aad0 2023-07-21T07:34:49.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.019+0000 7fb068b88700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640bebb0 con 0x7fb0640c5370 2023-07-21T07:34:49.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.019+0000 7fb068b88700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06413ef30 con 0x7fb0641510a0 2023-07-21T07:34:49.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.020+0000 7fb062d9d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0641510a0 0x7fb0640a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.020+0000 7fb061d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0640c5370 0x7fb0640befd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.020+0000 7fb061d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0640c5370 0x7fb0640befd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54528/0 (socket says 172.21.15.6:54528) 2023-07-21T07:34:49.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.020+0000 7fb061d9b700 1 -- 172.21.15.6:0/712952369 learned_addr learned my addr 172.21.15.6:0/712952369 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.020+0000 7fb06259c700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06406aad0 0x7fb064145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.020+0000 7fb061d9b700 1 -- 172.21.15.6:0/712952369 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0641510a0 msgr2=0x7fb0640a66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.020+0000 7fb061d9b700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0641510a0 0x7fb0640a66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.020+0000 7fb061d9b700 1 -- 172.21.15.6:0/712952369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06406aad0 msgr2=0x7fb064145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.020+0000 7fb061d9b700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06406aad0 0x7fb064145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.020+0000 7fb061d9b700 1 -- 172.21.15.6:0/712952369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0580094a0 con 0x7fb0640c5370 2023-07-21T07:34:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.020+0000 7fb06259c700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06406aad0 0x7fb064145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.021+0000 7fb061d9b700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0640c5370 0x7fb0640befd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00cbf0 tx=0x7fb05c00cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.021+0000 7fb052ffd700 1 -- 172.21.15.6:0/712952369 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c00ab10 con 0x7fb0640c5370 2023-07-21T07:34:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.021+0000 7fb052ffd700 1 -- 172.21.15.6:0/712952369 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c00ac70 con 0x7fb0640c5370 2023-07-21T07:34:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.021+0000 7fb052ffd700 1 -- 172.21.15.6:0/712952369 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c012400 con 0x7fb0640c5370 2023-07-21T07:34:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.022+0000 7fb068b88700 1 -- 172.21.15.6:0/712952369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0640be880 con 0x7fb0640c5370 2023-07-21T07:34:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.022+0000 7fb068b88700 1 -- 172.21.15.6:0/712952369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0640a73b0 con 0x7fb0640c5370 2023-07-21T07:34:49.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.023+0000 7fb068b88700 1 -- 172.21.15.6:0/712952369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0640becf0 con 0x7fb0640c5370 2023-07-21T07:34:49.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.025+0000 7fb052ffd700 1 -- 172.21.15.6:0/712952369 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb05c01b3b0 con 0x7fb0640c5370 2023-07-21T07:34:49.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.025+0000 7fb052ffd700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb04406adb0 0x7fb04406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.026+0000 7fb052ffd700 1 -- 172.21.15.6:0/712952369 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb05c089330 con 0x7fb0640c5370 2023-07-21T07:34:49.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.026+0000 7fb06259c700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb04406adb0 0x7fb04406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.026+0000 7fb06259c700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb04406adb0 0x7fb04406d270 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0580097c0 tx=0x7fb058008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.029+0000 7fb052ffd700 1 -- 172.21.15.6:0/712952369 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb05c054500 con 0x7fb0640c5370 2023-07-21T07:34:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.062+0000 7ff036ebf700 1 Processor -- start 2023-07-21T07:34:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.062+0000 7ff99eaa6700 1 Processor -- start 2023-07-21T07:34:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.063+0000 7ff99eaa6700 1 -- start start 2023-07-21T07:34:49.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.063+0000 7ff036ebf700 1 -- start start 2023-07-21T07:34:49.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7f0db787b700 1 Processor -- start 2023-07-21T07:34:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7ff036ebf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0300c1330 0x7ff030151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7ff036ebf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff030155110 0x7ff03014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7ff036ebf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff030152160 con 0x7ff0300c6c90 2023-07-21T07:34:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7ff036ebf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0300c4b70 con 0x7ff0300c1330 2023-07-21T07:34:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7ff036ebf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300c17d0 con 0x7ff030155110 2023-07-21T07:34:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7ff99eaa6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff9980c1330 0x7ff998151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7ff99eaa6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff998155110 0x7ff99814e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7ff99eaa6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff998152160 con 0x7ff9980c6c90 2023-07-21T07:34:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7ff99eaa6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9980c4b70 con 0x7ff9980c1330 2023-07-21T07:34:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7ff99eaa6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980c17d0 con 0x7ff998155110 2023-07-21T07:34:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7f0db787b700 1 -- start start 2023-07-21T07:34:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7ff997fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff9980c1330 0x7ff998151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7ff997fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff9980c1330 0x7ff998151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60964/0 (socket says 172.21.15.6:60964) 2023-07-21T07:34:49.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.064+0000 7ff997fff700 1 -- 172.21.15.6:0/2219997677 learned_addr learned my addr 172.21.15.6:0/2219997677 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7ff03545c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff030155110 0x7ff03014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7ff03545c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff030155110 0x7ff03014e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:58360/0 (socket says 172.21.15.6:58360) 2023-07-21T07:34:49.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7ff034c5b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff0300c6c90 0x7ff0300c5230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40756/0 (socket says 172.21.15.6:40756) 2023-07-21T07:34:49.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7ff03545c700 1 -- 172.21.15.6:0/385558853 learned_addr learned my addr 172.21.15.6:0/385558853 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7ff03545c700 1 -- 172.21.15.6:0/385558853 >> v2:172.21.15.6:3300/0 conn(0x7ff0300c1330 msgr2=0x7ff030151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:49.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7ff03545c700 1 --2- 172.21.15.6:0/385558853 >> v2:172.21.15.6:3300/0 conn(0x7ff0300c1330 0x7ff030151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7ff03545c700 1 -- 172.21.15.6:0/385558853 >> v1:172.21.15.6:6789/0 conn(0x7ff0300c6c90 legacy=0x7ff0300c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:49.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7ff03545c700 1 -- 172.21.15.6:0/385558853 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300c1ab0 con 0x7ff030155110 2023-07-21T07:34:49.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7f0db787b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 0x7f0db006ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7f0db787b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0db015c6c0 0x7f0db01631d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7f0db787b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db00bd140 con 0x7f0db015c240 2023-07-21T07:34:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7f0db787b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db00be0a0 con 0x7f0db015c6c0 2023-07-21T07:34:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7f0db787b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0071de0 con 0x7f0db015be60 2023-07-21T07:34:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7f0db5617700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 0x7f0db006ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7ff03545c700 1 --2- 172.21.15.6:0/385558853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff030155110 0x7ff03014e5c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff028009e50 tx=0x7ff02800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed478091ad796415 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7f0db5617700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 0x7f0db006ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:58370/0 (socket says 172.21.15.6:58370) 2023-07-21T07:34:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7f0db5617700 1 -- 172.21.15.6:0/3014556822 learned_addr learned my addr 172.21.15.6:0/3014556822 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7f0db5e18700 1 --2- 172.21.15.6:0/3014556822 >> v2:172.21.15.86:3300/0 conn(0x7f0db015c6c0 0x7f0db01631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7ff997fff700 1 -- 172.21.15.6:0/2219997677 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff998155110 msgr2=0x7ff99814e5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T07:34:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7ff997fff700 1 --2- 172.21.15.6:0/2219997677 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff998155110 0x7ff99814e5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7ff997fff700 1 -- 172.21.15.6:0/2219997677 >> v1:172.21.15.6:6789/0 conn(0x7ff9980c6c90 legacy=0x7ff9980c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.065+0000 7ff997fff700 1 -- 172.21.15.6:0/2219997677 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9980c1ab0 con 0x7ff9980c1330 2023-07-21T07:34:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7ff02f7fe700 1 -- 172.21.15.6:0/385558853 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02800e070 con 0x7ff030155110 2023-07-21T07:34:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7ff02f7fe700 1 -- 172.21.15.6:0/385558853 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff028003a20 con 0x7ff030155110 2023-07-21T07:34:49.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7ff02f7fe700 1 -- 172.21.15.6:0/385558853 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028003db0 con 0x7ff030155110 2023-07-21T07:34:49.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7ff997fff700 1 --2- 172.21.15.6:0/2219997677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9980c1330 0x7ff998151c20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00bb90 tx=0x7ff98c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decbfe724a2f999f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7f0db5617700 1 -- 172.21.15.6:0/3014556822 >> v2:172.21.15.86:3300/0 conn(0x7f0db015c6c0 msgr2=0x7f0db01631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:49.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7f0db5617700 1 --2- 172.21.15.6:0/3014556822 >> v2:172.21.15.86:3300/0 conn(0x7f0db015c6c0 0x7f0db01631d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7f0db5617700 1 -- 172.21.15.6:0/3014556822 >> v1:172.21.15.6:6789/0 conn(0x7f0db015c240 legacy=0x7f0db00711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7f0db5617700 1 -- 172.21.15.6:0/3014556822 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db00bcbf0 con 0x7f0db015be60 2023-07-21T07:34:49.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7f6ced994700 1 Processor -- start 2023-07-21T07:34:49.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7f0db5617700 1 --2- 172.21.15.6:0/3014556822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 0x7f0db006ff70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0098f0 tx=0x7f0dac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69374486320c14e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7ff9977fe700 1 -- 172.21.15.6:0/2219997677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c00dd50 con 0x7ff9980c1330 2023-07-21T07:34:49.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7ff9977fe700 1 -- 172.21.15.6:0/2219997677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c010470 con 0x7ff9980c1330 2023-07-21T07:34:49.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.066+0000 7ff9977fe700 1 -- 172.21.15.6:0/2219997677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c010800 con 0x7ff9980c1330 2023-07-21T07:34:49.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.067+0000 7ff99eaa6700 1 -- 172.21.15.6:0/2219997677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9980c1330 msgr2=0x7ff998151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.067+0000 7ff99eaa6700 1 --2- 172.21.15.6:0/2219997677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9980c1330 0x7ff998151c20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00bb90 tx=0x7ff98c00bea0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.067+0000 7f6ced994700 1 -- start start 2023-07-21T07:34:49.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7f0da7fff700 1 -- 172.21.15.6:0/3014556822 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac011830 con 0x7f0db015be60 2023-07-21T07:34:49.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7f0da7fff700 1 -- 172.21.15.6:0/3014556822 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac011990 con 0x7f0db015be60 2023-07-21T07:34:49.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7f0da7fff700 1 -- 172.21.15.6:0/3014556822 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac011d20 con 0x7f0db015be60 2023-07-21T07:34:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7ff99eaa6700 1 -- 172.21.15.6:0/2219997677 shutdown_connections 2023-07-21T07:34:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7ff99eaa6700 1 --2- 172.21.15.6:0/2219997677 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff998155110 0x7ff99814e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7ff99eaa6700 1 --2- 172.21.15.6:0/2219997677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9980c1330 0x7ff998151c20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7ff99eaa6700 1 -- 172.21.15.6:0/2219997677 >> 172.21.15.6:0/2219997677 conn(0x7ff99806b1a0 msgr2=0x7ff99806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7ff99eaa6700 1 -- 172.21.15.6:0/2219997677 shutdown_connections 2023-07-21T07:34:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7f6ced994700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ce806aad0 0x7f6ce8151010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7f6ced994700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ce80c52b0 0x7f6ce8153f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7f6ced994700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce80c09f0 con 0x7f6ce80c4e30 2023-07-21T07:34:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7f6ced994700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce80baff0 con 0x7f6ce80c52b0 2023-07-21T07:34:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7f6ced994700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80c0cd0 con 0x7f6ce806aad0 2023-07-21T07:34:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7f6ce77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ce80c52b0 0x7f6ce8153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7f6ce77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ce80c52b0 0x7f6ce8153f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60982/0 (socket says 172.21.15.6:60982) 2023-07-21T07:34:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7f6ce77fe700 1 -- 172.21.15.6:0/2408678673 learned_addr learned my addr 172.21.15.6:0/2408678673 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.068+0000 7ff99eaa6700 1 -- 172.21.15.6:0/2219997677 wait complete. 2023-07-21T07:34:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.069+0000 7f6ce77fe700 1 -- 172.21.15.6:0/2408678673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ce806aad0 msgr2=0x7f6ce8151010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T07:34:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.069+0000 7f6ce77fe700 1 --2- 172.21.15.6:0/2408678673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ce806aad0 0x7f6ce8151010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.069+0000 7f6ce77fe700 1 -- 172.21.15.6:0/2408678673 >> v1:172.21.15.6:6789/0 conn(0x7f6ce80c4e30 legacy=0x7f6ce80c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:49.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.069+0000 7ff036ebf700 1 -- 172.21.15.6:0/385558853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff030155110 msgr2=0x7ff03014e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.069+0000 7ff036ebf700 1 --2- 172.21.15.6:0/385558853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff030155110 0x7ff03014e5c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff028009e50 tx=0x7ff02800b330 comp rx=0 tx=0).stop 2023-07-21T07:34:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.069+0000 7f6ce77fe700 1 -- 172.21.15.6:0/2408678673 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80c0fb0 con 0x7f6ce80c52b0 2023-07-21T07:34:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.069+0000 7f6ce77fe700 1 --2- 172.21.15.6:0/2408678673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ce80c52b0 0x7f6ce8153f90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80098f0 tx=0x7f6cd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba78c481b37b26b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.069+0000 7f6ce5ffb700 1 -- 172.21.15.6:0/2408678673 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8004230 con 0x7f6ce80c52b0 2023-07-21T07:34:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.069+0000 7f6ce5ffb700 1 -- 172.21.15.6:0/2408678673 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd8004390 con 0x7f6ce80c52b0 2023-07-21T07:34:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.069+0000 7f6ce5ffb700 1 -- 172.21.15.6:0/2408678673 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80036a0 con 0x7f6ce80c52b0 2023-07-21T07:34:49.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.070+0000 7ff99eaa6700 1 Processor -- start 2023-07-21T07:34:49.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.070+0000 7f6ced994700 1 -- 172.21.15.6:0/2408678673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ce80c52b0 msgr2=0x7f6ce8153f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.070+0000 7f6ced994700 1 --2- 172.21.15.6:0/2408678673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ce80c52b0 0x7f6ce8153f90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80098f0 tx=0x7f6cd8009c00 comp rx=0 tx=0).stop 2023-07-21T07:34:49.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.070+0000 7ff99eaa6700 1 -- start start 2023-07-21T07:34:49.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.070+0000 7f6ced994700 1 -- 172.21.15.6:0/2408678673 shutdown_connections 2023-07-21T07:34:49.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.070+0000 7f6ced994700 1 --2- 172.21.15.6:0/2408678673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ce80c52b0 0x7f6ce8153f90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.070+0000 7f6ced994700 1 --2- 172.21.15.6:0/2408678673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ce806aad0 0x7f6ce8151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.070+0000 7f6ced994700 1 -- 172.21.15.6:0/2408678673 >> 172.21.15.6:0/2408678673 conn(0x7f6ce806a6c0 msgr2=0x7f6ce80a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff036ebf700 1 -- 172.21.15.6:0/385558853 shutdown_connections 2023-07-21T07:34:49.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff036ebf700 1 --2- 172.21.15.6:0/385558853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff030155110 0x7ff03014e5c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff036ebf700 1 --2- 172.21.15.6:0/385558853 >> v2:172.21.15.6:3300/0 conn(0x7ff0300c1330 0x7ff030151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff036ebf700 1 -- 172.21.15.6:0/385558853 >> 172.21.15.6:0/385558853 conn(0x7ff03006b1a0 msgr2=0x7ff03006b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff036ebf700 1 -- 172.21.15.6:0/385558853 shutdown_connections 2023-07-21T07:34:49.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7ff036ebf700 1 -- 172.21.15.6:0/385558853 wait complete. 2023-07-21T07:34:49.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.073+0000 7ff036ebf700 1 Processor -- start 2023-07-21T07:34:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7f0db787b700 1 -- 172.21.15.6:0/3014556822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 msgr2=0x7f0db006ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7f0db787b700 1 --2- 172.21.15.6:0/3014556822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 0x7f0db006ff70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0098f0 tx=0x7f0dac009c00 comp rx=0 tx=0).stop 2023-07-21T07:34:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff99eaa6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9980c1330 0x7ff9981e65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff99eaa6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9980c6c90 0x7ff99814feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff99eaa6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998155110 0x7ff9980b8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff99eaa6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980b8950 con 0x7ff998155110 2023-07-21T07:34:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff99eaa6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9981510d0 con 0x7ff9980c6c90 2023-07-21T07:34:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff99eaa6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9981e6b10 con 0x7ff9980c1330 2023-07-21T07:34:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff99d043700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998155110 0x7ff9980b8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff997fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9980c6c90 0x7ff99814feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.071+0000 7ff99d043700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998155110 0x7ff9980b8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60990/0 (socket says 172.21.15.6:60990) 2023-07-21T07:34:49.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7ff99d043700 1 -- 172.21.15.6:0/3056590346 learned_addr learned my addr 172.21.15.6:0/3056590346 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7ff99d043700 1 -- 172.21.15.6:0/3056590346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9980c1330 msgr2=0x7ff9981e65d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T07:34:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7ff99d043700 1 --2- 172.21.15.6:0/3056590346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9980c1330 0x7ff9981e65d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7ff99d043700 1 -- 172.21.15.6:0/3056590346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9980c6c90 msgr2=0x7ff99814feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7ff99d043700 1 --2- 172.21.15.6:0/3056590346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9980c6c90 0x7ff99814feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7ff99d043700 1 -- 172.21.15.6:0/3056590346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c00b7f0 con 0x7ff998155110 2023-07-21T07:34:49.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7ff997fff700 1 --2- 172.21.15.6:0/3056590346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9980c6c90 0x7ff99814feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:49.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7ff99d043700 1 --2- 172.21.15.6:0/3056590346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998155110 0x7ff9980b8de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff99000b990 tx=0x7ff99000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7ff9957fa700 1 -- 172.21.15.6:0/3056590346 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99000d8e0 con 0x7ff998155110 2023-07-21T07:34:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7ff9957fa700 1 -- 172.21.15.6:0/3056590346 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99000da40 con 0x7ff998155110 2023-07-21T07:34:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.072+0000 7ff99eaa6700 1 -- 172.21.15.6:0/3056590346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99814f010 con 0x7ff998155110 2023-07-21T07:34:49.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.073+0000 7ff99eaa6700 1 -- 172.21.15.6:0/3056590346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99814f5d0 con 0x7ff998155110 2023-07-21T07:34:49.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.073+0000 7ff9957fa700 1 -- 172.21.15.6:0/3056590346 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99000ddf0 con 0x7ff998155110 2023-07-21T07:34:49.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.073+0000 7ff036ebf700 1 -- start start 2023-07-21T07:34:49.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.074+0000 7ff036ebf700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0300c1330 0x7ff030152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.074+0000 7ff036ebf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0300c6c90 0x7ff030153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.074+0000 7ff036ebf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030155110 0x7ff030153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.074+0000 7ff036ebf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff030153dd0 con 0x7ff030155110 2023-07-21T07:34:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.074+0000 7ff036ebf700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff030150ee0 con 0x7ff0300c1330 2023-07-21T07:34:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.074+0000 7ff036ebf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0301542d0 con 0x7ff0300c6c90 2023-07-21T07:34:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.075+0000 7ff03545c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030155110 0x7ff030153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.075+0000 7ff03545c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030155110 0x7ff030153890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60994/0 (socket says 172.21.15.6:60994) 2023-07-21T07:34:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.075+0000 7ff03545c700 1 -- 172.21.15.6:0/3892487033 learned_addr learned my addr 172.21.15.6:0/3892487033 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.075+0000 7ff02ffff700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0300c6c90 0x7ff030153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.075+0000 7ff034c5b700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0300c1330 0x7ff030152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.075+0000 7ff03545c700 1 -- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0300c6c90 msgr2=0x7ff030153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.075+0000 7ff03545c700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0300c6c90 0x7ff030153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.075+0000 7ff03545c700 1 -- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0300c1330 msgr2=0x7ff030152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.075+0000 7ff03545c700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0300c1330 0x7ff030152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.075+0000 7ff03545c700 1 -- 172.21.15.6:0/3892487033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff028009b30 con 0x7ff030155110 2023-07-21T07:34:49.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.075+0000 7ff9957fa700 1 -- 172.21.15.6:0/3056590346 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff990006d50 con 0x7ff998155110 2023-07-21T07:34:49.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.075+0000 7ff02ffff700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0300c6c90 0x7ff030153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:49.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.075+0000 7ff03545c700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030155110 0x7ff030153890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff028015040 tx=0x7ff028004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.076+0000 7ff02d7fa700 1 -- 172.21.15.6:0/3892487033 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028004240 con 0x7ff030155110 2023-07-21T07:34:49.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.076+0000 7ff036ebf700 1 -- 172.21.15.6:0/3892487033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff030150890 con 0x7ff030155110 2023-07-21T07:34:49.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.076+0000 7ff036ebf700 1 -- 172.21.15.6:0/3892487033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03014f010 con 0x7ff030155110 2023-07-21T07:34:49.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.076+0000 7ff02d7fa700 1 -- 172.21.15.6:0/3892487033 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0280043c0 con 0x7ff030155110 2023-07-21T07:34:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.076+0000 7ff02d7fa700 1 -- 172.21.15.6:0/3892487033 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028004770 con 0x7ff030155110 2023-07-21T07:34:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.076+0000 7ff9957fa700 1 --2- 172.21.15.6:0/3056590346 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff97c07bcf0 0x7ff97c07e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.076+0000 7ff9957fa700 1 -- 172.21.15.6:0/3056590346 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff990011070 con 0x7ff998155110 2023-07-21T07:34:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.076+0000 7f0db787b700 1 -- 172.21.15.6:0/3014556822 shutdown_connections 2023-07-21T07:34:49.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.076+0000 7f0db787b700 1 --2- 172.21.15.6:0/3014556822 >> v2:172.21.15.86:3300/0 conn(0x7f0db015c6c0 0x7f0db01631d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.076+0000 7f0db787b700 1 --2- 172.21.15.6:0/3014556822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 0x7f0db006ff70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.076+0000 7f0db787b700 1 -- 172.21.15.6:0/3014556822 >> 172.21.15.6:0/3014556822 conn(0x7f0db00c09f0 msgr2=0x7f0db00c0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.077+0000 7ff036ebf700 1 -- 172.21.15.6:0/3892487033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0100052f0 con 0x7ff030155110 2023-07-21T07:34:49.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.077+0000 7f0db787b700 1 -- 172.21.15.6:0/3014556822 shutdown_connections 2023-07-21T07:34:49.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.077+0000 7ff99c842700 1 --2- 172.21.15.6:0/3056590346 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff97c07bcf0 0x7ff97c07e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.078+0000 7ff99c842700 1 --2- 172.21.15.6:0/3056590346 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff97c07bcf0 0x7ff97c07e1b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff984000f60 tx=0x7ff984007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.076+0000 7f6ced994700 1 -- 172.21.15.6:0/2408678673 shutdown_connections 2023-07-21T07:34:49.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.076+0000 7f6ced994700 1 -- 172.21.15.6:0/2408678673 wait complete. 2023-07-21T07:34:49.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.078+0000 7f6ced994700 1 Processor -- start 2023-07-21T07:34:49.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.078+0000 7f6ced994700 1 -- start start 2023-07-21T07:34:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.079+0000 7ff02d7fa700 1 -- 172.21.15.6:0/3892487033 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff028019070 con 0x7ff030155110 2023-07-21T07:34:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.079+0000 7ff02d7fa700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff01406ace0 0x7ff01406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.079+0000 7ff02d7fa700 1 -- 172.21.15.6:0/3892487033 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff02808a350 con 0x7ff030155110 2023-07-21T07:34:49.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.079+0000 7ff034c5b700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff01406ace0 0x7ff01406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.077+0000 7f0db787b700 1 -- 172.21.15.6:0/3014556822 wait complete. 2023-07-21T07:34:49.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.078+0000 7f0db787b700 1 Processor -- start 2023-07-21T07:34:49.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.079+0000 7f0db787b700 1 -- start start 2023-07-21T07:34:49.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ced994700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ce80c4e30 0x7f6ce814f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ced994700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ce80c52b0 0x7f6ce8071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ced994700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ce8072190 0x7f6ce80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ced994700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce81f6f60 con 0x7f6ce80c4e30 2023-07-21T07:34:49.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ced994700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce806fea0 con 0x7f6ce80c52b0 2023-07-21T07:34:49.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ced994700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce806f500 con 0x7f6ce8072190 2023-07-21T07:34:49.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7ff034c5b700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff01406ace0 0x7ff01406d1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0076c0 tx=0x7ff01c007ef0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db787b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 0x7f0db01f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db787b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0db015c240 0x7f0db00c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db787b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db015c6c0 0x7f0db01fa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db787b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01f7380 con 0x7f0db015c6c0 2023-07-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db787b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01f9bc0 con 0x7f0db015c240 2023-07-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db787b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0070170 con 0x7f0db015be60 2023-07-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db5617700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 0x7f0db01f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db5617700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 0x7f0db01f6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:58402/0 (socket says 172.21.15.6:58402) 2023-07-21T07:34:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db5617700 1 -- 172.21.15.6:0/1016421565 learned_addr learned my addr 172.21.15.6:0/1016421565 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db5e18700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db015c6c0 0x7f0db01fa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db4e16700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0db015c240 0x7f0db00c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ce67fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ce80c52b0 0x7f6ce8071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ce67fc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ce80c52b0 0x7f6ce8071c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54576/0 (socket says 172.21.15.6:54576) 2023-07-21T07:34:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ce67fc700 1 -- 172.21.15.6:0/2572675898 learned_addr learned my addr 172.21.15.6:0/2572675898 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ce67fc700 1 -- 172.21.15.6:0/2572675898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ce8072190 msgr2=0x7f6ce80702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ce67fc700 1 --2- 172.21.15.6:0/2572675898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ce8072190 0x7f6ce80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ce67fc700 1 -- 172.21.15.6:0/2572675898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ce80c4e30 msgr2=0x7f6ce814f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ce67fc700 1 --2- 172.21.15.6:0/2572675898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ce80c4e30 0x7f6ce814f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ce67fc700 1 -- 172.21.15.6:0/2572675898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd8009550 con 0x7f6ce80c52b0 2023-07-21T07:34:49.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.080+0000 7f6ce67fc700 1 --2- 172.21.15.6:0/2572675898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ce80c52b0 0x7f6ce8071c50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00c4d0 tx=0x7f6cdc00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f6ccffff700 1 -- 172.21.15.6:0/2572675898 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc0054e0 con 0x7f6ce80c52b0 2023-07-21T07:34:49.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f6ccffff700 1 -- 172.21.15.6:0/2572675898 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc003680 con 0x7f6ce80c52b0 2023-07-21T07:34:49.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f6ccffff700 1 -- 172.21.15.6:0/2572675898 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc003a30 con 0x7f6ce80c52b0 2023-07-21T07:34:49.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.082+0000 7f6ced994700 1 -- 172.21.15.6:0/2572675898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce806f7e0 con 0x7f6ce80c52b0 2023-07-21T07:34:49.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.082+0000 7f6ced994700 1 -- 172.21.15.6:0/2572675898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce80ab7c0 con 0x7f6ce80c52b0 2023-07-21T07:34:49.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.083+0000 7ff99eaa6700 1 -- 172.21.15.6:0/3056590346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9780052f0 con 0x7ff998155110 2023-07-21T07:34:49.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db5617700 1 -- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0db015c240 msgr2=0x7f0db00c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db5617700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0db015c240 0x7f0db00c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db5617700 1 -- 172.21.15.6:0/1016421565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db015c6c0 msgr2=0x7f0db01fa050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db5617700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db015c6c0 0x7f0db01fa050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.081+0000 7f0db5617700 1 -- 172.21.15.6:0/1016421565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac009550 con 0x7f0db015be60 2023-07-21T07:34:49.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.082+0000 7f0db5617700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 0x7f0db01f6e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0dac014040 tx=0x7f0dac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.082+0000 7f0da5ffb700 1 -- 172.21.15.6:0/1016421565 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac004450 con 0x7f0db015be60 2023-07-21T07:34:49.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.082+0000 7f0da5ffb700 1 -- 172.21.15.6:0/1016421565 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac01f070 con 0x7f0db015be60 2023-07-21T07:34:49.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.082+0000 7f0da5ffb700 1 -- 172.21.15.6:0/1016421565 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0038e0 con 0x7f0db015be60 2023-07-21T07:34:49.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.084+0000 7f6ccffff700 1 -- 172.21.15.6:0/2572675898 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6cdc003b90 con 0x7f6ce80c52b0 2023-07-21T07:34:49.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.084+0000 7f0db787b700 1 -- 172.21.15.6:0/1016421565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db0070450 con 0x7f0db015be60 2023-07-21T07:34:49.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.084+0000 7f194e2f3700 1 Processor -- start 2023-07-21T07:34:49.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.085+0000 7f6ced994700 1 -- 172.21.15.6:0/2572675898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce804ecc0 con 0x7f6ce80c52b0 2023-07-21T07:34:49.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.085+0000 7f6ccffff700 1 --2- 172.21.15.6:0/2572675898 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6cd406ad30 0x7f6cd406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.085+0000 7f6ccffff700 1 -- 172.21.15.6:0/2572675898 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6cdc088850 con 0x7f6ce80c52b0 2023-07-21T07:34:49.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.085+0000 7f6ce6ffd700 1 --2- 172.21.15.6:0/2572675898 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6cd406ad30 0x7f6cd406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.084+0000 7f0db787b700 1 -- 172.21.15.6:0/1016421565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db00c5b60 con 0x7f0db015be60 2023-07-21T07:34:49.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.086+0000 7fa94aa21700 1 Processor -- start 2023-07-21T07:34:49.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.085+0000 7f5e76117700 1 Processor -- start 2023-07-21T07:34:49.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.086+0000 7f5e76117700 1 -- start start 2023-07-21T07:34:49.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.085+0000 7f194e2f3700 1 -- start start 2023-07-21T07:34:49.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f194e2f3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19481510a0 0x7f19480c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f194e2f3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1948153f90 0x7f1948154420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f194e2f3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19480c09f0 con 0x7f19480c5370 2023-07-21T07:34:49.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f194e2f3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19480baff0 con 0x7f19481510a0 2023-07-21T07:34:49.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f194e2f3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19480c0cd0 con 0x7f1948153f90 2023-07-21T07:34:49.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f5e76117700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e7008a340 0x7f5e700a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f5e76117700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e701654d0 0x7f5e700bc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f5e76117700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5e700c3840 0x7f5e700c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f5e76117700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e700c56b0 con 0x7f5e701654d0 2023-07-21T07:34:49.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f5e76117700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e700a52c0 con 0x7f5e700c3840 2023-07-21T07:34:49.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f5e76117700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700c50f0 con 0x7f5e7008a340 2023-07-21T07:34:49.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.086+0000 7fa94aa21700 1 -- start start 2023-07-21T07:34:49.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f6ce6ffd700 1 --2- 172.21.15.6:0/2572675898 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6cd406ad30 0x7f6cd406d1f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80c30f0 tx=0x7f6ce0009230 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f1947fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19481510a0 0x7f19480c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f1947fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19481510a0 0x7f19480c4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54592/0 (socket says 172.21.15.6:54592) 2023-07-21T07:34:49.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f1947fff700 1 -- 172.21.15.6:0/3114919048 learned_addr learned my addr 172.21.15.6:0/3114919048 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f194c890700 1 --2- 172.21.15.6:0/3114919048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1948153f90 0x7f1948154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f5e6f7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e7008a340 0x7f5e700a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f0da5ffb700 1 -- 172.21.15.6:0/1016421565 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0dac003a40 con 0x7f0db015be60 2023-07-21T07:34:49.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7fa94aa21700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa9440c6c90 0x7fa9440c5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7fa94aa21700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9440c5770 con 0x7fa944155110 2023-07-21T07:34:49.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7fa94aa21700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9440c4b70 con 0x7fa9440c1330 2023-07-21T07:34:49.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7fa94aa21700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9440c17d0 con 0x7fa9440c6c90 2023-07-21T07:34:49.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f1947fff700 1 -- 172.21.15.6:0/3114919048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1948153f90 msgr2=0x7f1948154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:49.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f1947fff700 1 --2- 172.21.15.6:0/3114919048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1948153f90 0x7f1948154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f1947fff700 1 -- 172.21.15.6:0/3114919048 >> v1:172.21.15.6:6789/0 conn(0x7f19480c5370 legacy=0x7f19480c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:49.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f1947fff700 1 -- 172.21.15.6:0/3114919048 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19480c0fb0 con 0x7f19481510a0 2023-07-21T07:34:49.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f5e6effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e701654d0 0x7f5e700bc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f5e6effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e701654d0 0x7f5e700bc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32786/0 (socket says 172.21.15.6:32786) 2023-07-21T07:34:49.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.087+0000 7f5e6effd700 1 -- 172.21.15.6:0/84338072 learned_addr learned my addr 172.21.15.6:0/84338072 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7f1947fff700 1 --2- 172.21.15.6:0/3114919048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19481510a0 0x7f19480c4e30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f194000d370 tx=0x7f194000d680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ad606c807570d76 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7f0da5ffb700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d9c06af10 0x7f0d9c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7fa948fbe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa944155110 0x7fa94414e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40816/0 (socket says 172.21.15.6:40816) 2023-07-21T07:34:49.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7fa948fbe700 1 -- 172.21.15.6:0/3121772409 learned_addr learned my addr 172.21.15.6:0/3121772409 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:49.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7f0da5ffb700 1 -- 172.21.15.6:0/1016421565 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0dac021070 con 0x7f0db015be60 2023-07-21T07:34:49.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7f0db4e16700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d9c06af10 0x7f0d9c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7f5e6effd700 1 -- 172.21.15.6:0/84338072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e7008a340 msgr2=0x7f5e700a4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:49.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7f5e6effd700 1 --2- 172.21.15.6:0/84338072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e7008a340 0x7f5e700a4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7f5e6effd700 1 -- 172.21.15.6:0/84338072 >> v2:172.21.15.86:3300/0 conn(0x7f5e700c3840 msgr2=0x7f5e700c02c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T07:34:49.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7f5e6effd700 1 --2- 172.21.15.6:0/84338072 >> v2:172.21.15.86:3300/0 conn(0x7f5e700c3840 0x7f5e700c02c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7f5e6effd700 1 -- 172.21.15.6:0/84338072 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e700c53d0 con 0x7f5e701654d0 2023-07-21T07:34:49.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7f5e6f7fe700 1 --2- 172.21.15.6:0/84338072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e7008a340 0x7f5e700a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:49.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7f5e6effd700 1 --2- 172.21.15.6:0/84338072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e701654d0 0x7f5e700bc1e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e70066dd0 tx=0x7f5e64009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7017dc259c8e8e90 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7f0db4e16700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d9c06af10 0x7f0d9c06d3d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0db01552e0 tx=0x7f0da0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7ff02d7fa700 1 -- 172.21.15.6:0/3892487033 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff0280553f0 con 0x7ff030155110 2023-07-21T07:34:49.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.088+0000 7fa943fff700 1 --2- 172.21.15.6:0/3121772409 >> v2:172.21.15.86:3300/0 conn(0x7fa9440c6c90 0x7fa9440c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.089+0000 7f0db787b700 1 -- 172.21.15.6:0/1016421565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db01f9990 con 0x7f0db015be60 2023-07-21T07:34:49.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.089+0000 7fa943fff700 1 -- 172.21.15.6:0/3121772409 >> v1:172.21.15.86:6789/0 conn(0x7fa9440c1330 legacy=0x7fa944151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.089+0000 7fa943fff700 1 -- 172.21.15.6:0/3121772409 >> v1:172.21.15.6:6789/0 conn(0x7fa944155110 legacy=0x7fa94414e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.089+0000 7fa943fff700 1 -- 172.21.15.6:0/3121772409 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9440c1ab0 con 0x7fa9440c6c90 2023-07-21T07:34:49.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.089+0000 7fa943fff700 1 --2- 172.21.15.6:0/3121772409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9440c6c90 0x7fa9440c5230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa934009840 tx=0x7fa934009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6de458b79d9352e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.090+0000 7fa942ffd700 1 -- 172.21.15.6:0/3121772409 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934011830 con 0x7fa9440c6c90 2023-07-21T07:34:49.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.090+0000 7f1946ffd700 1 -- 172.21.15.6:0/3114919048 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940010070 con 0x7f19481510a0 2023-07-21T07:34:49.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.090+0000 7f1946ffd700 1 -- 172.21.15.6:0/3114919048 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194000dc20 con 0x7f19481510a0 2023-07-21T07:34:49.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.090+0000 7f1946ffd700 1 -- 172.21.15.6:0/3114919048 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940007b30 con 0x7f19481510a0 2023-07-21T07:34:49.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.090+0000 7f6ccffff700 1 -- 172.21.15.6:0/2572675898 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6cdc053a70 con 0x7f6ce80c52b0 2023-07-21T07:34:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.091+0000 7f194e2f3700 1 -- 172.21.15.6:0/3114919048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19481510a0 msgr2=0x7f19480c4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.091+0000 7f194e2f3700 1 --2- 172.21.15.6:0/3114919048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19481510a0 0x7f19480c4e30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f194000d370 tx=0x7f194000d680 comp rx=0 tx=0).stop 2023-07-21T07:34:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.091+0000 7f194e2f3700 1 -- 172.21.15.6:0/3114919048 shutdown_connections 2023-07-21T07:34:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.091+0000 7f194e2f3700 1 --2- 172.21.15.6:0/3114919048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1948153f90 0x7f1948154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.091+0000 7f194e2f3700 1 --2- 172.21.15.6:0/3114919048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19481510a0 0x7f19480c4e30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.091+0000 7f194e2f3700 1 -- 172.21.15.6:0/3114919048 >> 172.21.15.6:0/3114919048 conn(0x7f194806a6c0 msgr2=0x7f19480a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.091+0000 7f194e2f3700 1 -- 172.21.15.6:0/3114919048 shutdown_connections 2023-07-21T07:34:49.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.091+0000 7f194e2f3700 1 -- 172.21.15.6:0/3114919048 wait complete. 2023-07-21T07:34:49.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.092+0000 7fa942ffd700 1 -- 172.21.15.6:0/3121772409 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934011990 con 0x7fa9440c6c90 2023-07-21T07:34:49.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.092+0000 7fa942ffd700 1 -- 172.21.15.6:0/3121772409 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934011d20 con 0x7fa9440c6c90 2023-07-21T07:34:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.093+0000 7f194e2f3700 1 Processor -- start 2023-07-21T07:34:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.093+0000 7f194e2f3700 1 -- start start 2023-07-21T07:34:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f194e2f3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19480c5370 0x7f19480bca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f194e2f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19481510a0 0x7f194814b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f1947fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19480c5370 0x7f19480bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f1947fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19480c5370 0x7f19480bca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54606/0 (socket says 172.21.15.6:54606) 2023-07-21T07:34:49.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f194e2f3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1948153f90 0x7f19481eac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f194e2f3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19480bf970 con 0x7f19481510a0 2023-07-21T07:34:49.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f194e2f3700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19480bcf50 con 0x7f19480c5370 2023-07-21T07:34:49.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f194e2f3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19481ed4e0 con 0x7f1948153f90 2023-07-21T07:34:49.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f1947fff700 1 -- 172.21.15.6:0/3454592964 learned_addr learned my addr 172.21.15.6:0/3454592964 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f194c890700 1 --2- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1948153f90 0x7f19481eac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f1947fff700 1 -- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1948153f90 msgr2=0x7f19481eac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f1947fff700 1 --2- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1948153f90 0x7f19481eac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f1947fff700 1 -- 172.21.15.6:0/3454592964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19481510a0 msgr2=0x7f194814b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f1947fff700 1 --2- 172.21.15.6:0/3454592964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19481510a0 0x7f194814b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f1947fff700 1 -- 172.21.15.6:0/3454592964 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194000d050 con 0x7f19480c5370 2023-07-21T07:34:49.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.095+0000 7f1947fff700 1 --2- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19480c5370 0x7f19480bca10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1940018040 tx=0x7f1940004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.095+0000 7f1944ff9700 1 -- 172.21.15.6:0/3454592964 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940004450 con 0x7f19480c5370 2023-07-21T07:34:49.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.095+0000 7f1944ff9700 1 -- 172.21.15.6:0/3454592964 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19400045d0 con 0x7f19480c5370 2023-07-21T07:34:49.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.095+0000 7f194e2f3700 1 -- 172.21.15.6:0/3454592964 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19481ea200 con 0x7f19480c5370 2023-07-21T07:34:49.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.096+0000 7fa94aa21700 1 -- 172.21.15.6:0/3121772409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9440c6c90 msgr2=0x7fa9440c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.096+0000 7fa94aa21700 1 --2- 172.21.15.6:0/3121772409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9440c6c90 0x7fa9440c5230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa934009840 tx=0x7fa934009b50 comp rx=0 tx=0).stop 2023-07-21T07:34:49.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.096+0000 7fa94aa21700 1 -- 172.21.15.6:0/3121772409 shutdown_connections 2023-07-21T07:34:49.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.096+0000 7fa94aa21700 1 --2- 172.21.15.6:0/3121772409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9440c6c90 0x7fa9440c5230 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.096+0000 7fa94aa21700 1 -- 172.21.15.6:0/3121772409 >> 172.21.15.6:0/3121772409 conn(0x7fa94406b1a0 msgr2=0x7fa94406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.095+0000 7f1944ff9700 1 -- 172.21.15.6:0/3454592964 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940003e80 con 0x7f19480c5370 2023-07-21T07:34:49.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.096+0000 7f194e2f3700 1 -- 172.21.15.6:0/3454592964 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19481ece90 con 0x7f19480c5370 2023-07-21T07:34:49.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.096+0000 7ff9957fa700 1 -- 172.21.15.6:0/3056590346 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff99004e310 con 0x7ff998155110 2023-07-21T07:34:49.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.096+0000 7f5e6e7fc700 1 -- 172.21.15.6:0/84338072 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64011830 con 0x7f5e701654d0 2023-07-21T07:34:49.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.096+0000 7f5e6e7fc700 1 -- 172.21.15.6:0/84338072 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e64011990 con 0x7f5e701654d0 2023-07-21T07:34:49.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.096+0000 7f5e6e7fc700 1 -- 172.21.15.6:0/84338072 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64011d20 con 0x7f5e701654d0 2023-07-21T07:34:49.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.097+0000 7f5e76117700 1 -- 172.21.15.6:0/84338072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e701654d0 msgr2=0x7f5e700bc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.097+0000 7f5e76117700 1 --2- 172.21.15.6:0/84338072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e701654d0 0x7f5e700bc1e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5e70066dd0 tx=0x7f5e64009bd0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.094+0000 7f0da5ffb700 1 -- 172.21.15.6:0/1016421565 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0db01f9990 con 0x7f0db015be60 2023-07-21T07:34:49.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.099+0000 7f5e76117700 1 -- 172.21.15.6:0/84338072 shutdown_connections 2023-07-21T07:34:49.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.099+0000 7f5e76117700 1 --2- 172.21.15.6:0/84338072 >> v2:172.21.15.86:3300/0 conn(0x7f5e700c3840 0x7f5e700c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.099+0000 7f5e76117700 1 --2- 172.21.15.6:0/84338072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e7008a340 0x7f5e700a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.099+0000 7f5e76117700 1 --2- 172.21.15.6:0/84338072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e701654d0 0x7f5e700bc1e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.099+0000 7f5e76117700 1 -- 172.21.15.6:0/84338072 >> 172.21.15.6:0/84338072 conn(0x7f5e7006a6c0 msgr2=0x7f5e700a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.099+0000 7f5e76117700 1 -- 172.21.15.6:0/84338072 shutdown_connections 2023-07-21T07:34:49.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.099+0000 7f5e76117700 1 -- 172.21.15.6:0/84338072 wait complete. 2023-07-21T07:34:49.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.099+0000 7f1944ff9700 1 -- 172.21.15.6:0/3454592964 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1940008030 con 0x7f19480c5370 2023-07-21T07:34:49.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.099+0000 7fa94aa21700 1 -- 172.21.15.6:0/3121772409 shutdown_connections 2023-07-21T07:34:49.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.099+0000 7fa94aa21700 1 -- 172.21.15.6:0/3121772409 wait complete. 2023-07-21T07:34:49.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.099+0000 7f1944ff9700 1 --2- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f193406ace0 0x7f193406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.100+0000 7f19477fe700 1 --2- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f193406ace0 0x7f193406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.100+0000 7f19477fe700 1 --2- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f193406ace0 0x7f193406d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f19480c4750 tx=0x7f1938007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.101+0000 7f5e76117700 1 Processor -- start 2023-07-21T07:34:49.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.101+0000 7fa94aa21700 1 Processor -- start 2023-07-21T07:34:49.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.101+0000 7f1944ff9700 1 -- 172.21.15.6:0/3454592964 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f194005d570 con 0x7f19480c5370 2023-07-21T07:34:49.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.101+0000 7fa94aa21700 1 -- start start 2023-07-21T07:34:49.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.101+0000 7f5e76117700 1 -- start start 2023-07-21T07:34:49.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7fa94aa21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9440c1330 0x7fa944153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7fa94aa21700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9440c6c90 0x7fa9440c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7fa94aa21700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa944155110 0x7fa9440714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7fa94aa21700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa944153560 con 0x7fa9440c1330 2023-07-21T07:34:49.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7f5e76117700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e7008a340 0x7f5e700706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7f5e76117700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e700c3840 0x7f5e70070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7f5e76117700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e701654d0 0x7f5e701614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7f5e76117700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7006fc80 con 0x7f5e700c3840 2023-07-21T07:34:49.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7f5e76117700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e70162e50 con 0x7f5e701654d0 2023-07-21T07:34:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7fa94aa21700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9440ac660 con 0x7fa944155110 2023-07-21T07:34:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7fa94aa21700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa944072070 con 0x7fa9440c6c90 2023-07-21T07:34:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7f5e76117700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7006f650 con 0x7f5e7008a340 2023-07-21T07:34:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7f5e6f7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e7008a340 0x7f5e700706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7f5e6f7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e7008a340 0x7f5e700706f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:58436/0 (socket says 172.21.15.6:58436) 2023-07-21T07:34:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7f5e6f7fe700 1 -- 172.21.15.6:0/620281977 learned_addr learned my addr 172.21.15.6:0/620281977 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.102+0000 7f5e6ffff700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e701654d0 0x7f5e701614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7f5e6effd700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e700c3840 0x7f5e70070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7fa943fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9440c1330 0x7fa944153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7fa943fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9440c1330 0x7fa944153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32820/0 (socket says 172.21.15.6:32820) 2023-07-21T07:34:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7fa943fff700 1 -- 172.21.15.6:0/1310719870 learned_addr learned my addr 172.21.15.6:0/1310719870 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7f5e6f7fe700 1 -- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e701654d0 msgr2=0x7f5e701614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7f5e6f7fe700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e701654d0 0x7f5e701614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7f5e6f7fe700 1 -- 172.21.15.6:0/620281977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e700c3840 msgr2=0x7f5e70070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7f5e6f7fe700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e700c3840 0x7f5e70070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7f5e6f7fe700 1 -- 172.21.15.6:0/620281977 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e600094a0 con 0x7f5e7008a340 2023-07-21T07:34:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7f5e6f7fe700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e7008a340 0x7f5e700706f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000ebe0 tx=0x7f5e6000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7f5e57fff700 1 -- 172.21.15.6:0/620281977 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000c850 con 0x7f5e7008a340 2023-07-21T07:34:49.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7fa943fff700 1 -- 172.21.15.6:0/1310719870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9440c6c90 msgr2=0x7fa9440c01e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T07:34:49.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7fa943fff700 1 --2- 172.21.15.6:0/1310719870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9440c6c90 0x7fa9440c01e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7fa943fff700 1 -- 172.21.15.6:0/1310719870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa944155110 msgr2=0x7fa9440714c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T07:34:49.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7fa943fff700 1 --2- 172.21.15.6:0/1310719870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa944155110 0x7fa9440714c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7fa943fff700 1 -- 172.21.15.6:0/1310719870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9340094a0 con 0x7fa9440c1330 2023-07-21T07:34:49.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.104+0000 7fa943fff700 1 --2- 172.21.15.6:0/1310719870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9440c1330 0x7fa944153de0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa9340090b0 tx=0x7fa934004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.104+0000 7fa940ff9700 1 -- 172.21.15.6:0/1310719870 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340038a0 con 0x7fa9440c1330 2023-07-21T07:34:49.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.104+0000 7fa94aa21700 1 -- 172.21.15.6:0/1310719870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa944072350 con 0x7fa9440c1330 2023-07-21T07:34:49.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.104+0000 7fa94aa21700 1 -- 172.21.15.6:0/1310719870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94414f230 con 0x7fa9440c1330 2023-07-21T07:34:49.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7f5e57fff700 1 -- 172.21.15.6:0/620281977 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6000c9b0 con 0x7f5e7008a340 2023-07-21T07:34:49.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7f5e57fff700 1 -- 172.21.15.6:0/620281977 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000cd40 con 0x7f5e7008a340 2023-07-21T07:34:49.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.103+0000 7f5e76117700 1 -- 172.21.15.6:0/620281977 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e64009550 con 0x7f5e7008a340 2023-07-21T07:34:49.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.104+0000 7f5e76117700 1 -- 172.21.15.6:0/620281977 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e70163380 con 0x7f5e7008a340 2023-07-21T07:34:49.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.105+0000 7f5e76117700 1 -- 172.21.15.6:0/620281977 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7004ecc0 con 0x7f5e7008a340 2023-07-21T07:34:49.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.106+0000 7f194e2f3700 1 -- 172.21.15.6:0/3454592964 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19481ecce0 con 0x7f19480c5370 2023-07-21T07:34:49.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.106+0000 7f5e57fff700 1 -- 172.21.15.6:0/620281977 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e60013470 con 0x7f5e7008a340 2023-07-21T07:34:49.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.105+0000 7fa92a7fc700 1 -- 172.21.15.6:0/1310719870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa930005320 con 0x7fa9440c1330 2023-07-21T07:34:49.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.106+0000 7fa940ff9700 1 -- 172.21.15.6:0/1310719870 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93401f070 con 0x7fa9440c1330 2023-07-21T07:34:49.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.106+0000 7fa940ff9700 1 -- 172.21.15.6:0/1310719870 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934003c00 con 0x7fa9440c1330 2023-07-21T07:34:49.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.107+0000 7f5e57fff700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e5c06ace0 0x7f5e5c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.107+0000 7f5e57fff700 1 -- 172.21.15.6:0/620281977 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e60089490 con 0x7f5e7008a340 2023-07-21T07:34:49.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.107+0000 7f5e6effd700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e5c06ace0 0x7f5e5c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.108+0000 7f5e6effd700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e5c06ace0 0x7f5e5c06d1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5e64014040 tx=0x7f5e64008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.108+0000 7fa940ff9700 1 -- 172.21.15.6:0/1310719870 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa934026480 con 0x7fa9440c1330 2023-07-21T07:34:49.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.109+0000 7fa940ff9700 1 --2- 172.21.15.6:0/1310719870 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa92c06ada0 0x7fa92c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.109+0000 7fa940ff9700 1 -- 172.21.15.6:0/1310719870 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa934021070 con 0x7fa9440c1330 2023-07-21T07:34:49.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.110+0000 7fa9437fe700 1 --2- 172.21.15.6:0/1310719870 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa92c06ada0 0x7fa92c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.111+0000 7fa9437fe700 1 --2- 172.21.15.6:0/1310719870 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa92c06ada0 0x7fa92c06d260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa938000f60 tx=0x7fa938007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.114+0000 7f1944ff9700 1 -- 172.21.15.6:0/3454592964 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f19400558f0 con 0x7f19480c5370 2023-07-21T07:34:49.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.115+0000 7f5e57fff700 1 -- 172.21.15.6:0/620281977 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5e600545d0 con 0x7f5e7008a340 2023-07-21T07:34:49.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.116+0000 7fa940ff9700 1 -- 172.21.15.6:0/1310719870 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa9340562f0 con 0x7fa9440c1330 2023-07-21T07:34:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.431+0000 7fb068b88700 1 -- 172.21.15.6:0/712952369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb0640becf0 con 0x7fb0640c5370 2023-07-21T07:34:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.431+0000 7fb052ffd700 1 -- 172.21.15.6:0/712952369 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0640becf0 con 0x7fb0640c5370 2023-07-21T07:34:49.485 INFO:teuthology.orchestra.run.smithi006.stdout:55834574856 2023-07-21T07:34:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.435+0000 7fb068b88700 1 -- 172.21.15.6:0/712952369 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb04406adb0 msgr2=0x7fb04406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.435+0000 7fb068b88700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb04406adb0 0x7fb04406d270 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0580097c0 tx=0x7fb058008030 comp rx=0 tx=0).stop 2023-07-21T07:34:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.435+0000 7fb068b88700 1 -- 172.21.15.6:0/712952369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0640c5370 msgr2=0x7fb0640befd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.435+0000 7fb068b88700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0640c5370 0x7fb0640befd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00cbf0 tx=0x7fb05c00cf00 comp rx=0 tx=0).stop 2023-07-21T07:34:49.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.435+0000 7fb068b88700 1 -- 172.21.15.6:0/712952369 shutdown_connections 2023-07-21T07:34:49.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.435+0000 7fb068b88700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb04406adb0 0x7fb04406d270 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.435+0000 7fb068b88700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0641510a0 0x7fb0640a66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.435+0000 7fb068b88700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06406aad0 0x7fb064145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.435+0000 7fb068b88700 1 --2- 172.21.15.6:0/712952369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0640c5370 0x7fb0640befd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.435+0000 7fb068b88700 1 -- 172.21.15.6:0/712952369 >> 172.21.15.6:0/712952369 conn(0x7fb06406a6c0 msgr2=0x7fb0641526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.435+0000 7fb068b88700 1 -- 172.21.15.6:0/712952369 shutdown_connections 2023-07-21T07:34:49.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.438+0000 7fb068b88700 1 -- 172.21.15.6:0/712952369 wait complete. 2023-07-21T07:34:49.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.4 2023-07-21T07:34:49.509 DEBUG:teuthology.parallel:result is None 2023-07-21T07:34:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.488+0000 7ff99eaa6700 1 -- 172.21.15.6:0/3056590346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff9780055a0 con 0x7ff998155110 2023-07-21T07:34:49.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.489+0000 7ff9957fa700 1 -- 172.21.15.6:0/3056590346 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff990057d50 con 0x7ff998155110 2023-07-21T07:34:49.541 INFO:teuthology.orchestra.run.smithi006.stdout:55834574857 2023-07-21T07:34:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff99eaa6700 1 -- 172.21.15.6:0/3056590346 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff97c07bcf0 msgr2=0x7ff97c07e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff99eaa6700 1 --2- 172.21.15.6:0/3056590346 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff97c07bcf0 0x7ff97c07e1b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff984000f60 tx=0x7ff984007a40 comp rx=0 tx=0).stop 2023-07-21T07:34:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff99eaa6700 1 -- 172.21.15.6:0/3056590346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998155110 msgr2=0x7ff9980b8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff99eaa6700 1 --2- 172.21.15.6:0/3056590346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998155110 0x7ff9980b8de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff99000b990 tx=0x7ff99000bca0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff036ebf700 1 -- 172.21.15.6:0/3892487033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff0100055a0 con 0x7ff030155110 2023-07-21T07:34:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff99eaa6700 1 -- 172.21.15.6:0/3056590346 shutdown_connections 2023-07-21T07:34:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff99eaa6700 1 --2- 172.21.15.6:0/3056590346 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff97c07bcf0 0x7ff97c07e1b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff99eaa6700 1 --2- 172.21.15.6:0/3056590346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998155110 0x7ff9980b8de0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff99eaa6700 1 --2- 172.21.15.6:0/3056590346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9980c1330 0x7ff9981e65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff99eaa6700 1 --2- 172.21.15.6:0/3056590346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9980c6c90 0x7ff99814feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff99eaa6700 1 -- 172.21.15.6:0/3056590346 >> 172.21.15.6:0/3056590346 conn(0x7ff99806b1a0 msgr2=0x7ff998070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff02d7fa700 1 -- 172.21.15.6:0/3892487033 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff028020020 con 0x7ff030155110 2023-07-21T07:34:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff99eaa6700 1 -- 172.21.15.6:0/3056590346 shutdown_connections 2023-07-21T07:34:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7ff99eaa6700 1 -- 172.21.15.6:0/3056590346 wait complete. 2023-07-21T07:34:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.494+0000 7f6ced994700 1 -- 172.21.15.6:0/2572675898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6ce80c3bc0 con 0x7f6ce80c52b0 2023-07-21T07:34:49.549 INFO:teuthology.orchestra.run.smithi006.stdout:55834574857 2023-07-21T07:34:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.495+0000 7f6ccffff700 1 -- 172.21.15.6:0/2572675898 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6cdc057090 con 0x7f6ce80c52b0 2023-07-21T07:34:49.550 INFO:teuthology.orchestra.run.smithi006.stdout:55834574857 2023-07-21T07:34:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.497+0000 7ff036ebf700 1 -- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff01406ace0 msgr2=0x7ff01406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.497+0000 7ff036ebf700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff01406ace0 0x7ff01406d1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0076c0 tx=0x7ff01c007ef0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.497+0000 7ff036ebf700 1 -- 172.21.15.6:0/3892487033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030155110 msgr2=0x7ff030153890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.497+0000 7ff036ebf700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030155110 0x7ff030153890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff028015040 tx=0x7ff028004ad0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.498+0000 7ff036ebf700 1 -- 172.21.15.6:0/3892487033 shutdown_connections 2023-07-21T07:34:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.498+0000 7ff036ebf700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff01406ace0 0x7ff01406d1a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.498+0000 7ff036ebf700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030155110 0x7ff030153890 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.498+0000 7ff036ebf700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0300c1330 0x7ff030152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.498+0000 7ff036ebf700 1 --2- 172.21.15.6:0/3892487033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0300c6c90 0x7ff030153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.498+0000 7ff036ebf700 1 -- 172.21.15.6:0/3892487033 >> 172.21.15.6:0/3892487033 conn(0x7ff03006b1a0 msgr2=0x7ff0300c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.498+0000 7ff036ebf700 1 -- 172.21.15.6:0/3892487033 shutdown_connections 2023-07-21T07:34:49.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.498+0000 7ff036ebf700 1 -- 172.21.15.6:0/3892487033 wait complete. 2023-07-21T07:34:49.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.503+0000 7f6ced994700 1 -- 172.21.15.6:0/2572675898 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6cd406ad30 msgr2=0x7f6cd406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.503+0000 7f6ced994700 1 --2- 172.21.15.6:0/2572675898 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6cd406ad30 0x7f6cd406d1f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80c30f0 tx=0x7f6ce0009230 comp rx=0 tx=0).stop 2023-07-21T07:34:49.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.503+0000 7f6ced994700 1 -- 172.21.15.6:0/2572675898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ce80c52b0 msgr2=0x7f6ce8071c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.503+0000 7f6ced994700 1 --2- 172.21.15.6:0/2572675898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ce80c52b0 0x7f6ce8071c50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00c4d0 tx=0x7f6cdc00c890 comp rx=0 tx=0).stop 2023-07-21T07:34:49.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.503+0000 7f6ced994700 1 -- 172.21.15.6:0/2572675898 shutdown_connections 2023-07-21T07:34:49.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.503+0000 7f6ced994700 1 --2- 172.21.15.6:0/2572675898 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6cd406ad30 0x7f6cd406d1f0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80c30f0 tx=0x7f6ce0009230 comp rx=0 tx=0).stop 2023-07-21T07:34:49.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.503+0000 7f6ced994700 1 --2- 172.21.15.6:0/2572675898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ce8072190 0x7f6ce80702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.503+0000 7f6ced994700 1 --2- 172.21.15.6:0/2572675898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ce80c4e30 0x7f6ce814f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.503+0000 7f6ced994700 1 --2- 172.21.15.6:0/2572675898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ce80c52b0 0x7f6ce8071c50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.503+0000 7f6ced994700 1 -- 172.21.15.6:0/2572675898 >> 172.21.15.6:0/2572675898 conn(0x7f6ce806a6c0 msgr2=0x7f6ce8151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.504+0000 7f6ced994700 1 -- 172.21.15.6:0/2572675898 shutdown_connections 2023-07-21T07:34:49.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.504+0000 7f6ced994700 1 -- 172.21.15.6:0/2572675898 wait complete. 2023-07-21T07:34:49.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.514+0000 7f0db787b700 1 -- 172.21.15.6:0/1016421565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0db01f9990 con 0x7f0db015be60 2023-07-21T07:34:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.515+0000 7f0da5ffb700 1 -- 172.21.15.6:0/1016421565 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0db01f9990 con 0x7f0db015be60 2023-07-21T07:34:49.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.2 2023-07-21T07:34:49.567 INFO:teuthology.orchestra.run.smithi006.stdout:55834574857 2023-07-21T07:34:49.568 DEBUG:teuthology.parallel:result is None 2023-07-21T07:34:49.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.518+0000 7fa92a7fc700 1 -- 172.21.15.6:0/1310719870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa9300058a0 con 0x7fa9440c1330 2023-07-21T07:34:49.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.5 2023-07-21T07:34:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.519+0000 7fa940ff9700 1 -- 172.21.15.6:0/1310719870 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa934059910 con 0x7fa9440c1330 2023-07-21T07:34:49.571 INFO:teuthology.orchestra.run.smithi006.stdout:55834574856 2023-07-21T07:34:49.572 DEBUG:teuthology.parallel:result is None 2023-07-21T07:34:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.519+0000 7f0db787b700 1 -- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d9c06af10 msgr2=0x7f0d9c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.519+0000 7f0db787b700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d9c06af10 0x7f0d9c06d3d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0db01552e0 tx=0x7f0da0009040 comp rx=0 tx=0).stop 2023-07-21T07:34:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.519+0000 7f0db787b700 1 -- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 msgr2=0x7f0db01f6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.519+0000 7f0db787b700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 0x7f0db01f6e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0dac014040 tx=0x7f0dac004750 comp rx=0 tx=0).stop 2023-07-21T07:34:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.519+0000 7f0db787b700 1 -- 172.21.15.6:0/1016421565 shutdown_connections 2023-07-21T07:34:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.519+0000 7f0db787b700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d9c06af10 0x7f0d9c06d3d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.519+0000 7f0db787b700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db015c6c0 0x7f0db01fa050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.519+0000 7f0db787b700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0db015be60 0x7f0db01f6e40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.519+0000 7f0db787b700 1 --2- 172.21.15.6:0/1016421565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0db015c240 0x7f0db00c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.519+0000 7f0db787b700 1 -- 172.21.15.6:0/1016421565 >> 172.21.15.6:0/1016421565 conn(0x7f0db00c09f0 msgr2=0x7f0db0070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.519+0000 7f0db787b700 1 -- 172.21.15.6:0/1016421565 shutdown_connections 2023-07-21T07:34:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.519+0000 7f0db787b700 1 -- 172.21.15.6:0/1016421565 wait complete. 2023-07-21T07:34:49.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.521+0000 7fa92a7fc700 1 -- 172.21.15.6:0/1310719870 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa92c06ada0 msgr2=0x7fa92c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.521+0000 7fa92a7fc700 1 --2- 172.21.15.6:0/1310719870 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa92c06ada0 0x7fa92c06d260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa938000f60 tx=0x7fa938007a40 comp rx=0 tx=0).stop 2023-07-21T07:34:49.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.521+0000 7fa92a7fc700 1 -- 172.21.15.6:0/1310719870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9440c1330 msgr2=0x7fa944153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.521+0000 7fa92a7fc700 1 --2- 172.21.15.6:0/1310719870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9440c1330 0x7fa944153de0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa9340090b0 tx=0x7fa934004750 comp rx=0 tx=0).stop 2023-07-21T07:34:49.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.522+0000 7fa92a7fc700 1 -- 172.21.15.6:0/1310719870 shutdown_connections 2023-07-21T07:34:49.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.522+0000 7fa92a7fc700 1 --2- 172.21.15.6:0/1310719870 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa92c06ada0 0x7fa92c06d260 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.522+0000 7fa92a7fc700 1 --2- 172.21.15.6:0/1310719870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa944155110 0x7fa9440714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.522+0000 7fa92a7fc700 1 --2- 172.21.15.6:0/1310719870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9440c1330 0x7fa944153de0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.522+0000 7fa92a7fc700 1 --2- 172.21.15.6:0/1310719870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9440c6c90 0x7fa9440c01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.522+0000 7fa92a7fc700 1 -- 172.21.15.6:0/1310719870 >> 172.21.15.6:0/1310719870 conn(0x7fa94406b1a0 msgr2=0x7fa94406a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.522+0000 7fa92a7fc700 1 -- 172.21.15.6:0/1310719870 shutdown_connections 2023-07-21T07:34:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.522+0000 7fa92a7fc700 1 -- 172.21.15.6:0/1310719870 wait complete. 2023-07-21T07:34:49.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.0 2023-07-21T07:34:49.578 DEBUG:teuthology.parallel:result is None 2023-07-21T07:34:49.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.527+0000 7f194e2f3700 1 -- 172.21.15.6:0/3454592964 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f194804ecc0 con 0x7f19480c5370 2023-07-21T07:34:49.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.527+0000 7f1944ff9700 1 -- 172.21.15.6:0/3454592964 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1940058f10 con 0x7f19480c5370 2023-07-21T07:34:49.579 INFO:teuthology.orchestra.run.smithi006.stdout:55834574857 2023-07-21T07:34:49.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.528+0000 7f5e76117700 1 -- 172.21.15.6:0/620281977 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5e700a7fb0 con 0x7f5e7008a340 2023-07-21T07:34:49.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.529+0000 7f5e57fff700 1 -- 172.21.15.6:0/620281977 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e6000cea0 con 0x7f5e7008a340 2023-07-21T07:34:49.580 INFO:teuthology.orchestra.run.smithi006.stdout:55834574857 2023-07-21T07:34:49.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.530+0000 7f194e2f3700 1 -- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f193406ace0 msgr2=0x7f193406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.530+0000 7f194e2f3700 1 --2- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f193406ace0 0x7f193406d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f19480c4750 tx=0x7f1938007a20 comp rx=0 tx=0).stop 2023-07-21T07:34:49.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.530+0000 7f194e2f3700 1 -- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19480c5370 msgr2=0x7f19480bca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.530+0000 7f194e2f3700 1 --2- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19480c5370 0x7f19480bca10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1940018040 tx=0x7f1940004ad0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f194e2f3700 1 -- 172.21.15.6:0/3454592964 shutdown_connections 2023-07-21T07:34:49.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f194e2f3700 1 --2- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f193406ace0 0x7f193406d1a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f194e2f3700 1 --2- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1948153f90 0x7f19481eac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f194e2f3700 1 --2- 172.21.15.6:0/3454592964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19480c5370 0x7f19480bca10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f194e2f3700 1 --2- 172.21.15.6:0/3454592964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19481510a0 0x7f194814b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f194e2f3700 1 -- 172.21.15.6:0/3454592964 >> 172.21.15.6:0/3454592964 conn(0x7f194806a6c0 msgr2=0x7f194814f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f194e2f3700 1 -- 172.21.15.6:0/3454592964 shutdown_connections 2023-07-21T07:34:49.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f194e2f3700 1 -- 172.21.15.6:0/3454592964 wait complete. 2023-07-21T07:34:49.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f5e76117700 1 -- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e5c06ace0 msgr2=0x7f5e5c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f5e76117700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e5c06ace0 0x7f5e5c06d1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5e64014040 tx=0x7f5e64008030 comp rx=0 tx=0).stop 2023-07-21T07:34:49.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f5e76117700 1 -- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e7008a340 msgr2=0x7f5e700706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f5e76117700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e7008a340 0x7f5e700706f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000ebe0 tx=0x7f5e6000eef0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f5e76117700 1 -- 172.21.15.6:0/620281977 shutdown_connections 2023-07-21T07:34:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f5e76117700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e5c06ace0 0x7f5e5c06d1a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f5e76117700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e701654d0 0x7f5e701614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f5e76117700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e7008a340 0x7f5e700706f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f5e76117700 1 --2- 172.21.15.6:0/620281977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e700c3840 0x7f5e70070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f5e76117700 1 -- 172.21.15.6:0/620281977 >> 172.21.15.6:0/620281977 conn(0x7f5e7006a6c0 msgr2=0x7f5e701642a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f5e76117700 1 -- 172.21.15.6:0/620281977 shutdown_connections 2023-07-21T07:34:49.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.531+0000 7f5e76117700 1 -- 172.21.15.6:0/620281977 wait complete. 2023-07-21T07:34:49.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.7 2023-07-21T07:34:49.590 DEBUG:teuthology.parallel:result is None 2023-07-21T07:34:49.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.3 2023-07-21T07:34:49.592 DEBUG:teuthology.parallel:result is None 2023-07-21T07:34:49.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.1 2023-07-21T07:34:49.601 DEBUG:teuthology.parallel:result is None 2023-07-21T07:34:49.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.6 2023-07-21T07:34:49.602 DEBUG:teuthology.parallel:result is None 2023-07-21T07:34:49.602 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-21T07:34:49.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:34:49.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.714+0000 7f400219f700 1 Processor -- start 2023-07-21T07:34:49.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.714+0000 7f400219f700 1 -- start start 2023-07-21T07:34:49.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f400219f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ffc14e490 0x7f3ffc0c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f400219f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc0c1b20 con 0x7f3ffc1546c0 2023-07-21T07:34:49.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f400219f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc154b90 con 0x7f3ffc1542e0 2023-07-21T07:34:49.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f400219f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc154e70 con 0x7f3ffc14e490 2023-07-21T07:34:49.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffaffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3ffc1546c0 0x7f3ffc06a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40848/0 (socket says 172.21.15.6:40848) 2023-07-21T07:34:49.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffaffd700 1 -- 172.21.15.6:0/1343993892 learned_addr learned my addr 172.21.15.6:0/1343993892 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:49.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffbfff700 1 --2- 172.21.15.6:0/1343993892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ffc14e490 0x7f3ffc0c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643452394 0 0) 0x7f3ffc0c1b20 con 0x7f3ffc1546c0 2023-07-21T07:34:49.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe40035b0 con 0x7f3ffc1546c0 2023-07-21T07:34:49.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32527404 0 0) 0x7f3ffc154b90 con 0x7f3ffc1542e0 2023-07-21T07:34:49.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ffc0c1b20 con 0x7f3ffc1542e0 2023-07-21T07:34:49.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3642546538 0 0) 0x7f3fe40035b0 con 0x7f3ffc1546c0 2023-07-21T07:34:49.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ffc14e490 msgr2=0x7f3ffc0c25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:49.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 --2- 172.21.15.6:0/1343993892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ffc14e490 0x7f3ffc0c25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 >> v1:172.21.15.86:6789/0 conn(0x7f3ffc1542e0 legacy=0x7f3ffc14dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc0c14d0 con 0x7f3ffc1546c0 2023-07-21T07:34:49.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f3fec001670 con 0x7f3ffc1546c0 2023-07-21T07:34:49.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 >> v1:172.21.15.6:6789/0 conn(0x7f3ffc1546c0 legacy=0x7f3ffc06a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 --2- 172.21.15.6:0/1343993892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe4003bc0 0x7f3fe4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 --2- 172.21.15.6:0/1343993892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fe4004850 0x7f3fe4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 --2- 172.21.15.6:0/1343993892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe4005210 0x7f3fe400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc154e70 con 0x7f3fe4005210 2023-07-21T07:34:49.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe400c080 con 0x7f3fe4004850 2023-07-21T07:34:49.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe400c240 con 0x7f3fe4003bc0 2023-07-21T07:34:49.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.715+0000 7f3ffbfff700 1 --2- 172.21.15.6:0/1343993892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ffc14e490 0x7f3ffc0c25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:49.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.716+0000 7f3ffaffd700 1 --2- 172.21.15.6:0/1343993892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fe4004850 0x7f3fe4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.716+0000 7f3ffb7fe700 1 --2- 172.21.15.6:0/1343993892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe4003bc0 0x7f3fe4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.716+0000 7f3ffbfff700 1 --2- 172.21.15.6:0/1343993892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe4005210 0x7f3fe400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.716+0000 7f3ffbfff700 1 -- 172.21.15.6:0/1343993892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe4003bc0 msgr2=0x7f3fe4003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:49.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.716+0000 7f3ffbfff700 1 --2- 172.21.15.6:0/1343993892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe4003bc0 0x7f3fe4003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.716+0000 7f3ffbfff700 1 -- 172.21.15.6:0/1343993892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fe4004850 msgr2=0x7f3fe4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.716+0000 7f3ffbfff700 1 --2- 172.21.15.6:0/1343993892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fe4004850 0x7f3fe4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.716+0000 7f3ffbfff700 1 -- 172.21.15.6:0/1343993892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe40035b0 con 0x7f3fe4005210 2023-07-21T07:34:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.716+0000 7f3ffbfff700 1 --2- 172.21.15.6:0/1343993892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe4005210 0x7f3fe400ba10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc14e870 tx=0x7f3fe4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f7b143ad4f63e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.716+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4003c20 con 0x7f3fe4005210 2023-07-21T07:34:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.716+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff400f040 con 0x7f3fe4005210 2023-07-21T07:34:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.716+0000 7f3ffa7fc700 1 -- 172.21.15.6:0/1343993892 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff400ea30 con 0x7f3fe4005210 2023-07-21T07:34:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.717+0000 7f400219f700 1 -- 172.21.15.6:0/1343993892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe4005210 msgr2=0x7f3fe400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.717+0000 7f400219f700 1 --2- 172.21.15.6:0/1343993892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe4005210 0x7f3fe400ba10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc14e870 tx=0x7f3fe4005880 comp rx=0 tx=0).stop 2023-07-21T07:34:49.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.717+0000 7f3ffbfff700 1 -- 172.21.15.6:0/1343993892 reap_dead start 2023-07-21T07:34:49.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.717+0000 7f400219f700 1 -- 172.21.15.6:0/1343993892 shutdown_connections 2023-07-21T07:34:49.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.717+0000 7f400219f700 1 -- 172.21.15.6:0/1343993892 >> 172.21.15.6:0/1343993892 conn(0x7f3ffc0c6140 msgr2=0x7f3ffc0c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.717+0000 7f400219f700 1 -- 172.21.15.6:0/1343993892 shutdown_connections 2023-07-21T07:34:49.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.717+0000 7f400219f700 1 -- 172.21.15.6:0/1343993892 wait complete. 2023-07-21T07:34:49.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.718+0000 7f400219f700 1 Processor -- start 2023-07-21T07:34:49.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.718+0000 7f400219f700 1 -- start start 2023-07-21T07:34:49.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f400219f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc1dc4f0 0x7f3ffc0c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f400219f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ffc13be10 0x7f3ffc13c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f400219f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ffc1e9a00 0x7f3ffc1e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f400219f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc13c7d0 con 0x7f3ffc1dc4f0 2023-07-21T07:34:49.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f400219f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0c46c0 con 0x7f3ffc13be10 2023-07-21T07:34:49.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f400219f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc1ecf30 con 0x7f3ffc1e9a00 2023-07-21T07:34:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f3ffb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc1dc4f0 0x7f3ffc0c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f3ffb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc1dc4f0 0x7f3ffc0c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32838/0 (socket says 172.21.15.6:32838) 2023-07-21T07:34:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f3ffb7fe700 1 -- 172.21.15.6:0/2704078684 learned_addr learned my addr 172.21.15.6:0/2704078684 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f3ffaffd700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ffc13be10 0x7f3ffc13c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f3ffbfff700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ffc1e9a00 0x7f3ffc1e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f3ffb7fe700 1 -- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ffc1e9a00 msgr2=0x7f3ffc1e9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f3ffb7fe700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ffc1e9a00 0x7f3ffc1e9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f3ffb7fe700 1 -- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ffc13be10 msgr2=0x7f3ffc13c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f3ffb7fe700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ffc13be10 0x7f3ffc13c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f3ffb7fe700 1 -- 172.21.15.6:0/2704078684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc1ed210 con 0x7f3ffc1dc4f0 2023-07-21T07:34:49.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.719+0000 7f3ffb7fe700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc1dc4f0 0x7f3ffc0c4d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000f7f0 tx=0x7f3ff000fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.720+0000 7f3fe3fff700 1 -- 172.21.15.6:0/2704078684 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0001510 con 0x7f3ffc1dc4f0 2023-07-21T07:34:49.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.720+0000 7f3fe3fff700 1 -- 172.21.15.6:0/2704078684 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff00052e0 con 0x7f3ffc1dc4f0 2023-07-21T07:34:49.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.720+0000 7f400219f700 1 -- 172.21.15.6:0/2704078684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ffc1ed4f0 con 0x7f3ffc1dc4f0 2023-07-21T07:34:49.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.720+0000 7f3fe3fff700 1 -- 172.21.15.6:0/2704078684 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0003680 con 0x7f3ffc1dc4f0 2023-07-21T07:34:49.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.720+0000 7f400219f700 1 -- 172.21.15.6:0/2704078684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ffc1edab0 con 0x7f3ffc1dc4f0 2023-07-21T07:34:49.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.721+0000 7f400219f700 1 -- 172.21.15.6:0/2704078684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc074500 con 0x7f3ffc1dc4f0 2023-07-21T07:34:49.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.721+0000 7f3fe3fff700 1 -- 172.21.15.6:0/2704078684 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ff00037e0 con 0x7f3ffc1dc4f0 2023-07-21T07:34:49.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.721+0000 7f3fe3fff700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3fe806ace0 0x7f3fe806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:49.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.721+0000 7f3fe3fff700 1 -- 172.21.15.6:0/2704078684 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ff0089450 con 0x7f3ffc1dc4f0 2023-07-21T07:34:49.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.722+0000 7f3ffaffd700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3fe806ace0 0x7f3fe806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:49.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.722+0000 7f3ffaffd700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3fe806ace0 0x7f3fe806d1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0048d0 tx=0x7f3fec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:49.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.726+0000 7f3fe3fff700 1 -- 172.21.15.6:0/2704078684 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3ff0054510 con 0x7f3ffc1dc4f0 2023-07-21T07:34:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.919+0000 7f400219f700 1 -- 172.21.15.6:0/2704078684 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ffc0c1fb0 con 0x7f3fe806ace0 2023-07-21T07:34:49.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.928+0000 7f3fe3fff700 1 -- 172.21.15.6:0/2704078684 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286687 (secure 0 0 0) 0x7f3fec007050 con 0x7f3fe806ace0 2023-07-21T07:34:49.982 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:49.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.931+0000 7f400219f700 1 -- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3fe806ace0 msgr2=0x7f3fe806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.931+0000 7f400219f700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3fe806ace0 0x7f3fe806d1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0048d0 tx=0x7f3fec009040 comp rx=0 tx=0).stop 2023-07-21T07:34:49.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.931+0000 7f400219f700 1 -- 172.21.15.6:0/2704078684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc1dc4f0 msgr2=0x7f3ffc0c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:49.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.931+0000 7f400219f700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc1dc4f0 0x7f3ffc0c4d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000f7f0 tx=0x7f3ff000fbb0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.931+0000 7f400219f700 1 -- 172.21.15.6:0/2704078684 shutdown_connections 2023-07-21T07:34:49.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.931+0000 7f400219f700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3fe806ace0 0x7f3fe806d1a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.931+0000 7f400219f700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ffc1e9a00 0x7f3ffc1e9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.931+0000 7f400219f700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ffc1dc4f0 0x7f3ffc0c4d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.931+0000 7f400219f700 1 --2- 172.21.15.6:0/2704078684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ffc13be10 0x7f3ffc13c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.931+0000 7f400219f700 1 -- 172.21.15.6:0/2704078684 >> 172.21.15.6:0/2704078684 conn(0x7f3ffc0c6140 msgr2=0x7f3ffc06a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.931+0000 7f400219f700 1 -- 172.21.15.6:0/2704078684 shutdown_connections 2023-07-21T07:34:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:49.931+0000 7f400219f700 1 -- 172.21.15.6:0/2704078684 wait complete. 2023-07-21T07:34:49.985 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:34:49.994 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-21T07:34:48.692993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219408,"kb_used_data":3208,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755312,"statfs":{"total":773094113280,"available":772869439488,"internally_reserved":0,"allocated":3284992,"data_stored":1939620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001944"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988299+0000","last_change":"2023-07-21T07:34:41.013800+0000","last_active":"2023-07-21T07:34:41.988299+0000","last_peered":"2023-07-21T07:34:41.988299+0000","last_clean":"2023-07-21T07:34:41.988299+0000","last_became_active":"2023-07-21T07:34:41.013492+0000","last_became_peered":"2023-07-21T07:34:41.013492+0000","last_unstale":"2023-07-21T07:34:41.988299+0000","last_undegraded":"2023-07-21T07:34:41.988299+0000","last_fullsized":"2023-07-21T07:34:41.988299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:38.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711302+0000","last_change":"2023-07-21T07:34:40.994156+0000","last_active":"2023-07-21T07:34:43.711302+0000","last_peered":"2023-07-21T07:34:43.711302+0000","last_clean":"2023-07-21T07:34:43.711302+0000","last_became_active":"2023-07-21T07:34:40.993889+0000","last_became_peered":"2023-07-21T07:34:40.993889+0000","last_unstale":"2023-07-21T07:34:43.711302+0000","last_undegraded":"2023-07-21T07:34:43.711302+0000","last_fullsized":"2023-07-21T07:34:43.711302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:11:14.968095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992392+0000","last_change":"2023-07-21T07:34:41.003522+0000","last_active":"2023-07-21T07:34:41.992392+0000","last_peered":"2023-07-21T07:34:41.992392+0000","last_clean":"2023-07-21T07:34:41.992392+0000","last_became_active":"2023-07-21T07:34:41.003041+0000","last_became_peered":"2023-07-21T07:34:41.003041+0000","last_unstale":"2023-07-21T07:34:41.992392+0000","last_undegraded":"2023-07-21T07:34:41.992392+0000","last_fullsized":"2023-07-21T07:34:41.992392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:49.798268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991796+0000","last_change":"2023-07-21T07:34:41.005174+0000","last_active":"2023-07-21T07:34:41.991796+0000","last_peered":"2023-07-21T07:34:41.991796+0000","last_clean":"2023-07-21T07:34:41.991796+0000","last_became_active":"2023-07-21T07:34:41.004832+0000","last_became_peered":"2023-07-21T07:34:41.004832+0000","last_unstale":"2023-07-21T07:34:41.991796+0000","last_undegraded":"2023-07-21T07:34:41.991796+0000","last_fullsized":"2023-07-21T07:34:41.991796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:58:16.705923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252251+0000","last_change":"2023-07-21T07:34:41.011222+0000","last_active":"2023-07-21T07:34:42.252251+0000","last_peered":"2023-07-21T07:34:42.252251+0000","last_clean":"2023-07-21T07:34:42.252251+0000","last_became_active":"2023-07-21T07:34:41.010950+0000","last_became_peered":"2023-07-21T07:34:41.010950+0000","last_unstale":"2023-07-21T07:34:42.252251+0000","last_undegraded":"2023-07-21T07:34:42.252251+0000","last_fullsized":"2023-07-21T07:34:42.252251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:54:20.793513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992212+0000","last_change":"2023-07-21T07:34:41.004797+0000","last_active":"2023-07-21T07:34:41.992212+0000","last_peered":"2023-07-21T07:34:41.992212+0000","last_clean":"2023-07-21T07:34:41.992212+0000","last_became_active":"2023-07-21T07:34:41.004547+0000","last_became_peered":"2023-07-21T07:34:41.004547+0000","last_unstale":"2023-07-21T07:34:41.992212+0000","last_undegraded":"2023-07-21T07:34:41.992212+0000","last_fullsized":"2023-07-21T07:34:41.992212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739486+0000","last_change":"2023-07-21T07:34:41.010978+0000","last_active":"2023-07-21T07:34:43.739486+0000","last_peered":"2023-07-21T07:34:43.739486+0000","last_clean":"2023-07-21T07:34:43.739486+0000","last_became_active":"2023-07-21T07:34:41.010756+0000","last_became_peered":"2023-07-21T07:34:41.010756+0000","last_unstale":"2023-07-21T07:34:43.739486+0000","last_undegraded":"2023-07-21T07:34:43.739486+0000","last_fullsized":"2023-07-21T07:34:43.739486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:04:46.304259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.710934+0000","last_change":"2023-07-21T07:34:40.995907+0000","last_active":"2023-07-21T07:34:43.710934+0000","last_peered":"2023-07-21T07:34:43.710934+0000","last_clean":"2023-07-21T07:34:43.710934+0000","last_became_active":"2023-07-21T07:34:40.995624+0000","last_became_peered":"2023-07-21T07:34:40.995624+0000","last_unstale":"2023-07-21T07:34:43.710934+0000","last_undegraded":"2023-07-21T07:34:43.710934+0000","last_fullsized":"2023-07-21T07:34:43.710934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:42.606983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252562+0000","last_change":"2023-07-21T07:34:41.014976+0000","last_active":"2023-07-21T07:34:42.252562+0000","last_peered":"2023-07-21T07:34:42.252562+0000","last_clean":"2023-07-21T07:34:42.252562+0000","last_became_active":"2023-07-21T07:34:41.014683+0000","last_became_peered":"2023-07-21T07:34:41.014683+0000","last_unstale":"2023-07-21T07:34:42.252562+0000","last_undegraded":"2023-07-21T07:34:42.252562+0000","last_fullsized":"2023-07-21T07:34:42.252562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:53.769501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711488+0000","last_change":"2023-07-21T07:34:41.007114+0000","last_active":"2023-07-21T07:34:43.711488+0000","last_peered":"2023-07-21T07:34:43.711488+0000","last_clean":"2023-07-21T07:34:43.711488+0000","last_became_active":"2023-07-21T07:34:41.006839+0000","last_became_peered":"2023-07-21T07:34:41.006839+0000","last_unstale":"2023-07-21T07:34:43.711488+0000","last_undegraded":"2023-07-21T07:34:43.711488+0000","last_fullsized":"2023-07-21T07:34:43.711488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:47:28.206796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992571+0000","last_change":"2023-07-21T07:34:40.995650+0000","last_active":"2023-07-21T07:34:41.992571+0000","last_peered":"2023-07-21T07:34:41.992571+0000","last_clean":"2023-07-21T07:34:41.992571+0000","last_became_active":"2023-07-21T07:34:40.995387+0000","last_became_peered":"2023-07-21T07:34:40.995387+0000","last_unstale":"2023-07-21T07:34:41.992571+0000","last_undegraded":"2023-07-21T07:34:41.992571+0000","last_fullsized":"2023-07-21T07:34:41.992571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:25.315536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988206+0000","last_change":"2023-07-21T07:34:40.998318+0000","last_active":"2023-07-21T07:34:41.988206+0000","last_peered":"2023-07-21T07:34:41.988206+0000","last_clean":"2023-07-21T07:34:41.988206+0000","last_became_active":"2023-07-21T07:34:40.997993+0000","last_became_peered":"2023-07-21T07:34:40.997993+0000","last_unstale":"2023-07-21T07:34:41.988206+0000","last_undegraded":"2023-07-21T07:34:41.988206+0000","last_fullsized":"2023-07-21T07:34:41.988206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:16.791514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988109+0000","last_change":"2023-07-21T07:34:41.009290+0000","last_active":"2023-07-21T07:34:41.988109+0000","last_peered":"2023-07-21T07:34:41.988109+0000","last_clean":"2023-07-21T07:34:41.988109+0000","last_became_active":"2023-07-21T07:34:41.008979+0000","last_became_peered":"2023-07-21T07:34:41.008979+0000","last_unstale":"2023-07-21T07:34:41.988109+0000","last_undegraded":"2023-07-21T07:34:41.988109+0000","last_fullsized":"2023-07-21T07:34:41.988109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:28:11.312982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711020+0000","last_change":"2023-07-21T07:34:40.993283+0000","last_active":"2023-07-21T07:34:43.711020+0000","last_peered":"2023-07-21T07:34:43.711020+0000","last_clean":"2023-07-21T07:34:43.711020+0000","last_became_active":"2023-07-21T07:34:40.993023+0000","last_became_peered":"2023-07-21T07:34:40.993023+0000","last_unstale":"2023-07-21T07:34:43.711020+0000","last_undegraded":"2023-07-21T07:34:43.711020+0000","last_fullsized":"2023-07-21T07:34:43.711020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:49.798268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739578+0000","last_change":"2023-07-21T07:34:41.013555+0000","last_active":"2023-07-21T07:34:43.739578+0000","last_peered":"2023-07-21T07:34:43.739578+0000","last_clean":"2023-07-21T07:34:43.739578+0000","last_became_active":"2023-07-21T07:34:41.013237+0000","last_became_peered":"2023-07-21T07:34:41.013237+0000","last_unstale":"2023-07-21T07:34:43.739578+0000","last_undegraded":"2023-07-21T07:34:43.739578+0000","last_fullsized":"2023-07-21T07:34:43.739578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:06:12.274949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992133+0000","last_change":"2023-07-21T07:34:41.004335+0000","last_active":"2023-07-21T07:34:41.992133+0000","last_peered":"2023-07-21T07:34:41.992133+0000","last_clean":"2023-07-21T07:34:41.992133+0000","last_became_active":"2023-07-21T07:34:41.004051+0000","last_became_peered":"2023-07-21T07:34:41.004051+0000","last_unstale":"2023-07-21T07:34:41.992133+0000","last_undegraded":"2023-07-21T07:34:41.992133+0000","last_fullsized":"2023-07-21T07:34:41.992133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:13.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252673+0000","last_change":"2023-07-21T07:34:41.015026+0000","last_active":"2023-07-21T07:34:42.252673+0000","last_peered":"2023-07-21T07:34:42.252673+0000","last_clean":"2023-07-21T07:34:42.252673+0000","last_became_active":"2023-07-21T07:34:41.014710+0000","last_became_peered":"2023-07-21T07:34:41.014710+0000","last_unstale":"2023-07-21T07:34:42.252673+0000","last_undegraded":"2023-07-21T07:34:42.252673+0000","last_fullsized":"2023-07-21T07:34:42.252673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:22.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992073+0000","last_change":"2023-07-21T07:34:41.011628+0000","last_active":"2023-07-21T07:34:41.992073+0000","last_peered":"2023-07-21T07:34:41.992073+0000","last_clean":"2023-07-21T07:34:41.992073+0000","last_became_active":"2023-07-21T07:34:41.009074+0000","last_became_peered":"2023-07-21T07:34:41.009074+0000","last_unstale":"2023-07-21T07:34:41.992073+0000","last_undegraded":"2023-07-21T07:34:41.992073+0000","last_fullsized":"2023-07-21T07:34:41.992073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:06.735540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988155+0000","last_change":"2023-07-21T07:34:41.004665+0000","last_active":"2023-07-21T07:34:41.988155+0000","last_peered":"2023-07-21T07:34:41.988155+0000","last_clean":"2023-07-21T07:34:41.988155+0000","last_became_active":"2023-07-21T07:34:41.004361+0000","last_became_peered":"2023-07-21T07:34:41.004361+0000","last_unstale":"2023-07-21T07:34:41.988155+0000","last_undegraded":"2023-07-21T07:34:41.988155+0000","last_fullsized":"2023-07-21T07:34:41.988155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:10:00.672282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992656+0000","last_change":"2023-07-21T07:34:41.001444+0000","last_active":"2023-07-21T07:34:41.992656+0000","last_peered":"2023-07-21T07:34:41.992656+0000","last_clean":"2023-07-21T07:34:41.992656+0000","last_became_active":"2023-07-21T07:34:41.001171+0000","last_became_peered":"2023-07-21T07:34:41.001171+0000","last_unstale":"2023-07-21T07:34:41.992656+0000","last_undegraded":"2023-07-21T07:34:41.992656+0000","last_fullsized":"2023-07-21T07:34:41.992656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:11:14.968095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739546+0000","last_change":"2023-07-21T07:34:41.013317+0000","last_active":"2023-07-21T07:34:43.739546+0000","last_peered":"2023-07-21T07:34:43.739546+0000","last_clean":"2023-07-21T07:34:43.739546+0000","last_became_active":"2023-07-21T07:34:41.012800+0000","last_became_peered":"2023-07-21T07:34:41.012800+0000","last_unstale":"2023-07-21T07:34:43.739546+0000","last_undegraded":"2023-07-21T07:34:43.739546+0000","last_fullsized":"2023-07-21T07:34:43.739546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:47:28.206796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252426+0000","last_change":"2023-07-21T07:34:41.002953+0000","last_active":"2023-07-21T07:34:42.252426+0000","last_peered":"2023-07-21T07:34:42.252426+0000","last_clean":"2023-07-21T07:34:42.252426+0000","last_became_active":"2023-07-21T07:34:41.002569+0000","last_became_peered":"2023-07-21T07:34:41.002569+0000","last_unstale":"2023-07-21T07:34:42.252426+0000","last_undegraded":"2023-07-21T07:34:42.252426+0000","last_fullsized":"2023-07-21T07:34:42.252426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:37.840825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177317+0000","last_change":"2023-07-21T07:34:41.007432+0000","last_active":"2023-07-21T07:34:42.177317+0000","last_peered":"2023-07-21T07:34:42.177317+0000","last_clean":"2023-07-21T07:34:42.177317+0000","last_became_active":"2023-07-21T07:34:41.006964+0000","last_became_peered":"2023-07-21T07:34:41.006964+0000","last_unstale":"2023-07-21T07:34:42.177317+0000","last_undegraded":"2023-07-21T07:34:42.177317+0000","last_fullsized":"2023-07-21T07:34:42.177317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:22.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739330+0000","last_change":"2023-07-21T07:34:41.012722+0000","last_active":"2023-07-21T07:34:43.739330+0000","last_peered":"2023-07-21T07:34:43.739330+0000","last_clean":"2023-07-21T07:34:43.739330+0000","last_became_active":"2023-07-21T07:34:41.012304+0000","last_became_peered":"2023-07-21T07:34:41.012304+0000","last_unstale":"2023-07-21T07:34:43.739330+0000","last_undegraded":"2023-07-21T07:34:43.739330+0000","last_fullsized":"2023-07-21T07:34:43.739330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:11:14.968095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711938+0000","last_change":"2023-07-21T07:34:41.000784+0000","last_active":"2023-07-21T07:34:43.711938+0000","last_peered":"2023-07-21T07:34:43.711938+0000","last_clean":"2023-07-21T07:34:43.711938+0000","last_became_active":"2023-07-21T07:34:41.000488+0000","last_became_peered":"2023-07-21T07:34:41.000488+0000","last_unstale":"2023-07-21T07:34:43.711938+0000","last_undegraded":"2023-07-21T07:34:43.711938+0000","last_fullsized":"2023-07-21T07:34:43.711938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:22.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.712165+0000","last_change":"2023-07-21T07:34:41.006271+0000","last_active":"2023-07-21T07:34:43.712165+0000","last_peered":"2023-07-21T07:34:43.712165+0000","last_clean":"2023-07-21T07:34:43.712165+0000","last_became_active":"2023-07-21T07:34:41.005911+0000","last_became_peered":"2023-07-21T07:34:41.005911+0000","last_unstale":"2023-07-21T07:34:43.712165+0000","last_undegraded":"2023-07-21T07:34:43.712165+0000","last_fullsized":"2023-07-21T07:34:43.712165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:36.154510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711281+0000","last_change":"2023-07-21T07:34:41.014321+0000","last_active":"2023-07-21T07:34:43.711281+0000","last_peered":"2023-07-21T07:34:43.711281+0000","last_clean":"2023-07-21T07:34:43.711281+0000","last_became_active":"2023-07-21T07:34:41.013913+0000","last_became_peered":"2023-07-21T07:34:41.013913+0000","last_unstale":"2023-07-21T07:34:43.711281+0000","last_undegraded":"2023-07-21T07:34:43.711281+0000","last_fullsized":"2023-07-21T07:34:43.711281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:25.315536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992369+0000","last_change":"2023-07-21T07:34:40.006035+0000","last_active":"2023-07-21T07:34:41.992369+0000","last_peered":"2023-07-21T07:34:41.992369+0000","last_clean":"2023-07-21T07:34:41.992369+0000","last_became_active":"2023-07-21T07:34:40.005799+0000","last_became_peered":"2023-07-21T07:34:40.005799+0000","last_unstale":"2023-07-21T07:34:41.992369+0000","last_undegraded":"2023-07-21T07:34:41.992369+0000","last_fullsized":"2023-07-21T07:34:41.992369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:21.178454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177216+0000","last_change":"2023-07-21T07:34:41.007625+0000","last_active":"2023-07-21T07:34:42.177216+0000","last_peered":"2023-07-21T07:34:42.177216+0000","last_clean":"2023-07-21T07:34:42.177216+0000","last_became_active":"2023-07-21T07:34:41.006954+0000","last_became_peered":"2023-07-21T07:34:41.006954+0000","last_unstale":"2023-07-21T07:34:42.177216+0000","last_undegraded":"2023-07-21T07:34:42.177216+0000","last_fullsized":"2023-07-21T07:34:42.177216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:53.769501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711732+0000","last_change":"2023-07-21T07:34:40.006702+0000","last_active":"2023-07-21T07:34:43.711732+0000","last_peered":"2023-07-21T07:34:43.711732+0000","last_clean":"2023-07-21T07:34:43.711732+0000","last_became_active":"2023-07-21T07:34:40.006334+0000","last_became_peered":"2023-07-21T07:34:40.006334+0000","last_unstale":"2023-07-21T07:34:43.711732+0000","last_undegraded":"2023-07-21T07:34:43.711732+0000","last_fullsized":"2023-07-21T07:34:43.711732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:52.762722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252562+0000","last_change":"2023-07-21T07:34:41.013575+0000","last_active":"2023-07-21T07:34:42.252562+0000","last_peered":"2023-07-21T07:34:42.252562+0000","last_clean":"2023-07-21T07:34:42.252562+0000","last_became_active":"2023-07-21T07:34:41.013276+0000","last_became_peered":"2023-07-21T07:34:41.013276+0000","last_unstale":"2023-07-21T07:34:42.252562+0000","last_undegraded":"2023-07-21T07:34:42.252562+0000","last_fullsized":"2023-07-21T07:34:42.252562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177314+0000","last_change":"2023-07-21T07:34:40.004005+0000","last_active":"2023-07-21T07:34:42.177314+0000","last_peered":"2023-07-21T07:34:42.177314+0000","last_clean":"2023-07-21T07:34:42.177314+0000","last_became_active":"2023-07-21T07:34:40.003505+0000","last_became_peered":"2023-07-21T07:34:40.003505+0000","last_unstale":"2023-07-21T07:34:42.177314+0000","last_undegraded":"2023-07-21T07:34:42.177314+0000","last_fullsized":"2023-07-21T07:34:42.177314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:48.791489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992924+0000","last_change":"2023-07-21T07:34:41.004220+0000","last_active":"2023-07-21T07:34:41.992924+0000","last_peered":"2023-07-21T07:34:41.992924+0000","last_clean":"2023-07-21T07:34:41.992924+0000","last_became_active":"2023-07-21T07:34:41.003943+0000","last_became_peered":"2023-07-21T07:34:41.003943+0000","last_unstale":"2023-07-21T07:34:41.992924+0000","last_undegraded":"2023-07-21T07:34:41.992924+0000","last_fullsized":"2023-07-21T07:34:41.992924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:49:24.373411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252659+0000","last_change":"2023-07-21T07:34:40.000884+0000","last_active":"2023-07-21T07:34:42.252659+0000","last_peered":"2023-07-21T07:34:42.252659+0000","last_clean":"2023-07-21T07:34:42.252659+0000","last_became_active":"2023-07-21T07:34:40.000548+0000","last_became_peered":"2023-07-21T07:34:40.000548+0000","last_unstale":"2023-07-21T07:34:42.252659+0000","last_undegraded":"2023-07-21T07:34:42.252659+0000","last_fullsized":"2023-07-21T07:34:42.252659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:41.600204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177198+0000","last_change":"2023-07-21T07:34:41.008668+0000","last_active":"2023-07-21T07:34:42.177198+0000","last_peered":"2023-07-21T07:34:42.177198+0000","last_clean":"2023-07-21T07:34:42.177198+0000","last_became_active":"2023-07-21T07:34:41.008309+0000","last_became_peered":"2023-07-21T07:34:41.008309+0000","last_unstale":"2023-07-21T07:34:42.177198+0000","last_undegraded":"2023-07-21T07:34:42.177198+0000","last_fullsized":"2023-07-21T07:34:42.177198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711321+0000","last_change":"2023-07-21T07:34:40.000039+0000","last_active":"2023-07-21T07:34:43.711321+0000","last_peered":"2023-07-21T07:34:43.711321+0000","last_clean":"2023-07-21T07:34:43.711321+0000","last_became_active":"2023-07-21T07:34:39.999675+0000","last_became_peered":"2023-07-21T07:34:39.999675+0000","last_unstale":"2023-07-21T07:34:43.711321+0000","last_undegraded":"2023-07-21T07:34:43.711321+0000","last_fullsized":"2023-07-21T07:34:43.711321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:12:06.504533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177225+0000","last_change":"2023-07-21T07:34:41.015126+0000","last_active":"2023-07-21T07:34:42.177225+0000","last_peered":"2023-07-21T07:34:42.177225+0000","last_clean":"2023-07-21T07:34:42.177225+0000","last_became_active":"2023-07-21T07:34:41.014280+0000","last_became_peered":"2023-07-21T07:34:41.014280+0000","last_unstale":"2023-07-21T07:34:42.177225+0000","last_undegraded":"2023-07-21T07:34:42.177225+0000","last_fullsized":"2023-07-21T07:34:42.177225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:06.140274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739671+0000","last_change":"2023-07-21T07:34:40.006892+0000","last_active":"2023-07-21T07:34:43.739671+0000","last_peered":"2023-07-21T07:34:43.739671+0000","last_clean":"2023-07-21T07:34:43.739671+0000","last_became_active":"2023-07-21T07:34:40.006547+0000","last_became_peered":"2023-07-21T07:34:40.006547+0000","last_unstale":"2023-07-21T07:34:43.739671+0000","last_undegraded":"2023-07-21T07:34:43.739671+0000","last_fullsized":"2023-07-21T07:34:43.739671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:11:03.929122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711612+0000","last_change":"2023-07-21T07:34:41.005138+0000","last_active":"2023-07-21T07:34:43.711612+0000","last_peered":"2023-07-21T07:34:43.711612+0000","last_clean":"2023-07-21T07:34:43.711612+0000","last_became_active":"2023-07-21T07:34:41.004836+0000","last_became_peered":"2023-07-21T07:34:41.004836+0000","last_unstale":"2023-07-21T07:34:43.711612+0000","last_undegraded":"2023-07-21T07:34:43.711612+0000","last_fullsized":"2023-07-21T07:34:43.711612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:37.210979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992847+0000","last_change":"2023-07-21T07:34:40.001177+0000","last_active":"2023-07-21T07:34:41.992847+0000","last_peered":"2023-07-21T07:34:41.992847+0000","last_clean":"2023-07-21T07:34:41.992847+0000","last_became_active":"2023-07-21T07:34:40.000899+0000","last_became_peered":"2023-07-21T07:34:40.000899+0000","last_unstale":"2023-07-21T07:34:41.992847+0000","last_undegraded":"2023-07-21T07:34:41.992847+0000","last_fullsized":"2023-07-21T07:34:41.992847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:47:27.200017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992726+0000","last_change":"2023-07-21T07:34:41.003585+0000","last_active":"2023-07-21T07:34:41.992726+0000","last_peered":"2023-07-21T07:34:41.992726+0000","last_clean":"2023-07-21T07:34:41.992726+0000","last_became_active":"2023-07-21T07:34:41.003302+0000","last_became_peered":"2023-07-21T07:34:41.003302+0000","last_unstale":"2023-07-21T07:34:41.992726+0000","last_undegraded":"2023-07-21T07:34:41.992726+0000","last_fullsized":"2023-07-21T07:34:41.992726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:12:07.511312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739571+0000","last_change":"2023-07-21T07:34:40.003432+0000","last_active":"2023-07-21T07:34:43.739571+0000","last_peered":"2023-07-21T07:34:43.739571+0000","last_clean":"2023-07-21T07:34:43.739571+0000","last_became_active":"2023-07-21T07:34:40.003161+0000","last_became_peered":"2023-07-21T07:34:40.003161+0000","last_unstale":"2023-07-21T07:34:43.739571+0000","last_undegraded":"2023-07-21T07:34:43.739571+0000","last_fullsized":"2023-07-21T07:34:43.739571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:22:44.051293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177120+0000","last_change":"2023-07-21T07:34:41.009600+0000","last_active":"2023-07-21T07:34:42.177120+0000","last_peered":"2023-07-21T07:34:42.177120+0000","last_clean":"2023-07-21T07:34:42.177120+0000","last_became_active":"2023-07-21T07:34:41.008310+0000","last_became_peered":"2023-07-21T07:34:41.008310+0000","last_unstale":"2023-07-21T07:34:42.177120+0000","last_undegraded":"2023-07-21T07:34:42.177120+0000","last_fullsized":"2023-07-21T07:34:42.177120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:06.735540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252286+0000","last_change":"2023-07-21T07:34:40.002086+0000","last_active":"2023-07-21T07:34:42.252286+0000","last_peered":"2023-07-21T07:34:42.252286+0000","last_clean":"2023-07-21T07:34:42.252286+0000","last_became_active":"2023-07-21T07:34:40.001728+0000","last_became_peered":"2023-07-21T07:34:40.001728+0000","last_unstale":"2023-07-21T07:34:42.252286+0000","last_undegraded":"2023-07-21T07:34:42.252286+0000","last_fullsized":"2023-07-21T07:34:42.252286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:10.302016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711408+0000","last_change":"2023-07-21T07:34:41.014135+0000","last_active":"2023-07-21T07:34:43.711408+0000","last_peered":"2023-07-21T07:34:43.711408+0000","last_clean":"2023-07-21T07:34:43.711408+0000","last_became_active":"2023-07-21T07:34:41.013571+0000","last_became_peered":"2023-07-21T07:34:41.013571+0000","last_unstale":"2023-07-21T07:34:43.711408+0000","last_undegraded":"2023-07-21T07:34:43.711408+0000","last_fullsized":"2023-07-21T07:34:43.711408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:01:35.460233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739372+0000","last_change":"2023-07-21T07:34:40.005154+0000","last_active":"2023-07-21T07:34:43.739372+0000","last_peered":"2023-07-21T07:34:43.739372+0000","last_clean":"2023-07-21T07:34:43.739372+0000","last_became_active":"2023-07-21T07:34:40.004855+0000","last_became_peered":"2023-07-21T07:34:40.004855+0000","last_unstale":"2023-07-21T07:34:43.739372+0000","last_undegraded":"2023-07-21T07:34:43.739372+0000","last_fullsized":"2023-07-21T07:34:43.739372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:12:06.504533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252521+0000","last_change":"2023-07-21T07:34:41.010402+0000","last_active":"2023-07-21T07:34:42.252521+0000","last_peered":"2023-07-21T07:34:42.252521+0000","last_clean":"2023-07-21T07:34:42.252521+0000","last_became_active":"2023-07-21T07:34:41.010083+0000","last_became_peered":"2023-07-21T07:34:41.010083+0000","last_unstale":"2023-07-21T07:34:42.252521+0000","last_undegraded":"2023-07-21T07:34:42.252521+0000","last_fullsized":"2023-07-21T07:34:42.252521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:13.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991555+0000","last_change":"2023-07-21T07:34:40.001486+0000","last_active":"2023-07-21T07:34:41.991555+0000","last_peered":"2023-07-21T07:34:41.991555+0000","last_clean":"2023-07-21T07:34:41.991555+0000","last_became_active":"2023-07-21T07:34:40.001171+0000","last_became_peered":"2023-07-21T07:34:40.001171+0000","last_unstale":"2023-07-21T07:34:41.991555+0000","last_undegraded":"2023-07-21T07:34:41.991555+0000","last_fullsized":"2023-07-21T07:34:41.991555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:15.784735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177469+0000","last_change":"2023-07-21T07:34:41.015334+0000","last_active":"2023-07-21T07:34:42.177469+0000","last_peered":"2023-07-21T07:34:42.177469+0000","last_clean":"2023-07-21T07:34:42.177469+0000","last_became_active":"2023-07-21T07:34:41.014579+0000","last_became_peered":"2023-07-21T07:34:41.014579+0000","last_unstale":"2023-07-21T07:34:42.177469+0000","last_undegraded":"2023-07-21T07:34:42.177469+0000","last_fullsized":"2023-07-21T07:34:42.177469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:36.154510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739995+0000","last_change":"2023-07-21T07:34:40.002994+0000","last_active":"2023-07-21T07:34:43.739995+0000","last_peered":"2023-07-21T07:34:43.739995+0000","last_clean":"2023-07-21T07:34:43.739995+0000","last_became_active":"2023-07-21T07:34:40.002626+0000","last_became_peered":"2023-07-21T07:34:40.002626+0000","last_unstale":"2023-07-21T07:34:43.739995+0000","last_undegraded":"2023-07-21T07:34:43.739995+0000","last_fullsized":"2023-07-21T07:34:43.739995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:00:09.282694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.710969+0000","last_change":"2023-07-21T07:34:41.011397+0000","last_active":"2023-07-21T07:34:43.710969+0000","last_peered":"2023-07-21T07:34:43.710969+0000","last_clean":"2023-07-21T07:34:43.710969+0000","last_became_active":"2023-07-21T07:34:41.011074+0000","last_became_peered":"2023-07-21T07:34:41.011074+0000","last_unstale":"2023-07-21T07:34:43.710969+0000","last_undegraded":"2023-07-21T07:34:43.710969+0000","last_fullsized":"2023-07-21T07:34:43.710969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:22.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739866+0000","last_change":"2023-07-21T07:34:40.002951+0000","last_active":"2023-07-21T07:34:43.739866+0000","last_peered":"2023-07-21T07:34:43.739866+0000","last_clean":"2023-07-21T07:34:43.739866+0000","last_became_active":"2023-07-21T07:34:40.002644+0000","last_became_peered":"2023-07-21T07:34:40.002644+0000","last_unstale":"2023-07-21T07:34:43.739866+0000","last_undegraded":"2023-07-21T07:34:43.739866+0000","last_fullsized":"2023-07-21T07:34:43.739866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:11:07.596057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991994+0000","last_change":"2023-07-21T07:34:40.999968+0000","last_active":"2023-07-21T07:34:41.991994+0000","last_peered":"2023-07-21T07:34:41.991994+0000","last_clean":"2023-07-21T07:34:41.991994+0000","last_became_active":"2023-07-21T07:34:40.999426+0000","last_became_peered":"2023-07-21T07:34:40.999426+0000","last_unstale":"2023-07-21T07:34:41.991994+0000","last_undegraded":"2023-07-21T07:34:41.991994+0000","last_fullsized":"2023-07-21T07:34:41.991994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:37.840825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739806+0000","last_change":"2023-07-21T07:34:40.001121+0000","last_active":"2023-07-21T07:34:43.739806+0000","last_peered":"2023-07-21T07:34:43.739806+0000","last_clean":"2023-07-21T07:34:43.739806+0000","last_became_active":"2023-07-21T07:34:40.000781+0000","last_became_peered":"2023-07-21T07:34:40.000781+0000","last_unstale":"2023-07-21T07:34:43.739806+0000","last_undegraded":"2023-07-21T07:34:43.739806+0000","last_fullsized":"2023-07-21T07:34:43.739806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:45:11.389845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992005+0000","last_change":"2023-07-21T07:34:41.005148+0000","last_active":"2023-07-21T07:34:41.992005+0000","last_peered":"2023-07-21T07:34:41.992005+0000","last_clean":"2023-07-21T07:34:41.992005+0000","last_became_active":"2023-07-21T07:34:41.004857+0000","last_became_peered":"2023-07-21T07:34:41.004857+0000","last_unstale":"2023-07-21T07:34:41.992005+0000","last_undegraded":"2023-07-21T07:34:41.992005+0000","last_fullsized":"2023-07-21T07:34:41.992005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:23:03.521561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711155+0000","last_change":"2023-07-21T07:34:40.001134+0000","last_active":"2023-07-21T07:34:43.711155+0000","last_peered":"2023-07-21T07:34:43.711155+0000","last_clean":"2023-07-21T07:34:43.711155+0000","last_became_active":"2023-07-21T07:34:40.000862+0000","last_became_peered":"2023-07-21T07:34:40.000862+0000","last_unstale":"2023-07-21T07:34:43.711155+0000","last_undegraded":"2023-07-21T07:34:43.711155+0000","last_fullsized":"2023-07-21T07:34:43.711155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:35.147731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252524+0000","last_change":"2023-07-21T07:34:41.004129+0000","last_active":"2023-07-21T07:34:42.252524+0000","last_peered":"2023-07-21T07:34:42.252524+0000","last_clean":"2023-07-21T07:34:42.252524+0000","last_became_active":"2023-07-21T07:34:41.003528+0000","last_became_peered":"2023-07-21T07:34:41.003528+0000","last_unstale":"2023-07-21T07:34:42.252524+0000","last_undegraded":"2023-07-21T07:34:42.252524+0000","last_fullsized":"2023-07-21T07:34:42.252524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:37.210979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177185+0000","last_change":"2023-07-21T07:34:40.001941+0000","last_active":"2023-07-21T07:34:42.177185+0000","last_peered":"2023-07-21T07:34:42.177185+0000","last_clean":"2023-07-21T07:34:42.177185+0000","last_became_active":"2023-07-21T07:34:40.001558+0000","last_became_peered":"2023-07-21T07:34:40.001558+0000","last_unstale":"2023-07-21T07:34:42.177185+0000","last_undegraded":"2023-07-21T07:34:42.177185+0000","last_fullsized":"2023-07-21T07:34:42.177185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:36.204200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992762+0000","last_change":"2023-07-21T07:34:41.013224+0000","last_active":"2023-07-21T07:34:41.992762+0000","last_peered":"2023-07-21T07:34:41.992762+0000","last_clean":"2023-07-21T07:34:41.992762+0000","last_became_active":"2023-07-21T07:34:41.012940+0000","last_became_peered":"2023-07-21T07:34:41.012940+0000","last_unstale":"2023-07-21T07:34:41.992762+0000","last_undegraded":"2023-07-21T07:34:41.992762+0000","last_fullsized":"2023-07-21T07:34:41.992762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:04:46.304259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991852+0000","last_change":"2023-07-21T07:34:39.998058+0000","last_active":"2023-07-21T07:34:41.991852+0000","last_peered":"2023-07-21T07:34:41.991852+0000","last_clean":"2023-07-21T07:34:41.991852+0000","last_became_active":"2023-07-21T07:34:39.997803+0000","last_became_peered":"2023-07-21T07:34:39.997803+0000","last_unstale":"2023-07-21T07:34:41.991852+0000","last_undegraded":"2023-07-21T07:34:41.991852+0000","last_fullsized":"2023-07-21T07:34:41.991852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:13:39.091695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992732+0000","last_change":"2023-07-21T07:34:41.009229+0000","last_active":"2023-07-21T07:34:41.992732+0000","last_peered":"2023-07-21T07:34:41.992732+0000","last_clean":"2023-07-21T07:34:41.992732+0000","last_became_active":"2023-07-21T07:34:41.004241+0000","last_became_peered":"2023-07-21T07:34:41.004241+0000","last_unstale":"2023-07-21T07:34:41.992732+0000","last_undegraded":"2023-07-21T07:34:41.992732+0000","last_fullsized":"2023-07-21T07:34:41.992732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:01:35.460233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992269+0000","last_change":"2023-07-21T07:34:39.997085+0000","last_active":"2023-07-21T07:34:41.992269+0000","last_peered":"2023-07-21T07:34:41.992269+0000","last_clean":"2023-07-21T07:34:41.992269+0000","last_became_active":"2023-07-21T07:34:39.996276+0000","last_became_peered":"2023-07-21T07:34:39.996276+0000","last_unstale":"2023-07-21T07:34:41.992269+0000","last_undegraded":"2023-07-21T07:34:41.992269+0000","last_fullsized":"2023-07-21T07:34:41.992269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:52.762722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992364+0000","last_change":"2023-07-21T07:34:41.008766+0000","last_active":"2023-07-21T07:34:41.992364+0000","last_peered":"2023-07-21T07:34:41.992364+0000","last_clean":"2023-07-21T07:34:41.992364+0000","last_became_active":"2023-07-21T07:34:41.005525+0000","last_became_peered":"2023-07-21T07:34:41.005525+0000","last_unstale":"2023-07-21T07:34:41.992364+0000","last_undegraded":"2023-07-21T07:34:41.992364+0000","last_fullsized":"2023-07-21T07:34:41.992364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:42.606983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177142+0000","last_change":"2023-07-21T07:34:40.000981+0000","last_active":"2023-07-21T07:34:42.177142+0000","last_peered":"2023-07-21T07:34:42.177142+0000","last_clean":"2023-07-21T07:34:42.177142+0000","last_became_active":"2023-07-21T07:34:40.000659+0000","last_became_peered":"2023-07-21T07:34:40.000659+0000","last_unstale":"2023-07-21T07:34:42.177142+0000","last_undegraded":"2023-07-21T07:34:42.177142+0000","last_fullsized":"2023-07-21T07:34:42.177142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:12.395122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.712023+0000","last_change":"2023-07-21T07:34:41.014435+0000","last_active":"2023-07-21T07:34:43.712023+0000","last_peered":"2023-07-21T07:34:43.712023+0000","last_clean":"2023-07-21T07:34:43.712023+0000","last_became_active":"2023-07-21T07:34:41.014124+0000","last_became_peered":"2023-07-21T07:34:41.014124+0000","last_unstale":"2023-07-21T07:34:43.712023+0000","last_undegraded":"2023-07-21T07:34:43.712023+0000","last_fullsized":"2023-07-21T07:34:43.712023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:22.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711399+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:34:43.711399+0000","last_peered":"2023-07-21T07:34:43.711399+0000","last_clean":"2023-07-21T07:34:43.711399+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:34:43.711399+0000","last_undegraded":"2023-07-21T07:34:43.711399+0000","last_fullsized":"2023-07-21T07:34:43.711399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:00.596624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711436+0000","last_change":"2023-07-21T07:34:40.002419+0000","last_active":"2023-07-21T07:34:43.711436+0000","last_peered":"2023-07-21T07:34:43.711436+0000","last_clean":"2023-07-21T07:34:43.711436+0000","last_became_active":"2023-07-21T07:34:40.001968+0000","last_became_peered":"2023-07-21T07:34:40.001968+0000","last_unstale":"2023-07-21T07:34:43.711436+0000","last_undegraded":"2023-07-21T07:34:43.711436+0000","last_fullsized":"2023-07-21T07:34:43.711436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:04:45.297480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711644+0000","last_change":"2023-07-21T07:34:40.993474+0000","last_active":"2023-07-21T07:34:43.711644+0000","last_peered":"2023-07-21T07:34:43.711644+0000","last_clean":"2023-07-21T07:34:43.711644+0000","last_became_active":"2023-07-21T07:34:40.993127+0000","last_became_peered":"2023-07-21T07:34:40.993127+0000","last_unstale":"2023-07-21T07:34:43.711644+0000","last_undegraded":"2023-07-21T07:34:43.711644+0000","last_fullsized":"2023-07-21T07:34:43.711644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711103+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:34:43.711103+0000","last_peered":"2023-07-21T07:34:43.711103+0000","last_clean":"2023-07-21T07:34:43.711103+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:34:43.711103+0000","last_undegraded":"2023-07-21T07:34:43.711103+0000","last_fullsized":"2023-07-21T07:34:43.711103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:46.565041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992570+0000","last_change":"2023-07-21T07:34:40.002541+0000","last_active":"2023-07-21T07:34:41.992570+0000","last_peered":"2023-07-21T07:34:41.992570+0000","last_clean":"2023-07-21T07:34:41.992570+0000","last_became_active":"2023-07-21T07:34:40.002244+0000","last_became_peered":"2023-07-21T07:34:40.002244+0000","last_unstale":"2023-07-21T07:34:41.992570+0000","last_undegraded":"2023-07-21T07:34:41.992570+0000","last_fullsized":"2023-07-21T07:34:41.992570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:35.147731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711907+0000","last_change":"2023-07-21T07:34:40.993583+0000","last_active":"2023-07-21T07:34:43.711907+0000","last_peered":"2023-07-21T07:34:43.711907+0000","last_clean":"2023-07-21T07:34:43.711907+0000","last_became_active":"2023-07-21T07:34:40.992984+0000","last_became_peered":"2023-07-21T07:34:40.992984+0000","last_unstale":"2023-07-21T07:34:43.711907+0000","last_undegraded":"2023-07-21T07:34:43.711907+0000","last_fullsized":"2023-07-21T07:34:43.711907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:42.606983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.987877+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:34:41.987877+0000","last_peered":"2023-07-21T07:34:41.987877+0000","last_clean":"2023-07-21T07:34:41.987877+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:34:41.987877+0000","last_undegraded":"2023-07-21T07:34:41.987877+0000","last_fullsized":"2023-07-21T07:34:41.987877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:52:05.194684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711490+0000","last_change":"2023-07-21T07:34:40.002203+0000","last_active":"2023-07-21T07:34:43.711490+0000","last_peered":"2023-07-21T07:34:43.711490+0000","last_clean":"2023-07-21T07:34:43.711490+0000","last_became_active":"2023-07-21T07:34:40.001222+0000","last_became_peered":"2023-07-21T07:34:40.001222+0000","last_unstale":"2023-07-21T07:34:43.711490+0000","last_undegraded":"2023-07-21T07:34:43.711490+0000","last_fullsized":"2023-07-21T07:34:43.711490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:12.395122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.712029+0000","last_change":"2023-07-21T07:34:40.994556+0000","last_active":"2023-07-21T07:34:43.712029+0000","last_peered":"2023-07-21T07:34:43.712029+0000","last_clean":"2023-07-21T07:34:43.712029+0000","last_became_active":"2023-07-21T07:34:40.994093+0000","last_became_peered":"2023-07-21T07:34:40.994093+0000","last_unstale":"2023-07-21T07:34:43.712029+0000","last_undegraded":"2023-07-21T07:34:43.712029+0000","last_fullsized":"2023-07-21T07:34:43.712029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:52.703957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.710864+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:34:43.710864+0000","last_peered":"2023-07-21T07:34:43.710864+0000","last_clean":"2023-07-21T07:34:43.710864+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:34:43.710864+0000","last_undegraded":"2023-07-21T07:34:43.710864+0000","last_fullsized":"2023-07-21T07:34:43.710864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:00.001359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739258+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:34:43.739258+0000","last_peered":"2023-07-21T07:34:43.739258+0000","last_clean":"2023-07-21T07:34:43.739258+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:34:43.739258+0000","last_undegraded":"2023-07-21T07:34:43.739258+0000","last_fullsized":"2023-07-21T07:34:43.739258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:14.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.176949+0000","last_change":"2023-07-21T07:34:39.999821+0000","last_active":"2023-07-21T07:34:42.176949+0000","last_peered":"2023-07-21T07:34:42.176949+0000","last_clean":"2023-07-21T07:34:42.176949+0000","last_became_active":"2023-07-21T07:34:39.999465+0000","last_became_peered":"2023-07-21T07:34:39.999465+0000","last_unstale":"2023-07-21T07:34:42.176949+0000","last_undegraded":"2023-07-21T07:34:42.176949+0000","last_fullsized":"2023-07-21T07:34:42.176949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:09.858244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992699+0000","last_change":"2023-07-21T07:34:41.002207+0000","last_active":"2023-07-21T07:34:41.992699+0000","last_peered":"2023-07-21T07:34:41.992699+0000","last_clean":"2023-07-21T07:34:41.992699+0000","last_became_active":"2023-07-21T07:34:41.001868+0000","last_became_peered":"2023-07-21T07:34:41.001868+0000","last_unstale":"2023-07-21T07:34:41.992699+0000","last_undegraded":"2023-07-21T07:34:41.992699+0000","last_fullsized":"2023-07-21T07:34:41.992699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:23:45.330390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739433+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:34:43.739433+0000","last_peered":"2023-07-21T07:34:43.739433+0000","last_clean":"2023-07-21T07:34:43.739433+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:34:43.739433+0000","last_undegraded":"2023-07-21T07:34:43.739433+0000","last_fullsized":"2023-07-21T07:34:43.739433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:01:29.321317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252218+0000","last_change":"2023-07-21T07:34:40.001692+0000","last_active":"2023-07-21T07:34:42.252218+0000","last_peered":"2023-07-21T07:34:42.252218+0000","last_clean":"2023-07-21T07:34:42.252218+0000","last_became_active":"2023-07-21T07:34:40.001345+0000","last_became_peered":"2023-07-21T07:34:40.001345+0000","last_unstale":"2023-07-21T07:34:42.252218+0000","last_undegraded":"2023-07-21T07:34:42.252218+0000","last_fullsized":"2023-07-21T07:34:42.252218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:05:53.987510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252678+0000","last_change":"2023-07-21T07:34:41.005653+0000","last_active":"2023-07-21T07:34:42.252678+0000","last_peered":"2023-07-21T07:34:42.252678+0000","last_clean":"2023-07-21T07:34:42.252678+0000","last_became_active":"2023-07-21T07:34:41.005291+0000","last_became_peered":"2023-07-21T07:34:41.005291+0000","last_unstale":"2023-07-21T07:34:42.252678+0000","last_undegraded":"2023-07-21T07:34:42.252678+0000","last_fullsized":"2023-07-21T07:34:42.252678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:49.798268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739127+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:34:43.739127+0000","last_peered":"2023-07-21T07:34:43.739127+0000","last_clean":"2023-07-21T07:34:43.739127+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:34:43.739127+0000","last_undegraded":"2023-07-21T07:34:43.739127+0000","last_fullsized":"2023-07-21T07:34:43.739127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:30.015594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711977+0000","last_change":"2023-07-21T07:34:40.005160+0000","last_active":"2023-07-21T07:34:43.711977+0000","last_peered":"2023-07-21T07:34:43.711977+0000","last_clean":"2023-07-21T07:34:43.711977+0000","last_became_active":"2023-07-21T07:34:40.004876+0000","last_became_peered":"2023-07-21T07:34:40.004876+0000","last_unstale":"2023-07-21T07:34:43.711977+0000","last_undegraded":"2023-07-21T07:34:43.711977+0000","last_fullsized":"2023-07-21T07:34:43.711977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:48.791489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252272+0000","last_change":"2023-07-21T07:34:41.004325+0000","last_active":"2023-07-21T07:34:42.252272+0000","last_peered":"2023-07-21T07:34:42.252272+0000","last_clean":"2023-07-21T07:34:42.252272+0000","last_became_active":"2023-07-21T07:34:41.003810+0000","last_became_peered":"2023-07-21T07:34:41.003810+0000","last_unstale":"2023-07-21T07:34:42.252272+0000","last_undegraded":"2023-07-21T07:34:42.252272+0000","last_fullsized":"2023-07-21T07:34:42.252272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:10.865023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177420+0000","last_change":"2023-07-21T07:34:40.003127+0000","last_active":"2023-07-21T07:34:42.177420+0000","last_peered":"2023-07-21T07:34:42.177420+0000","last_clean":"2023-07-21T07:34:42.177420+0000","last_became_active":"2023-07-21T07:34:40.002749+0000","last_became_peered":"2023-07-21T07:34:40.002749+0000","last_unstale":"2023-07-21T07:34:42.177420+0000","last_undegraded":"2023-07-21T07:34:42.177420+0000","last_fullsized":"2023-07-21T07:34:42.177420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:51.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711393+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:34:43.711393+0000","last_peered":"2023-07-21T07:34:43.711393+0000","last_clean":"2023-07-21T07:34:43.711393+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:34:43.711393+0000","last_undegraded":"2023-07-21T07:34:43.711393+0000","last_fullsized":"2023-07-21T07:34:43.711393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:31.701910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177019+0000","last_change":"2023-07-21T07:34:41.013799+0000","last_active":"2023-07-21T07:34:42.177019+0000","last_peered":"2023-07-21T07:34:42.177019+0000","last_clean":"2023-07-21T07:34:42.177019+0000","last_became_active":"2023-07-21T07:34:41.013507+0000","last_became_peered":"2023-07-21T07:34:41.013507+0000","last_unstale":"2023-07-21T07:34:42.177019+0000","last_undegraded":"2023-07-21T07:34:42.177019+0000","last_fullsized":"2023-07-21T07:34:42.177019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:37.840825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992790+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:34:41.992790+0000","last_peered":"2023-07-21T07:34:41.992790+0000","last_clean":"2023-07-21T07:34:41.992790+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:34:41.992790+0000","last_undegraded":"2023-07-21T07:34:41.992790+0000","last_fullsized":"2023-07-21T07:34:41.992790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:19:33.625591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.718589+0000","last_change":"2023-07-21T07:34:40.008949+0000","last_active":"2023-07-21T07:34:42.718589+0000","last_peered":"2023-07-21T07:34:42.718589+0000","last_clean":"2023-07-21T07:34:42.718589+0000","last_became_active":"2023-07-21T07:34:40.008673+0000","last_became_peered":"2023-07-21T07:34:40.008673+0000","last_unstale":"2023-07-21T07:34:42.718589+0000","last_undegraded":"2023-07-21T07:34:42.718589+0000","last_fullsized":"2023-07-21T07:34:42.718589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:05.133495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992135+0000","last_change":"2023-07-21T07:34:41.000146+0000","last_active":"2023-07-21T07:34:41.992135+0000","last_peered":"2023-07-21T07:34:41.992135+0000","last_clean":"2023-07-21T07:34:41.992135+0000","last_became_active":"2023-07-21T07:34:40.999714+0000","last_became_peered":"2023-07-21T07:34:40.999714+0000","last_unstale":"2023-07-21T07:34:41.992135+0000","last_undegraded":"2023-07-21T07:34:41.992135+0000","last_fullsized":"2023-07-21T07:34:41.992135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:37.210979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252474+0000","last_change":"2023-07-21T07:34:40.008365+0000","last_active":"2023-07-21T07:34:42.252474+0000","last_peered":"2023-07-21T07:34:42.252474+0000","last_clean":"2023-07-21T07:34:42.252474+0000","last_became_active":"2023-07-21T07:34:40.007918+0000","last_became_peered":"2023-07-21T07:34:40.007918+0000","last_unstale":"2023-07-21T07:34:42.252474+0000","last_undegraded":"2023-07-21T07:34:42.252474+0000","last_fullsized":"2023-07-21T07:34:42.252474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:05.728761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988078+0000","last_change":"2023-07-21T07:34:41.004151+0000","last_active":"2023-07-21T07:34:41.988078+0000","last_peered":"2023-07-21T07:34:41.988078+0000","last_clean":"2023-07-21T07:34:41.988078+0000","last_became_active":"2023-07-21T07:34:41.003809+0000","last_became_peered":"2023-07-21T07:34:41.003809+0000","last_unstale":"2023-07-21T07:34:41.988078+0000","last_undegraded":"2023-07-21T07:34:41.988078+0000","last_fullsized":"2023-07-21T07:34:41.988078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:13:50.121515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711103+0000","last_change":"2023-07-21T07:34:39.999418+0000","last_active":"2023-07-21T07:34:43.711103+0000","last_peered":"2023-07-21T07:34:43.711103+0000","last_clean":"2023-07-21T07:34:43.711103+0000","last_became_active":"2023-07-21T07:34:39.999189+0000","last_became_peered":"2023-07-21T07:34:39.999189+0000","last_unstale":"2023-07-21T07:34:43.711103+0000","last_undegraded":"2023-07-21T07:34:43.711103+0000","last_fullsized":"2023-07-21T07:34:43.711103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:21.952698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992547+0000","last_change":"2023-07-21T07:34:41.012402+0000","last_active":"2023-07-21T07:34:41.992547+0000","last_peered":"2023-07-21T07:34:41.992547+0000","last_clean":"2023-07-21T07:34:41.992547+0000","last_became_active":"2023-07-21T07:34:41.012138+0000","last_became_peered":"2023-07-21T07:34:41.012138+0000","last_unstale":"2023-07-21T07:34:41.992547+0000","last_undegraded":"2023-07-21T07:34:41.992547+0000","last_fullsized":"2023-07-21T07:34:41.992547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:22.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711543+0000","last_change":"2023-07-21T07:34:39.999316+0000","last_active":"2023-07-21T07:34:43.711543+0000","last_peered":"2023-07-21T07:34:43.711543+0000","last_clean":"2023-07-21T07:34:43.711543+0000","last_became_active":"2023-07-21T07:34:39.999072+0000","last_became_peered":"2023-07-21T07:34:39.999072+0000","last_unstale":"2023-07-21T07:34:43.711543+0000","last_undegraded":"2023-07-21T07:34:43.711543+0000","last_fullsized":"2023-07-21T07:34:43.711543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:06:11.268170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992553+0000","last_change":"2023-07-21T07:34:41.012360+0000","last_active":"2023-07-21T07:34:41.992553+0000","last_peered":"2023-07-21T07:34:41.992553+0000","last_clean":"2023-07-21T07:34:41.992553+0000","last_became_active":"2023-07-21T07:34:41.011969+0000","last_became_peered":"2023-07-21T07:34:41.011969+0000","last_unstale":"2023-07-21T07:34:41.992553+0000","last_undegraded":"2023-07-21T07:34:41.992553+0000","last_fullsized":"2023-07-21T07:34:41.992553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:52.703957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177280+0000","last_change":"2023-07-21T07:34:40.000613+0000","last_active":"2023-07-21T07:34:42.177280+0000","last_peered":"2023-07-21T07:34:42.177280+0000","last_clean":"2023-07-21T07:34:42.177280+0000","last_became_active":"2023-07-21T07:34:40.000306+0000","last_became_peered":"2023-07-21T07:34:40.000306+0000","last_unstale":"2023-07-21T07:34:42.177280+0000","last_undegraded":"2023-07-21T07:34:42.177280+0000","last_fullsized":"2023-07-21T07:34:42.177280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:41.600204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.176982+0000","last_change":"2023-07-21T07:34:41.011382+0000","last_active":"2023-07-21T07:34:42.176982+0000","last_peered":"2023-07-21T07:34:42.176982+0000","last_clean":"2023-07-21T07:34:42.176982+0000","last_became_active":"2023-07-21T07:34:41.010734+0000","last_became_peered":"2023-07-21T07:34:41.010734+0000","last_unstale":"2023-07-21T07:34:42.176982+0000","last_undegraded":"2023-07-21T07:34:42.176982+0000","last_fullsized":"2023-07-21T07:34:42.176982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:11.308795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252733+0000","last_change":"2023-07-21T07:34:40.000848+0000","last_active":"2023-07-21T07:34:42.252733+0000","last_peered":"2023-07-21T07:34:42.252733+0000","last_clean":"2023-07-21T07:34:42.252733+0000","last_became_active":"2023-07-21T07:34:40.000505+0000","last_became_peered":"2023-07-21T07:34:40.000505+0000","last_unstale":"2023-07-21T07:34:42.252733+0000","last_undegraded":"2023-07-21T07:34:42.252733+0000","last_fullsized":"2023-07-21T07:34:42.252733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:21.952698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992223+0000","last_change":"2023-07-21T07:34:41.000904+0000","last_active":"2023-07-21T07:34:41.992223+0000","last_peered":"2023-07-21T07:34:41.992223+0000","last_clean":"2023-07-21T07:34:41.992223+0000","last_became_active":"2023-07-21T07:34:41.000652+0000","last_became_peered":"2023-07-21T07:34:41.000652+0000","last_unstale":"2023-07-21T07:34:41.992223+0000","last_undegraded":"2023-07-21T07:34:41.992223+0000","last_fullsized":"2023-07-21T07:34:41.992223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:11.308795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991630+0000","last_change":"2023-07-21T07:34:41.007386+0000","last_active":"2023-07-21T07:34:41.991630+0000","last_peered":"2023-07-21T07:34:41.991630+0000","last_clean":"2023-07-21T07:34:41.991630+0000","last_became_active":"2023-07-21T07:34:41.007132+0000","last_became_peered":"2023-07-21T07:34:41.007132+0000","last_unstale":"2023-07-21T07:34:41.991630+0000","last_undegraded":"2023-07-21T07:34:41.991630+0000","last_fullsized":"2023-07-21T07:34:41.991630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:38.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.176926+0000","last_change":"2023-07-21T07:34:41.011588+0000","last_active":"2023-07-21T07:34:42.176926+0000","last_peered":"2023-07-21T07:34:42.176926+0000","last_clean":"2023-07-21T07:34:42.176926+0000","last_became_active":"2023-07-21T07:34:41.011068+0000","last_became_peered":"2023-07-21T07:34:41.011068+0000","last_unstale":"2023-07-21T07:34:42.176926+0000","last_undegraded":"2023-07-21T07:34:42.176926+0000","last_fullsized":"2023-07-21T07:34:42.176926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:54:20.793513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992299+0000","last_change":"2023-07-21T07:34:41.009302+0000","last_active":"2023-07-21T07:34:41.992299+0000","last_peered":"2023-07-21T07:34:41.992299+0000","last_clean":"2023-07-21T07:34:41.992299+0000","last_became_active":"2023-07-21T07:34:41.008833+0000","last_became_peered":"2023-07-21T07:34:41.008833+0000","last_unstale":"2023-07-21T07:34:41.992299+0000","last_undegraded":"2023-07-21T07:34:41.992299+0000","last_fullsized":"2023-07-21T07:34:41.992299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:06.140274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177335+0000","last_change":"2023-07-21T07:34:41.016235+0000","last_active":"2023-07-21T07:34:42.177335+0000","last_peered":"2023-07-21T07:34:42.177335+0000","last_clean":"2023-07-21T07:34:42.177335+0000","last_became_active":"2023-07-21T07:34:41.015889+0000","last_became_peered":"2023-07-21T07:34:41.015889+0000","last_unstale":"2023-07-21T07:34:42.177335+0000","last_undegraded":"2023-07-21T07:34:42.177335+0000","last_fullsized":"2023-07-21T07:34:42.177335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:22.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711838+0000","last_change":"2023-07-21T07:34:40.999714+0000","last_active":"2023-07-21T07:34:43.711838+0000","last_peered":"2023-07-21T07:34:43.711838+0000","last_clean":"2023-07-21T07:34:43.711838+0000","last_became_active":"2023-07-21T07:34:40.999382+0000","last_became_peered":"2023-07-21T07:34:40.999382+0000","last_unstale":"2023-07-21T07:34:43.711838+0000","last_undegraded":"2023-07-21T07:34:43.711838+0000","last_fullsized":"2023-07-21T07:34:43.711838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:06.140274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.4990000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":685220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6819999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.18}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1019999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3380000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":94922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:34:50.001 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:34:50.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.109+0000 7fd25b818700 1 Processor -- start 2023-07-21T07:34:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.109+0000 7fd25b818700 1 -- start start 2023-07-21T07:34:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.109+0000 7fd25b818700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd25414e870 0x7fd25414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.109+0000 7fd25b818700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2540a5f00 0x7fd2540c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd25b818700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2540c4ef0 con 0x7fd2540c3980 2023-07-21T07:34:50.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd25b818700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2540c1df0 con 0x7fd2540a5f00 2023-07-21T07:34:50.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd25b818700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540c1450 con 0x7fd25414e870 2023-07-21T07:34:50.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd259db5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd2540c3980 0x7fd254151330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40870/0 (socket says 172.21.15.6:40870) 2023-07-21T07:34:50.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd259db5700 1 -- 172.21.15.6:0/2834399354 learned_addr learned my addr 172.21.15.6:0/2834399354 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:50.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd258db3700 1 --2- 172.21.15.6:0/2834399354 >> v2:172.21.15.86:3300/0 conn(0x7fd2540a5f00 0x7fd2540c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd2595b4700 1 --2- 172.21.15.6:0/2834399354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd25414e870 0x7fd25414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485366896 0 0) 0x7fd2540c4ef0 con 0x7fd2540c3980 2023-07-21T07:34:50.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2400035b0 con 0x7fd2540c3980 2023-07-21T07:34:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2851782172 0 0) 0x7fd2400035b0 con 0x7fd2540c3980 2023-07-21T07:34:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd25414e870 msgr2=0x7fd25414ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 --2- 172.21.15.6:0/2834399354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd25414e870 0x7fd25414ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 >> v2:172.21.15.86:3300/0 conn(0x7fd2540a5f00 msgr2=0x7fd2540c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:50.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 --2- 172.21.15.6:0/2834399354 >> v2:172.21.15.86:3300/0 conn(0x7fd2540a5f00 0x7fd2540c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2540c1730 con 0x7fd2540c3980 2023-07-21T07:34:50.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7fd24c0019f0 con 0x7fd2540c3980 2023-07-21T07:34:50.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 >> v1:172.21.15.6:6789/0 conn(0x7fd2540c3980 legacy=0x7fd254151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 --2- 172.21.15.6:0/2834399354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd25414e870 0x7fd240003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 --2- 172.21.15.6:0/2834399354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd240003f80 0x7fd240004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 --2- 172.21.15.6:0/2834399354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd240004d90 0x7fd240005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540c1df0 con 0x7fd240004d90 2023-07-21T07:34:50.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540c1450 con 0x7fd240003f80 2023-07-21T07:34:50.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24000dc70 con 0x7fd25414e870 2023-07-21T07:34:50.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd259db5700 1 --2- 172.21.15.6:0/2834399354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd240004d90 0x7fd240005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd2595b4700 1 --2- 172.21.15.6:0/2834399354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd25414e870 0x7fd240003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.110+0000 7fd258db3700 1 --2- 172.21.15.6:0/2834399354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd240003f80 0x7fd240004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd259db5700 1 -- 172.21.15.6:0/2834399354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd25414e870 msgr2=0x7fd240003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:50.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd259db5700 1 --2- 172.21.15.6:0/2834399354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd25414e870 0x7fd240003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd259db5700 1 -- 172.21.15.6:0/2834399354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd240003f80 msgr2=0x7fd240004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:50.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd259db5700 1 --2- 172.21.15.6:0/2834399354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd240003f80 0x7fd240004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd259db5700 1 -- 172.21.15.6:0/2834399354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2400035b0 con 0x7fd240004d90 2023-07-21T07:34:50.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd259db5700 1 --2- 172.21.15.6:0/2834399354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd240004d90 0x7fd240005210 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00a890 tx=0x7fd240005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3622c2b96fdcc44 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:50.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c012600 con 0x7fd240004d90 2023-07-21T07:34:50.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c012780 con 0x7fd240004d90 2023-07-21T07:34:50.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd24bfff700 1 -- 172.21.15.6:0/2834399354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c012b30 con 0x7fd240004d90 2023-07-21T07:34:50.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd25b818700 1 -- 172.21.15.6:0/2834399354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd240004d90 msgr2=0x7fd240005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd25b818700 1 --2- 172.21.15.6:0/2834399354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd240004d90 0x7fd240005210 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00a890 tx=0x7fd240005880 comp rx=0 tx=0).stop 2023-07-21T07:34:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd259db5700 1 -- 172.21.15.6:0/2834399354 reap_dead start 2023-07-21T07:34:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd25b818700 1 -- 172.21.15.6:0/2834399354 shutdown_connections 2023-07-21T07:34:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.111+0000 7fd25b818700 1 -- 172.21.15.6:0/2834399354 >> 172.21.15.6:0/2834399354 conn(0x7fd2540a8660 msgr2=0x7fd2540a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.112+0000 7fd25b818700 1 -- 172.21.15.6:0/2834399354 shutdown_connections 2023-07-21T07:34:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.112+0000 7fd25b818700 1 -- 172.21.15.6:0/2834399354 wait complete. 2023-07-21T07:34:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.113+0000 7fd25b818700 1 Processor -- start 2023-07-21T07:34:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.113+0000 7fd25b818700 1 -- start start 2023-07-21T07:34:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.113+0000 7fd25b818700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2540a6f00 0x7fd2541e5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.113+0000 7fd25b818700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2541e99b0 0x7fd2541e5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.113+0000 7fd25b818700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2540a9960 0x7fd2541e2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.113+0000 7fd25b818700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2541e9590 con 0x7fd2540a6f00 2023-07-21T07:34:50.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.113+0000 7fd25b818700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd254071fd0 con 0x7fd2540a9960 2023-07-21T07:34:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.113+0000 7fd25b818700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd254071cf0 con 0x7fd2541e99b0 2023-07-21T07:34:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.113+0000 7fd2595b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2540a6f00 0x7fd2541e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd2595b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2540a6f00 0x7fd2541e5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32858/0 (socket says 172.21.15.6:32858) 2023-07-21T07:34:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd2595b4700 1 -- 172.21.15.6:0/3810675830 learned_addr learned my addr 172.21.15.6:0/3810675830 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd258db3700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2541e99b0 0x7fd2541e5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd259db5700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2540a9960 0x7fd2541e2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd2595b4700 1 -- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2541e99b0 msgr2=0x7fd2541e5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd2595b4700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2541e99b0 0x7fd2541e5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd2595b4700 1 -- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2540a9960 msgr2=0x7fd2541e2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd2595b4700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2540a9960 0x7fd2541e2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd2595b4700 1 -- 172.21.15.6:0/3810675830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2541e8ed0 con 0x7fd2540a6f00 2023-07-21T07:34:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd2595b4700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2540a6f00 0x7fd2541e5830 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd250011ad0 tx=0x7fd250011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd249ffb700 1 -- 172.21.15.6:0/3810675830 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000f940 con 0x7fd2540a6f00 2023-07-21T07:34:50.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd249ffb700 1 -- 172.21.15.6:0/3810675830 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25000faa0 con 0x7fd2540a6f00 2023-07-21T07:34:50.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd25b818700 1 -- 172.21.15.6:0/3810675830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2541e91b0 con 0x7fd2540a6f00 2023-07-21T07:34:50.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd249ffb700 1 -- 172.21.15.6:0/3810675830 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000fe50 con 0x7fd2540a6f00 2023-07-21T07:34:50.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.114+0000 7fd25b818700 1 -- 172.21.15.6:0/3810675830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2540a72e0 con 0x7fd2540a6f00 2023-07-21T07:34:50.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.115+0000 7fd25b818700 1 -- 172.21.15.6:0/3810675830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2541e9800 con 0x7fd2540a6f00 2023-07-21T07:34:50.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.116+0000 7fd249ffb700 1 -- 172.21.15.6:0/3810675830 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd250014440 con 0x7fd2540a6f00 2023-07-21T07:34:50.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.116+0000 7fd249ffb700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd23806ace0 0x7fd23806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.117+0000 7fd249ffb700 1 -- 172.21.15.6:0/3810675830 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd250089b40 con 0x7fd2540a6f00 2023-07-21T07:34:50.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.117+0000 7fd258db3700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd23806ace0 0x7fd23806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.117+0000 7fd258db3700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd23806ace0 0x7fd23806d1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd2540ac5b0 tx=0x7fd244009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:50.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.121+0000 7fd249ffb700 1 -- 172.21.15.6:0/3810675830 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd250054ca0 con 0x7fd2540a6f00 2023-07-21T07:34:50.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.315+0000 7fd25b818700 1 -- 172.21.15.6:0/3810675830 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2540c66a0 con 0x7fd23806ace0 2023-07-21T07:34:50.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.323+0000 7fd249ffb700 1 -- 172.21.15.6:0/3810675830 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286687 (secure 0 0 0) 0x7fd244019070 con 0x7fd23806ace0 2023-07-21T07:34:50.378 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:50.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.327+0000 7fd25b818700 1 -- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd23806ace0 msgr2=0x7fd23806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.327+0000 7fd25b818700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd23806ace0 0x7fd23806d1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd2540ac5b0 tx=0x7fd244009210 comp rx=0 tx=0).stop 2023-07-21T07:34:50.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.327+0000 7fd25b818700 1 -- 172.21.15.6:0/3810675830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2540a6f00 msgr2=0x7fd2541e5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.327+0000 7fd25b818700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2540a6f00 0x7fd2541e5830 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd250011ad0 tx=0x7fd250011de0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.327+0000 7fd25b818700 1 -- 172.21.15.6:0/3810675830 shutdown_connections 2023-07-21T07:34:50.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.327+0000 7fd25b818700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd23806ace0 0x7fd23806d1a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.327+0000 7fd25b818700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2540a9960 0x7fd2541e2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.327+0000 7fd25b818700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2540a6f00 0x7fd2541e5830 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.327+0000 7fd25b818700 1 --2- 172.21.15.6:0/3810675830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2541e99b0 0x7fd2541e5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.327+0000 7fd25b818700 1 -- 172.21.15.6:0/3810675830 >> 172.21.15.6:0/3810675830 conn(0x7fd2540a8660 msgr2=0x7fd2540c5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.327+0000 7fd25b818700 1 -- 172.21.15.6:0/3810675830 shutdown_connections 2023-07-21T07:34:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.327+0000 7fd25b818700 1 -- 172.21.15.6:0/3810675830 wait complete. 2023-07-21T07:34:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:34:50.390 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-21T07:34:48.692993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219408,"kb_used_data":3208,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755312,"statfs":{"total":773094113280,"available":772869439488,"internally_reserved":0,"allocated":3284992,"data_stored":1939620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001944"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988299+0000","last_change":"2023-07-21T07:34:41.013800+0000","last_active":"2023-07-21T07:34:41.988299+0000","last_peered":"2023-07-21T07:34:41.988299+0000","last_clean":"2023-07-21T07:34:41.988299+0000","last_became_active":"2023-07-21T07:34:41.013492+0000","last_became_peered":"2023-07-21T07:34:41.013492+0000","last_unstale":"2023-07-21T07:34:41.988299+0000","last_undegraded":"2023-07-21T07:34:41.988299+0000","last_fullsized":"2023-07-21T07:34:41.988299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:38.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711302+0000","last_change":"2023-07-21T07:34:40.994156+0000","last_active":"2023-07-21T07:34:43.711302+0000","last_peered":"2023-07-21T07:34:43.711302+0000","last_clean":"2023-07-21T07:34:43.711302+0000","last_became_active":"2023-07-21T07:34:40.993889+0000","last_became_peered":"2023-07-21T07:34:40.993889+0000","last_unstale":"2023-07-21T07:34:43.711302+0000","last_undegraded":"2023-07-21T07:34:43.711302+0000","last_fullsized":"2023-07-21T07:34:43.711302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:11:14.968095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992392+0000","last_change":"2023-07-21T07:34:41.003522+0000","last_active":"2023-07-21T07:34:41.992392+0000","last_peered":"2023-07-21T07:34:41.992392+0000","last_clean":"2023-07-21T07:34:41.992392+0000","last_became_active":"2023-07-21T07:34:41.003041+0000","last_became_peered":"2023-07-21T07:34:41.003041+0000","last_unstale":"2023-07-21T07:34:41.992392+0000","last_undegraded":"2023-07-21T07:34:41.992392+0000","last_fullsized":"2023-07-21T07:34:41.992392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:49.798268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991796+0000","last_change":"2023-07-21T07:34:41.005174+0000","last_active":"2023-07-21T07:34:41.991796+0000","last_peered":"2023-07-21T07:34:41.991796+0000","last_clean":"2023-07-21T07:34:41.991796+0000","last_became_active":"2023-07-21T07:34:41.004832+0000","last_became_peered":"2023-07-21T07:34:41.004832+0000","last_unstale":"2023-07-21T07:34:41.991796+0000","last_undegraded":"2023-07-21T07:34:41.991796+0000","last_fullsized":"2023-07-21T07:34:41.991796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:58:16.705923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252251+0000","last_change":"2023-07-21T07:34:41.011222+0000","last_active":"2023-07-21T07:34:42.252251+0000","last_peered":"2023-07-21T07:34:42.252251+0000","last_clean":"2023-07-21T07:34:42.252251+0000","last_became_active":"2023-07-21T07:34:41.010950+0000","last_became_peered":"2023-07-21T07:34:41.010950+0000","last_unstale":"2023-07-21T07:34:42.252251+0000","last_undegraded":"2023-07-21T07:34:42.252251+0000","last_fullsized":"2023-07-21T07:34:42.252251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:54:20.793513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992212+0000","last_change":"2023-07-21T07:34:41.004797+0000","last_active":"2023-07-21T07:34:41.992212+0000","last_peered":"2023-07-21T07:34:41.992212+0000","last_clean":"2023-07-21T07:34:41.992212+0000","last_became_active":"2023-07-21T07:34:41.004547+0000","last_became_peered":"2023-07-21T07:34:41.004547+0000","last_unstale":"2023-07-21T07:34:41.992212+0000","last_undegraded":"2023-07-21T07:34:41.992212+0000","last_fullsized":"2023-07-21T07:34:41.992212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739486+0000","last_change":"2023-07-21T07:34:41.010978+0000","last_active":"2023-07-21T07:34:43.739486+0000","last_peered":"2023-07-21T07:34:43.739486+0000","last_clean":"2023-07-21T07:34:43.739486+0000","last_became_active":"2023-07-21T07:34:41.010756+0000","last_became_peered":"2023-07-21T07:34:41.010756+0000","last_unstale":"2023-07-21T07:34:43.739486+0000","last_undegraded":"2023-07-21T07:34:43.739486+0000","last_fullsized":"2023-07-21T07:34:43.739486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:04:46.304259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.710934+0000","last_change":"2023-07-21T07:34:40.995907+0000","last_active":"2023-07-21T07:34:43.710934+0000","last_peered":"2023-07-21T07:34:43.710934+0000","last_clean":"2023-07-21T07:34:43.710934+0000","last_became_active":"2023-07-21T07:34:40.995624+0000","last_became_peered":"2023-07-21T07:34:40.995624+0000","last_unstale":"2023-07-21T07:34:43.710934+0000","last_undegraded":"2023-07-21T07:34:43.710934+0000","last_fullsized":"2023-07-21T07:34:43.710934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:42.606983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252562+0000","last_change":"2023-07-21T07:34:41.014976+0000","last_active":"2023-07-21T07:34:42.252562+0000","last_peered":"2023-07-21T07:34:42.252562+0000","last_clean":"2023-07-21T07:34:42.252562+0000","last_became_active":"2023-07-21T07:34:41.014683+0000","last_became_peered":"2023-07-21T07:34:41.014683+0000","last_unstale":"2023-07-21T07:34:42.252562+0000","last_undegraded":"2023-07-21T07:34:42.252562+0000","last_fullsized":"2023-07-21T07:34:42.252562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:53.769501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711488+0000","last_change":"2023-07-21T07:34:41.007114+0000","last_active":"2023-07-21T07:34:43.711488+0000","last_peered":"2023-07-21T07:34:43.711488+0000","last_clean":"2023-07-21T07:34:43.711488+0000","last_became_active":"2023-07-21T07:34:41.006839+0000","last_became_peered":"2023-07-21T07:34:41.006839+0000","last_unstale":"2023-07-21T07:34:43.711488+0000","last_undegraded":"2023-07-21T07:34:43.711488+0000","last_fullsized":"2023-07-21T07:34:43.711488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:47:28.206796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992571+0000","last_change":"2023-07-21T07:34:40.995650+0000","last_active":"2023-07-21T07:34:41.992571+0000","last_peered":"2023-07-21T07:34:41.992571+0000","last_clean":"2023-07-21T07:34:41.992571+0000","last_became_active":"2023-07-21T07:34:40.995387+0000","last_became_peered":"2023-07-21T07:34:40.995387+0000","last_unstale":"2023-07-21T07:34:41.992571+0000","last_undegraded":"2023-07-21T07:34:41.992571+0000","last_fullsized":"2023-07-21T07:34:41.992571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:25.315536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988206+0000","last_change":"2023-07-21T07:34:40.998318+0000","last_active":"2023-07-21T07:34:41.988206+0000","last_peered":"2023-07-21T07:34:41.988206+0000","last_clean":"2023-07-21T07:34:41.988206+0000","last_became_active":"2023-07-21T07:34:40.997993+0000","last_became_peered":"2023-07-21T07:34:40.997993+0000","last_unstale":"2023-07-21T07:34:41.988206+0000","last_undegraded":"2023-07-21T07:34:41.988206+0000","last_fullsized":"2023-07-21T07:34:41.988206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:16.791514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988109+0000","last_change":"2023-07-21T07:34:41.009290+0000","last_active":"2023-07-21T07:34:41.988109+0000","last_peered":"2023-07-21T07:34:41.988109+0000","last_clean":"2023-07-21T07:34:41.988109+0000","last_became_active":"2023-07-21T07:34:41.008979+0000","last_became_peered":"2023-07-21T07:34:41.008979+0000","last_unstale":"2023-07-21T07:34:41.988109+0000","last_undegraded":"2023-07-21T07:34:41.988109+0000","last_fullsized":"2023-07-21T07:34:41.988109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:28:11.312982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711020+0000","last_change":"2023-07-21T07:34:40.993283+0000","last_active":"2023-07-21T07:34:43.711020+0000","last_peered":"2023-07-21T07:34:43.711020+0000","last_clean":"2023-07-21T07:34:43.711020+0000","last_became_active":"2023-07-21T07:34:40.993023+0000","last_became_peered":"2023-07-21T07:34:40.993023+0000","last_unstale":"2023-07-21T07:34:43.711020+0000","last_undegraded":"2023-07-21T07:34:43.711020+0000","last_fullsized":"2023-07-21T07:34:43.711020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:49.798268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739578+0000","last_change":"2023-07-21T07:34:41.013555+0000","last_active":"2023-07-21T07:34:43.739578+0000","last_peered":"2023-07-21T07:34:43.739578+0000","last_clean":"2023-07-21T07:34:43.739578+0000","last_became_active":"2023-07-21T07:34:41.013237+0000","last_became_peered":"2023-07-21T07:34:41.013237+0000","last_unstale":"2023-07-21T07:34:43.739578+0000","last_undegraded":"2023-07-21T07:34:43.739578+0000","last_fullsized":"2023-07-21T07:34:43.739578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:06:12.274949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992133+0000","last_change":"2023-07-21T07:34:41.004335+0000","last_active":"2023-07-21T07:34:41.992133+0000","last_peered":"2023-07-21T07:34:41.992133+0000","last_clean":"2023-07-21T07:34:41.992133+0000","last_became_active":"2023-07-21T07:34:41.004051+0000","last_became_peered":"2023-07-21T07:34:41.004051+0000","last_unstale":"2023-07-21T07:34:41.992133+0000","last_undegraded":"2023-07-21T07:34:41.992133+0000","last_fullsized":"2023-07-21T07:34:41.992133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:13.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252673+0000","last_change":"2023-07-21T07:34:41.015026+0000","last_active":"2023-07-21T07:34:42.252673+0000","last_peered":"2023-07-21T07:34:42.252673+0000","last_clean":"2023-07-21T07:34:42.252673+0000","last_became_active":"2023-07-21T07:34:41.014710+0000","last_became_peered":"2023-07-21T07:34:41.014710+0000","last_unstale":"2023-07-21T07:34:42.252673+0000","last_undegraded":"2023-07-21T07:34:42.252673+0000","last_fullsized":"2023-07-21T07:34:42.252673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:22.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992073+0000","last_change":"2023-07-21T07:34:41.011628+0000","last_active":"2023-07-21T07:34:41.992073+0000","last_peered":"2023-07-21T07:34:41.992073+0000","last_clean":"2023-07-21T07:34:41.992073+0000","last_became_active":"2023-07-21T07:34:41.009074+0000","last_became_peered":"2023-07-21T07:34:41.009074+0000","last_unstale":"2023-07-21T07:34:41.992073+0000","last_undegraded":"2023-07-21T07:34:41.992073+0000","last_fullsized":"2023-07-21T07:34:41.992073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:06.735540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988155+0000","last_change":"2023-07-21T07:34:41.004665+0000","last_active":"2023-07-21T07:34:41.988155+0000","last_peered":"2023-07-21T07:34:41.988155+0000","last_clean":"2023-07-21T07:34:41.988155+0000","last_became_active":"2023-07-21T07:34:41.004361+0000","last_became_peered":"2023-07-21T07:34:41.004361+0000","last_unstale":"2023-07-21T07:34:41.988155+0000","last_undegraded":"2023-07-21T07:34:41.988155+0000","last_fullsized":"2023-07-21T07:34:41.988155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:10:00.672282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992656+0000","last_change":"2023-07-21T07:34:41.001444+0000","last_active":"2023-07-21T07:34:41.992656+0000","last_peered":"2023-07-21T07:34:41.992656+0000","last_clean":"2023-07-21T07:34:41.992656+0000","last_became_active":"2023-07-21T07:34:41.001171+0000","last_became_peered":"2023-07-21T07:34:41.001171+0000","last_unstale":"2023-07-21T07:34:41.992656+0000","last_undegraded":"2023-07-21T07:34:41.992656+0000","last_fullsized":"2023-07-21T07:34:41.992656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:11:14.968095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739546+0000","last_change":"2023-07-21T07:34:41.013317+0000","last_active":"2023-07-21T07:34:43.739546+0000","last_peered":"2023-07-21T07:34:43.739546+0000","last_clean":"2023-07-21T07:34:43.739546+0000","last_became_active":"2023-07-21T07:34:41.012800+0000","last_became_peered":"2023-07-21T07:34:41.012800+0000","last_unstale":"2023-07-21T07:34:43.739546+0000","last_undegraded":"2023-07-21T07:34:43.739546+0000","last_fullsized":"2023-07-21T07:34:43.739546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:47:28.206796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252426+0000","last_change":"2023-07-21T07:34:41.002953+0000","last_active":"2023-07-21T07:34:42.252426+0000","last_peered":"2023-07-21T07:34:42.252426+0000","last_clean":"2023-07-21T07:34:42.252426+0000","last_became_active":"2023-07-21T07:34:41.002569+0000","last_became_peered":"2023-07-21T07:34:41.002569+0000","last_unstale":"2023-07-21T07:34:42.252426+0000","last_undegraded":"2023-07-21T07:34:42.252426+0000","last_fullsized":"2023-07-21T07:34:42.252426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:37.840825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177317+0000","last_change":"2023-07-21T07:34:41.007432+0000","last_active":"2023-07-21T07:34:42.177317+0000","last_peered":"2023-07-21T07:34:42.177317+0000","last_clean":"2023-07-21T07:34:42.177317+0000","last_became_active":"2023-07-21T07:34:41.006964+0000","last_became_peered":"2023-07-21T07:34:41.006964+0000","last_unstale":"2023-07-21T07:34:42.177317+0000","last_undegraded":"2023-07-21T07:34:42.177317+0000","last_fullsized":"2023-07-21T07:34:42.177317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:22.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739330+0000","last_change":"2023-07-21T07:34:41.012722+0000","last_active":"2023-07-21T07:34:43.739330+0000","last_peered":"2023-07-21T07:34:43.739330+0000","last_clean":"2023-07-21T07:34:43.739330+0000","last_became_active":"2023-07-21T07:34:41.012304+0000","last_became_peered":"2023-07-21T07:34:41.012304+0000","last_unstale":"2023-07-21T07:34:43.739330+0000","last_undegraded":"2023-07-21T07:34:43.739330+0000","last_fullsized":"2023-07-21T07:34:43.739330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:11:14.968095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711938+0000","last_change":"2023-07-21T07:34:41.000784+0000","last_active":"2023-07-21T07:34:43.711938+0000","last_peered":"2023-07-21T07:34:43.711938+0000","last_clean":"2023-07-21T07:34:43.711938+0000","last_became_active":"2023-07-21T07:34:41.000488+0000","last_became_peered":"2023-07-21T07:34:41.000488+0000","last_unstale":"2023-07-21T07:34:43.711938+0000","last_undegraded":"2023-07-21T07:34:43.711938+0000","last_fullsized":"2023-07-21T07:34:43.711938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:22.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.712165+0000","last_change":"2023-07-21T07:34:41.006271+0000","last_active":"2023-07-21T07:34:43.712165+0000","last_peered":"2023-07-21T07:34:43.712165+0000","last_clean":"2023-07-21T07:34:43.712165+0000","last_became_active":"2023-07-21T07:34:41.005911+0000","last_became_peered":"2023-07-21T07:34:41.005911+0000","last_unstale":"2023-07-21T07:34:43.712165+0000","last_undegraded":"2023-07-21T07:34:43.712165+0000","last_fullsized":"2023-07-21T07:34:43.712165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:36.154510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711281+0000","last_change":"2023-07-21T07:34:41.014321+0000","last_active":"2023-07-21T07:34:43.711281+0000","last_peered":"2023-07-21T07:34:43.711281+0000","last_clean":"2023-07-21T07:34:43.711281+0000","last_became_active":"2023-07-21T07:34:41.013913+0000","last_became_peered":"2023-07-21T07:34:41.013913+0000","last_unstale":"2023-07-21T07:34:43.711281+0000","last_undegraded":"2023-07-21T07:34:43.711281+0000","last_fullsized":"2023-07-21T07:34:43.711281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:25.315536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992369+0000","last_change":"2023-07-21T07:34:40.006035+0000","last_active":"2023-07-21T07:34:41.992369+0000","last_peered":"2023-07-21T07:34:41.992369+0000","last_clean":"2023-07-21T07:34:41.992369+0000","last_became_active":"2023-07-21T07:34:40.005799+0000","last_became_peered":"2023-07-21T07:34:40.005799+0000","last_unstale":"2023-07-21T07:34:41.992369+0000","last_undegraded":"2023-07-21T07:34:41.992369+0000","last_fullsized":"2023-07-21T07:34:41.992369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:21.178454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177216+0000","last_change":"2023-07-21T07:34:41.007625+0000","last_active":"2023-07-21T07:34:42.177216+0000","last_peered":"2023-07-21T07:34:42.177216+0000","last_clean":"2023-07-21T07:34:42.177216+0000","last_became_active":"2023-07-21T07:34:41.006954+0000","last_became_peered":"2023-07-21T07:34:41.006954+0000","last_unstale":"2023-07-21T07:34:42.177216+0000","last_undegraded":"2023-07-21T07:34:42.177216+0000","last_fullsized":"2023-07-21T07:34:42.177216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:53.769501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711732+0000","last_change":"2023-07-21T07:34:40.006702+0000","last_active":"2023-07-21T07:34:43.711732+0000","last_peered":"2023-07-21T07:34:43.711732+0000","last_clean":"2023-07-21T07:34:43.711732+0000","last_became_active":"2023-07-21T07:34:40.006334+0000","last_became_peered":"2023-07-21T07:34:40.006334+0000","last_unstale":"2023-07-21T07:34:43.711732+0000","last_undegraded":"2023-07-21T07:34:43.711732+0000","last_fullsized":"2023-07-21T07:34:43.711732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:52.762722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252562+0000","last_change":"2023-07-21T07:34:41.013575+0000","last_active":"2023-07-21T07:34:42.252562+0000","last_peered":"2023-07-21T07:34:42.252562+0000","last_clean":"2023-07-21T07:34:42.252562+0000","last_became_active":"2023-07-21T07:34:41.013276+0000","last_became_peered":"2023-07-21T07:34:41.013276+0000","last_unstale":"2023-07-21T07:34:42.252562+0000","last_undegraded":"2023-07-21T07:34:42.252562+0000","last_fullsized":"2023-07-21T07:34:42.252562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177314+0000","last_change":"2023-07-21T07:34:40.004005+0000","last_active":"2023-07-21T07:34:42.177314+0000","last_peered":"2023-07-21T07:34:42.177314+0000","last_clean":"2023-07-21T07:34:42.177314+0000","last_became_active":"2023-07-21T07:34:40.003505+0000","last_became_peered":"2023-07-21T07:34:40.003505+0000","last_unstale":"2023-07-21T07:34:42.177314+0000","last_undegraded":"2023-07-21T07:34:42.177314+0000","last_fullsized":"2023-07-21T07:34:42.177314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:48.791489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992924+0000","last_change":"2023-07-21T07:34:41.004220+0000","last_active":"2023-07-21T07:34:41.992924+0000","last_peered":"2023-07-21T07:34:41.992924+0000","last_clean":"2023-07-21T07:34:41.992924+0000","last_became_active":"2023-07-21T07:34:41.003943+0000","last_became_peered":"2023-07-21T07:34:41.003943+0000","last_unstale":"2023-07-21T07:34:41.992924+0000","last_undegraded":"2023-07-21T07:34:41.992924+0000","last_fullsized":"2023-07-21T07:34:41.992924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:49:24.373411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252659+0000","last_change":"2023-07-21T07:34:40.000884+0000","last_active":"2023-07-21T07:34:42.252659+0000","last_peered":"2023-07-21T07:34:42.252659+0000","last_clean":"2023-07-21T07:34:42.252659+0000","last_became_active":"2023-07-21T07:34:40.000548+0000","last_became_peered":"2023-07-21T07:34:40.000548+0000","last_unstale":"2023-07-21T07:34:42.252659+0000","last_undegraded":"2023-07-21T07:34:42.252659+0000","last_fullsized":"2023-07-21T07:34:42.252659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:41.600204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177198+0000","last_change":"2023-07-21T07:34:41.008668+0000","last_active":"2023-07-21T07:34:42.177198+0000","last_peered":"2023-07-21T07:34:42.177198+0000","last_clean":"2023-07-21T07:34:42.177198+0000","last_became_active":"2023-07-21T07:34:41.008309+0000","last_became_peered":"2023-07-21T07:34:41.008309+0000","last_unstale":"2023-07-21T07:34:42.177198+0000","last_undegraded":"2023-07-21T07:34:42.177198+0000","last_fullsized":"2023-07-21T07:34:42.177198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711321+0000","last_change":"2023-07-21T07:34:40.000039+0000","last_active":"2023-07-21T07:34:43.711321+0000","last_peered":"2023-07-21T07:34:43.711321+0000","last_clean":"2023-07-21T07:34:43.711321+0000","last_became_active":"2023-07-21T07:34:39.999675+0000","last_became_peered":"2023-07-21T07:34:39.999675+0000","last_unstale":"2023-07-21T07:34:43.711321+0000","last_undegraded":"2023-07-21T07:34:43.711321+0000","last_fullsized":"2023-07-21T07:34:43.711321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:12:06.504533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177225+0000","last_change":"2023-07-21T07:34:41.015126+0000","last_active":"2023-07-21T07:34:42.177225+0000","last_peered":"2023-07-21T07:34:42.177225+0000","last_clean":"2023-07-21T07:34:42.177225+0000","last_became_active":"2023-07-21T07:34:41.014280+0000","last_became_peered":"2023-07-21T07:34:41.014280+0000","last_unstale":"2023-07-21T07:34:42.177225+0000","last_undegraded":"2023-07-21T07:34:42.177225+0000","last_fullsized":"2023-07-21T07:34:42.177225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:06.140274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739671+0000","last_change":"2023-07-21T07:34:40.006892+0000","last_active":"2023-07-21T07:34:43.739671+0000","last_peered":"2023-07-21T07:34:43.739671+0000","last_clean":"2023-07-21T07:34:43.739671+0000","last_became_active":"2023-07-21T07:34:40.006547+0000","last_became_peered":"2023-07-21T07:34:40.006547+0000","last_unstale":"2023-07-21T07:34:43.739671+0000","last_undegraded":"2023-07-21T07:34:43.739671+0000","last_fullsized":"2023-07-21T07:34:43.739671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:11:03.929122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711612+0000","last_change":"2023-07-21T07:34:41.005138+0000","last_active":"2023-07-21T07:34:43.711612+0000","last_peered":"2023-07-21T07:34:43.711612+0000","last_clean":"2023-07-21T07:34:43.711612+0000","last_became_active":"2023-07-21T07:34:41.004836+0000","last_became_peered":"2023-07-21T07:34:41.004836+0000","last_unstale":"2023-07-21T07:34:43.711612+0000","last_undegraded":"2023-07-21T07:34:43.711612+0000","last_fullsized":"2023-07-21T07:34:43.711612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:37.210979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992847+0000","last_change":"2023-07-21T07:34:40.001177+0000","last_active":"2023-07-21T07:34:41.992847+0000","last_peered":"2023-07-21T07:34:41.992847+0000","last_clean":"2023-07-21T07:34:41.992847+0000","last_became_active":"2023-07-21T07:34:40.000899+0000","last_became_peered":"2023-07-21T07:34:40.000899+0000","last_unstale":"2023-07-21T07:34:41.992847+0000","last_undegraded":"2023-07-21T07:34:41.992847+0000","last_fullsized":"2023-07-21T07:34:41.992847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:47:27.200017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992726+0000","last_change":"2023-07-21T07:34:41.003585+0000","last_active":"2023-07-21T07:34:41.992726+0000","last_peered":"2023-07-21T07:34:41.992726+0000","last_clean":"2023-07-21T07:34:41.992726+0000","last_became_active":"2023-07-21T07:34:41.003302+0000","last_became_peered":"2023-07-21T07:34:41.003302+0000","last_unstale":"2023-07-21T07:34:41.992726+0000","last_undegraded":"2023-07-21T07:34:41.992726+0000","last_fullsized":"2023-07-21T07:34:41.992726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:12:07.511312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739571+0000","last_change":"2023-07-21T07:34:40.003432+0000","last_active":"2023-07-21T07:34:43.739571+0000","last_peered":"2023-07-21T07:34:43.739571+0000","last_clean":"2023-07-21T07:34:43.739571+0000","last_became_active":"2023-07-21T07:34:40.003161+0000","last_became_peered":"2023-07-21T07:34:40.003161+0000","last_unstale":"2023-07-21T07:34:43.739571+0000","last_undegraded":"2023-07-21T07:34:43.739571+0000","last_fullsized":"2023-07-21T07:34:43.739571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:22:44.051293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177120+0000","last_change":"2023-07-21T07:34:41.009600+0000","last_active":"2023-07-21T07:34:42.177120+0000","last_peered":"2023-07-21T07:34:42.177120+0000","last_clean":"2023-07-21T07:34:42.177120+0000","last_became_active":"2023-07-21T07:34:41.008310+0000","last_became_peered":"2023-07-21T07:34:41.008310+0000","last_unstale":"2023-07-21T07:34:42.177120+0000","last_undegraded":"2023-07-21T07:34:42.177120+0000","last_fullsized":"2023-07-21T07:34:42.177120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:06.735540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252286+0000","last_change":"2023-07-21T07:34:40.002086+0000","last_active":"2023-07-21T07:34:42.252286+0000","last_peered":"2023-07-21T07:34:42.252286+0000","last_clean":"2023-07-21T07:34:42.252286+0000","last_became_active":"2023-07-21T07:34:40.001728+0000","last_became_peered":"2023-07-21T07:34:40.001728+0000","last_unstale":"2023-07-21T07:34:42.252286+0000","last_undegraded":"2023-07-21T07:34:42.252286+0000","last_fullsized":"2023-07-21T07:34:42.252286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:10.302016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711408+0000","last_change":"2023-07-21T07:34:41.014135+0000","last_active":"2023-07-21T07:34:43.711408+0000","last_peered":"2023-07-21T07:34:43.711408+0000","last_clean":"2023-07-21T07:34:43.711408+0000","last_became_active":"2023-07-21T07:34:41.013571+0000","last_became_peered":"2023-07-21T07:34:41.013571+0000","last_unstale":"2023-07-21T07:34:43.711408+0000","last_undegraded":"2023-07-21T07:34:43.711408+0000","last_fullsized":"2023-07-21T07:34:43.711408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:01:35.460233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739372+0000","last_change":"2023-07-21T07:34:40.005154+0000","last_active":"2023-07-21T07:34:43.739372+0000","last_peered":"2023-07-21T07:34:43.739372+0000","last_clean":"2023-07-21T07:34:43.739372+0000","last_became_active":"2023-07-21T07:34:40.004855+0000","last_became_peered":"2023-07-21T07:34:40.004855+0000","last_unstale":"2023-07-21T07:34:43.739372+0000","last_undegraded":"2023-07-21T07:34:43.739372+0000","last_fullsized":"2023-07-21T07:34:43.739372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:12:06.504533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252521+0000","last_change":"2023-07-21T07:34:41.010402+0000","last_active":"2023-07-21T07:34:42.252521+0000","last_peered":"2023-07-21T07:34:42.252521+0000","last_clean":"2023-07-21T07:34:42.252521+0000","last_became_active":"2023-07-21T07:34:41.010083+0000","last_became_peered":"2023-07-21T07:34:41.010083+0000","last_unstale":"2023-07-21T07:34:42.252521+0000","last_undegraded":"2023-07-21T07:34:42.252521+0000","last_fullsized":"2023-07-21T07:34:42.252521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:13.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991555+0000","last_change":"2023-07-21T07:34:40.001486+0000","last_active":"2023-07-21T07:34:41.991555+0000","last_peered":"2023-07-21T07:34:41.991555+0000","last_clean":"2023-07-21T07:34:41.991555+0000","last_became_active":"2023-07-21T07:34:40.001171+0000","last_became_peered":"2023-07-21T07:34:40.001171+0000","last_unstale":"2023-07-21T07:34:41.991555+0000","last_undegraded":"2023-07-21T07:34:41.991555+0000","last_fullsized":"2023-07-21T07:34:41.991555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:15.784735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177469+0000","last_change":"2023-07-21T07:34:41.015334+0000","last_active":"2023-07-21T07:34:42.177469+0000","last_peered":"2023-07-21T07:34:42.177469+0000","last_clean":"2023-07-21T07:34:42.177469+0000","last_became_active":"2023-07-21T07:34:41.014579+0000","last_became_peered":"2023-07-21T07:34:41.014579+0000","last_unstale":"2023-07-21T07:34:42.177469+0000","last_undegraded":"2023-07-21T07:34:42.177469+0000","last_fullsized":"2023-07-21T07:34:42.177469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:36.154510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739995+0000","last_change":"2023-07-21T07:34:40.002994+0000","last_active":"2023-07-21T07:34:43.739995+0000","last_peered":"2023-07-21T07:34:43.739995+0000","last_clean":"2023-07-21T07:34:43.739995+0000","last_became_active":"2023-07-21T07:34:40.002626+0000","last_became_peered":"2023-07-21T07:34:40.002626+0000","last_unstale":"2023-07-21T07:34:43.739995+0000","last_undegraded":"2023-07-21T07:34:43.739995+0000","last_fullsized":"2023-07-21T07:34:43.739995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:00:09.282694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.710969+0000","last_change":"2023-07-21T07:34:41.011397+0000","last_active":"2023-07-21T07:34:43.710969+0000","last_peered":"2023-07-21T07:34:43.710969+0000","last_clean":"2023-07-21T07:34:43.710969+0000","last_became_active":"2023-07-21T07:34:41.011074+0000","last_became_peered":"2023-07-21T07:34:41.011074+0000","last_unstale":"2023-07-21T07:34:43.710969+0000","last_undegraded":"2023-07-21T07:34:43.710969+0000","last_fullsized":"2023-07-21T07:34:43.710969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:17:22.185233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739866+0000","last_change":"2023-07-21T07:34:40.002951+0000","last_active":"2023-07-21T07:34:43.739866+0000","last_peered":"2023-07-21T07:34:43.739866+0000","last_clean":"2023-07-21T07:34:43.739866+0000","last_became_active":"2023-07-21T07:34:40.002644+0000","last_became_peered":"2023-07-21T07:34:40.002644+0000","last_unstale":"2023-07-21T07:34:43.739866+0000","last_undegraded":"2023-07-21T07:34:43.739866+0000","last_fullsized":"2023-07-21T07:34:43.739866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:11:07.596057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991994+0000","last_change":"2023-07-21T07:34:40.999968+0000","last_active":"2023-07-21T07:34:41.991994+0000","last_peered":"2023-07-21T07:34:41.991994+0000","last_clean":"2023-07-21T07:34:41.991994+0000","last_became_active":"2023-07-21T07:34:40.999426+0000","last_became_peered":"2023-07-21T07:34:40.999426+0000","last_unstale":"2023-07-21T07:34:41.991994+0000","last_undegraded":"2023-07-21T07:34:41.991994+0000","last_fullsized":"2023-07-21T07:34:41.991994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:37.840825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739806+0000","last_change":"2023-07-21T07:34:40.001121+0000","last_active":"2023-07-21T07:34:43.739806+0000","last_peered":"2023-07-21T07:34:43.739806+0000","last_clean":"2023-07-21T07:34:43.739806+0000","last_became_active":"2023-07-21T07:34:40.000781+0000","last_became_peered":"2023-07-21T07:34:40.000781+0000","last_unstale":"2023-07-21T07:34:43.739806+0000","last_undegraded":"2023-07-21T07:34:43.739806+0000","last_fullsized":"2023-07-21T07:34:43.739806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:45:11.389845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992005+0000","last_change":"2023-07-21T07:34:41.005148+0000","last_active":"2023-07-21T07:34:41.992005+0000","last_peered":"2023-07-21T07:34:41.992005+0000","last_clean":"2023-07-21T07:34:41.992005+0000","last_became_active":"2023-07-21T07:34:41.004857+0000","last_became_peered":"2023-07-21T07:34:41.004857+0000","last_unstale":"2023-07-21T07:34:41.992005+0000","last_undegraded":"2023-07-21T07:34:41.992005+0000","last_fullsized":"2023-07-21T07:34:41.992005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:23:03.521561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711155+0000","last_change":"2023-07-21T07:34:40.001134+0000","last_active":"2023-07-21T07:34:43.711155+0000","last_peered":"2023-07-21T07:34:43.711155+0000","last_clean":"2023-07-21T07:34:43.711155+0000","last_became_active":"2023-07-21T07:34:40.000862+0000","last_became_peered":"2023-07-21T07:34:40.000862+0000","last_unstale":"2023-07-21T07:34:43.711155+0000","last_undegraded":"2023-07-21T07:34:43.711155+0000","last_fullsized":"2023-07-21T07:34:43.711155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:35.147731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252524+0000","last_change":"2023-07-21T07:34:41.004129+0000","last_active":"2023-07-21T07:34:42.252524+0000","last_peered":"2023-07-21T07:34:42.252524+0000","last_clean":"2023-07-21T07:34:42.252524+0000","last_became_active":"2023-07-21T07:34:41.003528+0000","last_became_peered":"2023-07-21T07:34:41.003528+0000","last_unstale":"2023-07-21T07:34:42.252524+0000","last_undegraded":"2023-07-21T07:34:42.252524+0000","last_fullsized":"2023-07-21T07:34:42.252524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:37.210979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177185+0000","last_change":"2023-07-21T07:34:40.001941+0000","last_active":"2023-07-21T07:34:42.177185+0000","last_peered":"2023-07-21T07:34:42.177185+0000","last_clean":"2023-07-21T07:34:42.177185+0000","last_became_active":"2023-07-21T07:34:40.001558+0000","last_became_peered":"2023-07-21T07:34:40.001558+0000","last_unstale":"2023-07-21T07:34:42.177185+0000","last_undegraded":"2023-07-21T07:34:42.177185+0000","last_fullsized":"2023-07-21T07:34:42.177185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:36.204200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992762+0000","last_change":"2023-07-21T07:34:41.013224+0000","last_active":"2023-07-21T07:34:41.992762+0000","last_peered":"2023-07-21T07:34:41.992762+0000","last_clean":"2023-07-21T07:34:41.992762+0000","last_became_active":"2023-07-21T07:34:41.012940+0000","last_became_peered":"2023-07-21T07:34:41.012940+0000","last_unstale":"2023-07-21T07:34:41.992762+0000","last_undegraded":"2023-07-21T07:34:41.992762+0000","last_fullsized":"2023-07-21T07:34:41.992762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:04:46.304259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991852+0000","last_change":"2023-07-21T07:34:39.998058+0000","last_active":"2023-07-21T07:34:41.991852+0000","last_peered":"2023-07-21T07:34:41.991852+0000","last_clean":"2023-07-21T07:34:41.991852+0000","last_became_active":"2023-07-21T07:34:39.997803+0000","last_became_peered":"2023-07-21T07:34:39.997803+0000","last_unstale":"2023-07-21T07:34:41.991852+0000","last_undegraded":"2023-07-21T07:34:41.991852+0000","last_fullsized":"2023-07-21T07:34:41.991852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:13:39.091695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992732+0000","last_change":"2023-07-21T07:34:41.009229+0000","last_active":"2023-07-21T07:34:41.992732+0000","last_peered":"2023-07-21T07:34:41.992732+0000","last_clean":"2023-07-21T07:34:41.992732+0000","last_became_active":"2023-07-21T07:34:41.004241+0000","last_became_peered":"2023-07-21T07:34:41.004241+0000","last_unstale":"2023-07-21T07:34:41.992732+0000","last_undegraded":"2023-07-21T07:34:41.992732+0000","last_fullsized":"2023-07-21T07:34:41.992732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:01:35.460233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992269+0000","last_change":"2023-07-21T07:34:39.997085+0000","last_active":"2023-07-21T07:34:41.992269+0000","last_peered":"2023-07-21T07:34:41.992269+0000","last_clean":"2023-07-21T07:34:41.992269+0000","last_became_active":"2023-07-21T07:34:39.996276+0000","last_became_peered":"2023-07-21T07:34:39.996276+0000","last_unstale":"2023-07-21T07:34:41.992269+0000","last_undegraded":"2023-07-21T07:34:41.992269+0000","last_fullsized":"2023-07-21T07:34:41.992269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:52.762722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992364+0000","last_change":"2023-07-21T07:34:41.008766+0000","last_active":"2023-07-21T07:34:41.992364+0000","last_peered":"2023-07-21T07:34:41.992364+0000","last_clean":"2023-07-21T07:34:41.992364+0000","last_became_active":"2023-07-21T07:34:41.005525+0000","last_became_peered":"2023-07-21T07:34:41.005525+0000","last_unstale":"2023-07-21T07:34:41.992364+0000","last_undegraded":"2023-07-21T07:34:41.992364+0000","last_fullsized":"2023-07-21T07:34:41.992364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:42.606983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177142+0000","last_change":"2023-07-21T07:34:40.000981+0000","last_active":"2023-07-21T07:34:42.177142+0000","last_peered":"2023-07-21T07:34:42.177142+0000","last_clean":"2023-07-21T07:34:42.177142+0000","last_became_active":"2023-07-21T07:34:40.000659+0000","last_became_peered":"2023-07-21T07:34:40.000659+0000","last_unstale":"2023-07-21T07:34:42.177142+0000","last_undegraded":"2023-07-21T07:34:42.177142+0000","last_fullsized":"2023-07-21T07:34:42.177142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:12.395122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.712023+0000","last_change":"2023-07-21T07:34:41.014435+0000","last_active":"2023-07-21T07:34:43.712023+0000","last_peered":"2023-07-21T07:34:43.712023+0000","last_clean":"2023-07-21T07:34:43.712023+0000","last_became_active":"2023-07-21T07:34:41.014124+0000","last_became_peered":"2023-07-21T07:34:41.014124+0000","last_unstale":"2023-07-21T07:34:43.712023+0000","last_undegraded":"2023-07-21T07:34:43.712023+0000","last_fullsized":"2023-07-21T07:34:43.712023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:22.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711399+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:34:43.711399+0000","last_peered":"2023-07-21T07:34:43.711399+0000","last_clean":"2023-07-21T07:34:43.711399+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:34:43.711399+0000","last_undegraded":"2023-07-21T07:34:43.711399+0000","last_fullsized":"2023-07-21T07:34:43.711399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:00.596624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711436+0000","last_change":"2023-07-21T07:34:40.002419+0000","last_active":"2023-07-21T07:34:43.711436+0000","last_peered":"2023-07-21T07:34:43.711436+0000","last_clean":"2023-07-21T07:34:43.711436+0000","last_became_active":"2023-07-21T07:34:40.001968+0000","last_became_peered":"2023-07-21T07:34:40.001968+0000","last_unstale":"2023-07-21T07:34:43.711436+0000","last_undegraded":"2023-07-21T07:34:43.711436+0000","last_fullsized":"2023-07-21T07:34:43.711436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:04:45.297480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711644+0000","last_change":"2023-07-21T07:34:40.993474+0000","last_active":"2023-07-21T07:34:43.711644+0000","last_peered":"2023-07-21T07:34:43.711644+0000","last_clean":"2023-07-21T07:34:43.711644+0000","last_became_active":"2023-07-21T07:34:40.993127+0000","last_became_peered":"2023-07-21T07:34:40.993127+0000","last_unstale":"2023-07-21T07:34:43.711644+0000","last_undegraded":"2023-07-21T07:34:43.711644+0000","last_fullsized":"2023-07-21T07:34:43.711644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:26:45.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711103+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:34:43.711103+0000","last_peered":"2023-07-21T07:34:43.711103+0000","last_clean":"2023-07-21T07:34:43.711103+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:34:43.711103+0000","last_undegraded":"2023-07-21T07:34:43.711103+0000","last_fullsized":"2023-07-21T07:34:43.711103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:46.565041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992570+0000","last_change":"2023-07-21T07:34:40.002541+0000","last_active":"2023-07-21T07:34:41.992570+0000","last_peered":"2023-07-21T07:34:41.992570+0000","last_clean":"2023-07-21T07:34:41.992570+0000","last_became_active":"2023-07-21T07:34:40.002244+0000","last_became_peered":"2023-07-21T07:34:40.002244+0000","last_unstale":"2023-07-21T07:34:41.992570+0000","last_undegraded":"2023-07-21T07:34:41.992570+0000","last_fullsized":"2023-07-21T07:34:41.992570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:35.147731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711907+0000","last_change":"2023-07-21T07:34:40.993583+0000","last_active":"2023-07-21T07:34:43.711907+0000","last_peered":"2023-07-21T07:34:43.711907+0000","last_clean":"2023-07-21T07:34:43.711907+0000","last_became_active":"2023-07-21T07:34:40.992984+0000","last_became_peered":"2023-07-21T07:34:40.992984+0000","last_unstale":"2023-07-21T07:34:43.711907+0000","last_undegraded":"2023-07-21T07:34:43.711907+0000","last_fullsized":"2023-07-21T07:34:43.711907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:42.606983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.987877+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:34:41.987877+0000","last_peered":"2023-07-21T07:34:41.987877+0000","last_clean":"2023-07-21T07:34:41.987877+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:34:41.987877+0000","last_undegraded":"2023-07-21T07:34:41.987877+0000","last_fullsized":"2023-07-21T07:34:41.987877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:52:05.194684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711490+0000","last_change":"2023-07-21T07:34:40.002203+0000","last_active":"2023-07-21T07:34:43.711490+0000","last_peered":"2023-07-21T07:34:43.711490+0000","last_clean":"2023-07-21T07:34:43.711490+0000","last_became_active":"2023-07-21T07:34:40.001222+0000","last_became_peered":"2023-07-21T07:34:40.001222+0000","last_unstale":"2023-07-21T07:34:43.711490+0000","last_undegraded":"2023-07-21T07:34:43.711490+0000","last_fullsized":"2023-07-21T07:34:43.711490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:48:12.395122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.712029+0000","last_change":"2023-07-21T07:34:40.994556+0000","last_active":"2023-07-21T07:34:43.712029+0000","last_peered":"2023-07-21T07:34:43.712029+0000","last_clean":"2023-07-21T07:34:43.712029+0000","last_became_active":"2023-07-21T07:34:40.994093+0000","last_became_peered":"2023-07-21T07:34:40.994093+0000","last_unstale":"2023-07-21T07:34:43.712029+0000","last_undegraded":"2023-07-21T07:34:43.712029+0000","last_fullsized":"2023-07-21T07:34:43.712029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:52.703957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.710864+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:34:43.710864+0000","last_peered":"2023-07-21T07:34:43.710864+0000","last_clean":"2023-07-21T07:34:43.710864+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:34:43.710864+0000","last_undegraded":"2023-07-21T07:34:43.710864+0000","last_fullsized":"2023-07-21T07:34:43.710864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:00.001359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739258+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:34:43.739258+0000","last_peered":"2023-07-21T07:34:43.739258+0000","last_clean":"2023-07-21T07:34:43.739258+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:34:43.739258+0000","last_undegraded":"2023-07-21T07:34:43.739258+0000","last_fullsized":"2023-07-21T07:34:43.739258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:14.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.176949+0000","last_change":"2023-07-21T07:34:39.999821+0000","last_active":"2023-07-21T07:34:42.176949+0000","last_peered":"2023-07-21T07:34:42.176949+0000","last_clean":"2023-07-21T07:34:42.176949+0000","last_became_active":"2023-07-21T07:34:39.999465+0000","last_became_peered":"2023-07-21T07:34:39.999465+0000","last_unstale":"2023-07-21T07:34:42.176949+0000","last_undegraded":"2023-07-21T07:34:42.176949+0000","last_fullsized":"2023-07-21T07:34:42.176949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:09.858244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992699+0000","last_change":"2023-07-21T07:34:41.002207+0000","last_active":"2023-07-21T07:34:41.992699+0000","last_peered":"2023-07-21T07:34:41.992699+0000","last_clean":"2023-07-21T07:34:41.992699+0000","last_became_active":"2023-07-21T07:34:41.001868+0000","last_became_peered":"2023-07-21T07:34:41.001868+0000","last_unstale":"2023-07-21T07:34:41.992699+0000","last_undegraded":"2023-07-21T07:34:41.992699+0000","last_fullsized":"2023-07-21T07:34:41.992699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:23:45.330390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739433+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:34:43.739433+0000","last_peered":"2023-07-21T07:34:43.739433+0000","last_clean":"2023-07-21T07:34:43.739433+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:34:43.739433+0000","last_undegraded":"2023-07-21T07:34:43.739433+0000","last_fullsized":"2023-07-21T07:34:43.739433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:01:29.321317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252218+0000","last_change":"2023-07-21T07:34:40.001692+0000","last_active":"2023-07-21T07:34:42.252218+0000","last_peered":"2023-07-21T07:34:42.252218+0000","last_clean":"2023-07-21T07:34:42.252218+0000","last_became_active":"2023-07-21T07:34:40.001345+0000","last_became_peered":"2023-07-21T07:34:40.001345+0000","last_unstale":"2023-07-21T07:34:42.252218+0000","last_undegraded":"2023-07-21T07:34:42.252218+0000","last_fullsized":"2023-07-21T07:34:42.252218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:05:53.987510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252678+0000","last_change":"2023-07-21T07:34:41.005653+0000","last_active":"2023-07-21T07:34:42.252678+0000","last_peered":"2023-07-21T07:34:42.252678+0000","last_clean":"2023-07-21T07:34:42.252678+0000","last_became_active":"2023-07-21T07:34:41.005291+0000","last_became_peered":"2023-07-21T07:34:41.005291+0000","last_unstale":"2023-07-21T07:34:42.252678+0000","last_undegraded":"2023-07-21T07:34:42.252678+0000","last_fullsized":"2023-07-21T07:34:42.252678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:49.798268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.739127+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:34:43.739127+0000","last_peered":"2023-07-21T07:34:43.739127+0000","last_clean":"2023-07-21T07:34:43.739127+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:34:43.739127+0000","last_undegraded":"2023-07-21T07:34:43.739127+0000","last_fullsized":"2023-07-21T07:34:43.739127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:30.015594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711977+0000","last_change":"2023-07-21T07:34:40.005160+0000","last_active":"2023-07-21T07:34:43.711977+0000","last_peered":"2023-07-21T07:34:43.711977+0000","last_clean":"2023-07-21T07:34:43.711977+0000","last_became_active":"2023-07-21T07:34:40.004876+0000","last_became_peered":"2023-07-21T07:34:40.004876+0000","last_unstale":"2023-07-21T07:34:43.711977+0000","last_undegraded":"2023-07-21T07:34:43.711977+0000","last_fullsized":"2023-07-21T07:34:43.711977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:42:48.791489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252272+0000","last_change":"2023-07-21T07:34:41.004325+0000","last_active":"2023-07-21T07:34:42.252272+0000","last_peered":"2023-07-21T07:34:42.252272+0000","last_clean":"2023-07-21T07:34:42.252272+0000","last_became_active":"2023-07-21T07:34:41.003810+0000","last_became_peered":"2023-07-21T07:34:41.003810+0000","last_unstale":"2023-07-21T07:34:42.252272+0000","last_undegraded":"2023-07-21T07:34:42.252272+0000","last_fullsized":"2023-07-21T07:34:42.252272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:10.865023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177420+0000","last_change":"2023-07-21T07:34:40.003127+0000","last_active":"2023-07-21T07:34:42.177420+0000","last_peered":"2023-07-21T07:34:42.177420+0000","last_clean":"2023-07-21T07:34:42.177420+0000","last_became_active":"2023-07-21T07:34:40.002749+0000","last_became_peered":"2023-07-21T07:34:40.002749+0000","last_unstale":"2023-07-21T07:34:42.177420+0000","last_undegraded":"2023-07-21T07:34:42.177420+0000","last_fullsized":"2023-07-21T07:34:42.177420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:51.697177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711393+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:34:43.711393+0000","last_peered":"2023-07-21T07:34:43.711393+0000","last_clean":"2023-07-21T07:34:43.711393+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:34:43.711393+0000","last_undegraded":"2023-07-21T07:34:43.711393+0000","last_fullsized":"2023-07-21T07:34:43.711393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:31.701910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177019+0000","last_change":"2023-07-21T07:34:41.013799+0000","last_active":"2023-07-21T07:34:42.177019+0000","last_peered":"2023-07-21T07:34:42.177019+0000","last_clean":"2023-07-21T07:34:42.177019+0000","last_became_active":"2023-07-21T07:34:41.013507+0000","last_became_peered":"2023-07-21T07:34:41.013507+0000","last_unstale":"2023-07-21T07:34:42.177019+0000","last_undegraded":"2023-07-21T07:34:42.177019+0000","last_fullsized":"2023-07-21T07:34:42.177019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:10:37.840825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992790+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:34:41.992790+0000","last_peered":"2023-07-21T07:34:41.992790+0000","last_clean":"2023-07-21T07:34:41.992790+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:34:41.992790+0000","last_undegraded":"2023-07-21T07:34:41.992790+0000","last_fullsized":"2023-07-21T07:34:41.992790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:19:33.625591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.718589+0000","last_change":"2023-07-21T07:34:40.008949+0000","last_active":"2023-07-21T07:34:42.718589+0000","last_peered":"2023-07-21T07:34:42.718589+0000","last_clean":"2023-07-21T07:34:42.718589+0000","last_became_active":"2023-07-21T07:34:40.008673+0000","last_became_peered":"2023-07-21T07:34:40.008673+0000","last_unstale":"2023-07-21T07:34:42.718589+0000","last_undegraded":"2023-07-21T07:34:42.718589+0000","last_fullsized":"2023-07-21T07:34:42.718589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:05.133495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992135+0000","last_change":"2023-07-21T07:34:41.000146+0000","last_active":"2023-07-21T07:34:41.992135+0000","last_peered":"2023-07-21T07:34:41.992135+0000","last_clean":"2023-07-21T07:34:41.992135+0000","last_became_active":"2023-07-21T07:34:40.999714+0000","last_became_peered":"2023-07-21T07:34:40.999714+0000","last_unstale":"2023-07-21T07:34:41.992135+0000","last_undegraded":"2023-07-21T07:34:41.992135+0000","last_fullsized":"2023-07-21T07:34:41.992135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:02:37.210979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252474+0000","last_change":"2023-07-21T07:34:40.008365+0000","last_active":"2023-07-21T07:34:42.252474+0000","last_peered":"2023-07-21T07:34:42.252474+0000","last_clean":"2023-07-21T07:34:42.252474+0000","last_became_active":"2023-07-21T07:34:40.007918+0000","last_became_peered":"2023-07-21T07:34:40.007918+0000","last_unstale":"2023-07-21T07:34:42.252474+0000","last_undegraded":"2023-07-21T07:34:42.252474+0000","last_fullsized":"2023-07-21T07:34:42.252474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:05.728761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.988078+0000","last_change":"2023-07-21T07:34:41.004151+0000","last_active":"2023-07-21T07:34:41.988078+0000","last_peered":"2023-07-21T07:34:41.988078+0000","last_clean":"2023-07-21T07:34:41.988078+0000","last_became_active":"2023-07-21T07:34:41.003809+0000","last_became_peered":"2023-07-21T07:34:41.003809+0000","last_unstale":"2023-07-21T07:34:41.988078+0000","last_undegraded":"2023-07-21T07:34:41.988078+0000","last_fullsized":"2023-07-21T07:34:41.988078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:13:50.121515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711103+0000","last_change":"2023-07-21T07:34:39.999418+0000","last_active":"2023-07-21T07:34:43.711103+0000","last_peered":"2023-07-21T07:34:43.711103+0000","last_clean":"2023-07-21T07:34:43.711103+0000","last_became_active":"2023-07-21T07:34:39.999189+0000","last_became_peered":"2023-07-21T07:34:39.999189+0000","last_unstale":"2023-07-21T07:34:43.711103+0000","last_undegraded":"2023-07-21T07:34:43.711103+0000","last_fullsized":"2023-07-21T07:34:43.711103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:21.952698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992547+0000","last_change":"2023-07-21T07:34:41.012402+0000","last_active":"2023-07-21T07:34:41.992547+0000","last_peered":"2023-07-21T07:34:41.992547+0000","last_clean":"2023-07-21T07:34:41.992547+0000","last_became_active":"2023-07-21T07:34:41.012138+0000","last_became_peered":"2023-07-21T07:34:41.012138+0000","last_unstale":"2023-07-21T07:34:41.992547+0000","last_undegraded":"2023-07-21T07:34:41.992547+0000","last_fullsized":"2023-07-21T07:34:41.992547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:22.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711543+0000","last_change":"2023-07-21T07:34:39.999316+0000","last_active":"2023-07-21T07:34:43.711543+0000","last_peered":"2023-07-21T07:34:43.711543+0000","last_clean":"2023-07-21T07:34:43.711543+0000","last_became_active":"2023-07-21T07:34:39.999072+0000","last_became_peered":"2023-07-21T07:34:39.999072+0000","last_unstale":"2023-07-21T07:34:43.711543+0000","last_undegraded":"2023-07-21T07:34:43.711543+0000","last_fullsized":"2023-07-21T07:34:43.711543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:06:11.268170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992553+0000","last_change":"2023-07-21T07:34:41.012360+0000","last_active":"2023-07-21T07:34:41.992553+0000","last_peered":"2023-07-21T07:34:41.992553+0000","last_clean":"2023-07-21T07:34:41.992553+0000","last_became_active":"2023-07-21T07:34:41.011969+0000","last_became_peered":"2023-07-21T07:34:41.011969+0000","last_unstale":"2023-07-21T07:34:41.992553+0000","last_undegraded":"2023-07-21T07:34:41.992553+0000","last_fullsized":"2023-07-21T07:34:41.992553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:52.703957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177280+0000","last_change":"2023-07-21T07:34:40.000613+0000","last_active":"2023-07-21T07:34:42.177280+0000","last_peered":"2023-07-21T07:34:42.177280+0000","last_clean":"2023-07-21T07:34:42.177280+0000","last_became_active":"2023-07-21T07:34:40.000306+0000","last_became_peered":"2023-07-21T07:34:40.000306+0000","last_unstale":"2023-07-21T07:34:42.177280+0000","last_undegraded":"2023-07-21T07:34:42.177280+0000","last_fullsized":"2023-07-21T07:34:42.177280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:41.600204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.176982+0000","last_change":"2023-07-21T07:34:41.011382+0000","last_active":"2023-07-21T07:34:42.176982+0000","last_peered":"2023-07-21T07:34:42.176982+0000","last_clean":"2023-07-21T07:34:42.176982+0000","last_became_active":"2023-07-21T07:34:41.010734+0000","last_became_peered":"2023-07-21T07:34:41.010734+0000","last_unstale":"2023-07-21T07:34:42.176982+0000","last_undegraded":"2023-07-21T07:34:42.176982+0000","last_fullsized":"2023-07-21T07:34:42.176982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:11.308795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.252733+0000","last_change":"2023-07-21T07:34:40.000848+0000","last_active":"2023-07-21T07:34:42.252733+0000","last_peered":"2023-07-21T07:34:42.252733+0000","last_clean":"2023-07-21T07:34:42.252733+0000","last_became_active":"2023-07-21T07:34:40.000505+0000","last_became_peered":"2023-07-21T07:34:40.000505+0000","last_unstale":"2023-07-21T07:34:42.252733+0000","last_undegraded":"2023-07-21T07:34:42.252733+0000","last_fullsized":"2023-07-21T07:34:42.252733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:38.970019+0000","last_clean_scrub_stamp":"2023-07-21T07:34:38.970019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:21.952698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992223+0000","last_change":"2023-07-21T07:34:41.000904+0000","last_active":"2023-07-21T07:34:41.992223+0000","last_peered":"2023-07-21T07:34:41.992223+0000","last_clean":"2023-07-21T07:34:41.992223+0000","last_became_active":"2023-07-21T07:34:41.000652+0000","last_became_peered":"2023-07-21T07:34:41.000652+0000","last_unstale":"2023-07-21T07:34:41.992223+0000","last_undegraded":"2023-07-21T07:34:41.992223+0000","last_fullsized":"2023-07-21T07:34:41.992223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:39:11.308795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.991630+0000","last_change":"2023-07-21T07:34:41.007386+0000","last_active":"2023-07-21T07:34:41.991630+0000","last_peered":"2023-07-21T07:34:41.991630+0000","last_clean":"2023-07-21T07:34:41.991630+0000","last_became_active":"2023-07-21T07:34:41.007132+0000","last_became_peered":"2023-07-21T07:34:41.007132+0000","last_unstale":"2023-07-21T07:34:41.991630+0000","last_undegraded":"2023-07-21T07:34:41.991630+0000","last_fullsized":"2023-07-21T07:34:41.991630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:38.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.176926+0000","last_change":"2023-07-21T07:34:41.011588+0000","last_active":"2023-07-21T07:34:42.176926+0000","last_peered":"2023-07-21T07:34:42.176926+0000","last_clean":"2023-07-21T07:34:42.176926+0000","last_became_active":"2023-07-21T07:34:41.011068+0000","last_became_peered":"2023-07-21T07:34:41.011068+0000","last_unstale":"2023-07-21T07:34:42.176926+0000","last_undegraded":"2023-07-21T07:34:42.176926+0000","last_fullsized":"2023-07-21T07:34:42.176926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:54:20.793513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:41.992299+0000","last_change":"2023-07-21T07:34:41.009302+0000","last_active":"2023-07-21T07:34:41.992299+0000","last_peered":"2023-07-21T07:34:41.992299+0000","last_clean":"2023-07-21T07:34:41.992299+0000","last_became_active":"2023-07-21T07:34:41.008833+0000","last_became_peered":"2023-07-21T07:34:41.008833+0000","last_unstale":"2023-07-21T07:34:41.992299+0000","last_undegraded":"2023-07-21T07:34:41.992299+0000","last_fullsized":"2023-07-21T07:34:41.992299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:06.140274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:42.177335+0000","last_change":"2023-07-21T07:34:41.016235+0000","last_active":"2023-07-21T07:34:42.177335+0000","last_peered":"2023-07-21T07:34:42.177335+0000","last_clean":"2023-07-21T07:34:42.177335+0000","last_became_active":"2023-07-21T07:34:41.015889+0000","last_became_peered":"2023-07-21T07:34:41.015889+0000","last_unstale":"2023-07-21T07:34:42.177335+0000","last_undegraded":"2023-07-21T07:34:42.177335+0000","last_fullsized":"2023-07-21T07:34:42.177335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:52:22.959477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T07:34:43.711838+0000","last_change":"2023-07-21T07:34:40.999714+0000","last_active":"2023-07-21T07:34:43.711838+0000","last_peered":"2023-07-21T07:34:43.711838+0000","last_clean":"2023-07-21T07:34:43.711838+0000","last_became_active":"2023-07-21T07:34:40.999382+0000","last_became_peered":"2023-07-21T07:34:40.999382+0000","last_unstale":"2023-07-21T07:34:43.711838+0000","last_undegraded":"2023-07-21T07:34:43.711838+0000","last_fullsized":"2023-07-21T07:34:43.711838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:39.976798+0000","last_clean_scrub_stamp":"2023-07-21T07:34:39.976798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:06.140274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.4990000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":685220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6819999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.18}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1019999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3380000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":94922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:34:50.396 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-21T07:34:50.397 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-21T07:34:50.397 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-21T07:34:50.397 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-21T07:34:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.502+0000 7f8e56c05700 1 Processor -- start 2023-07-21T07:34:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.502+0000 7f8e56c05700 1 -- start start 2023-07-21T07:34:50.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.503+0000 7f8e56c05700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8e500a5f00 0x7f8e5014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.503+0000 7f8e56c05700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e500c4ef0 con 0x7f8e500c4930 2023-07-21T07:34:50.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.503+0000 7f8e56c05700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e500c1450 con 0x7f8e5014e870 2023-07-21T07:34:50.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.503+0000 7f8e56c05700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e500c1df0 con 0x7f8e500a5f00 2023-07-21T07:34:50.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.503+0000 7f8e551a2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8e500c4930 0x7f8e50151330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40890/0 (socket says 172.21.15.6:40890) 2023-07-21T07:34:50.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.503+0000 7f8e551a2700 1 -- 172.21.15.6:0/2568318670 learned_addr learned my addr 172.21.15.6:0/2568318670 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:50.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.503+0000 7f8e4ffff700 1 --2- 172.21.15.6:0/2568318670 >> v2:172.21.15.86:3300/0 conn(0x7f8e500a5f00 0x7f8e5014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.503+0000 7f8e4f7fe700 1 -- 172.21.15.6:0/2568318670 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223064439 0 0) 0x7f8e500c4ef0 con 0x7f8e500c4930 2023-07-21T07:34:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.503+0000 7f8e4f7fe700 1 -- 172.21.15.6:0/2568318670 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e400035b0 con 0x7f8e500c4930 2023-07-21T07:34:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.504+0000 7f8e4f7fe700 1 -- 172.21.15.6:0/2568318670 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1556070815 0 0) 0x7f8e400035b0 con 0x7f8e500c4930 2023-07-21T07:34:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.504+0000 7f8e4ffff700 1 -- 172.21.15.6:0/2568318670 >> v1:172.21.15.86:6789/0 conn(0x7f8e5014e870 legacy=0x7f8e500c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.504+0000 7f8e4ffff700 1 -- 172.21.15.6:0/2568318670 >> v1:172.21.15.6:6789/0 conn(0x7f8e500c4930 legacy=0x7f8e50151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.504+0000 7f8e4ffff700 1 -- 172.21.15.6:0/2568318670 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e500c1730 con 0x7f8e500a5f00 2023-07-21T07:34:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.504+0000 7f8e4ffff700 1 --2- 172.21.15.6:0/2568318670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e500a5f00 0x7f8e5014ec50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009840 tx=0x7f8e3c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67315630935f6d9d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:50.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.504+0000 7f8e4f7fe700 1 -- 172.21.15.6:0/2568318670 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480019f0 con 0x7f8e500a5f00 2023-07-21T07:34:50.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.504+0000 7f8e4f7fe700 1 -- 172.21.15.6:0/2568318670 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c004030 con 0x7f8e500a5f00 2023-07-21T07:34:50.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.504+0000 7f8e4f7fe700 1 -- 172.21.15.6:0/2568318670 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c0043c0 con 0x7f8e500a5f00 2023-07-21T07:34:50.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.504+0000 7f8e56c05700 1 -- 172.21.15.6:0/2568318670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e500a5f00 msgr2=0x7f8e5014ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.504+0000 7f8e56c05700 1 --2- 172.21.15.6:0/2568318670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e500a5f00 0x7f8e5014ec50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009840 tx=0x7f8e3c009b50 comp rx=0 tx=0).stop 2023-07-21T07:34:50.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.504+0000 7f8e56c05700 1 -- 172.21.15.6:0/2568318670 shutdown_connections 2023-07-21T07:34:50.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.504+0000 7f8e56c05700 1 --2- 172.21.15.6:0/2568318670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e500a5f00 0x7f8e5014ec50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.504+0000 7f8e56c05700 1 -- 172.21.15.6:0/2568318670 >> 172.21.15.6:0/2568318670 conn(0x7f8e500a8660 msgr2=0x7f8e500a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.505+0000 7f8e56c05700 1 -- 172.21.15.6:0/2568318670 shutdown_connections 2023-07-21T07:34:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.505+0000 7f8e56c05700 1 -- 172.21.15.6:0/2568318670 wait complete. 2023-07-21T07:34:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.506+0000 7f8e56c05700 1 Processor -- start 2023-07-21T07:34:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.506+0000 7f8e56c05700 1 -- start start 2023-07-21T07:34:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.506+0000 7f8e56c05700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e500a5f00 0x7f8e500a7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.506+0000 7f8e56c05700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e500c4930 0x7f8e500bfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.506+0000 7f8e56c05700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5014e870 0x7f8e500c0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.506+0000 7f8e56c05700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5014c9e0 con 0x7f8e5014e870 2023-07-21T07:34:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.506+0000 7f8e56c05700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e501ea4b0 con 0x7f8e500a5f00 2023-07-21T07:34:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.506+0000 7f8e56c05700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5014f240 con 0x7f8e500c4930 2023-07-21T07:34:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e551a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5014e870 0x7f8e500c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e551a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5014e870 0x7f8e500c0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32876/0 (socket says 172.21.15.6:32876) 2023-07-21T07:34:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e551a2700 1 -- 172.21.15.6:0/4033088663 learned_addr learned my addr 172.21.15.6:0/4033088663 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e549a1700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e500a5f00 0x7f8e500a7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e4ffff700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e500c4930 0x7f8e500bfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e551a2700 1 -- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e500c4930 msgr2=0x7f8e500bfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e551a2700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e500c4930 0x7f8e500bfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e551a2700 1 -- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e500a5f00 msgr2=0x7f8e500a7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e551a2700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e500a5f00 0x7f8e500a7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e551a2700 1 -- 172.21.15.6:0/4033088663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c0094a0 con 0x7f8e5014e870 2023-07-21T07:34:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e551a2700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5014e870 0x7f8e500c0150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800cc10 tx=0x7f8e4800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e4d7fa700 1 -- 172.21.15.6:0/4033088663 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800aa20 con 0x7f8e5014e870 2023-07-21T07:34:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e4d7fa700 1 -- 172.21.15.6:0/4033088663 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4800aba0 con 0x7f8e5014e870 2023-07-21T07:34:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e56c05700 1 -- 172.21.15.6:0/4033088663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e501509b0 con 0x7f8e5014e870 2023-07-21T07:34:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e4d7fa700 1 -- 172.21.15.6:0/4033088663 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480070d0 con 0x7f8e5014e870 2023-07-21T07:34:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.507+0000 7f8e56c05700 1 -- 172.21.15.6:0/4033088663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e500a78d0 con 0x7f8e5014e870 2023-07-21T07:34:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.508+0000 7f8e56c05700 1 -- 172.21.15.6:0/4033088663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5014f410 con 0x7f8e5014e870 2023-07-21T07:34:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.509+0000 7f8e4d7fa700 1 -- 172.21.15.6:0/4033088663 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e48007230 con 0x7f8e5014e870 2023-07-21T07:34:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.509+0000 7f8e4d7fa700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8e3406ace0 0x7f8e3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.509+0000 7f8e4d7fa700 1 -- 172.21.15.6:0/4033088663 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8e480891b0 con 0x7f8e5014e870 2023-07-21T07:34:50.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.509+0000 7f8e549a1700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8e3406ace0 0x7f8e3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.510+0000 7f8e549a1700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8e3406ace0 0x7f8e3406d1a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e44007fd0 tx=0x7f8e44009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:50.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.513+0000 7f8e4d7fa700 1 -- 172.21.15.6:0/4033088663 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8e5014f410 con 0x7f8e5014e870 2023-07-21T07:34:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.755+0000 7f8e56c05700 1 -- 172.21.15.6:0/4033088663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8e5014f410 con 0x7f8e5014e870 2023-07-21T07:34:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.755+0000 7f8e4d7fa700 1 -- 172.21.15.6:0/4033088663 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8e5014f410 con 0x7f8e5014e870 2023-07-21T07:34:50.808 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:50.808 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-21T07:34:50.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.757+0000 7f8e56c05700 1 -- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8e3406ace0 msgr2=0x7f8e3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.757+0000 7f8e56c05700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8e3406ace0 0x7f8e3406d1a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e44007fd0 tx=0x7f8e44009040 comp rx=0 tx=0).stop 2023-07-21T07:34:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.757+0000 7f8e56c05700 1 -- 172.21.15.6:0/4033088663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5014e870 msgr2=0x7f8e500c0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.757+0000 7f8e56c05700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5014e870 0x7f8e500c0150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800cc10 tx=0x7f8e4800cf20 comp rx=0 tx=0).stop 2023-07-21T07:34:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.758+0000 7f8e56c05700 1 -- 172.21.15.6:0/4033088663 shutdown_connections 2023-07-21T07:34:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.758+0000 7f8e56c05700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8e3406ace0 0x7f8e3406d1a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.758+0000 7f8e56c05700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5014e870 0x7f8e500c0150 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.758+0000 7f8e56c05700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e500a5f00 0x7f8e500a7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.758+0000 7f8e56c05700 1 --2- 172.21.15.6:0/4033088663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e500c4930 0x7f8e500bfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.758+0000 7f8e56c05700 1 -- 172.21.15.6:0/4033088663 >> 172.21.15.6:0/4033088663 conn(0x7f8e500a8660 msgr2=0x7f8e500a6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.758+0000 7f8e56c05700 1 -- 172.21.15.6:0/4033088663 shutdown_connections 2023-07-21T07:34:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.758+0000 7f8e56c05700 1 -- 172.21.15.6:0/4033088663 wait complete. 2023-07-21T07:34:50.821 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-21T07:34:50.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.894+0000 7f367ce91700 1 Processor -- start 2023-07-21T07:34:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.894+0000 7f367ce91700 1 -- start start 2023-07-21T07:34:50.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.895+0000 7f367ce91700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f367806da20 0x7f3678151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.895+0000 7f367ce91700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3678151c50 0x7f36780c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.895+0000 7f367ce91700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36780c2ab0 con 0x7f367806a300 2023-07-21T07:34:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.895+0000 7f367ce91700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367806e000 con 0x7f3678151c50 2023-07-21T07:34:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.895+0000 7f367ce91700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367806e2e0 con 0x7f367806da20 2023-07-21T07:34:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.895+0000 7f367659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f367806a300 0x7f3678155050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40900/0 (socket says 172.21.15.6:40900) 2023-07-21T07:34:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.895+0000 7f367659c700 1 -- 172.21.15.6:0/2572651759 learned_addr learned my addr 172.21.15.6:0/2572651759 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.896+0000 7f3676d9d700 1 --2- 172.21.15.6:0/2572651759 >> v2:172.21.15.86:3300/0 conn(0x7f3678151c50 0x7f36780c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.896+0000 7f3675d9b700 1 --2- 172.21.15.6:0/2572651759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f367806da20 0x7f3678151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.896+0000 7f367559a700 1 -- 172.21.15.6:0/2572651759 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249785407 0 0) 0x7f36780c2ab0 con 0x7f367806a300 2023-07-21T07:34:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.896+0000 7f367559a700 1 -- 172.21.15.6:0/2572651759 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36600035b0 con 0x7f367806a300 2023-07-21T07:34:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.896+0000 7f3676d9d700 1 -- 172.21.15.6:0/2572651759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f367806da20 msgr2=0x7f3678151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.896+0000 7f3676d9d700 1 --2- 172.21.15.6:0/2572651759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f367806da20 0x7f3678151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.896+0000 7f367559a700 1 -- 172.21.15.6:0/2572651759 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3502434222 0 0) 0x7f36600035b0 con 0x7f367806a300 2023-07-21T07:34:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.896+0000 7f3676d9d700 1 -- 172.21.15.6:0/2572651759 >> v1:172.21.15.6:6789/0 conn(0x7f367806a300 legacy=0x7f3678155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.896+0000 7f3676d9d700 1 -- 172.21.15.6:0/2572651759 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367806e5c0 con 0x7f3678151c50 2023-07-21T07:34:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.896+0000 7f3676d9d700 1 --2- 172.21.15.6:0/2572651759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3678151c50 0x7f36780c2f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3670009d90 tx=0x7f367000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2624ba57d1f94e37 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.896+0000 7f367559a700 1 -- 172.21.15.6:0/2572651759 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367000e070 con 0x7f3678151c50 2023-07-21T07:34:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.896+0000 7f367559a700 1 -- 172.21.15.6:0/2572651759 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3670003a20 con 0x7f3678151c50 2023-07-21T07:34:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.896+0000 7f367559a700 1 -- 172.21.15.6:0/2572651759 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c001670 con 0x7f3678151c50 2023-07-21T07:34:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.897+0000 7f367ce91700 1 -- 172.21.15.6:0/2572651759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3678151c50 msgr2=0x7f36780c2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.897+0000 7f367ce91700 1 --2- 172.21.15.6:0/2572651759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3678151c50 0x7f36780c2f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3670009d90 tx=0x7f367000b330 comp rx=0 tx=0).stop 2023-07-21T07:34:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.897+0000 7f367ce91700 1 -- 172.21.15.6:0/2572651759 shutdown_connections 2023-07-21T07:34:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.897+0000 7f367ce91700 1 --2- 172.21.15.6:0/2572651759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3678151c50 0x7f36780c2f40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.897+0000 7f367ce91700 1 --2- 172.21.15.6:0/2572651759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f367806da20 0x7f3678151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.897+0000 7f367ce91700 1 -- 172.21.15.6:0/2572651759 >> 172.21.15.6:0/2572651759 conn(0x7f36780a8c90 msgr2=0x7f367806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.897+0000 7f367ce91700 1 -- 172.21.15.6:0/2572651759 shutdown_connections 2023-07-21T07:34:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.897+0000 7f367ce91700 1 -- 172.21.15.6:0/2572651759 wait complete. 2023-07-21T07:34:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.898+0000 7f367ce91700 1 Processor -- start 2023-07-21T07:34:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.898+0000 7f367ce91700 1 -- start start 2023-07-21T07:34:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367ce91700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f367806a300 0x7f36781ecd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367ce91700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f367806da20 0x7f36781502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367ce91700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3678151c50 0x7f36781507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367ce91700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3678151170 con 0x7f367806a300 2023-07-21T07:34:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367ce91700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36780bd1d0 con 0x7f367806da20 2023-07-21T07:34:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367ce91700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36780c72b0 con 0x7f3678151c50 2023-07-21T07:34:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f367806a300 0x7f36781ecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f367806a300 0x7f36781ecd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32886/0 (socket says 172.21.15.6:32886) 2023-07-21T07:34:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367659c700 1 -- 172.21.15.6:0/4124745164 learned_addr learned my addr 172.21.15.6:0/4124745164 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f3675d9b700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f367806da20 0x7f36781502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f3676d9d700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3678151c50 0x7f36781507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367659c700 1 -- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3678151c50 msgr2=0x7f36781507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367659c700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3678151c50 0x7f36781507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367659c700 1 -- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f367806da20 msgr2=0x7f36781502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367659c700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f367806da20 0x7f36781502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.899+0000 7f367659c700 1 -- 172.21.15.6:0/4124745164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670009a70 con 0x7f367806a300 2023-07-21T07:34:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.900+0000 7f367659c700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f367806a300 0x7f36781ecd60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f366c00c7b0 tx=0x7f366c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.900+0000 7f3666ffd700 1 -- 172.21.15.6:0/4124745164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c004c80 con 0x7f367806a300 2023-07-21T07:34:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.900+0000 7f3666ffd700 1 -- 172.21.15.6:0/4124745164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366c004de0 con 0x7f367806a300 2023-07-21T07:34:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.900+0000 7f367ce91700 1 -- 172.21.15.6:0/4124745164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36781ed870 con 0x7f367806a300 2023-07-21T07:34:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.900+0000 7f3666ffd700 1 -- 172.21.15.6:0/4124745164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c0072d0 con 0x7f367806a300 2023-07-21T07:34:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.900+0000 7f367ce91700 1 -- 172.21.15.6:0/4124745164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36780c77e0 con 0x7f367806a300 2023-07-21T07:34:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.901+0000 7f367ce91700 1 -- 172.21.15.6:0/4124745164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36780c7a00 con 0x7f367806a300 2023-07-21T07:34:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.901+0000 7f3666ffd700 1 -- 172.21.15.6:0/4124745164 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f366c007430 con 0x7f367806a300 2023-07-21T07:34:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.902+0000 7f3666ffd700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f365806ace0 0x7f365806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.902+0000 7f3666ffd700 1 -- 172.21.15.6:0/4124745164 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f366c088a80 con 0x7f367806a300 2023-07-21T07:34:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.902+0000 7f3675d9b700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f365806ace0 0x7f365806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.902+0000 7f3675d9b700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f365806ace0 0x7f365806d1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f36781dee00 tx=0x7f3668008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:50.906+0000 7f3666ffd700 1 -- 172.21.15.6:0/4124745164 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f366c053bc0 con 0x7f367806a300 2023-07-21T07:34:51.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.111+0000 7f367ce91700 1 -- 172.21.15.6:0/4124745164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3678074500 con 0x7f367806a300 2023-07-21T07:34:51.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.112+0000 7f3666ffd700 1 -- 172.21.15.6:0/4124745164 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f366c018020 con 0x7f367806a300 2023-07-21T07:34:51.164 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:51.164 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:51.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.114+0000 7f367ce91700 1 -- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f365806ace0 msgr2=0x7f365806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.114+0000 7f367ce91700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f365806ace0 0x7f365806d1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f36781dee00 tx=0x7f3668008040 comp rx=0 tx=0).stop 2023-07-21T07:34:51.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.114+0000 7f367ce91700 1 -- 172.21.15.6:0/4124745164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f367806a300 msgr2=0x7f36781ecd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.114+0000 7f367ce91700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f367806a300 0x7f36781ecd60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f366c00c7b0 tx=0x7f366c00cb70 comp rx=0 tx=0).stop 2023-07-21T07:34:51.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.114+0000 7f367ce91700 1 -- 172.21.15.6:0/4124745164 shutdown_connections 2023-07-21T07:34:51.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.114+0000 7f367ce91700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f365806ace0 0x7f365806d1a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.114+0000 7f367ce91700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3678151c50 0x7f36781507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.114+0000 7f367ce91700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f367806a300 0x7f36781ecd60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.114+0000 7f367ce91700 1 --2- 172.21.15.6:0/4124745164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f367806da20 0x7f36781502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.114+0000 7f367ce91700 1 -- 172.21.15.6:0/4124745164 >> 172.21.15.6:0/4124745164 conn(0x7f36780a8c90 msgr2=0x7f3678152e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:51.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.114+0000 7f367ce91700 1 -- 172.21.15.6:0/4124745164 shutdown_connections 2023-07-21T07:34:51.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.115+0000 7f367ce91700 1 -- 172.21.15.6:0/4124745164 wait complete. 2023-07-21T07:34:51.178 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:34:38.107491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:34:39.423138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:34:51.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:34:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.256+0000 7fa57ef13700 1 Processor -- start 2023-07-21T07:34:51.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.256+0000 7fa57ef13700 1 -- start start 2023-07-21T07:34:51.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa57ef13700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa578072160 0x7fa57814f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa57ef13700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5780c3c90 con 0x7fa5780a6f80 2023-07-21T07:34:51.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa57ef13700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5780c3680 con 0x7fa5780c4120 2023-07-21T07:34:51.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa57ef13700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5780c26e0 con 0x7fa578072160 2023-07-21T07:34:51.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa57ccaf700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa5780a6f80 0x7fa578152380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40914/0 (socket says 172.21.15.6:40914) 2023-07-21T07:34:51.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa57ccaf700 1 -- 172.21.15.6:0/849489463 learned_addr learned my addr 172.21.15.6:0/849489463 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:51.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283219346 0 0) 0x7fa5780c3c90 con 0x7fa5780a6f80 2023-07-21T07:34:51.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa577fff700 1 --2- 172.21.15.6:0/849489463 >> v2:172.21.15.86:3300/0 conn(0x7fa578072160 0x7fa57814f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5680035b0 con 0x7fa5780a6f80 2023-07-21T07:34:51.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1051922269 0 0) 0x7fa5680035b0 con 0x7fa5780a6f80 2023-07-21T07:34:51.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 >> v2:172.21.15.86:3300/0 conn(0x7fa578072160 msgr2=0x7fa57814f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:51.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 --2- 172.21.15.6:0/849489463 >> v2:172.21.15.86:3300/0 conn(0x7fa578072160 0x7fa57814f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 >> v1:172.21.15.86:6789/0 conn(0x7fa5780c4120 legacy=0x7fa57815cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5780c6fe0 con 0x7fa5780a6f80 2023-07-21T07:34:51.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7fa56c001670 con 0x7fa5780a6f80 2023-07-21T07:34:51.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 >> v1:172.21.15.6:6789/0 conn(0x7fa5780a6f80 legacy=0x7fa578152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 --2- 172.21.15.6:0/849489463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa568003a00 0x7fa568003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 --2- 172.21.15.6:0/849489463 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa568004850 0x7fa568004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 --2- 172.21.15.6:0/849489463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa568005210 0x7fa56800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5780c26e0 con 0x7fa568003a00 2023-07-21T07:34:51.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56800c1b0 con 0x7fa568005210 2023-07-21T07:34:51.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56800c370 con 0x7fa568004850 2023-07-21T07:34:51.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.257+0000 7fa57ccaf700 1 --2- 172.21.15.6:0/849489463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa568003a00 0x7fa568003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa577fff700 1 --2- 172.21.15.6:0/849489463 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa568004850 0x7fa568004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa57d4b0700 1 --2- 172.21.15.6:0/849489463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa568005210 0x7fa56800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa57ccaf700 1 -- 172.21.15.6:0/849489463 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa568004850 msgr2=0x7fa568004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:51.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa57ccaf700 1 --2- 172.21.15.6:0/849489463 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa568004850 0x7fa568004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa57ccaf700 1 -- 172.21.15.6:0/849489463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa568005210 msgr2=0x7fa56800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:51.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa57ccaf700 1 --2- 172.21.15.6:0/849489463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa568005210 0x7fa56800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa57ccaf700 1 -- 172.21.15.6:0/849489463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5680035b0 con 0x7fa568003a00 2023-07-21T07:34:51.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa57d4b0700 1 --2- 172.21.15.6:0/849489463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa568005210 0x7fa56800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa577fff700 1 --2- 172.21.15.6:0/849489463 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa568004850 0x7fa568004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa57d4b0700 1 -- 172.21.15.6:0/849489463 reap_dead start 2023-07-21T07:34:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa57ccaf700 1 --2- 172.21.15.6:0/849489463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa568003a00 0x7fa568003e20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00c240 tx=0x7fa568005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783cdc90e677b87e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c007c10 con 0x7fa568003a00 2023-07-21T07:34:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c00cde0 con 0x7fa568003a00 2023-07-21T07:34:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa5777fe700 1 -- 172.21.15.6:0/849489463 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c005ba0 con 0x7fa568003a00 2023-07-21T07:34:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa57ef13700 1 -- 172.21.15.6:0/849489463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa568003a00 msgr2=0x7fa568003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.258+0000 7fa57ef13700 1 --2- 172.21.15.6:0/849489463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa568003a00 0x7fa568003e20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00c240 tx=0x7fa568005880 comp rx=0 tx=0).stop 2023-07-21T07:34:51.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.259+0000 7fa57ef13700 1 -- 172.21.15.6:0/849489463 shutdown_connections 2023-07-21T07:34:51.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.259+0000 7fa57ef13700 1 --2- 172.21.15.6:0/849489463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa568003a00 0x7fa568003e20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.259+0000 7fa57ef13700 1 -- 172.21.15.6:0/849489463 >> 172.21.15.6:0/849489463 conn(0x7fa5780c7b50 msgr2=0x7fa5780c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:51.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.259+0000 7fa57ef13700 1 -- 172.21.15.6:0/849489463 shutdown_connections 2023-07-21T07:34:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.259+0000 7fa57ef13700 1 -- 172.21.15.6:0/849489463 wait complete. 2023-07-21T07:34:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.260+0000 7fa57ef13700 1 Processor -- start 2023-07-21T07:34:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.260+0000 7fa57ef13700 1 -- start start 2023-07-21T07:34:51.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.260+0000 7fa57ef13700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa568003a00 0x7fa5780c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa57ef13700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5781e9100 0x7fa5781475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa57ef13700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5781e8710 0x7fa57814a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa57ef13700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5781e8c60 con 0x7fa5781e9100 2023-07-21T07:34:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa57ef13700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa578149930 con 0x7fa568003a00 2023-07-21T07:34:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa57ef13700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa578149c10 con 0x7fa5781e8710 2023-07-21T07:34:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa577fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5781e9100 0x7fa5781475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa577fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5781e9100 0x7fa5781475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32908/0 (socket says 172.21.15.6:32908) 2023-07-21T07:34:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa577fff700 1 -- 172.21.15.6:0/1842044526 learned_addr learned my addr 172.21.15.6:0/1842044526 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa57ccaf700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa568003a00 0x7fa5780c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa57d4b0700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5781e8710 0x7fa57814a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa577fff700 1 -- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5781e8710 msgr2=0x7fa57814a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa577fff700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5781e8710 0x7fa57814a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa577fff700 1 -- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa568003a00 msgr2=0x7fa5780c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa577fff700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa568003a00 0x7fa5780c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa577fff700 1 -- 172.21.15.6:0/1842044526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57814b640 con 0x7fa5781e9100 2023-07-21T07:34:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa57d4b0700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5781e8710 0x7fa57814a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa577fff700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5781e9100 0x7fa5781475c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa5640115c0 tx=0x7fa5640118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa5757fa700 1 -- 172.21.15.6:0/1842044526 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564004220 con 0x7fa5781e9100 2023-07-21T07:34:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa5757fa700 1 -- 172.21.15.6:0/1842044526 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa564004380 con 0x7fa5781e9100 2023-07-21T07:34:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa57ef13700 1 -- 172.21.15.6:0/1842044526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57814b920 con 0x7fa5781e9100 2023-07-21T07:34:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa5757fa700 1 -- 172.21.15.6:0/1842044526 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640036a0 con 0x7fa5781e9100 2023-07-21T07:34:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.261+0000 7fa57ef13700 1 -- 172.21.15.6:0/1842044526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa578147b00 con 0x7fa5781e9100 2023-07-21T07:34:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.262+0000 7fa57ef13700 1 -- 172.21.15.6:0/1842044526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa578074500 con 0x7fa5781e9100 2023-07-21T07:34:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.263+0000 7fa5757fa700 1 -- 172.21.15.6:0/1842044526 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa564003800 con 0x7fa5781e9100 2023-07-21T07:34:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.263+0000 7fa5757fa700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa55c06ace0 0x7fa55c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.263+0000 7fa5757fa700 1 -- 172.21.15.6:0/1842044526 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa5640895e0 con 0x7fa5781e9100 2023-07-21T07:34:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.263+0000 7fa57ccaf700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa55c06ace0 0x7fa55c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.264+0000 7fa57ccaf700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa55c06ace0 0x7fa55c06d1a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa56c000c00 tx=0x7fa56c007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.267+0000 7fa5757fa700 1 -- 172.21.15.6:0/1842044526 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa564054720 con 0x7fa5781e9100 2023-07-21T07:34:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.465+0000 7fa57ef13700 1 -- 172.21.15.6:0/1842044526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa578066140 con 0x7fa5781e9100 2023-07-21T07:34:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.466+0000 7fa5757fa700 1 -- 172.21.15.6:0/1842044526 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa564057d40 con 0x7fa5781e9100 2023-07-21T07:34:51.518 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:34:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.468+0000 7fa57ef13700 1 -- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa55c06ace0 msgr2=0x7fa55c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.468+0000 7fa57ef13700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa55c06ace0 0x7fa55c06d1a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa56c000c00 tx=0x7fa56c007000 comp rx=0 tx=0).stop 2023-07-21T07:34:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.468+0000 7fa57ef13700 1 -- 172.21.15.6:0/1842044526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5781e9100 msgr2=0x7fa5781475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.468+0000 7fa57ef13700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5781e9100 0x7fa5781475c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa5640115c0 tx=0x7fa5640118d0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.468+0000 7fa57ef13700 1 -- 172.21.15.6:0/1842044526 shutdown_connections 2023-07-21T07:34:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.468+0000 7fa57ef13700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa55c06ace0 0x7fa55c06d1a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.468+0000 7fa57ef13700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5781e8710 0x7fa57814a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.468+0000 7fa57ef13700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa568003a00 0x7fa5780c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.468+0000 7fa57ef13700 1 --2- 172.21.15.6:0/1842044526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5781e9100 0x7fa5781475c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.468+0000 7fa57ef13700 1 -- 172.21.15.6:0/1842044526 >> 172.21.15.6:0/1842044526 conn(0x7fa5780c7b50 msgr2=0x7fa5780c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.468+0000 7fa57ef13700 1 -- 172.21.15.6:0/1842044526 shutdown_connections 2023-07-21T07:34:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.468+0000 7fa57ef13700 1 -- 172.21.15.6:0/1842044526 wait complete. 2023-07-21T07:34:51.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:34:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.607+0000 7f09c89cf700 1 Processor -- start 2023-07-21T07:34:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.607+0000 7f09c89cf700 1 -- start start 2023-07-21T07:34:51.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.608+0000 7f09c89cf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c406a090 0x7f09c40bfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.608+0000 7f09c89cf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f09c41518d0 0x7f09c4151d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.608+0000 7f09c89cf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c40c1540 con 0x7f09c41547a0 2023-07-21T07:34:51.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.608+0000 7f09c89cf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c40c26b0 con 0x7f09c41518d0 2023-07-21T07:34:51.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.608+0000 7f09c89cf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4065e30 con 0x7f09c406a090 2023-07-21T07:34:51.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f09c41547a0 0x7f09c40c19d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40934/0 (socket says 172.21.15.6:40934) 2023-07-21T07:34:51.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c259c700 1 -- 172.21.15.6:0/301896090 learned_addr learned my addr 172.21.15.6:0/301896090 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:51.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c2d9d700 1 --2- 172.21.15.6:0/301896090 >> v2:172.21.15.86:3300/0 conn(0x7f09c41518d0 0x7f09c4151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c1d9b700 1 --2- 172.21.15.6:0/301896090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c406a090 0x7f09c40bfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446587556 0 0) 0x7f09c40c1540 con 0x7f09c41547a0 2023-07-21T07:34:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09b00035b0 con 0x7f09c41547a0 2023-07-21T07:34:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3127221217 0 0) 0x7f09b00035b0 con 0x7f09c41547a0 2023-07-21T07:34:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c406a090 msgr2=0x7f09c40bfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 --2- 172.21.15.6:0/301896090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c406a090 0x7f09c40bfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 >> v2:172.21.15.86:3300/0 conn(0x7f09c41518d0 msgr2=0x7f09c4151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 --2- 172.21.15.6:0/301896090 >> v2:172.21.15.86:3300/0 conn(0x7f09c41518d0 0x7f09c4151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c4066110 con 0x7f09c41547a0 2023-07-21T07:34:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f09b4001670 con 0x7f09c41547a0 2023-07-21T07:34:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 >> v1:172.21.15.6:6789/0 conn(0x7f09c41547a0 legacy=0x7f09c40c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 --2- 172.21.15.6:0/301896090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b0003a00 0x7f09b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 --2- 172.21.15.6:0/301896090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c406a090 0x7f09b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 --2- 172.21.15.6:0/301896090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09b0004d90 0x7f09b0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40c26b0 con 0x7f09b0004d90 2023-07-21T07:34:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4065e30 con 0x7f09b0003a00 2023-07-21T07:34:51.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b000ba10 con 0x7f09c406a090 2023-07-21T07:34:51.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c2d9d700 1 --2- 172.21.15.6:0/301896090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09b0004d90 0x7f09b0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c259c700 1 --2- 172.21.15.6:0/301896090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b0003a00 0x7f09b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.609+0000 7f09c1d9b700 1 --2- 172.21.15.6:0/301896090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c406a090 0x7f09b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c2d9d700 1 -- 172.21.15.6:0/301896090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c406a090 msgr2=0x7f09b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:51.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c2d9d700 1 --2- 172.21.15.6:0/301896090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c406a090 0x7f09b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c2d9d700 1 -- 172.21.15.6:0/301896090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b0003a00 msgr2=0x7f09b0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c2d9d700 1 --2- 172.21.15.6:0/301896090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b0003a00 0x7f09b0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c2d9d700 1 -- 172.21.15.6:0/301896090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b00035b0 con 0x7f09b0004d90 2023-07-21T07:34:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c2d9d700 1 --2- 172.21.15.6:0/301896090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09b0004d90 0x7f09b0005210 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f09bc00e170 tx=0x7f09b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47b959c894baec5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc00ec90 con 0x7f09b0004d90 2023-07-21T07:34:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09bc00f040 con 0x7f09b0004d90 2023-07-21T07:34:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c159a700 1 -- 172.21.15.6:0/301896090 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc014480 con 0x7f09b0004d90 2023-07-21T07:34:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c89cf700 1 -- 172.21.15.6:0/301896090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09b0004d90 msgr2=0x7f09b0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c89cf700 1 --2- 172.21.15.6:0/301896090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09b0004d90 0x7f09b0005210 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f09bc00e170 tx=0x7f09b0005880 comp rx=0 tx=0).stop 2023-07-21T07:34:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c2d9d700 1 -- 172.21.15.6:0/301896090 reap_dead start 2023-07-21T07:34:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c89cf700 1 -- 172.21.15.6:0/301896090 shutdown_connections 2023-07-21T07:34:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c89cf700 1 -- 172.21.15.6:0/301896090 >> 172.21.15.6:0/301896090 conn(0x7f09c40c2c20 msgr2=0x7f09c40c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.610+0000 7f09c89cf700 1 -- 172.21.15.6:0/301896090 shutdown_connections 2023-07-21T07:34:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.611+0000 7f09c89cf700 1 -- 172.21.15.6:0/301896090 wait complete. 2023-07-21T07:34:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.612+0000 7f09c89cf700 1 Processor -- start 2023-07-21T07:34:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.612+0000 7f09c89cf700 1 -- start start 2023-07-21T07:34:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.612+0000 7f09c89cf700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b0004d90 0x7f09c41ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.612+0000 7f09c89cf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c41474e0 0x7f09c41ecac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.612+0000 7f09c89cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c41ed000 0x7f09c4143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.612+0000 7f09c89cf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4147a60 con 0x7f09c41ed000 2023-07-21T07:34:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.612+0000 7f09c89cf700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c414fe10 con 0x7f09b0004d90 2023-07-21T07:34:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.612+0000 7f09c89cf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4147d00 con 0x7f09c41474e0 2023-07-21T07:34:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c41ed000 0x7f09c4143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b0004d90 0x7f09c41ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c1d9b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c41474e0 0x7f09c41ecac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c259c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b0004d90 0x7f09c41ddd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:54730/0 (socket says 172.21.15.6:54730) 2023-07-21T07:34:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c41ed000 0x7f09c4143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32930/0 (socket says 172.21.15.6:32930) 2023-07-21T07:34:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c259c700 1 -- 172.21.15.6:0/3384099524 learned_addr learned my addr 172.21.15.6:0/3384099524 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c2d9d700 1 -- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c41474e0 msgr2=0x7f09c41ecac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c2d9d700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c41474e0 0x7f09c41ecac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c2d9d700 1 -- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b0004d90 msgr2=0x7f09c41ddd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c2d9d700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b0004d90 0x7f09c41ddd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c2d9d700 1 -- 172.21.15.6:0/3384099524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c4146ce0 con 0x7f09c41ed000 2023-07-21T07:34:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c1d9b700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c41474e0 0x7f09c41ecac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c259c700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b0004d90 0x7f09c41ddd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c2d9d700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c41ed000 0x7f09c4143f60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f09bc019000 tx=0x7f09bc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09baffd700 1 -- 172.21.15.6:0/3384099524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc007000 con 0x7f09c41ed000 2023-07-21T07:34:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09baffd700 1 -- 172.21.15.6:0/3384099524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09bc00eec0 con 0x7f09c41ed000 2023-07-21T07:34:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c89cf700 1 -- 172.21.15.6:0/3384099524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c4146fc0 con 0x7f09c41ed000 2023-07-21T07:34:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09baffd700 1 -- 172.21.15.6:0/3384099524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc01e670 con 0x7f09c41ed000 2023-07-21T07:34:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.613+0000 7f09c89cf700 1 -- 172.21.15.6:0/3384099524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c41dfa20 con 0x7f09c41ed000 2023-07-21T07:34:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.614+0000 7f09c89cf700 1 -- 172.21.15.6:0/3384099524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c4074500 con 0x7f09c41ed000 2023-07-21T07:34:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.615+0000 7f09baffd700 1 -- 172.21.15.6:0/3384099524 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09bc024070 con 0x7f09c41ed000 2023-07-21T07:34:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.615+0000 7f09baffd700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09a406ace0 0x7f09a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.615+0000 7f09baffd700 1 -- 172.21.15.6:0/3384099524 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09bc08abd0 con 0x7f09c41ed000 2023-07-21T07:34:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.615+0000 7f09c259c700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09a406ace0 0x7f09a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.616+0000 7f09c259c700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09a406ace0 0x7f09a406d1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f09c40713a0 tx=0x7f09b4007980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.619+0000 7f09baffd700 1 -- 172.21.15.6:0/3384099524 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f09bc055d10 con 0x7f09c41ed000 2023-07-21T07:34:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.819+0000 7f09c89cf700 1 -- 172.21.15.6:0/3384099524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09c406e730 con 0x7f09c41ed000 2023-07-21T07:34:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.819+0000 7f09baffd700 1 -- 172.21.15.6:0/3384099524 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f09bc059330 con 0x7f09c41ed000 2023-07-21T07:34:51.871 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:34:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.821+0000 7f09c89cf700 1 -- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09a406ace0 msgr2=0x7f09a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.821+0000 7f09c89cf700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09a406ace0 0x7f09a406d1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f09c40713a0 tx=0x7f09b4007980 comp rx=0 tx=0).stop 2023-07-21T07:34:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.821+0000 7f09c89cf700 1 -- 172.21.15.6:0/3384099524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c41ed000 msgr2=0x7f09c4143f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.821+0000 7f09c89cf700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c41ed000 0x7f09c4143f60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f09bc019000 tx=0x7f09bc004b40 comp rx=0 tx=0).stop 2023-07-21T07:34:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.821+0000 7f09c89cf700 1 -- 172.21.15.6:0/3384099524 shutdown_connections 2023-07-21T07:34:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.821+0000 7f09c89cf700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09a406ace0 0x7f09a406d1a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.821+0000 7f09c89cf700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c41ed000 0x7f09c4143f60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.821+0000 7f09c89cf700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09b0004d90 0x7f09c41ddd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.821+0000 7f09c89cf700 1 --2- 172.21.15.6:0/3384099524 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09c41474e0 0x7f09c41ecac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.821+0000 7f09c89cf700 1 -- 172.21.15.6:0/3384099524 >> 172.21.15.6:0/3384099524 conn(0x7f09c40c2c20 msgr2=0x7f09c4154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.821+0000 7f09c89cf700 1 -- 172.21.15.6:0/3384099524 shutdown_connections 2023-07-21T07:34:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.821+0000 7f09c89cf700 1 -- 172.21.15.6:0/3384099524 wait complete. 2023-07-21T07:34:51.885 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:34:52.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.960+0000 7f7ee82a5700 1 Processor -- start 2023-07-21T07:34:52.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.960+0000 7f7ee82a5700 1 -- start start 2023-07-21T07:34:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.961+0000 7f7ee82a5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7ee00abee0 0x7f7ee006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.961+0000 7f7ee82a5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee0155d20 con 0x7f7ee014f4b0 2023-07-21T07:34:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.961+0000 7f7ee82a5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee00c4ce0 con 0x7f7ee0152da0 2023-07-21T07:34:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.961+0000 7f7ee82a5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee00c5de0 con 0x7f7ee00abee0 2023-07-21T07:34:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.961+0000 7f7ee6842700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7ee014f4b0 0x7f7ee015cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40956/0 (socket says 172.21.15.6:40956) 2023-07-21T07:34:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.961+0000 7f7ee6842700 1 -- 172.21.15.6:0/4057548942 learned_addr learned my addr 172.21.15.6:0/4057548942 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.961+0000 7f7ee6041700 1 --2- 172.21.15.6:0/4057548942 >> v2:172.21.15.86:3300/0 conn(0x7f7ee00abee0 0x7f7ee006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.961+0000 7f7ee503f700 1 -- 172.21.15.6:0/4057548942 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952429154 0 0) 0x7f7ee0155d20 con 0x7f7ee014f4b0 2023-07-21T07:34:52.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.961+0000 7f7ee503f700 1 -- 172.21.15.6:0/4057548942 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ecc0035b0 con 0x7f7ee014f4b0 2023-07-21T07:34:52.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.962+0000 7f7ee6041700 1 -- 172.21.15.6:0/4057548942 >> v1:172.21.15.86:6789/0 conn(0x7f7ee0152da0 legacy=0x7f7ee01561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.962+0000 7f7ee6041700 1 -- 172.21.15.6:0/4057548942 >> v1:172.21.15.6:6789/0 conn(0x7f7ee014f4b0 legacy=0x7f7ee015cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.962+0000 7f7ee6041700 1 -- 172.21.15.6:0/4057548942 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee00c4fc0 con 0x7f7ee00abee0 2023-07-21T07:34:52.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.962+0000 7f7ee6041700 1 --2- 172.21.15.6:0/4057548942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee00abee0 0x7f7ee006d680 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009840 tx=0x7f7ed0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d57fc38217fd7510 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:52.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.962+0000 7f7ee503f700 1 -- 172.21.15.6:0/4057548942 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0011830 con 0x7f7ee00abee0 2023-07-21T07:34:52.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.962+0000 7f7ee503f700 1 -- 172.21.15.6:0/4057548942 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed0011990 con 0x7f7ee00abee0 2023-07-21T07:34:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.962+0000 7f7ee503f700 1 -- 172.21.15.6:0/4057548942 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0011d20 con 0x7f7ee00abee0 2023-07-21T07:34:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.962+0000 7f7ee82a5700 1 -- 172.21.15.6:0/4057548942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee00abee0 msgr2=0x7f7ee006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.962+0000 7f7ee82a5700 1 --2- 172.21.15.6:0/4057548942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee00abee0 0x7f7ee006d680 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009840 tx=0x7f7ed0009b50 comp rx=0 tx=0).stop 2023-07-21T07:34:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.963+0000 7f7ee82a5700 1 -- 172.21.15.6:0/4057548942 shutdown_connections 2023-07-21T07:34:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.963+0000 7f7ee82a5700 1 --2- 172.21.15.6:0/4057548942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee00abee0 0x7f7ee006d680 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.963+0000 7f7ee82a5700 1 -- 172.21.15.6:0/4057548942 >> 172.21.15.6:0/4057548942 conn(0x7f7ee00a8660 msgr2=0x7f7ee00a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.963+0000 7f7ee82a5700 1 -- 172.21.15.6:0/4057548942 shutdown_connections 2023-07-21T07:34:52.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.963+0000 7f7ee82a5700 1 -- 172.21.15.6:0/4057548942 wait complete. 2023-07-21T07:34:52.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.964+0000 7f7ee82a5700 1 Processor -- start 2023-07-21T07:34:52.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.964+0000 7f7ee82a5700 1 -- start start 2023-07-21T07:34:52.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.964+0000 7f7ee82a5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ee00abee0 0x7f7ee00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.964+0000 7f7ee82a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ee014f4b0 0x7f7ee00a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.964+0000 7f7ee82a5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee0152da0 0x7f7ee00a7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.964+0000 7f7ee82a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee01568c0 con 0x7f7ee014f4b0 2023-07-21T07:34:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.964+0000 7f7ee82a5700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0151ae0 con 0x7f7ee0152da0 2023-07-21T07:34:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.964+0000 7f7ee82a5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0151d80 con 0x7f7ee00abee0 2023-07-21T07:34:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.964+0000 7f7ee5840700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ee014f4b0 0x7f7ee00a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ee5840700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ee014f4b0 0x7f7ee00a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32940/0 (socket says 172.21.15.6:32940) 2023-07-21T07:34:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ee5840700 1 -- 172.21.15.6:0/3333626991 learned_addr learned my addr 172.21.15.6:0/3333626991 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ee6842700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee0152da0 0x7f7ee00a7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ee6041700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ee00abee0 0x7f7ee00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ee5840700 1 -- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ee00abee0 msgr2=0x7f7ee00c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ee5840700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ee00abee0 0x7f7ee00c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ee5840700 1 -- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee0152da0 msgr2=0x7f7ee00a7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ee5840700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee0152da0 0x7f7ee00a7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ee5840700 1 -- 172.21.15.6:0/3333626991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed00094a0 con 0x7f7ee014f4b0 2023-07-21T07:34:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ee5840700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ee014f4b0 0x7f7ee00a72e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00c450 tx=0x7f7edc00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/3333626991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0052d0 con 0x7f7ee014f4b0 2023-07-21T07:34:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/3333626991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc005430 con 0x7f7ee014f4b0 2023-07-21T07:34:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/3333626991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0038c0 con 0x7f7ee014f4b0 2023-07-21T07:34:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ee82a5700 1 -- 172.21.15.6:0/3333626991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee00c41d0 con 0x7f7ee014f4b0 2023-07-21T07:34:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.965+0000 7f7ee82a5700 1 -- 172.21.15.6:0/3333626991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee00a7820 con 0x7f7ee014f4b0 2023-07-21T07:34:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.966+0000 7f7ee82a5700 1 -- 172.21.15.6:0/3333626991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee00c1fb0 con 0x7f7ee014f4b0 2023-07-21T07:34:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.967+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/3333626991 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7edc003a20 con 0x7f7ee014f4b0 2023-07-21T07:34:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.967+0000 7f7ed6ffd700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7ec406ace0 0x7f7ec406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.967+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/3333626991 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7edc088710 con 0x7f7ee014f4b0 2023-07-21T07:34:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.967+0000 7f7ee6041700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7ec406ace0 0x7f7ec406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.968+0000 7f7ee6041700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7ec406ace0 0x7f7ec406d1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00090b0 tx=0x7f7ed0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:52.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:51.971+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/3333626991 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7ee00c1fb0 con 0x7f7ee014f4b0 2023-07-21T07:34:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.167+0000 7f7ee82a5700 1 -- 172.21.15.6:0/3333626991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ee00c1fb0 con 0x7f7ee014f4b0 2023-07-21T07:34:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.167+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/3333626991 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ee00c1fb0 con 0x7f7ee014f4b0 2023-07-21T07:34:52.219 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:34:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.169+0000 7f7ee82a5700 1 -- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7ec406ace0 msgr2=0x7f7ec406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.169+0000 7f7ee82a5700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7ec406ace0 0x7f7ec406d1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00090b0 tx=0x7f7ed0008030 comp rx=0 tx=0).stop 2023-07-21T07:34:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.169+0000 7f7ee82a5700 1 -- 172.21.15.6:0/3333626991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ee014f4b0 msgr2=0x7f7ee00a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.169+0000 7f7ee82a5700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ee014f4b0 0x7f7ee00a72e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00c450 tx=0x7f7edc00c760 comp rx=0 tx=0).stop 2023-07-21T07:34:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.169+0000 7f7ee82a5700 1 -- 172.21.15.6:0/3333626991 shutdown_connections 2023-07-21T07:34:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.169+0000 7f7ee82a5700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7ec406ace0 0x7f7ec406d1a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.169+0000 7f7ee82a5700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee0152da0 0x7f7ee00a7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.169+0000 7f7ee82a5700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ee00abee0 0x7f7ee00c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.169+0000 7f7ee82a5700 1 --2- 172.21.15.6:0/3333626991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ee014f4b0 0x7f7ee00a72e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.169+0000 7f7ee82a5700 1 -- 172.21.15.6:0/3333626991 >> 172.21.15.6:0/3333626991 conn(0x7f7ee00a8660 msgr2=0x7f7ee0154b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.169+0000 7f7ee82a5700 1 -- 172.21.15.6:0/3333626991 shutdown_connections 2023-07-21T07:34:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.169+0000 7f7ee82a5700 1 -- 172.21.15.6:0/3333626991 wait complete. 2023-07-21T07:34:52.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:34:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.308+0000 7f881220b700 1 Processor -- start 2023-07-21T07:34:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.308+0000 7f881220b700 1 -- start start 2023-07-21T07:34:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.309+0000 7f881220b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f880c0abd40 0x7f880c0aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.309+0000 7f881220b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f880c0aae10 0x7f880c0ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.309+0000 7f881220b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880c066050 con 0x7f880c14c580 2023-07-21T07:34:52.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.309+0000 7f881220b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880c066580 con 0x7f880c0aae10 2023-07-21T07:34:52.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.309+0000 7f881220b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880c152f50 con 0x7f880c0abd40 2023-07-21T07:34:52.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.309+0000 7f880bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f880c0aae10 0x7f880c0ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.309+0000 7f880bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f880c0aae10 0x7f880c0ab2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32950/0 (socket says 172.21.15.6:32950) 2023-07-21T07:34:52.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.309+0000 7f880bfff700 1 -- 172.21.15.6:0/3439511027 learned_addr learned my addr 172.21.15.6:0/3439511027 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:52.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.309+0000 7f880affd700 1 --2- 172.21.15.6:0/3439511027 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f880c0abd40 0x7f880c0aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.310+0000 7f880bfff700 1 -- 172.21.15.6:0/3439511027 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f880c0abd40 msgr2=0x7f880c0aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.310+0000 7f880bfff700 1 --2- 172.21.15.6:0/3439511027 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f880c0abd40 0x7f880c0aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.310+0000 7f880bfff700 1 -- 172.21.15.6:0/3439511027 >> v1:172.21.15.86:6789/0 conn(0x7f880c14c580 legacy=0x7f880c0c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.310+0000 7f880bfff700 1 -- 172.21.15.6:0/3439511027 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c14c960 con 0x7f880c0aae10 2023-07-21T07:34:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.310+0000 7f880affd700 1 --2- 172.21.15.6:0/3439511027 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f880c0abd40 0x7f880c0aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.310+0000 7f880bfff700 1 --2- 172.21.15.6:0/3439511027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c0aae10 0x7f880c0ab2a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8804009e50 tx=0x7f880400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a135f297b4be58d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.310+0000 7f880a7fc700 1 -- 172.21.15.6:0/3439511027 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880400e070 con 0x7f880c0aae10 2023-07-21T07:34:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.310+0000 7f880a7fc700 1 -- 172.21.15.6:0/3439511027 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880400b9c0 con 0x7f880c0aae10 2023-07-21T07:34:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.310+0000 7f880a7fc700 1 -- 172.21.15.6:0/3439511027 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880400bd70 con 0x7f880c0aae10 2023-07-21T07:34:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.310+0000 7f881220b700 1 -- 172.21.15.6:0/3439511027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c0aae10 msgr2=0x7f880c0ab2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.310+0000 7f881220b700 1 --2- 172.21.15.6:0/3439511027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c0aae10 0x7f880c0ab2a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8804009e50 tx=0x7f880400b330 comp rx=0 tx=0).stop 2023-07-21T07:34:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.311+0000 7f881220b700 1 -- 172.21.15.6:0/3439511027 shutdown_connections 2023-07-21T07:34:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.311+0000 7f881220b700 1 --2- 172.21.15.6:0/3439511027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c0aae10 0x7f880c0ab2a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.311+0000 7f881220b700 1 --2- 172.21.15.6:0/3439511027 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f880c0abd40 0x7f880c0aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.311+0000 7f881220b700 1 -- 172.21.15.6:0/3439511027 >> 172.21.15.6:0/3439511027 conn(0x7f880c0c2c20 msgr2=0x7f880c0c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.311+0000 7f881220b700 1 -- 172.21.15.6:0/3439511027 shutdown_connections 2023-07-21T07:34:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.311+0000 7f881220b700 1 -- 172.21.15.6:0/3439511027 wait complete. 2023-07-21T07:34:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.312+0000 7f881220b700 1 Processor -- start 2023-07-21T07:34:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.312+0000 7f881220b700 1 -- start start 2023-07-21T07:34:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f881220b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f880c0aae10 0x7f880c0711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f881220b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f880c0abd40 0x7f880c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f881220b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c14c580 0x7f880c141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f881220b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c070730 con 0x7f880c14c580 2023-07-21T07:34:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f881220b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c1503b0 con 0x7f880c0aae10 2023-07-21T07:34:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f881220b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880c070920 con 0x7f880c0abd40 2023-07-21T07:34:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f880bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c14c580 0x7f880c141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f880bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c14c580 0x7f880c141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32956/0 (socket says 172.21.15.6:32956) 2023-07-21T07:34:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f880bfff700 1 -- 172.21.15.6:0/3040031105 learned_addr learned my addr 172.21.15.6:0/3040031105 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f880b7fe700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f880c0aae10 0x7f880c0711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f880affd700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f880c0abd40 0x7f880c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f880bfff700 1 -- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f880c0abd40 msgr2=0x7f880c0718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f880bfff700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f880c0abd40 0x7f880c0718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f880bfff700 1 -- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f880c0aae10 msgr2=0x7f880c0711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f880bfff700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f880c0aae10 0x7f880c0711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f880bfff700 1 -- 172.21.15.6:0/3040031105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8804009b30 con 0x7f880c14c580 2023-07-21T07:34:52.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f880bfff700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c14c580 0x7f880c141e20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8804012000 tx=0x7f8804004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f87f3fff700 1 -- 172.21.15.6:0/3040031105 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804004900 con 0x7f880c14c580 2023-07-21T07:34:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f87f3fff700 1 -- 172.21.15.6:0/3040031105 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88040092e0 con 0x7f880c14c580 2023-07-21T07:34:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f87f3fff700 1 -- 172.21.15.6:0/3040031105 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880401c660 con 0x7f880c14c580 2023-07-21T07:34:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f881220b700 1 -- 172.21.15.6:0/3040031105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880c070c00 con 0x7f880c14c580 2023-07-21T07:34:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.313+0000 7f881220b700 1 -- 172.21.15.6:0/3040031105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880c150040 con 0x7f880c14c580 2023-07-21T07:34:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.314+0000 7f881220b700 1 -- 172.21.15.6:0/3040031105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880c150560 con 0x7f880c14c580 2023-07-21T07:34:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.315+0000 7f87f3fff700 1 -- 172.21.15.6:0/3040031105 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f880401c7c0 con 0x7f880c14c580 2023-07-21T07:34:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.315+0000 7f87f3fff700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f87f806ace0 0x7f87f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.315+0000 7f87f3fff700 1 -- 172.21.15.6:0/3040031105 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f880408b000 con 0x7f880c14c580 2023-07-21T07:34:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.315+0000 7f880b7fe700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f87f806ace0 0x7f87f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.316+0000 7f880b7fe700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f87f806ace0 0x7f87f806d1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0018a0 tx=0x7f87fc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:52.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.319+0000 7f87f3fff700 1 -- 172.21.15.6:0/3040031105 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f880c150560 con 0x7f880c14c580 2023-07-21T07:34:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.515+0000 7f881220b700 1 -- 172.21.15.6:0/3040031105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f880c1501d0 con 0x7f880c14c580 2023-07-21T07:34:52.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.515+0000 7f87f3fff700 1 -- 172.21.15.6:0/3040031105 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8804056140 con 0x7f880c14c580 2023-07-21T07:34:52.567 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:34:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.517+0000 7f881220b700 1 -- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f87f806ace0 msgr2=0x7f87f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.517+0000 7f881220b700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f87f806ace0 0x7f87f806d1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0018a0 tx=0x7f87fc009040 comp rx=0 tx=0).stop 2023-07-21T07:34:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.517+0000 7f881220b700 1 -- 172.21.15.6:0/3040031105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c14c580 msgr2=0x7f880c141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.517+0000 7f881220b700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c14c580 0x7f880c141e20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8804012000 tx=0x7f8804004ad0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.517+0000 7f881220b700 1 -- 172.21.15.6:0/3040031105 shutdown_connections 2023-07-21T07:34:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.517+0000 7f881220b700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f87f806ace0 0x7f87f806d1a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.517+0000 7f881220b700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c14c580 0x7f880c141e20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.517+0000 7f881220b700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f880c0aae10 0x7f880c0711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.517+0000 7f881220b700 1 --2- 172.21.15.6:0/3040031105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f880c0abd40 0x7f880c0718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.517+0000 7f881220b700 1 -- 172.21.15.6:0/3040031105 >> 172.21.15.6:0/3040031105 conn(0x7f880c0c2c20 msgr2=0x7f880c145ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.517+0000 7f881220b700 1 -- 172.21.15.6:0/3040031105 shutdown_connections 2023-07-21T07:34:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.517+0000 7f881220b700 1 -- 172.21.15.6:0/3040031105 wait complete. 2023-07-21T07:34:52.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:34:52.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.653+0000 7ff33f19f700 1 Processor -- start 2023-07-21T07:34:52.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.653+0000 7ff33f19f700 1 -- start start 2023-07-21T07:34:52.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.654+0000 7ff33f19f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff33814a650 0x7ff3380c0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.654+0000 7ff33f19f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff3381506a0 0x7ff3380c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.654+0000 7ff33f19f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3380c0e50 con 0x7ff3380c4910 2023-07-21T07:34:52.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.654+0000 7ff33f19f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33806fcf0 con 0x7ff3381506a0 2023-07-21T07:34:52.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.654+0000 7ff33f19f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33806ffd0 con 0x7ff33814a650 2023-07-21T07:34:52.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.654+0000 7ff33e19d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff33814a650 0x7ff3380c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.654+0000 7ff33e99e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff3381506a0 0x7ff3380c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.655+0000 7ff33d99c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff3380c4910 0x7ff338070d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:44222/0 (socket says 172.21.15.6:44222) 2023-07-21T07:34:52.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.655+0000 7ff33d99c700 1 -- 172.21.15.6:0/3386838124 learned_addr learned my addr 172.21.15.6:0/3386838124 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:52.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.655+0000 7ff33e99e700 1 -- 172.21.15.6:0/3386838124 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff33814a650 msgr2=0x7ff3380c0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:52.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.655+0000 7ff33e99e700 1 --2- 172.21.15.6:0/3386838124 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff33814a650 0x7ff3380c0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.655+0000 7ff33e99e700 1 -- 172.21.15.6:0/3386838124 >> v1:172.21.15.86:6789/0 conn(0x7ff3380c4910 legacy=0x7ff338070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.655+0000 7ff33e99e700 1 -- 172.21.15.6:0/3386838124 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3380702b0 con 0x7ff3381506a0 2023-07-21T07:34:52.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.655+0000 7ff33e19d700 1 --2- 172.21.15.6:0/3386838124 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff33814a650 0x7ff3380c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:52.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.655+0000 7ff33e99e700 1 --2- 172.21.15.6:0/3386838124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3381506a0 0x7ff3380c5300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff33000bfa0 tx=0x7ff33000d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cca7ec71968bcfb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:52.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.655+0000 7ff33d19b700 1 -- 172.21.15.6:0/3386838124 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330010070 con 0x7ff3381506a0 2023-07-21T07:34:52.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.655+0000 7ff33d19b700 1 -- 172.21.15.6:0/3386838124 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33000b2e0 con 0x7ff3381506a0 2023-07-21T07:34:52.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.655+0000 7ff33d19b700 1 -- 172.21.15.6:0/3386838124 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000dc40 con 0x7ff3381506a0 2023-07-21T07:34:52.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.656+0000 7ff33f19f700 1 -- 172.21.15.6:0/3386838124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3381506a0 msgr2=0x7ff3380c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.656+0000 7ff33f19f700 1 --2- 172.21.15.6:0/3386838124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3381506a0 0x7ff3380c5300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff33000bfa0 tx=0x7ff33000d330 comp rx=0 tx=0).stop 2023-07-21T07:34:52.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.656+0000 7ff33f19f700 1 -- 172.21.15.6:0/3386838124 shutdown_connections 2023-07-21T07:34:52.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.656+0000 7ff33f19f700 1 --2- 172.21.15.6:0/3386838124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3381506a0 0x7ff3380c5300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.656+0000 7ff33f19f700 1 --2- 172.21.15.6:0/3386838124 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff33814a650 0x7ff3380c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.656+0000 7ff33f19f700 1 -- 172.21.15.6:0/3386838124 >> 172.21.15.6:0/3386838124 conn(0x7ff33806a090 msgr2=0x7ff33806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:52.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.656+0000 7ff33f19f700 1 -- 172.21.15.6:0/3386838124 shutdown_connections 2023-07-21T07:34:52.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.656+0000 7ff33f19f700 1 -- 172.21.15.6:0/3386838124 wait complete. 2023-07-21T07:34:52.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.657+0000 7ff33f19f700 1 Processor -- start 2023-07-21T07:34:52.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.657+0000 7ff33f19f700 1 -- start start 2023-07-21T07:34:52.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33f19f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3380c4910 0x7ff3380ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33f19f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff33814a650 0x7ff3380a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33f19f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3381506a0 0x7ff3381448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33f19f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3380aa3a0 con 0x7ff33814a650 2023-07-21T07:34:52.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33f19f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff338149590 con 0x7ff3381506a0 2023-07-21T07:34:52.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33f19f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381468f0 con 0x7ff3380c4910 2023-07-21T07:34:52.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33d99c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff33814a650 0x7ff3380a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33d99c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff33814a650 0x7ff3380a9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32968/0 (socket says 172.21.15.6:32968) 2023-07-21T07:34:52.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33d99c700 1 -- 172.21.15.6:0/3999901587 learned_addr learned my addr 172.21.15.6:0/3999901587 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:52.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33e99e700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3381506a0 0x7ff3381448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33e19d700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3380c4910 0x7ff3380ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33e99e700 1 -- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3380c4910 msgr2=0x7ff3380ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33e99e700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3380c4910 0x7ff3380ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33e99e700 1 -- 172.21.15.6:0/3999901587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff33814a650 msgr2=0x7ff3380a9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33e99e700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff33814a650 0x7ff3380a9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33e99e700 1 -- 172.21.15.6:0/3999901587 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3280094a0 con 0x7ff3381506a0 2023-07-21T07:34:52.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33d99c700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff33814a650 0x7ff3380a9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:34:52.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.658+0000 7ff33e99e700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3381506a0 0x7ff3381448f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff330017000 tx=0x7ff330004b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:52.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.659+0000 7ff32effd700 1 -- 172.21.15.6:0/3999901587 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000bb00 con 0x7ff3381506a0 2023-07-21T07:34:52.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.659+0000 7ff32effd700 1 -- 172.21.15.6:0/3999901587 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff330009750 con 0x7ff3381506a0 2023-07-21T07:34:52.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.659+0000 7ff33f19f700 1 -- 172.21.15.6:0/3999901587 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33000bc80 con 0x7ff3381506a0 2023-07-21T07:34:52.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.659+0000 7ff32effd700 1 -- 172.21.15.6:0/3999901587 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330009ae0 con 0x7ff3381506a0 2023-07-21T07:34:52.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.659+0000 7ff33f19f700 1 -- 172.21.15.6:0/3999901587 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3381e9440 con 0x7ff3381506a0 2023-07-21T07:34:52.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.660+0000 7ff33f19f700 1 -- 172.21.15.6:0/3999901587 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff338149700 con 0x7ff3381506a0 2023-07-21T07:34:52.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.660+0000 7ff32effd700 1 -- 172.21.15.6:0/3999901587 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff330009c40 con 0x7ff3381506a0 2023-07-21T07:34:52.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.660+0000 7ff32effd700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff31c06ace0 0x7ff31c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:52.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.661+0000 7ff32effd700 1 -- 172.21.15.6:0/3999901587 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff33008c920 con 0x7ff3381506a0 2023-07-21T07:34:52.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.661+0000 7ff33e19d700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff31c06ace0 0x7ff31c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:52.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.661+0000 7ff33e19d700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff31c06ace0 0x7ff31c06d1a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff328009d70 tx=0x7ff328009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:52.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.665+0000 7ff32effd700 1 -- 172.21.15.6:0/3999901587 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff330057a60 con 0x7ff3381506a0 2023-07-21T07:34:52.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.908+0000 7ff33f19f700 1 -- 172.21.15.6:0/3999901587 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff33804ecc0 con 0x7ff3381506a0 2023-07-21T07:34:52.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.909+0000 7ff32effd700 1 -- 172.21.15.6:0/3999901587 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7ff330022020 con 0x7ff3381506a0 2023-07-21T07:34:52.961 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:52.961 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3052758988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3052758988},{"type":"v1","addr":"172.21.15.6:6833","nonce":3052758988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3514948644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3514948644},{"type":"v1","addr":"172.21.15.6:6835","nonce":3514948644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/3188395603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3188395603},{"type":"v1","addr":"172.21.15.86:6836","nonce":3188395603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:34:40.418961+0000","modified":"2023-07-21T07:34:44.014954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6837/815488925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":815488925},{"type":"v1","addr":"172.21.15.86:6837","nonce":815488925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T07:34:52.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.911+0000 7ff33f19f700 1 -- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff31c06ace0 msgr2=0x7ff31c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.911+0000 7ff33f19f700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff31c06ace0 0x7ff31c06d1a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff328009d70 tx=0x7ff328009210 comp rx=0 tx=0).stop 2023-07-21T07:34:52.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.911+0000 7ff33f19f700 1 -- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3381506a0 msgr2=0x7ff3381448f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:52.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.911+0000 7ff33f19f700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3381506a0 0x7ff3381448f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff330017000 tx=0x7ff330004b20 comp rx=0 tx=0).stop 2023-07-21T07:34:52.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.911+0000 7ff33f19f700 1 -- 172.21.15.6:0/3999901587 shutdown_connections 2023-07-21T07:34:52.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.911+0000 7ff33f19f700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff31c06ace0 0x7ff31c06d1a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.911+0000 7ff33f19f700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3381506a0 0x7ff3381448f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.911+0000 7ff33f19f700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3380c4910 0x7ff3380ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.911+0000 7ff33f19f700 1 --2- 172.21.15.6:0/3999901587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff33814a650 0x7ff3380a9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:52.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.911+0000 7ff33f19f700 1 -- 172.21.15.6:0/3999901587 >> 172.21.15.6:0/3999901587 conn(0x7ff33806a090 msgr2=0x7ff33806ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:52.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.911+0000 7ff33f19f700 1 -- 172.21.15.6:0/3999901587 shutdown_connections 2023-07-21T07:34:52.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:52.911+0000 7ff33f19f700 1 -- 172.21.15.6:0/3999901587 wait complete. 2023-07-21T07:34:52.965 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T07:34:52.975 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:53.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.049+0000 7fabaa6de700 1 Processor -- start 2023-07-21T07:34:53.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.050+0000 7fabaa6de700 1 -- start start 2023-07-21T07:34:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.050+0000 7fabaa6de700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faba414ed60 0x7faba40c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.050+0000 7fabaa6de700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba40ba440 con 0x7faba40c6170 2023-07-21T07:34:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.050+0000 7fabaa6de700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba40c15d0 con 0x7faba40c3750 2023-07-21T07:34:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.050+0000 7fabaa6de700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba414f140 con 0x7faba414ed60 2023-07-21T07:34:53.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.050+0000 7faba8c7b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faba414ed60 0x7faba40c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.050+0000 7faba37fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faba40c6170 0x7faba4154c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40996/0 (socket says 172.21.15.6:40996) 2023-07-21T07:34:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.050+0000 7faba37fe700 1 -- 172.21.15.6:0/1940059832 learned_addr learned my addr 172.21.15.6:0/1940059832 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.051+0000 7faba8c7b700 1 -- 172.21.15.6:0/1940059832 >> v1:172.21.15.86:6789/0 conn(0x7faba40c3750 legacy=0x7faba414e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.051+0000 7faba8c7b700 1 -- 172.21.15.6:0/1940059832 >> v1:172.21.15.6:6789/0 conn(0x7faba40c6170 legacy=0x7faba4154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.051+0000 7faba8c7b700 1 -- 172.21.15.6:0/1940059832 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40c18b0 con 0x7faba414ed60 2023-07-21T07:34:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.051+0000 7faba8c7b700 1 --2- 172.21.15.6:0/1940059832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba414ed60 0x7faba40c53e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009d90 tx=0x7fab9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d04cd86b8919892 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:53.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.051+0000 7faba2ffd700 1 -- 172.21.15.6:0/1940059832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00e070 con 0x7faba414ed60 2023-07-21T07:34:53.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.051+0000 7faba2ffd700 1 -- 172.21.15.6:0/1940059832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c00bbd0 con 0x7faba414ed60 2023-07-21T07:34:53.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.051+0000 7faba2ffd700 1 -- 172.21.15.6:0/1940059832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c012430 con 0x7faba414ed60 2023-07-21T07:34:53.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.052+0000 7fabaa6de700 1 -- 172.21.15.6:0/1940059832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba414ed60 msgr2=0x7faba40c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.052+0000 7fabaa6de700 1 --2- 172.21.15.6:0/1940059832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba414ed60 0x7faba40c53e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009d90 tx=0x7fab9c00b330 comp rx=0 tx=0).stop 2023-07-21T07:34:53.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.052+0000 7fabaa6de700 1 -- 172.21.15.6:0/1940059832 shutdown_connections 2023-07-21T07:34:53.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.052+0000 7fabaa6de700 1 --2- 172.21.15.6:0/1940059832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba414ed60 0x7faba40c53e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.052+0000 7fabaa6de700 1 -- 172.21.15.6:0/1940059832 >> 172.21.15.6:0/1940059832 conn(0x7faba40a8c90 msgr2=0x7faba406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:53.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.052+0000 7fabaa6de700 1 -- 172.21.15.6:0/1940059832 shutdown_connections 2023-07-21T07:34:53.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.052+0000 7fabaa6de700 1 -- 172.21.15.6:0/1940059832 wait complete. 2023-07-21T07:34:53.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.054+0000 7fabaa6de700 1 Processor -- start 2023-07-21T07:34:53.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.054+0000 7fabaa6de700 1 -- start start 2023-07-21T07:34:53.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7fabaa6de700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faba40c3750 0x7faba40abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7fabaa6de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba40c6170 0x7faba40ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7fabaa6de700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faba414ed60 0x7faba414a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7fabaa6de700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba40ac830 con 0x7faba40c6170 2023-07-21T07:34:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7fabaa6de700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba40c0540 con 0x7faba40c3750 2023-07-21T07:34:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7fabaa6de700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba40bdf70 con 0x7faba414ed60 2023-07-21T07:34:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba40c6170 0x7faba40ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba40c6170 0x7faba40ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32982/0 (socket says 172.21.15.6:32982) 2023-07-21T07:34:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba37fe700 1 -- 172.21.15.6:0/4133458036 learned_addr learned my addr 172.21.15.6:0/4133458036 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:53.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba3fff700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faba40c3750 0x7faba40abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba8c7b700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faba414ed60 0x7faba414a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba37fe700 1 -- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faba414ed60 msgr2=0x7faba414a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba37fe700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faba414ed60 0x7faba414a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba37fe700 1 -- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faba40c3750 msgr2=0x7faba40abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba37fe700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faba40c3750 0x7faba40abdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba37fe700 1 -- 172.21.15.6:0/4133458036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c009a70 con 0x7faba40c6170 2023-07-21T07:34:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba8c7b700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faba414ed60 0x7faba414a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba3fff700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faba40c3750 0x7faba40abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:53.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba37fe700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba40c6170 0x7faba40ac2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fab9800c520 tx=0x7fab9800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:53.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba0ff9700 1 -- 172.21.15.6:0/4133458036 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98005d70 con 0x7faba40c6170 2023-07-21T07:34:53.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.055+0000 7faba0ff9700 1 -- 172.21.15.6:0/4133458036 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab980070d0 con 0x7faba40c6170 2023-07-21T07:34:53.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.056+0000 7fabaa6de700 1 -- 172.21.15.6:0/4133458036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba40c5090 con 0x7faba40c6170 2023-07-21T07:34:53.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.056+0000 7faba0ff9700 1 -- 172.21.15.6:0/4133458036 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98007440 con 0x7faba40c6170 2023-07-21T07:34:53.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.056+0000 7fabaa6de700 1 -- 172.21.15.6:0/4133458036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba41eba90 con 0x7faba40c6170 2023-07-21T07:34:53.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.057+0000 7fabaa6de700 1 -- 172.21.15.6:0/4133458036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba41ebdd0 con 0x7faba40c6170 2023-07-21T07:34:53.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.057+0000 7faba0ff9700 1 -- 172.21.15.6:0/4133458036 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab980075a0 con 0x7faba40c6170 2023-07-21T07:34:53.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.057+0000 7faba0ff9700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab9006ace0 0x7fab9006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.057+0000 7faba0ff9700 1 -- 172.21.15.6:0/4133458036 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab980887b0 con 0x7faba40c6170 2023-07-21T07:34:53.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.058+0000 7faba3fff700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab9006ace0 0x7fab9006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.058+0000 7faba3fff700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab9006ace0 0x7fab9006d1a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fab94000f60 tx=0x7fab94009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.062+0000 7faba0ff9700 1 -- 172.21.15.6:0/4133458036 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab980539a0 con 0x7faba40c6170 2023-07-21T07:34:53.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.261+0000 7fabaa6de700 1 -- 172.21.15.6:0/4133458036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faba4074500 con 0x7faba40c6170 2023-07-21T07:34:53.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.262+0000 7faba0ff9700 1 -- 172.21.15.6:0/4133458036 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7fab98056fc0 con 0x7faba40c6170 2023-07-21T07:34:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:53.315 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:53.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.264+0000 7fabaa6de700 1 -- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab9006ace0 msgr2=0x7fab9006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.264+0000 7fabaa6de700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab9006ace0 0x7fab9006d1a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fab94000f60 tx=0x7fab94009040 comp rx=0 tx=0).stop 2023-07-21T07:34:53.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.264+0000 7fabaa6de700 1 -- 172.21.15.6:0/4133458036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba40c6170 msgr2=0x7faba40ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.264+0000 7fabaa6de700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba40c6170 0x7faba40ac2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fab9800c520 tx=0x7fab9800c8e0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.264+0000 7fabaa6de700 1 -- 172.21.15.6:0/4133458036 shutdown_connections 2023-07-21T07:34:53.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.264+0000 7fabaa6de700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab9006ace0 0x7fab9006d1a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.264+0000 7fabaa6de700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faba414ed60 0x7faba414a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.264+0000 7fabaa6de700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faba40c3750 0x7faba40abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.264+0000 7fabaa6de700 1 --2- 172.21.15.6:0/4133458036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba40c6170 0x7faba40ac2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.264+0000 7fabaa6de700 1 -- 172.21.15.6:0/4133458036 >> 172.21.15.6:0/4133458036 conn(0x7faba40a8c90 msgr2=0x7faba40c48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:53.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.264+0000 7fabaa6de700 1 -- 172.21.15.6:0/4133458036 shutdown_connections 2023-07-21T07:34:53.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.264+0000 7fabaa6de700 1 -- 172.21.15.6:0/4133458036 wait complete. 2023-07-21T07:34:53.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:34:38.107491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:34:39.423138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:34:53.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:34:53.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.405+0000 7f4335772700 1 Processor -- start 2023-07-21T07:34:53.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.405+0000 7f4335772700 1 -- start start 2023-07-21T07:34:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.406+0000 7f4335772700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f433006d8a0 0x7f43300c5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.406+0000 7f4335772700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4330155530 con 0x7f433006a300 2023-07-21T07:34:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.406+0000 7f4335772700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43300c5690 con 0x7f43300ba140 2023-07-21T07:34:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.406+0000 7f4335772700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43300c1a30 con 0x7f433006d8a0 2023-07-21T07:34:53.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.406+0000 7f432effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f433006a300 0x7f43301519b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41008/0 (socket says 172.21.15.6:41008) 2023-07-21T07:34:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.406+0000 7f432effd700 1 -- 172.21.15.6:0/3508971616 learned_addr learned my addr 172.21.15.6:0/3508971616 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.406+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775359552 0 0) 0x7f4330155530 con 0x7f433006a300 2023-07-21T07:34:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.406+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43180035b0 con 0x7f433006a300 2023-07-21T07:34:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432f7fe700 1 --2- 172.21.15.6:0/3508971616 >> v2:172.21.15.86:3300/0 conn(0x7f433006d8a0 0x7f43300c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 770630412 0 0) 0x7f43180035b0 con 0x7f433006a300 2023-07-21T07:34:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 >> v2:172.21.15.86:3300/0 conn(0x7f433006d8a0 msgr2=0x7f43300c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:53.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 --2- 172.21.15.6:0/3508971616 >> v2:172.21.15.86:3300/0 conn(0x7f433006d8a0 0x7f43300c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 >> v1:172.21.15.86:6789/0 conn(0x7f43300ba140 legacy=0x7f43300c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4330154920 con 0x7f433006a300 2023-07-21T07:34:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f4324001670 con 0x7f433006a300 2023-07-21T07:34:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 >> v1:172.21.15.6:6789/0 conn(0x7f433006a300 legacy=0x7f43301519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 --2- 172.21.15.6:0/3508971616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4318003a00 0x7f4318003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 --2- 172.21.15.6:0/3508971616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4318004850 0x7f4318004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 --2- 172.21.15.6:0/3508971616 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4318005210 0x7f431800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43300c1a30 con 0x7f4318004850 2023-07-21T07:34:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431800c1b0 con 0x7f4318003a00 2023-07-21T07:34:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f431800c370 con 0x7f4318005210 2023-07-21T07:34:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432e7fc700 1 --2- 172.21.15.6:0/3508971616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4318004850 0x7f4318004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432effd700 1 --2- 172.21.15.6:0/3508971616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4318003a00 0x7f4318003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432f7fe700 1 --2- 172.21.15.6:0/3508971616 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4318005210 0x7f431800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432e7fc700 1 -- 172.21.15.6:0/3508971616 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4318005210 msgr2=0x7f431800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432e7fc700 1 --2- 172.21.15.6:0/3508971616 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4318005210 0x7f431800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432e7fc700 1 -- 172.21.15.6:0/3508971616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4318003a00 msgr2=0x7f4318003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:53.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432e7fc700 1 --2- 172.21.15.6:0/3508971616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4318003a00 0x7f4318003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432e7fc700 1 -- 172.21.15.6:0/3508971616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43180035b0 con 0x7f4318004850 2023-07-21T07:34:53.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432effd700 1 --2- 172.21.15.6:0/3508971616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4318003a00 0x7f4318003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:53.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432f7fe700 1 --2- 172.21.15.6:0/3508971616 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4318005210 0x7f431800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:53.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432f7fe700 1 -- 172.21.15.6:0/3508971616 reap_dead start 2023-07-21T07:34:53.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432e7fc700 1 --2- 172.21.15.6:0/3508971616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4318004850 0x7f4318004cd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f43300ba5b0 tx=0x7f4318005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d6cdbbcf600d0b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:53.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.407+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43200052d0 con 0x7f4318004850 2023-07-21T07:34:53.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.408+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4320005430 con 0x7f4318004850 2023-07-21T07:34:53.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.408+0000 7f432dffb700 1 -- 172.21.15.6:0/3508971616 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43200038c0 con 0x7f4318004850 2023-07-21T07:34:53.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.408+0000 7f4335772700 1 -- 172.21.15.6:0/3508971616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4318004850 msgr2=0x7f4318004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.408+0000 7f4335772700 1 --2- 172.21.15.6:0/3508971616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4318004850 0x7f4318004cd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f43300ba5b0 tx=0x7f4318005880 comp rx=0 tx=0).stop 2023-07-21T07:34:53.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.408+0000 7f4335772700 1 -- 172.21.15.6:0/3508971616 shutdown_connections 2023-07-21T07:34:53.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.408+0000 7f4335772700 1 --2- 172.21.15.6:0/3508971616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4318004850 0x7f4318004cd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.408+0000 7f4335772700 1 -- 172.21.15.6:0/3508971616 >> 172.21.15.6:0/3508971616 conn(0x7f43300a8660 msgr2=0x7f43300a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.408+0000 7f4335772700 1 -- 172.21.15.6:0/3508971616 shutdown_connections 2023-07-21T07:34:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.408+0000 7f4335772700 1 -- 172.21.15.6:0/3508971616 wait complete. 2023-07-21T07:34:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.409+0000 7f4335772700 1 Processor -- start 2023-07-21T07:34:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.409+0000 7f4335772700 1 -- start start 2023-07-21T07:34:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.410+0000 7f4335772700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4318004850 0x7f43300bf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.410+0000 7f4335772700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43300be950 0x7f43301ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.410+0000 7f4335772700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4330155e40 0x7f43300718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.410+0000 7f4335772700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43301eaaa0 con 0x7f4330155e40 2023-07-21T07:34:53.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.410+0000 7f4335772700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43301ea4e0 con 0x7f4318004850 2023-07-21T07:34:53.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.410+0000 7f4335772700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43301ea7c0 con 0x7f43300be950 2023-07-21T07:34:53.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.410+0000 7f432f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4330155e40 0x7f43300718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.410+0000 7f432f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4330155e40 0x7f43300718f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33002/0 (socket says 172.21.15.6:33002) 2023-07-21T07:34:53.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.410+0000 7f432f7fe700 1 -- 172.21.15.6:0/2510940686 learned_addr learned my addr 172.21.15.6:0/2510940686 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:53.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.410+0000 7f432effd700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4318004850 0x7f43300bf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.410+0000 7f432e7fc700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43300be950 0x7f43301ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.411+0000 7f432f7fe700 1 -- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43300be950 msgr2=0x7f43301ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.411+0000 7f432f7fe700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43300be950 0x7f43301ed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.411+0000 7f432f7fe700 1 -- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4318004850 msgr2=0x7f43300bf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.411+0000 7f432f7fe700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4318004850 0x7f43300bf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.411+0000 7f432f7fe700 1 -- 172.21.15.6:0/2510940686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43301ed1b0 con 0x7f4330155e40 2023-07-21T07:34:53.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.411+0000 7f432effd700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4318004850 0x7f43300bf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.411+0000 7f432e7fc700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43300be950 0x7f43301ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.411+0000 7f432f7fe700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4330155e40 0x7f43300718f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4330073ff0 tx=0x7f43280104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.411+0000 7f43177fe700 1 -- 172.21.15.6:0/2510940686 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432801b070 con 0x7f4330155e40 2023-07-21T07:34:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.411+0000 7f43177fe700 1 -- 172.21.15.6:0/2510940686 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432800f040 con 0x7f4330155e40 2023-07-21T07:34:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.411+0000 7f4335772700 1 -- 172.21.15.6:0/2510940686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43301ed490 con 0x7f4330155e40 2023-07-21T07:34:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.411+0000 7f43177fe700 1 -- 172.21.15.6:0/2510940686 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432800e050 con 0x7f4330155e40 2023-07-21T07:34:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.411+0000 7f4335772700 1 -- 172.21.15.6:0/2510940686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43301edef0 con 0x7f4330155e40 2023-07-21T07:34:53.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.412+0000 7f4335772700 1 -- 172.21.15.6:0/2510940686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43301ed010 con 0x7f4330155e40 2023-07-21T07:34:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.413+0000 7f43177fe700 1 -- 172.21.15.6:0/2510940686 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4328003a20 con 0x7f4330155e40 2023-07-21T07:34:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.413+0000 7f43177fe700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f431c06ace0 0x7f431c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.413+0000 7f43177fe700 1 -- 172.21.15.6:0/2510940686 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43280897a0 con 0x7f4330155e40 2023-07-21T07:34:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.413+0000 7f432effd700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f431c06ace0 0x7f431c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.414+0000 7f432effd700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f431c06ace0 0x7f431c06d1a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4324000f60 tx=0x7f4324009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.417+0000 7f43177fe700 1 -- 172.21.15.6:0/2510940686 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43301ed010 con 0x7f4330155e40 2023-07-21T07:34:53.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.614+0000 7f4335772700 1 -- 172.21.15.6:0/2510940686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43301ed6d0 con 0x7f4330155e40 2023-07-21T07:34:53.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.615+0000 7f43177fe700 1 -- 172.21.15.6:0/2510940686 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43301ed6d0 con 0x7f4330155e40 2023-07-21T07:34:53.667 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:34:53.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.617+0000 7f4335772700 1 -- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f431c06ace0 msgr2=0x7f431c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.617+0000 7f4335772700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f431c06ace0 0x7f431c06d1a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4324000f60 tx=0x7f4324009040 comp rx=0 tx=0).stop 2023-07-21T07:34:53.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.617+0000 7f4335772700 1 -- 172.21.15.6:0/2510940686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4330155e40 msgr2=0x7f43300718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.617+0000 7f4335772700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4330155e40 0x7f43300718f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4330073ff0 tx=0x7f43280104a0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.617+0000 7f4335772700 1 -- 172.21.15.6:0/2510940686 shutdown_connections 2023-07-21T07:34:53.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.617+0000 7f4335772700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f431c06ace0 0x7f431c06d1a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.617+0000 7f4335772700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4330155e40 0x7f43300718f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.617+0000 7f4335772700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4318004850 0x7f43300bf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.617+0000 7f4335772700 1 --2- 172.21.15.6:0/2510940686 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43300be950 0x7f43301ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.617+0000 7f4335772700 1 -- 172.21.15.6:0/2510940686 >> 172.21.15.6:0/2510940686 conn(0x7f43300a8660 msgr2=0x7f43301500c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:53.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.617+0000 7f4335772700 1 -- 172.21.15.6:0/2510940686 shutdown_connections 2023-07-21T07:34:53.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.617+0000 7f4335772700 1 -- 172.21.15.6:0/2510940686 wait complete. 2023-07-21T07:34:53.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:34:53.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.756+0000 7f1cb7bd7700 1 Processor -- start 2023-07-21T07:34:53.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.757+0000 7f1cb7bd7700 1 -- start start 2023-07-21T07:34:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.757+0000 7f1cb7bd7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb014c580 0x7f1cb00abd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.757+0000 7f1cb7bd7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb00ac280 con 0x7f1cb00c2260 2023-07-21T07:34:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.757+0000 7f1cb7bd7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb0066050 con 0x7f1cb00aafe0 2023-07-21T07:34:53.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.757+0000 7f1cb7bd7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0066580 con 0x7f1cb014c580 2023-07-21T07:34:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb5172700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1cb00c2260 0x7f1cb00aa8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41026/0 (socket says 172.21.15.6:41026) 2023-07-21T07:34:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb5172700 1 -- 172.21.15.6:0/4069941593 learned_addr learned my addr 172.21.15.6:0/4069941593 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb5973700 1 --2- 172.21.15.6:0/4069941593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb014c580 0x7f1cb00abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583225800 0 0) 0x7f1cac001110 con 0x7f1cb00c2260 2023-07-21T07:34:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c9c0035b0 con 0x7f1cb00c2260 2023-07-21T07:34:53.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042125074 0 0) 0x7f1cb0066050 con 0x7f1cb00aafe0 2023-07-21T07:34:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cac001110 con 0x7f1cb00aafe0 2023-07-21T07:34:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224648408 0 0) 0x7f1c9c0035b0 con 0x7f1cb00c2260 2023-07-21T07:34:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb014c580 msgr2=0x7f1cb00abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 --2- 172.21.15.6:0/4069941593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb014c580 0x7f1cb00abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 >> v1:172.21.15.86:6789/0 conn(0x7f1cb00aafe0 legacy=0x7f1cb015cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb014c960 con 0x7f1cb00c2260 2023-07-21T07:34:53.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f1cac001800 con 0x7f1cb00c2260 2023-07-21T07:34:53.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 >> v1:172.21.15.6:6789/0 conn(0x7f1cb00c2260 legacy=0x7f1cb00aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 --2- 172.21.15.6:0/4069941593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c003bc0 0x7f1c9c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 --2- 172.21.15.6:0/4069941593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb014c580 0x7f1c9c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 --2- 172.21.15.6:0/4069941593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c9c004d90 0x7f1c9c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0066580 con 0x7f1c9c003bc0 2023-07-21T07:34:53.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c00bb10 con 0x7f1c9c004d90 2023-07-21T07:34:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c00bcd0 con 0x7f1cb014c580 2023-07-21T07:34:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb5973700 1 --2- 172.21.15.6:0/4069941593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c003bc0 0x7f1c9c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb5172700 1 --2- 172.21.15.6:0/4069941593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb014c580 0x7f1c9c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.758+0000 7f1cb6174700 1 --2- 172.21.15.6:0/4069941593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c9c004d90 0x7f1c9c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb5973700 1 -- 172.21.15.6:0/4069941593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb014c580 msgr2=0x7f1c9c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:53.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb5973700 1 --2- 172.21.15.6:0/4069941593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb014c580 0x7f1c9c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb5973700 1 -- 172.21.15.6:0/4069941593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c9c004d90 msgr2=0x7f1c9c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb5973700 1 --2- 172.21.15.6:0/4069941593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c9c004d90 0x7f1c9c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb5973700 1 -- 172.21.15.6:0/4069941593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c0035b0 con 0x7f1c9c003bc0 2023-07-21T07:34:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb5973700 1 --2- 172.21.15.6:0/4069941593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c003bc0 0x7f1c9c003fc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009b60 tx=0x7f1c9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc613220d0c3c95 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca000e6c0 con 0x7f1c9c003bc0 2023-07-21T07:34:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca000e820 con 0x7f1c9c003bc0 2023-07-21T07:34:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb4971700 1 -- 172.21.15.6:0/4069941593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca000eb90 con 0x7f1c9c003bc0 2023-07-21T07:34:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/4069941593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c003bc0 msgr2=0x7f1c9c003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb7bd7700 1 --2- 172.21.15.6:0/4069941593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c003bc0 0x7f1c9c003fc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009b60 tx=0x7f1c9c005880 comp rx=0 tx=0).stop 2023-07-21T07:34:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb6174700 1 -- 172.21.15.6:0/4069941593 reap_dead start 2023-07-21T07:34:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/4069941593 shutdown_connections 2023-07-21T07:34:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.759+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/4069941593 >> 172.21.15.6:0/4069941593 conn(0x7f1cb00c2c20 msgr2=0x7f1cb00c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.760+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/4069941593 shutdown_connections 2023-07-21T07:34:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.760+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/4069941593 wait complete. 2023-07-21T07:34:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.761+0000 7f1cb7bd7700 1 Processor -- start 2023-07-21T07:34:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.761+0000 7f1cb7bd7700 1 -- start start 2023-07-21T07:34:53.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.761+0000 7f1cb7bd7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c9c003bc0 0x7f1cb014fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.761+0000 7f1cb7bd7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb01451e0 0x7f1cb0155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.761+0000 7f1cb7bd7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb0155f40 0x7f1cb0141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.761+0000 7f1cb7bd7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0152f50 con 0x7f1cb01451e0 2023-07-21T07:34:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.761+0000 7f1cb7bd7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0145660 con 0x7f1c9c003bc0 2023-07-21T07:34:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.761+0000 7f1cb7bd7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb01eab40 con 0x7f1cb0155f40 2023-07-21T07:34:53.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.761+0000 7f1cb5172700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb01451e0 0x7f1cb0155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1cb5172700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb01451e0 0x7f1cb0155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33018/0 (socket says 172.21.15.6:33018) 2023-07-21T07:34:53.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1cb5172700 1 -- 172.21.15.6:0/916794763 learned_addr learned my addr 172.21.15.6:0/916794763 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:53.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1cb5973700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c9c003bc0 0x7f1cb014fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1cb6174700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb0155f40 0x7f1cb0141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1cb5172700 1 -- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb0155f40 msgr2=0x7f1cb0141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1cb5172700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb0155f40 0x7f1cb0141110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1cb5172700 1 -- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c9c003bc0 msgr2=0x7f1cb014fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:53.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1cb5172700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c9c003bc0 0x7f1cb014fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:53.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1cb5172700 1 -- 172.21.15.6:0/916794763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb01503b0 con 0x7f1cb01451e0 2023-07-21T07:34:53.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1cb5172700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb01451e0 0x7f1cb0155a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1cac007310 tx=0x7f1cac007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:53.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1ca67fc700 1 -- 172.21.15.6:0/916794763 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac00f680 con 0x7f1cb01451e0 2023-07-21T07:34:53.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1ca67fc700 1 -- 172.21.15.6:0/916794763 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac00f840 con 0x7f1cb01451e0 2023-07-21T07:34:53.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1ca67fc700 1 -- 172.21.15.6:0/916794763 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac00fbf0 con 0x7f1cb01451e0 2023-07-21T07:34:53.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/916794763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb01dc970 con 0x7f1cb01451e0 2023-07-21T07:34:53.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.762+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/916794763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb01dcf30 con 0x7f1cb01451e0 2023-07-21T07:34:53.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.763+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/916794763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb0074500 con 0x7f1cb01451e0 2023-07-21T07:34:53.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.763+0000 7f1ca67fc700 1 -- 172.21.15.6:0/916794763 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1cac00fd50 con 0x7f1cb01451e0 2023-07-21T07:34:53.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.764+0000 7f1ca67fc700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1c9406ace0 0x7f1c9406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:53.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.764+0000 7f1ca67fc700 1 -- 172.21.15.6:0/916794763 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1cac089220 con 0x7f1cb01451e0 2023-07-21T07:34:53.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.764+0000 7f1cb5973700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1c9406ace0 0x7f1c9406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:53.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.765+0000 7f1cb5973700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1c9406ace0 0x7f1c9406d1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00090b0 tx=0x7f1ca0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:53.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.768+0000 7f1ca67fc700 1 -- 172.21.15.6:0/916794763 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1cac054360 con 0x7f1cb01451e0 2023-07-21T07:34:54.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.965+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/916794763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1cb00ac280 con 0x7f1cb01451e0 2023-07-21T07:34:54.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.965+0000 7f1ca67fc700 1 -- 172.21.15.6:0/916794763 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1cb00ac280 con 0x7f1cb01451e0 2023-07-21T07:34:54.017 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:34:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.967+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1c9406ace0 msgr2=0x7f1c9406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.967+0000 7f1cb7bd7700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1c9406ace0 0x7f1c9406d1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00090b0 tx=0x7f1ca0008030 comp rx=0 tx=0).stop 2023-07-21T07:34:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.967+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/916794763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb01451e0 msgr2=0x7f1cb0155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.967+0000 7f1cb7bd7700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb01451e0 0x7f1cb0155a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1cac007310 tx=0x7f1cac007620 comp rx=0 tx=0).stop 2023-07-21T07:34:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.967+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/916794763 shutdown_connections 2023-07-21T07:34:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.967+0000 7f1cb7bd7700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1c9406ace0 0x7f1c9406d1a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.967+0000 7f1cb7bd7700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb0155f40 0x7f1cb0141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.967+0000 7f1cb7bd7700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c9c003bc0 0x7f1cb014fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.967+0000 7f1cb7bd7700 1 --2- 172.21.15.6:0/916794763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb01451e0 0x7f1cb0155a00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.967+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/916794763 >> 172.21.15.6:0/916794763 conn(0x7f1cb00c2c20 msgr2=0x7f1cb01522a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.967+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/916794763 shutdown_connections 2023-07-21T07:34:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:53.967+0000 7f1cb7bd7700 1 -- 172.21.15.6:0/916794763 wait complete. 2023-07-21T07:34:54.031 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:34:54.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.108+0000 7f5f80e50700 1 Processor -- start 2023-07-21T07:34:54.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.108+0000 7f5f80e50700 1 -- start start 2023-07-21T07:34:54.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.109+0000 7f5f80e50700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f7c14c580 0x7f5f7c0abd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.109+0000 7f5f80e50700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f7c0aafe0 0x7f5f7c15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.109+0000 7f5f80e50700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0ac280 con 0x7f5f7c0c2260 2023-07-21T07:34:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.109+0000 7f5f80e50700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c066580 con 0x7f5f7c14c580 2023-07-21T07:34:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.109+0000 7f5f80e50700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c152f50 con 0x7f5f7c0aafe0 2023-07-21T07:34:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.109+0000 7f5f7a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f7c14c580 0x7f5f7c0abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.109+0000 7f5f7a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f7c14c580 0x7f5f7c0abd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33024/0 (socket says 172.21.15.6:33024) 2023-07-21T07:34:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.109+0000 7f5f79d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5f7c0c2260 0x7f5f7c0aa8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41044/0 (socket says 172.21.15.6:41044) 2023-07-21T07:34:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.109+0000 7f5f7a59c700 1 -- 172.21.15.6:0/4195668237 learned_addr learned my addr 172.21.15.6:0/4195668237 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.110+0000 7f5f7a59c700 1 -- 172.21.15.6:0/4195668237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f7c0aafe0 msgr2=0x7f5f7c15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.110+0000 7f5f7ad9d700 1 --2- 172.21.15.6:0/4195668237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f7c0aafe0 0x7f5f7c15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.110+0000 7f5f7a59c700 1 --2- 172.21.15.6:0/4195668237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f7c0aafe0 0x7f5f7c15cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.110+0000 7f5f7959a700 1 -- 172.21.15.6:0/4195668237 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638767996 0 0) 0x7f5f6c001110 con 0x7f5f7c0c2260 2023-07-21T07:34:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.110+0000 7f5f7a59c700 1 -- 172.21.15.6:0/4195668237 >> v1:172.21.15.6:6789/0 conn(0x7f5f7c0c2260 legacy=0x7f5f7c0aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.110+0000 7f5f7a59c700 1 -- 172.21.15.6:0/4195668237 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c066050 con 0x7f5f7c14c580 2023-07-21T07:34:54.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.110+0000 7f5f7a59c700 1 --2- 172.21.15.6:0/4195668237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c14c580 0x7f5f7c0abd40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f700098f0 tx=0x7f5f70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d2719294f6263a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:54.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.110+0000 7f5f7959a700 1 -- 172.21.15.6:0/4195668237 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000b8a0 con 0x7f5f7c14c580 2023-07-21T07:34:54.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.110+0000 7f5f7959a700 1 -- 172.21.15.6:0/4195668237 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7000ba00 con 0x7f5f7c14c580 2023-07-21T07:34:54.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.110+0000 7f5f7959a700 1 -- 172.21.15.6:0/4195668237 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000bd90 con 0x7f5f7c14c580 2023-07-21T07:34:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.110+0000 7f5f80e50700 1 -- 172.21.15.6:0/4195668237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c14c580 msgr2=0x7f5f7c0abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.111+0000 7f5f80e50700 1 --2- 172.21.15.6:0/4195668237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c14c580 0x7f5f7c0abd40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f700098f0 tx=0x7f5f70009c00 comp rx=0 tx=0).stop 2023-07-21T07:34:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.111+0000 7f5f80e50700 1 -- 172.21.15.6:0/4195668237 shutdown_connections 2023-07-21T07:34:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.111+0000 7f5f80e50700 1 --2- 172.21.15.6:0/4195668237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f7c0aafe0 0x7f5f7c15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.111+0000 7f5f80e50700 1 --2- 172.21.15.6:0/4195668237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c14c580 0x7f5f7c0abd40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.111+0000 7f5f80e50700 1 -- 172.21.15.6:0/4195668237 >> 172.21.15.6:0/4195668237 conn(0x7f5f7c0c2c20 msgr2=0x7f5f7c0c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.111+0000 7f5f80e50700 1 -- 172.21.15.6:0/4195668237 shutdown_connections 2023-07-21T07:34:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.111+0000 7f5f80e50700 1 -- 172.21.15.6:0/4195668237 wait complete. 2023-07-21T07:34:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.112+0000 7f5f80e50700 1 Processor -- start 2023-07-21T07:34:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.112+0000 7f5f80e50700 1 -- start start 2023-07-21T07:34:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f80e50700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f7c0aafe0 0x7f5f7c0bf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f80e50700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c0c2260 0x7f5f7c06fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f80e50700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f7c14c580 0x7f5f7c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f80e50700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1e9fd0 con 0x7f5f7c0c2260 2023-07-21T07:34:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f80e50700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1ea2b0 con 0x7f5f7c0aafe0 2023-07-21T07:34:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f80e50700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1ea590 con 0x7f5f7c14c580 2023-07-21T07:34:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f79d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c0c2260 0x7f5f7c06fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f79d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c0c2260 0x7f5f7c06fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33032/0 (socket says 172.21.15.6:33032) 2023-07-21T07:34:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f79d9b700 1 -- 172.21.15.6:0/2044762805 learned_addr learned my addr 172.21.15.6:0/2044762805 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f7a59c700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f7c0aafe0 0x7f5f7c0bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f7ad9d700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f7c14c580 0x7f5f7c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f79d9b700 1 -- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f7c14c580 msgr2=0x7f5f7c0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f79d9b700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f7c14c580 0x7f5f7c0702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f79d9b700 1 -- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f7c0aafe0 msgr2=0x7f5f7c0bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f79d9b700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f7c0aafe0 0x7f5f7c0bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f79d9b700 1 -- 172.21.15.6:0/2044762805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f70009550 con 0x7f5f7c0c2260 2023-07-21T07:34:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f79d9b700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c0c2260 0x7f5f7c06fd70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00c550 tx=0x7f5f6c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f6affd700 1 -- 172.21.15.6:0/2044762805 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c004c80 con 0x7f5f7c0c2260 2023-07-21T07:34:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f6affd700 1 -- 172.21.15.6:0/2044762805 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c004e00 con 0x7f5f7c0c2260 2023-07-21T07:34:54.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f6affd700 1 -- 172.21.15.6:0/2044762805 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c007310 con 0x7f5f7c0c2260 2023-07-21T07:34:54.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.113+0000 7f5f80e50700 1 -- 172.21.15.6:0/2044762805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c1ea870 con 0x7f5f7c0c2260 2023-07-21T07:34:54.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.114+0000 7f5f80e50700 1 -- 172.21.15.6:0/2044762805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c143730 con 0x7f5f7c0c2260 2023-07-21T07:34:54.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.114+0000 7f5f80e50700 1 -- 172.21.15.6:0/2044762805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c1ea110 con 0x7f5f7c0c2260 2023-07-21T07:34:54.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.115+0000 7f5f6affd700 1 -- 172.21.15.6:0/2044762805 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f6c007470 con 0x7f5f7c0c2260 2023-07-21T07:34:54.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.115+0000 7f5f6affd700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5f5c06ace0 0x7f5f5c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.115+0000 7f5f6affd700 1 -- 172.21.15.6:0/2044762805 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f6c088e10 con 0x7f5f7c0c2260 2023-07-21T07:34:54.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.115+0000 7f5f7a59c700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5f5c06ace0 0x7f5f5c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.116+0000 7f5f7a59c700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5f5c06ace0 0x7f5f5c06d1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009c40 tx=0x7f5f70008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:54.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.120+0000 7f5f6affd700 1 -- 172.21.15.6:0/2044762805 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5f7c1ea110 con 0x7f5f7c0c2260 2023-07-21T07:34:54.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.317+0000 7f5f80e50700 1 -- 172.21.15.6:0/2044762805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f7c0ac280 con 0x7f5f7c0c2260 2023-07-21T07:34:54.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.317+0000 7f5f6affd700 1 -- 172.21.15.6:0/2044762805 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f7c0ac280 con 0x7f5f7c0c2260 2023-07-21T07:34:54.369 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.319+0000 7f5f80e50700 1 -- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5f5c06ace0 msgr2=0x7f5f5c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.319+0000 7f5f80e50700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5f5c06ace0 0x7f5f5c06d1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009c40 tx=0x7f5f70008030 comp rx=0 tx=0).stop 2023-07-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.319+0000 7f5f80e50700 1 -- 172.21.15.6:0/2044762805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c0c2260 msgr2=0x7f5f7c06fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.319+0000 7f5f80e50700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c0c2260 0x7f5f7c06fd70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00c550 tx=0x7f5f6c00c860 comp rx=0 tx=0).stop 2023-07-21T07:34:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.319+0000 7f5f80e50700 1 -- 172.21.15.6:0/2044762805 shutdown_connections 2023-07-21T07:34:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.319+0000 7f5f80e50700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5f5c06ace0 0x7f5f5c06d1a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.319+0000 7f5f80e50700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f7c14c580 0x7f5f7c0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.319+0000 7f5f80e50700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5f7c0aafe0 0x7f5f7c0bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.319+0000 7f5f80e50700 1 --2- 172.21.15.6:0/2044762805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c0c2260 0x7f5f7c06fd70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.319+0000 7f5f80e50700 1 -- 172.21.15.6:0/2044762805 >> 172.21.15.6:0/2044762805 conn(0x7f5f7c0c2c20 msgr2=0x7f5f7c06b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.319+0000 7f5f80e50700 1 -- 172.21.15.6:0/2044762805 shutdown_connections 2023-07-21T07:34:54.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.319+0000 7f5f80e50700 1 -- 172.21.15.6:0/2044762805 wait complete. 2023-07-21T07:34:54.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:34:54.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.458+0000 7f7cdf3a3700 1 Processor -- start 2023-07-21T07:34:54.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.459+0000 7f7cdf3a3700 1 -- start start 2023-07-21T07:34:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.459+0000 7f7cdf3a3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7cd80ba140 0x7f7cd80c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.459+0000 7f7cdf3a3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd8155530 con 0x7f7cd806d8a0 2023-07-21T07:34:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.459+0000 7f7cdf3a3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd80c5690 con 0x7f7cd806a300 2023-07-21T07:34:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.459+0000 7f7cdf3a3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd80c1a30 con 0x7f7cd80ba140 2023-07-21T07:34:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.459+0000 7f7cdc93e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7cd80ba140 0x7f7cd80c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.459+0000 7f7cdd940700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7cd806d8a0 0x7f7cd80c4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41062/0 (socket says 172.21.15.6:41062) 2023-07-21T07:34:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.459+0000 7f7cdd940700 1 -- 172.21.15.6:0/3088805288 learned_addr learned my addr 172.21.15.6:0/3088805288 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.460+0000 7f7cdc93e700 1 -- 172.21.15.6:0/3088805288 >> v1:172.21.15.86:6789/0 conn(0x7f7cd806a300 legacy=0x7f7cd81519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.460+0000 7f7cdc93e700 1 -- 172.21.15.6:0/3088805288 >> v1:172.21.15.6:6789/0 conn(0x7f7cd806d8a0 legacy=0x7f7cd80c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.460+0000 7f7cdc93e700 1 -- 172.21.15.6:0/3088805288 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd8154920 con 0x7f7cd80ba140 2023-07-21T07:34:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.460+0000 7f7ccffff700 1 -- 172.21.15.6:0/3088805288 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234163037 0 0) 0x7f7cd8155530 con 0x7f7cd806d8a0 2023-07-21T07:34:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.460+0000 7f7cdc93e700 1 --2- 172.21.15.6:0/3088805288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80ba140 0x7f7cd80c4a40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009840 tx=0x7f7cd4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd91b08e59a397a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.460+0000 7f7ccffff700 1 -- 172.21.15.6:0/3088805288 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4011830 con 0x7f7cd80ba140 2023-07-21T07:34:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.460+0000 7f7ccffff700 1 -- 172.21.15.6:0/3088805288 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd4011990 con 0x7f7cd80ba140 2023-07-21T07:34:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.460+0000 7f7ccffff700 1 -- 172.21.15.6:0/3088805288 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4011d20 con 0x7f7cd80ba140 2023-07-21T07:34:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.461+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/3088805288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80ba140 msgr2=0x7f7cd80c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.461+0000 7f7cdf3a3700 1 --2- 172.21.15.6:0/3088805288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80ba140 0x7f7cd80c4a40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009840 tx=0x7f7cd4009b50 comp rx=0 tx=0).stop 2023-07-21T07:34:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.461+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/3088805288 shutdown_connections 2023-07-21T07:34:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.461+0000 7f7cdf3a3700 1 --2- 172.21.15.6:0/3088805288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80ba140 0x7f7cd80c4a40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.461+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/3088805288 >> 172.21.15.6:0/3088805288 conn(0x7f7cd80a8660 msgr2=0x7f7cd80a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.461+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/3088805288 shutdown_connections 2023-07-21T07:34:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.461+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/3088805288 wait complete. 2023-07-21T07:34:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.462+0000 7f7cdf3a3700 1 Processor -- start 2023-07-21T07:34:54.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.462+0000 7f7cdf3a3700 1 -- start start 2023-07-21T07:34:54.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdf3a3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cd806a300 0x7f7cd80bf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdf3a3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7cd806d8a0 0x7f7cd80c03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdf3a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80ba140 0x7f7cd81ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdf3a3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8070880 con 0x7f7cd80ba140 2023-07-21T07:34:54.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdf3a3700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8070b40 con 0x7f7cd806d8a0 2023-07-21T07:34:54.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdf3a3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd814c040 con 0x7f7cd806a300 2023-07-21T07:34:54.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdd940700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80ba140 0x7f7cd81ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdd940700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80ba140 0x7f7cd81ed530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33048/0 (socket says 172.21.15.6:33048) 2023-07-21T07:34:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdd940700 1 -- 172.21.15.6:0/2702582163 learned_addr learned my addr 172.21.15.6:0/2702582163 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdd13f700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cd806a300 0x7f7cd80bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdc93e700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7cd806d8a0 0x7f7cd80c03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdd940700 1 -- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cd806a300 msgr2=0x7f7cd80bf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdd940700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cd806a300 0x7f7cd80bf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdd940700 1 -- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7cd806d8a0 msgr2=0x7f7cd80c03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdd940700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7cd806d8a0 0x7f7cd80c03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdd940700 1 -- 172.21.15.6:0/2702582163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd40094a0 con 0x7f7cd80ba140 2023-07-21T07:34:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdd940700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80ba140 0x7f7cd81ed530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0002230 tx=0x7f7cd000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7ccdffb700 1 -- 172.21.15.6:0/2702582163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd000aac0 con 0x7f7cd80ba140 2023-07-21T07:34:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7ccdffb700 1 -- 172.21.15.6:0/2702582163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd000ac40 con 0x7f7cd80ba140 2023-07-21T07:34:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/2702582163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd814c320 con 0x7f7cd80ba140 2023-07-21T07:34:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.463+0000 7f7ccdffb700 1 -- 172.21.15.6:0/2702582163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd00070d0 con 0x7f7cd80ba140 2023-07-21T07:34:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.464+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/2702582163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd80c0910 con 0x7f7cd80ba140 2023-07-21T07:34:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.464+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/2702582163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd8070cb0 con 0x7f7cd80ba140 2023-07-21T07:34:54.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.465+0000 7f7ccdffb700 1 -- 172.21.15.6:0/2702582163 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7cd0007250 con 0x7f7cd80ba140 2023-07-21T07:34:54.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.465+0000 7f7ccdffb700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7cbc06ace0 0x7f7cbc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.465+0000 7f7ccdffb700 1 -- 172.21.15.6:0/2702582163 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7cd00891d0 con 0x7f7cd80ba140 2023-07-21T07:34:54.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.465+0000 7f7cdd13f700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7cbc06ace0 0x7f7cbc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.466+0000 7f7cdd13f700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7cbc06ace0 0x7f7cbc06d1a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80c3700 tx=0x7f7cc8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:54.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.469+0000 7f7ccdffb700 1 -- 172.21.15.6:0/2702582163 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7cd0054310 con 0x7f7cd80ba140 2023-07-21T07:34:54.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.667+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/2702582163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7cd8074500 con 0x7f7cd80ba140 2023-07-21T07:34:54.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.667+0000 7f7ccdffb700 1 -- 172.21.15.6:0/2702582163 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7cd0057930 con 0x7f7cd80ba140 2023-07-21T07:34:54.719 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:34:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.669+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7cbc06ace0 msgr2=0x7f7cbc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.669+0000 7f7cdf3a3700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7cbc06ace0 0x7f7cbc06d1a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80c3700 tx=0x7f7cc8009040 comp rx=0 tx=0).stop 2023-07-21T07:34:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.669+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/2702582163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80ba140 msgr2=0x7f7cd81ed530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.669+0000 7f7cdf3a3700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80ba140 0x7f7cd81ed530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0002230 tx=0x7f7cd000cf50 comp rx=0 tx=0).stop 2023-07-21T07:34:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.669+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/2702582163 shutdown_connections 2023-07-21T07:34:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.669+0000 7f7cdf3a3700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7cbc06ace0 0x7f7cbc06d1a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.669+0000 7f7cdf3a3700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80ba140 0x7f7cd81ed530 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.669+0000 7f7cdf3a3700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cd806a300 0x7f7cd80bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.669+0000 7f7cdf3a3700 1 --2- 172.21.15.6:0/2702582163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7cd806d8a0 0x7f7cd80c03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.669+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/2702582163 >> 172.21.15.6:0/2702582163 conn(0x7f7cd80a8660 msgr2=0x7f7cd80c2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.669+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/2702582163 shutdown_connections 2023-07-21T07:34:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.669+0000 7f7cdf3a3700 1 -- 172.21.15.6:0/2702582163 wait complete. 2023-07-21T07:34:54.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:34:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.806+0000 7f0776d88700 1 Processor -- start 2023-07-21T07:34:54.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.806+0000 7f0776d88700 1 -- start start 2023-07-21T07:34:54.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0776d88700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f077014e870 0x7f077014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0776d88700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f07700a5f00 0x7f07700c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0776d88700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07700c4ef0 con 0x7f07700c3980 2023-07-21T07:34:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0776d88700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07700c1df0 con 0x7f077014e870 2023-07-21T07:34:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0776d88700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07700c1450 con 0x7f07700a5f00 2023-07-21T07:34:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0774b24700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f077014e870 0x7f077014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0775325700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f07700c3980 0x7f0770151330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41074/0 (socket says 172.21.15.6:41074) 2023-07-21T07:34:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0774b24700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f077014e870 0x7f077014ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33052/0 (socket says 172.21.15.6:33052) 2023-07-21T07:34:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0775325700 1 -- 172.21.15.6:0/1506698771 learned_addr learned my addr 172.21.15.6:0/1506698771 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f076ffff700 1 --2- 172.21.15.6:0/1506698771 >> v2:172.21.15.86:3300/0 conn(0x7f07700a5f00 0x7f07700c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0774b24700 1 -- 172.21.15.6:0/1506698771 >> v2:172.21.15.86:3300/0 conn(0x7f07700a5f00 msgr2=0x7f07700c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0774b24700 1 --2- 172.21.15.6:0/1506698771 >> v2:172.21.15.86:3300/0 conn(0x7f07700a5f00 0x7f07700c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0774b24700 1 -- 172.21.15.6:0/1506698771 >> v1:172.21.15.6:6789/0 conn(0x7f07700c3980 legacy=0x7f0770151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f076f7fe700 1 -- 172.21.15.6:0/1506698771 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431177801 0 0) 0x7f07700c4ef0 con 0x7f07700c3980 2023-07-21T07:34:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0774b24700 1 -- 172.21.15.6:0/1506698771 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07700c1730 con 0x7f077014e870 2023-07-21T07:34:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.807+0000 7f0774b24700 1 --2- 172.21.15.6:0/1506698771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077014e870 0x7f077014ec50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f07700a9310 tx=0x7f0764009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad635f71f893abff server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.808+0000 7f076f7fe700 1 -- 172.21.15.6:0/1506698771 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764011830 con 0x7f077014e870 2023-07-21T07:34:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.808+0000 7f076f7fe700 1 -- 172.21.15.6:0/1506698771 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0764011990 con 0x7f077014e870 2023-07-21T07:34:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.808+0000 7f076f7fe700 1 -- 172.21.15.6:0/1506698771 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764011d20 con 0x7f077014e870 2023-07-21T07:34:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.808+0000 7f0776d88700 1 -- 172.21.15.6:0/1506698771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077014e870 msgr2=0x7f077014ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.808+0000 7f0776d88700 1 --2- 172.21.15.6:0/1506698771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077014e870 0x7f077014ec50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f07700a9310 tx=0x7f0764009b20 comp rx=0 tx=0).stop 2023-07-21T07:34:54.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.808+0000 7f0776d88700 1 -- 172.21.15.6:0/1506698771 shutdown_connections 2023-07-21T07:34:54.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.808+0000 7f0776d88700 1 --2- 172.21.15.6:0/1506698771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077014e870 0x7f077014ec50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.808+0000 7f0776d88700 1 --2- 172.21.15.6:0/1506698771 >> v2:172.21.15.86:3300/0 conn(0x7f07700a5f00 0x7f07700c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.808+0000 7f0776d88700 1 -- 172.21.15.6:0/1506698771 >> 172.21.15.6:0/1506698771 conn(0x7f07700a8660 msgr2=0x7f07700a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:54.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.808+0000 7f0776d88700 1 -- 172.21.15.6:0/1506698771 shutdown_connections 2023-07-21T07:34:54.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.808+0000 7f0776d88700 1 -- 172.21.15.6:0/1506698771 wait complete. 2023-07-21T07:34:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.809+0000 7f0776d88700 1 Processor -- start 2023-07-21T07:34:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.809+0000 7f0776d88700 1 -- start start 2023-07-21T07:34:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.810+0000 7f0776d88700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07700a5f00 0x7f0770144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.810+0000 7f0776d88700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07700c3980 0x7f077014eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.810+0000 7f0776d88700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f077014e870 0x7f077014f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.810+0000 7f0776d88700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077015d580 con 0x7f07700a5f00 2023-07-21T07:34:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.810+0000 7f0776d88700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0770146260 con 0x7f077014e870 2023-07-21T07:34:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.810+0000 7f0776d88700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077014f920 con 0x7f07700c3980 2023-07-21T07:34:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.810+0000 7f0774b24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07700a5f00 0x7f0770144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.810+0000 7f0774b24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07700a5f00 0x7f0770144cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33058/0 (socket says 172.21.15.6:33058) 2023-07-21T07:34:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.810+0000 7f0774b24700 1 -- 172.21.15.6:0/1195526197 learned_addr learned my addr 172.21.15.6:0/1195526197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.810+0000 7f076ffff700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07700c3980 0x7f077014eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.810+0000 7f0775325700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f077014e870 0x7f077014f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.811+0000 7f0774b24700 1 -- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07700c3980 msgr2=0x7f077014eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.811+0000 7f0774b24700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07700c3980 0x7f077014eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.811+0000 7f0774b24700 1 -- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f077014e870 msgr2=0x7f077014f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.811+0000 7f0774b24700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f077014e870 0x7f077014f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.811+0000 7f0774b24700 1 -- 172.21.15.6:0/1195526197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640094a0 con 0x7f07700a5f00 2023-07-21T07:34:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.811+0000 7f0774b24700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07700a5f00 0x7f0770144cb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f07640090b0 tx=0x7f0764004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.811+0000 7f076d7fa700 1 -- 172.21.15.6:0/1195526197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640038a0 con 0x7f07700a5f00 2023-07-21T07:34:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.811+0000 7f076d7fa700 1 -- 172.21.15.6:0/1195526197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076401e070 con 0x7f07700a5f00 2023-07-21T07:34:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.811+0000 7f0776d88700 1 -- 172.21.15.6:0/1195526197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07700c5320 con 0x7f07700a5f00 2023-07-21T07:34:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.811+0000 7f076d7fa700 1 -- 172.21.15.6:0/1195526197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764003c20 con 0x7f07700a5f00 2023-07-21T07:34:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.811+0000 7f0776d88700 1 -- 172.21.15.6:0/1195526197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0770145930 con 0x7f07700a5f00 2023-07-21T07:34:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.812+0000 7f0776d88700 1 -- 172.21.15.6:0/1195526197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0770146540 con 0x7f07700a5f00 2023-07-21T07:34:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.812+0000 7f076d7fa700 1 -- 172.21.15.6:0/1195526197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f076401a420 con 0x7f07700a5f00 2023-07-21T07:34:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.813+0000 7f076d7fa700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f075406ace0 0x7f075406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.813+0000 7f076d7fa700 1 -- 172.21.15.6:0/1195526197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f076408a440 con 0x7f07700a5f00 2023-07-21T07:34:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.813+0000 7f076ffff700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f075406ace0 0x7f075406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.813+0000 7f076ffff700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f075406ace0 0x7f075406d1a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f07700bc630 tx=0x7f075c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:54.817+0000 7f076d7fa700 1 -- 172.21.15.6:0/1195526197 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0764055580 con 0x7f07700a5f00 2023-07-21T07:34:55.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.059+0000 7f0776d88700 1 -- 172.21.15.6:0/1195526197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0770074500 con 0x7f07700a5f00 2023-07-21T07:34:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.060+0000 7f076d7fa700 1 -- 172.21.15.6:0/1195526197 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f0764058ba0 con 0x7f07700a5f00 2023-07-21T07:34:55.111 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:55.112 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3052758988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3052758988},{"type":"v1","addr":"172.21.15.6:6833","nonce":3052758988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3514948644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3514948644},{"type":"v1","addr":"172.21.15.6:6835","nonce":3514948644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/3188395603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3188395603},{"type":"v1","addr":"172.21.15.86:6836","nonce":3188395603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:34:40.418961+0000","modified":"2023-07-21T07:34:44.014954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6837/815488925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":815488925},{"type":"v1","addr":"172.21.15.86:6837","nonce":815488925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T07:34:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.062+0000 7f0776d88700 1 -- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f075406ace0 msgr2=0x7f075406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.062+0000 7f0776d88700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f075406ace0 0x7f075406d1a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f07700bc630 tx=0x7f075c008040 comp rx=0 tx=0).stop 2023-07-21T07:34:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.062+0000 7f0776d88700 1 -- 172.21.15.6:0/1195526197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07700a5f00 msgr2=0x7f0770144cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.062+0000 7f0776d88700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07700a5f00 0x7f0770144cb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f07640090b0 tx=0x7f0764004750 comp rx=0 tx=0).stop 2023-07-21T07:34:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.062+0000 7f0776d88700 1 -- 172.21.15.6:0/1195526197 shutdown_connections 2023-07-21T07:34:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.062+0000 7f0776d88700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f075406ace0 0x7f075406d1a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.062+0000 7f0776d88700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f077014e870 0x7f077014f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.062+0000 7f0776d88700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07700a5f00 0x7f0770144cb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.062+0000 7f0776d88700 1 --2- 172.21.15.6:0/1195526197 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07700c3980 0x7f077014eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.062+0000 7f0776d88700 1 -- 172.21.15.6:0/1195526197 >> 172.21.15.6:0/1195526197 conn(0x7f07700a8660 msgr2=0x7f07701514d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:55.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.062+0000 7f0776d88700 1 -- 172.21.15.6:0/1195526197 shutdown_connections 2023-07-21T07:34:55.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.062+0000 7f0776d88700 1 -- 172.21.15.6:0/1195526197 wait complete. 2023-07-21T07:34:55.115 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T07:34:55.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:34:55.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.199+0000 7f9322db9700 1 Processor -- start 2023-07-21T07:34:55.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.199+0000 7f9322db9700 1 -- start start 2023-07-21T07:34:55.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.199+0000 7f9322db9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f931c06da20 0x7f931c151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:55.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.199+0000 7f9322db9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f931c151c50 0x7f931c0c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:55.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.199+0000 7f9322db9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931c0c2ab0 con 0x7f931c06a300 2023-07-21T07:34:55.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.199+0000 7f9322db9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931c152090 con 0x7f931c06da20 2023-07-21T07:34:55.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.199+0000 7f9322db9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931c06e000 con 0x7f931c151c50 2023-07-21T07:34:55.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.200+0000 7f931bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f931c06da20 0x7f931c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:55.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.200+0000 7f931bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f931c06da20 0x7f931c151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33068/0 (socket says 172.21.15.6:33068) 2023-07-21T07:34:55.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.200+0000 7f931bfff700 1 -- 172.21.15.6:0/2736170672 learned_addr learned my addr 172.21.15.6:0/2736170672 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:55.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.200+0000 7f9321356700 1 --2- 172.21.15.6:0/2736170672 >> v2:172.21.15.86:3300/0 conn(0x7f931c151c50 0x7f931c0c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:55.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.200+0000 7f931bfff700 1 -- 172.21.15.6:0/2736170672 >> v2:172.21.15.86:3300/0 conn(0x7f931c151c50 msgr2=0x7f931c0c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:55.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.200+0000 7f931bfff700 1 --2- 172.21.15.6:0/2736170672 >> v2:172.21.15.86:3300/0 conn(0x7f931c151c50 0x7f931c0c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.200+0000 7f931bfff700 1 -- 172.21.15.6:0/2736170672 >> v1:172.21.15.86:6789/0 conn(0x7f931c06a300 legacy=0x7f931c155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:55.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.200+0000 7f931bfff700 1 -- 172.21.15.6:0/2736170672 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c06e2e0 con 0x7f931c06da20 2023-07-21T07:34:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.200+0000 7f9321356700 1 --2- 172.21.15.6:0/2736170672 >> v2:172.21.15.86:3300/0 conn(0x7f931c151c50 0x7f931c0c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.200+0000 7f931bfff700 1 --2- 172.21.15.6:0/2736170672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f931c06da20 0x7f931c151710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f93080098f0 tx=0x7f9308009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20edf755ca5ae44a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.200+0000 7f931b7fe700 1 -- 172.21.15.6:0/2736170672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308004230 con 0x7f931c06da20 2023-07-21T07:34:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.200+0000 7f931b7fe700 1 -- 172.21.15.6:0/2736170672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9308004390 con 0x7f931c06da20 2023-07-21T07:34:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.200+0000 7f931b7fe700 1 -- 172.21.15.6:0/2736170672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93080036a0 con 0x7f931c06da20 2023-07-21T07:34:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.201+0000 7f9322db9700 1 -- 172.21.15.6:0/2736170672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f931c06da20 msgr2=0x7f931c151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.201+0000 7f9322db9700 1 --2- 172.21.15.6:0/2736170672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f931c06da20 0x7f931c151710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f93080098f0 tx=0x7f9308009c00 comp rx=0 tx=0).stop 2023-07-21T07:34:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.201+0000 7f9322db9700 1 -- 172.21.15.6:0/2736170672 shutdown_connections 2023-07-21T07:34:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.201+0000 7f9322db9700 1 --2- 172.21.15.6:0/2736170672 >> v2:172.21.15.86:3300/0 conn(0x7f931c151c50 0x7f931c0c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.201+0000 7f9322db9700 1 --2- 172.21.15.6:0/2736170672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f931c06da20 0x7f931c151710 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.201+0000 7f9322db9700 1 -- 172.21.15.6:0/2736170672 >> 172.21.15.6:0/2736170672 conn(0x7f931c0a8c90 msgr2=0x7f931c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.201+0000 7f9322db9700 1 -- 172.21.15.6:0/2736170672 shutdown_connections 2023-07-21T07:34:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.201+0000 7f9322db9700 1 -- 172.21.15.6:0/2736170672 wait complete. 2023-07-21T07:34:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.202+0000 7f9322db9700 1 Processor -- start 2023-07-21T07:34:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.202+0000 7f9322db9700 1 -- start start 2023-07-21T07:34:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9322db9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f931c06a300 0x7f931c0c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9322db9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f931c06da20 0x7f931c0c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9322db9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f931c151c50 0x7f931c0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9322db9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c1563f0 con 0x7f931c06a300 2023-07-21T07:34:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9322db9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c158b00 con 0x7f931c151c50 2023-07-21T07:34:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9322db9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931c155980 con 0x7f931c06da20 2023-07-21T07:34:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9320b55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f931c06a300 0x7f931c0c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9320b55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f931c06a300 0x7f931c0c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33072/0 (socket says 172.21.15.6:33072) 2023-07-21T07:34:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9320b55700 1 -- 172.21.15.6:0/4049084801 learned_addr learned my addr 172.21.15.6:0/4049084801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9321356700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f931c151c50 0x7f931c0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f931bfff700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f931c06da20 0x7f931c0c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9320b55700 1 -- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f931c06da20 msgr2=0x7f931c0c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9320b55700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f931c06da20 0x7f931c0c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9320b55700 1 -- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f931c151c50 msgr2=0x7f931c0c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9320b55700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f931c151c50 0x7f931c0c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9320b55700 1 -- 172.21.15.6:0/4049084801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9308009550 con 0x7f931c06a300 2023-07-21T07:34:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f931bfff700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f931c06da20 0x7f931c0c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.203+0000 7f9320b55700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f931c06a300 0x7f931c0c63f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f931000c500 tx=0x7f931000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.204+0000 7f93197fa700 1 -- 172.21.15.6:0/4049084801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310011790 con 0x7f931c06a300 2023-07-21T07:34:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.204+0000 7f93197fa700 1 -- 172.21.15.6:0/4049084801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93100118f0 con 0x7f931c06a300 2023-07-21T07:34:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.204+0000 7f93197fa700 1 -- 172.21.15.6:0/4049084801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310011ca0 con 0x7f931c06a300 2023-07-21T07:34:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.204+0000 7f9322db9700 1 -- 172.21.15.6:0/4049084801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c155bd0 con 0x7f931c06a300 2023-07-21T07:34:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.204+0000 7f9322db9700 1 -- 172.21.15.6:0/4049084801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931c158020 con 0x7f931c06a300 2023-07-21T07:34:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.204+0000 7f9322db9700 1 -- 172.21.15.6:0/4049084801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c074500 con 0x7f931c06a300 2023-07-21T07:34:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.205+0000 7f93197fa700 1 -- 172.21.15.6:0/4049084801 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f931001c460 con 0x7f931c06a300 2023-07-21T07:34:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.205+0000 7f93197fa700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f930006ace0 0x7f930006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.205+0000 7f93197fa700 1 -- 172.21.15.6:0/4049084801 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9310089290 con 0x7f931c06a300 2023-07-21T07:34:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.206+0000 7f931bfff700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f930006ace0 0x7f930006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.206+0000 7f931bfff700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f930006ace0 0x7f930006d1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f931c0b9d20 tx=0x7f9308008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.210+0000 7f93197fa700 1 -- 172.21.15.6:0/4049084801 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f93100543d0 con 0x7f931c06a300 2023-07-21T07:34:55.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.409+0000 7f9322db9700 1 -- 172.21.15.6:0/4049084801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f931c06d750 con 0x7f931c06a300 2023-07-21T07:34:55.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.410+0000 7f93197fa700 1 -- 172.21.15.6:0/4049084801 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f93100579f0 con 0x7f931c06a300 2023-07-21T07:34:55.462 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:55.463 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:34:55.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.413+0000 7f9322db9700 1 -- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f930006ace0 msgr2=0x7f930006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.413+0000 7f9322db9700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f930006ace0 0x7f930006d1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f931c0b9d20 tx=0x7f9308008030 comp rx=0 tx=0).stop 2023-07-21T07:34:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.413+0000 7f9322db9700 1 -- 172.21.15.6:0/4049084801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f931c06a300 msgr2=0x7f931c0c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.413+0000 7f9322db9700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f931c06a300 0x7f931c0c63f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f931000c500 tx=0x7f931000c8c0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.413+0000 7f9322db9700 1 -- 172.21.15.6:0/4049084801 shutdown_connections 2023-07-21T07:34:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.413+0000 7f9322db9700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f930006ace0 0x7f930006d1a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.413+0000 7f9322db9700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f931c151c50 0x7f931c0c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.413+0000 7f9322db9700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f931c06a300 0x7f931c0c63f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.413+0000 7f9322db9700 1 --2- 172.21.15.6:0/4049084801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f931c06da20 0x7f931c0c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.413+0000 7f9322db9700 1 -- 172.21.15.6:0/4049084801 >> 172.21.15.6:0/4049084801 conn(0x7f931c0a8c90 msgr2=0x7f931c0c3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:55.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.413+0000 7f9322db9700 1 -- 172.21.15.6:0/4049084801 shutdown_connections 2023-07-21T07:34:55.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.413+0000 7f9322db9700 1 -- 172.21.15.6:0/4049084801 wait complete. 2023-07-21T07:34:55.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:34:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.550+0000 7fd1138c4700 1 Processor -- start 2023-07-21T07:34:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.550+0000 7fd1138c4700 1 -- start start 2023-07-21T07:34:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd1138c4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd10c0c3750 0x7fd10c0c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd1138c4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd10c14ed60 0x7fd10c154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd1138c4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10c0ba440 con 0x7fd10c0c6170 2023-07-21T07:34:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd1138c4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10c14f140 con 0x7fd10c0c3750 2023-07-21T07:34:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd1138c4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10c0c15d0 con 0x7fd10c14ed60 2023-07-21T07:34:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd111660700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd10c0c3750 0x7fd10c0c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd110e5f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd10c0c6170 0x7fd10c14e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41100/0 (socket says 172.21.15.6:41100) 2023-07-21T07:34:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd110e5f700 1 -- 172.21.15.6:0/3336729764 learned_addr learned my addr 172.21.15.6:0/3336729764 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:34:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd111e61700 1 --2- 172.21.15.6:0/3336729764 >> v2:172.21.15.86:3300/0 conn(0x7fd10c14ed60 0x7fd10c154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd111660700 1 -- 172.21.15.6:0/3336729764 >> v2:172.21.15.86:3300/0 conn(0x7fd10c14ed60 msgr2=0x7fd10c154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd111660700 1 --2- 172.21.15.6:0/3336729764 >> v2:172.21.15.86:3300/0 conn(0x7fd10c14ed60 0x7fd10c154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd111660700 1 -- 172.21.15.6:0/3336729764 >> v1:172.21.15.6:6789/0 conn(0x7fd10c0c6170 legacy=0x7fd10c14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd111660700 1 -- 172.21.15.6:0/3336729764 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c0c18b0 con 0x7fd10c0c3750 2023-07-21T07:34:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.551+0000 7fd111660700 1 --2- 172.21.15.6:0/3336729764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd10c0c3750 0x7fd10c0c53e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0a6570 tx=0x7fd0fc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7524bf09aaffc7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.552+0000 7fd103fff700 1 -- 172.21.15.6:0/3336729764 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc011830 con 0x7fd10c0c3750 2023-07-21T07:34:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.552+0000 7fd103fff700 1 -- 172.21.15.6:0/3336729764 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0fc011990 con 0x7fd10c0c3750 2023-07-21T07:34:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.552+0000 7fd103fff700 1 -- 172.21.15.6:0/3336729764 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc011d20 con 0x7fd10c0c3750 2023-07-21T07:34:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.552+0000 7fd1138c4700 1 -- 172.21.15.6:0/3336729764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd10c0c3750 msgr2=0x7fd10c0c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:55.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.552+0000 7fd1138c4700 1 --2- 172.21.15.6:0/3336729764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd10c0c3750 0x7fd10c0c53e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0a6570 tx=0x7fd0fc009b20 comp rx=0 tx=0).stop 2023-07-21T07:34:55.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.552+0000 7fd1138c4700 1 -- 172.21.15.6:0/3336729764 shutdown_connections 2023-07-21T07:34:55.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.552+0000 7fd1138c4700 1 --2- 172.21.15.6:0/3336729764 >> v2:172.21.15.86:3300/0 conn(0x7fd10c14ed60 0x7fd10c154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.552+0000 7fd1138c4700 1 --2- 172.21.15.6:0/3336729764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd10c0c3750 0x7fd10c0c53e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.552+0000 7fd1138c4700 1 -- 172.21.15.6:0/3336729764 >> 172.21.15.6:0/3336729764 conn(0x7fd10c0a8c90 msgr2=0x7fd10c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:55.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.552+0000 7fd1138c4700 1 -- 172.21.15.6:0/3336729764 shutdown_connections 2023-07-21T07:34:55.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.552+0000 7fd1138c4700 1 -- 172.21.15.6:0/3336729764 wait complete. 2023-07-21T07:34:55.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.553+0000 7fd1138c4700 1 Processor -- start 2023-07-21T07:34:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.553+0000 7fd1138c4700 1 -- start start 2023-07-21T07:34:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd1138c4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd10c0c3750 0x7fd10c0bdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd1138c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd10c0c6170 0x7fd10c1e8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd1138c4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd10c14ed60 0x7fd10c1e9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd1138c4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c1e9640 con 0x7fd10c0c6170 2023-07-21T07:34:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd1138c4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c1e8730 con 0x7fd10c0c3750 2023-07-21T07:34:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd1138c4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0be510 con 0x7fd10c14ed60 2023-07-21T07:34:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd110e5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd10c0c6170 0x7fd10c1e8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd110e5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd10c0c6170 0x7fd10c1e8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33088/0 (socket says 172.21.15.6:33088) 2023-07-21T07:34:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd110e5f700 1 -- 172.21.15.6:0/296698958 learned_addr learned my addr 172.21.15.6:0/296698958 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd111660700 1 --2- 172.21.15.6:0/296698958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd10c0c3750 0x7fd10c0bdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd110e5f700 1 -- 172.21.15.6:0/296698958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd10c14ed60 msgr2=0x7fd10c1e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd110e5f700 1 --2- 172.21.15.6:0/296698958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd10c14ed60 0x7fd10c1e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd110e5f700 1 -- 172.21.15.6:0/296698958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd10c0c3750 msgr2=0x7fd10c0bdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd110e5f700 1 --2- 172.21.15.6:0/296698958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd10c0c3750 0x7fd10c0bdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.554+0000 7fd110e5f700 1 -- 172.21.15.6:0/296698958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc0094a0 con 0x7fd10c0c6170 2023-07-21T07:34:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.555+0000 7fd110e5f700 1 --2- 172.21.15.6:0/296698958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd10c0c6170 0x7fd10c1e8bc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd10800c520 tx=0x7fd10800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.555+0000 7fd101ffb700 1 -- 172.21.15.6:0/296698958 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd108005d70 con 0x7fd10c0c6170 2023-07-21T07:34:55.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.555+0000 7fd101ffb700 1 -- 172.21.15.6:0/296698958 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1080070d0 con 0x7fd10c0c6170 2023-07-21T07:34:55.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.555+0000 7fd1138c4700 1 -- 172.21.15.6:0/296698958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c1e7e40 con 0x7fd10c0c6170 2023-07-21T07:34:55.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.555+0000 7fd101ffb700 1 -- 172.21.15.6:0/296698958 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd108007440 con 0x7fd10c0c6170 2023-07-21T07:34:55.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.555+0000 7fd1138c4700 1 -- 172.21.15.6:0/296698958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c1e9850 con 0x7fd10c0c6170 2023-07-21T07:34:55.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.556+0000 7fd1138c4700 1 -- 172.21.15.6:0/296698958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c06c650 con 0x7fd10c0c6170 2023-07-21T07:34:55.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.556+0000 7fd101ffb700 1 -- 172.21.15.6:0/296698958 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd1080075a0 con 0x7fd10c0c6170 2023-07-21T07:34:55.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.557+0000 7fd101ffb700 1 --2- 172.21.15.6:0/296698958 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd0f006ace0 0x7fd0f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:55.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.557+0000 7fd101ffb700 1 -- 172.21.15.6:0/296698958 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd108088800 con 0x7fd10c0c6170 2023-07-21T07:34:55.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.557+0000 7fd111660700 1 --2- 172.21.15.6:0/296698958 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd0f006ace0 0x7fd0f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:55.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.558+0000 7fd111660700 1 --2- 172.21.15.6:0/296698958 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd0f006ace0 0x7fd0f006d1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0090b0 tx=0x7fd0fc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:55.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.561+0000 7fd101ffb700 1 -- 172.21.15.6:0/296698958 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd1080539f0 con 0x7fd10c0c6170 2023-07-21T07:34:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.805+0000 7fd1138c4700 1 -- 172.21.15.6:0/296698958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd10c0c6870 con 0x7fd10c0c6170 2023-07-21T07:34:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.806+0000 7fd101ffb700 1 -- 172.21.15.6:0/296698958 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7fd108057010 con 0x7fd10c0c6170 2023-07-21T07:34:55.858 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:34:55.858 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3052758988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3052758988},{"type":"v1","addr":"172.21.15.6:6833","nonce":3052758988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3514948644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3514948644},{"type":"v1","addr":"172.21.15.6:6835","nonce":3514948644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/3188395603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3188395603},{"type":"v1","addr":"172.21.15.86:6836","nonce":3188395603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:34:40.418961+0000","modified":"2023-07-21T07:34:44.014954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6837/815488925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":815488925},{"type":"v1","addr":"172.21.15.86:6837","nonce":815488925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T07:34:55.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.808+0000 7fd1138c4700 1 -- 172.21.15.6:0/296698958 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd0f006ace0 msgr2=0x7fd0f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.808+0000 7fd1138c4700 1 --2- 172.21.15.6:0/296698958 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd0f006ace0 0x7fd0f006d1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0090b0 tx=0x7fd0fc008030 comp rx=0 tx=0).stop 2023-07-21T07:34:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.808+0000 7fd1138c4700 1 -- 172.21.15.6:0/296698958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd10c0c6170 msgr2=0x7fd10c1e8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.808+0000 7fd1138c4700 1 --2- 172.21.15.6:0/296698958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd10c0c6170 0x7fd10c1e8bc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd10800c520 tx=0x7fd10800c8e0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.808+0000 7fd1138c4700 1 -- 172.21.15.6:0/296698958 shutdown_connections 2023-07-21T07:34:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.808+0000 7fd1138c4700 1 --2- 172.21.15.6:0/296698958 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd0f006ace0 0x7fd0f006d1a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.808+0000 7fd1138c4700 1 --2- 172.21.15.6:0/296698958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd10c14ed60 0x7fd10c1e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.808+0000 7fd1138c4700 1 --2- 172.21.15.6:0/296698958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd10c0c3750 0x7fd10c0bdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.808+0000 7fd1138c4700 1 --2- 172.21.15.6:0/296698958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd10c0c6170 0x7fd10c1e8bc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:55.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.808+0000 7fd1138c4700 1 -- 172.21.15.6:0/296698958 >> 172.21.15.6:0/296698958 conn(0x7fd10c0a8c90 msgr2=0x7fd10c06b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:55.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.808+0000 7fd1138c4700 1 -- 172.21.15.6:0/296698958 shutdown_connections 2023-07-21T07:34:55.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:55.808+0000 7fd1138c4700 1 -- 172.21.15.6:0/296698958 wait complete. 2023-07-21T07:34:55.862 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T07:34:56.273 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T07:34:40.418961+0000', 'modified': '2023-07-21T07:34:44.014954+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4303}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4303': {'gid': 4303, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.86:6837/815488925', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6834', 'nonce': 815488925}, {'type': 'v1', 'addr': '172.21.15.86:6837', 'nonce': 815488925}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T07:34:56.274 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T07:34:56.274 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-21T07:34:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.355+0000 7fcd63cc4700 1 Processor -- start 2023-07-21T07:34:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.355+0000 7fcd63cc4700 1 -- start start 2023-07-21T07:34:56.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.355+0000 7fcd63cc4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd5c0c19f0 0x7fcd5c0c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd63cc4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd5c06e350 0x7fcd5c066050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd63cc4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd5c06fd50 0x7fcd5c0a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd63cc4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c0a98a0 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd63cc4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c1560f0 con 0x7fcd5c06e350 2023-07-21T07:34:56.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd63cc4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c072350 con 0x7fcd5c06fd50 2023-07-21T07:34:56.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd61a60700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd5c0c19f0 0x7fcd5c0c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd61a60700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd5c0c19f0 0x7fcd5c0c1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33094/0 (socket says 172.21.15.6:33094) 2023-07-21T07:34:56.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd61a60700 1 -- 172.21.15.6:0/3860743420 learned_addr learned my addr 172.21.15.6:0/3860743420 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:56.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd6125f700 1 --2- 172.21.15.6:0/3860743420 >> v2:172.21.15.86:3300/0 conn(0x7fcd5c06e350 0x7fcd5c066050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd62261700 1 --2- 172.21.15.6:0/3860743420 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd5c06fd50 0x7fcd5c0a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd61a60700 1 -- 172.21.15.6:0/3860743420 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd5c06fd50 msgr2=0x7fcd5c0a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:56.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd61a60700 1 --2- 172.21.15.6:0/3860743420 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd5c06fd50 0x7fcd5c0a8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd61a60700 1 -- 172.21.15.6:0/3860743420 >> v2:172.21.15.86:3300/0 conn(0x7fcd5c06e350 msgr2=0x7fcd5c066050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:56.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd61a60700 1 --2- 172.21.15.6:0/3860743420 >> v2:172.21.15.86:3300/0 conn(0x7fcd5c06e350 0x7fcd5c066050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd61a60700 1 -- 172.21.15.6:0/3860743420 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c1562e0 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd61a60700 1 --2- 172.21.15.6:0/3860743420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0c19f0 0x7fcd5c0c1dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c066e90 tx=0x7fcd58009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d757623ff6aef0d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:56.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd60a5e700 1 -- 172.21.15.6:0/3860743420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58011830 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd60a5e700 1 -- 172.21.15.6:0/3860743420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58011990 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.356+0000 7fcd60a5e700 1 -- 172.21.15.6:0/3860743420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58011d20 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.357+0000 7fcd63cc4700 1 -- 172.21.15.6:0/3860743420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0c19f0 msgr2=0x7fcd5c0c1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:56.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.357+0000 7fcd63cc4700 1 --2- 172.21.15.6:0/3860743420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0c19f0 0x7fcd5c0c1dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c066e90 tx=0x7fcd58009bd0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.357+0000 7fcd63cc4700 1 -- 172.21.15.6:0/3860743420 shutdown_connections 2023-07-21T07:34:56.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.357+0000 7fcd63cc4700 1 --2- 172.21.15.6:0/3860743420 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd5c06fd50 0x7fcd5c0a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.357+0000 7fcd63cc4700 1 --2- 172.21.15.6:0/3860743420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0c19f0 0x7fcd5c0c1dd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.357+0000 7fcd63cc4700 1 --2- 172.21.15.6:0/3860743420 >> v2:172.21.15.86:3300/0 conn(0x7fcd5c06e350 0x7fcd5c066050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.357+0000 7fcd63cc4700 1 -- 172.21.15.6:0/3860743420 >> 172.21.15.6:0/3860743420 conn(0x7fcd5c06afa0 msgr2=0x7fcd5c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:56.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.357+0000 7fcd63cc4700 1 -- 172.21.15.6:0/3860743420 shutdown_connections 2023-07-21T07:34:56.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.357+0000 7fcd63cc4700 1 -- 172.21.15.6:0/3860743420 wait complete. 2023-07-21T07:34:56.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.358+0000 7fcd63cc4700 1 Processor -- start 2023-07-21T07:34:56.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.358+0000 7fcd63cc4700 1 -- start start 2023-07-21T07:34:56.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd63cc4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd5c06e350 0x7fcd5c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd63cc4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd5c06fd50 0x7fcd5c14fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd63cc4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0c19f0 0x7fcd5c0bf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd63cc4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c1518b0 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd63cc4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c153190 con 0x7fcd5c06e350 2023-07-21T07:34:56.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd63cc4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c151ae0 con 0x7fcd5c06fd50 2023-07-21T07:34:56.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd62261700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0c19f0 0x7fcd5c0bf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd62261700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0c19f0 0x7fcd5c0bf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33104/0 (socket says 172.21.15.6:33104) 2023-07-21T07:34:56.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd62261700 1 -- 172.21.15.6:0/1057028468 learned_addr learned my addr 172.21.15.6:0/1057028468 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:56.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd6125f700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd5c06fd50 0x7fcd5c14fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd61a60700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd5c06e350 0x7fcd5c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd62261700 1 -- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd5c06fd50 msgr2=0x7fcd5c14fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:56.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd62261700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd5c06fd50 0x7fcd5c14fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd62261700 1 -- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd5c06e350 msgr2=0x7fcd5c152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:56.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd62261700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd5c06e350 0x7fcd5c152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd62261700 1 -- 172.21.15.6:0/1057028468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd58009550 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.359+0000 7fcd62261700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0c19f0 0x7fcd5c0bf620 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400efc0 tx=0x7fcd5400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:56.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.360+0000 7fcd527fc700 1 -- 172.21.15.6:0/1057028468 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54009ea0 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.360+0000 7fcd527fc700 1 -- 172.21.15.6:0/1057028468 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5400f040 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.360+0000 7fcd63cc4700 1 -- 172.21.15.6:0/1057028468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c151dc0 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.360+0000 7fcd527fc700 1 -- 172.21.15.6:0/1057028468 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5400ced0 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.360+0000 7fcd63cc4700 1 -- 172.21.15.6:0/1057028468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c152380 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.361+0000 7fcd527fc700 1 -- 172.21.15.6:0/1057028468 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcd54014480 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.361+0000 7fcd527fc700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcd4006ace0 0x7fcd4006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.362+0000 7fcd527fc700 1 -- 172.21.15.6:0/1057028468 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd54089ec0 con 0x7fcd5c0c19f0 2023-07-21T07:34:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.362+0000 7fcd61a60700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcd4006ace0 0x7fcd4006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.362+0000 7fcd61a60700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcd4006ace0 0x7fcd4006d1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd58014040 tx=0x7fcd58008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:56.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.364+0000 7fcd6fe5cb80 1 Processor -- start 2023-07-21T07:34:56.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.364+0000 7fcd6fe5cb80 1 -- start start 2023-07-21T07:34:56.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.364+0000 7fcd6fe5cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 0x55d08d9f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd6fe5cb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f8c90 0x55d08d9f2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd6fe5cb80 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f2c40 0x55d08da152c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd6fe5cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d08d8efb80 con 0x55d08d9f7910 2023-07-21T07:34:56.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd6fe5cb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d08d94f540 con 0x55d08d9f8c90 2023-07-21T07:34:56.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd6fe5cb80 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d08d94ce60 con 0x55d08d9f2c40 2023-07-21T07:34:56.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd61a60700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 0x55d08d9f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd61a60700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 0x55d08d9f21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33108/0 (socket says 172.21.15.6:33108) 2023-07-21T07:34:56.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd61a60700 1 -- 172.21.15.6:0/3081974057 learned_addr learned my addr 172.21.15.6:0/3081974057 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd6125f700 1 --2- 172.21.15.6:0/3081974057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f8c90 0x55d08d9f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd62261700 1 --2- 172.21.15.6:0/3081974057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f2c40 0x55d08da152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd61a60700 1 -- 172.21.15.6:0/3081974057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f2c40 msgr2=0x55d08da152c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd61a60700 1 --2- 172.21.15.6:0/3081974057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f2c40 0x55d08da152c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd61a60700 1 -- 172.21.15.6:0/3081974057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f8c90 msgr2=0x55d08d9f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd61a60700 1 --2- 172.21.15.6:0/3081974057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f8c90 0x55d08d9f2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd61a60700 1 -- 172.21.15.6:0/3081974057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d08d7c95e0 con 0x55d08d9f7910 2023-07-21T07:34:56.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd61a60700 1 --2- 172.21.15.6:0/3081974057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 0x55d08d9f21c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcd58011b80 tx=0x7fcd58010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb6db827330a2f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:56.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd3f7fe700 1 -- 172.21.15.6:0/3081974057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5802b070 con 0x55d08d9f7910 2023-07-21T07:34:56.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd3f7fe700 1 -- 172.21.15.6:0/3081974057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58011bb0 con 0x55d08d9f7910 2023-07-21T07:34:56.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.365+0000 7fcd3f7fe700 1 -- 172.21.15.6:0/3081974057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5801f070 con 0x55d08d9f7910 2023-07-21T07:34:56.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.366+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/3081974057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 msgr2=0x55d08d9f21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:56.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.366+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/3081974057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 0x55d08d9f21c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcd58011b80 tx=0x7fcd58010000 comp rx=0 tx=0).stop 2023-07-21T07:34:56.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.366+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/3081974057 shutdown_connections 2023-07-21T07:34:56.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.366+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/3081974057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f2c40 0x55d08da152c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.366+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/3081974057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 0x55d08d9f21c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.366+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/3081974057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f8c90 0x55d08d9f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.366+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/3081974057 >> 172.21.15.6:0/3081974057 conn(0x55d08d954c80 msgr2=0x55d08d9f5570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:56.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.366+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/3081974057 shutdown_connections 2023-07-21T07:34:56.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.366+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/3081974057 wait complete. 2023-07-21T07:34:56.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.367+0000 7fcd6fe5cb80 1 -- start start 2023-07-21T07:34:56.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.367+0000 7fcd6fe5cb80 1 Processor -- start 2023-07-21T07:34:56.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6fe5cb80 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f2c40 0x55d08da37450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6fe5cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 0x55d08da46a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6fe5cb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f8c90 0x55d08da0fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6fe5cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d08d948750 con 0x55d08d9f7910 2023-07-21T07:34:56.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6fe5cb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d08d8e7a70 con 0x55d08d9f8c90 2023-07-21T07:34:56.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6fe5cb80 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d08d8e7770 con 0x55d08d9f2c40 2023-07-21T07:34:56.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6fe5cb80 10 client.0 _ll_register_callbacks cb 0x55d08d8e5630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T07:34:56.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6125f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 0x55d08da46a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6125f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 0x55d08da46a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33116/0 (socket says 172.21.15.6:33116) 2023-07-21T07:34:56.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6125f700 1 -- 172.21.15.6:0/2296524898 learned_addr learned my addr 172.21.15.6:0/2296524898 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:56.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd61a60700 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f2c40 0x55d08da37450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd62261700 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f8c90 0x55d08da0fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6125f700 1 -- 172.21.15.6:0/2296524898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f2c40 msgr2=0x55d08da37450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:56.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6125f700 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f2c40 0x55d08da37450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6125f700 1 -- 172.21.15.6:0/2296524898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f8c90 msgr2=0x55d08da0fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:56.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.368+0000 7fcd6125f700 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f8c90 0x55d08da0fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd6125f700 1 -- 172.21.15.6:0/2296524898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c1562e0 con 0x55d08d9f7910 2023-07-21T07:34:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd62261700 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f8c90 0x55d08da0fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd6125f700 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 0x55d08da46a60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0149a0 tx=0x7fcd4c0149d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f1a6ae4a25d321 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd3cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T07:34:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd3cff9700 1 -- 172.21.15.6:0/2296524898 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0156f0 con 0x55d08d9f7910 2023-07-21T07:34:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd3cff9700 1 -- 172.21.15.6:0/2296524898 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd4c015850 con 0x55d08d9f7910 2023-07-21T07:34:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/2296524898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d08d9c6b40 con 0x55d08d9f7910 2023-07-21T07:34:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd3cff9700 1 -- 172.21.15.6:0/2296524898 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd4c015a10 con 0x55d08d9f7910 2023-07-21T07:34:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd6fe5cb80 10 client.4656 fetch_fsmap learned FSMap version 8 2023-07-21T07:34:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/2296524898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d08d775d90 con 0x55d08d9f7910 2023-07-21T07:34:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd3cff9700 1 -- 172.21.15.6:0/2296524898 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d08d9c6b40 con 0x55d08d9f7910 2023-07-21T07:34:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd3cff9700 1 -- 172.21.15.6:0/2296524898 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcd4c015b70 con 0x55d08d9f7910 2023-07-21T07:34:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd6fe5cb80 10 client.4656 fetch_fsmap finished waiting for FSMap version 8 2023-07-21T07:34:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd6fe5cb80 10 client.4656 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-21T07:34:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd6fe5cb80 20 client.4656 populate_metadata read hostname 'smithi006' 2023-07-21T07:34:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.86:6834/815488925,v1:172.21.15.86:6837/815488925] conn(0x55d08da101c0 0x55d08da12e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd6fe5cb80 4 client.4656 mds_command: new command op to 4303 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T07:34:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/2296524898 --> [v2:172.21.15.86:6834/815488925,v1:172.21.15.86:6837/815488925] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d08d972d40 con 0x55d08da101c0 2023-07-21T07:34:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.369+0000 7fcd61a60700 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.86:6834/815488925,v1:172.21.15.86:6837/815488925] conn(0x55d08da101c0 0x55d08da12e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.370+0000 7fcd3cff9700 10 client.4656 ms_handle_connect on v2:172.21.15.86:6834/815488925 2023-07-21T07:34:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.370+0000 7fcd61a60700 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.86:6834/815488925,v1:172.21.15.86:6837/815488925] conn(0x55d08da101c0 0x55d08da12e90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f84bfddca8f99a server_cookie=372ba156462ca265 in_seq=0 out_seq=0 2023-07-21T07:34:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd3cff9700 1 -- 172.21.15.6:0/2296524898 <== mds.0 v2:172.21.15.86:6834/815488925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d08d972d40 con 0x55d08da101c0 2023-07-21T07:34:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd3cff9700 10 client.4656 handle_command_reply: tid=0 2023-07-21T07:34:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd6fe5cb80 1 client.4656 shutdown 2023-07-21T07:34:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/2296524898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 msgr2=0x55d08da46a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 0x55d08da46a60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0149a0 tx=0x7fcd4c0149d0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/2296524898 shutdown_connections 2023-07-21T07:34:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.86:6834/815488925,v1:172.21.15.86:6837/815488925] conn(0x55d08da101c0 0x55d08da12e90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f8c90 0x55d08da0fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd3cff9700 0 client.4656 ms_handle_reset on v2:172.21.15.86:6834/815488925 2023-07-21T07:34:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f2c40 0x55d08da37450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/2296524898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f7910 0x55d08da46a60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/2296524898 >> 172.21.15.6:0/2296524898 conn(0x55d08d954c80 msgr2=0x55d08da30f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/2296524898 shutdown_connections 2023-07-21T07:34:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/2296524898 wait complete. 2023-07-21T07:34:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.371+0000 7fcd6fe5cb80 20 client.4656 trim_cache size 0 max 16384 2023-07-21T07:34:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.389+0000 7fcd6fe5cb80 1 Processor -- start 2023-07-21T07:34:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.389+0000 7fcd6fe5cb80 1 -- start start 2023-07-21T07:34:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.389+0000 7fcd6fe5cb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f2c40 0x55d08da46a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.389+0000 7fcd6fe5cb80 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f7910 0x55d08da29c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.389+0000 7fcd6fe5cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 0x55d08da456f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.389+0000 7fcd6fe5cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d08da321d0 con 0x55d08d9f8c90 2023-07-21T07:34:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.389+0000 7fcd6fe5cb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d08da10870 con 0x55d08d9f2c40 2023-07-21T07:34:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.389+0000 7fcd6fe5cb80 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d08d7cb8d0 con 0x55d08d9f7910 2023-07-21T07:34:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.389+0000 7fcd62261700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 0x55d08da456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.389+0000 7fcd62261700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 0x55d08da456f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33126/0 (socket says 172.21.15.6:33126) 2023-07-21T07:34:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.390+0000 7fcd62261700 1 -- 172.21.15.6:0/2465581789 learned_addr learned my addr 172.21.15.6:0/2465581789 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.390+0000 7fcd61a60700 1 --2- 172.21.15.6:0/2465581789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f2c40 0x55d08da46a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.390+0000 7fcd62261700 1 -- 172.21.15.6:0/2465581789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f7910 msgr2=0x55d08da29c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.390+0000 7fcd6125f700 1 --2- 172.21.15.6:0/2465581789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f7910 0x55d08da29c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.390+0000 7fcd62261700 1 --2- 172.21.15.6:0/2465581789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f7910 0x55d08da29c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.390+0000 7fcd62261700 1 -- 172.21.15.6:0/2465581789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f2c40 msgr2=0x55d08da46a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.390+0000 7fcd62261700 1 --2- 172.21.15.6:0/2465581789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f2c40 0x55d08da46a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.390+0000 7fcd62261700 1 -- 172.21.15.6:0/2465581789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d08d75ec10 con 0x55d08d9f8c90 2023-07-21T07:34:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.390+0000 7fcd61a60700 1 --2- 172.21.15.6:0/2465581789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f2c40 0x55d08da46a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:34:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.390+0000 7fcd62261700 1 --2- 172.21.15.6:0/2465581789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 0x55d08da456f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcd540551c0 tx=0x7fcd54055130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe9030a15eab9ed server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:56.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.390+0000 7fcd3ffff700 1 -- 172.21.15.6:0/2465581789 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd540583b0 con 0x55d08d9f8c90 2023-07-21T07:34:56.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.390+0000 7fcd3ffff700 1 -- 172.21.15.6:0/2465581789 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd54056ec0 con 0x55d08d9f8c90 2023-07-21T07:34:56.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.390+0000 7fcd3ffff700 1 -- 172.21.15.6:0/2465581789 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54060dc0 con 0x55d08d9f8c90 2023-07-21T07:34:56.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.391+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/2465581789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 msgr2=0x55d08da456f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:56.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.391+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/2465581789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 0x55d08da456f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcd540551c0 tx=0x7fcd54055130 comp rx=0 tx=0).stop 2023-07-21T07:34:56.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.391+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/2465581789 shutdown_connections 2023-07-21T07:34:56.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.391+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/2465581789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 0x55d08da456f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.391+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/2465581789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f2c40 0x55d08da46a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.391+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/2465581789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f7910 0x55d08da29c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.391+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/2465581789 >> 172.21.15.6:0/2465581789 conn(0x55d08d954c80 msgr2=0x55d08da345f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:56.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.391+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/2465581789 shutdown_connections 2023-07-21T07:34:56.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.391+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/2465581789 wait complete. 2023-07-21T07:34:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.391+0000 7fcd6fe5cb80 1 -- start start 2023-07-21T07:34:56.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.391+0000 7fcd6fe5cb80 1 Processor -- start 2023-07-21T07:34:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd6fe5cb80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f2c40 0x55d08da4b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd6fe5cb80 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f7910 0x55d08da312c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd6fe5cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 0x55d08da9ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd6fe5cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d08da13bf0 con 0x55d08d9f8c90 2023-07-21T07:34:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd6fe5cb80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d08da15270 con 0x55d08d9f2c40 2023-07-21T07:34:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd6fe5cb80 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d08da9bb00 con 0x55d08d9f7910 2023-07-21T07:34:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd6fe5cb80 10 client.0 _ll_register_callbacks cb 0x55d08d8e5630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T07:34:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd62261700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 0x55d08da9ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd62261700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 0x55d08da9ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33132/0 (socket says 172.21.15.6:33132) 2023-07-21T07:34:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd62261700 1 -- 172.21.15.6:0/1640447486 learned_addr learned my addr 172.21.15.6:0/1640447486 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd61a60700 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f2c40 0x55d08da4b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd6125f700 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f7910 0x55d08da312c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd62261700 1 -- 172.21.15.6:0/1640447486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f7910 msgr2=0x55d08da312c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd62261700 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f7910 0x55d08da312c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd62261700 1 -- 172.21.15.6:0/1640447486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f2c40 msgr2=0x55d08da4b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd62261700 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f2c40 0x55d08da4b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd62261700 1 -- 172.21.15.6:0/1640447486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c152380 con 0x55d08d9f8c90 2023-07-21T07:34:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.392+0000 7fcd61a60700 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f2c40 0x55d08da4b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd62261700 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 0x55d08da9ade0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd540551c0 tx=0x7fcd54004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236efda189df9cd4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd3cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T07:34:56.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd3cff9700 1 -- 172.21.15.6:0/1640447486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54058a90 con 0x55d08d9f8c90 2023-07-21T07:34:56.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd3cff9700 1 -- 172.21.15.6:0/1640447486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd54054ab0 con 0x55d08d9f8c90 2023-07-21T07:34:56.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/1640447486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d08d941730 con 0x55d08d9f8c90 2023-07-21T07:34:56.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd3cff9700 1 -- 172.21.15.6:0/1640447486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd54056ec0 con 0x55d08d9f8c90 2023-07-21T07:34:56.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd6fe5cb80 10 client.4662 fetch_fsmap learned FSMap version 8 2023-07-21T07:34:56.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/1640447486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d08d79c200 con 0x55d08d9f8c90 2023-07-21T07:34:56.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd3cff9700 1 -- 172.21.15.6:0/1640447486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d08d941730 con 0x55d08d9f8c90 2023-07-21T07:34:56.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd3cff9700 1 -- 172.21.15.6:0/1640447486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcd54054c70 con 0x55d08d9f8c90 2023-07-21T07:34:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd6fe5cb80 10 client.4662 fetch_fsmap finished waiting for FSMap version 8 2023-07-21T07:34:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd6fe5cb80 10 client.4662 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-21T07:34:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd6fe5cb80 20 client.4662 populate_metadata read hostname 'smithi006' 2023-07-21T07:34:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.86:6834/815488925,v1:172.21.15.86:6837/815488925] conn(0x55d08da101c0 0x55d08da97f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd6fe5cb80 4 client.4662 mds_command: new command op to 4303 tid=0[{"prefix": "status"}] 2023-07-21T07:34:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/1640447486 --> [v2:172.21.15.86:6834/815488925,v1:172.21.15.86:6837/815488925] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d08d903000 con 0x55d08da101c0 2023-07-21T07:34:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.393+0000 7fcd61a60700 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.86:6834/815488925,v1:172.21.15.86:6837/815488925] conn(0x55d08da101c0 0x55d08da97f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd3cff9700 10 client.4662 ms_handle_connect on v2:172.21.15.86:6834/815488925 2023-07-21T07:34:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd61a60700 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.86:6834/815488925,v1:172.21.15.86:6837/815488925] conn(0x55d08da101c0 0x55d08da97f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed1ebb05449963ce server_cookie=e39ef107214bfca4 in_seq=0 out_seq=0 2023-07-21T07:34:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd3cff9700 1 -- 172.21.15.6:0/1640447486 <== mds.0 v2:172.21.15.86:6834/815488925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55d08d903000 con 0x55d08da101c0 2023-07-21T07:34:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd3cff9700 10 client.4662 handle_command_reply: tid=0 2023-07-21T07:34:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd6fe5cb80 1 client.4662 shutdown 2023-07-21T07:34:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/1640447486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 msgr2=0x55d08da9ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 0x55d08da9ade0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd540551c0 tx=0x7fcd54004ad0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/1640447486 shutdown_connections 2023-07-21T07:34:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.86:6834/815488925,v1:172.21.15.86:6837/815488925] conn(0x55d08da101c0 0x55d08da97f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d08d9f8c90 0x55d08da9ade0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d08d9f2c40 0x55d08da4b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd3cff9700 0 client.4662 ms_handle_reset on v2:172.21.15.86:6834/815488925 2023-07-21T07:34:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd6fe5cb80 1 --2- 172.21.15.6:0/1640447486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d08d9f7910 0x55d08da312c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/1640447486 >> 172.21.15.6:0/1640447486 conn(0x55d08d954c80 msgr2=0x55d08da344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/1640447486 shutdown_connections 2023-07-21T07:34:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd6fe5cb80 1 -- 172.21.15.6:0/1640447486 wait complete. 2023-07-21T07:34:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.394+0000 7fcd6fe5cb80 20 client.4662 trim_cache size 0 max 16384 2023-07-21T07:34:56.458 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T07:34:56.458 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "8c602ac0-17b3-4df5-8928-640a7524b3b3", 2023-07-21T07:34:56.458 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T07:34:56.459 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4303, 2023-07-21T07:34:56.459 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T07:34:56.459 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T07:34:56.459 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T07:34:56.459 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 15.397346987000001, 2023-07-21T07:34:56.459 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 8, 2023-07-21T07:34:56.459 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 24, 2023-07-21T07:34:56.460 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 24, 2023-07-21T07:34:56.460 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 21.432780042000001 2023-07-21T07:34:56.460 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T07:34:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.395+0000 7fcd63cc4700 1 -- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcd4006ace0 msgr2=0x7fcd4006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.395+0000 7fcd63cc4700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcd4006ace0 0x7fcd4006d1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd58014040 tx=0x7fcd58008030 comp rx=0 tx=0).stop 2023-07-21T07:34:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.395+0000 7fcd63cc4700 1 -- 172.21.15.6:0/1057028468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0c19f0 msgr2=0x7fcd5c0bf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.395+0000 7fcd63cc4700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0c19f0 0x7fcd5c0bf620 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400efc0 tx=0x7fcd5400c3a0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.395+0000 7fcd63cc4700 1 -- 172.21.15.6:0/1057028468 shutdown_connections 2023-07-21T07:34:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.395+0000 7fcd63cc4700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcd4006ace0 0x7fcd4006d1a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.395+0000 7fcd63cc4700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0c19f0 0x7fcd5c0bf620 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.395+0000 7fcd63cc4700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd5c06e350 0x7fcd5c152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.395+0000 7fcd63cc4700 1 --2- 172.21.15.6:0/1057028468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd5c06fd50 0x7fcd5c14fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.395+0000 7fcd63cc4700 1 -- 172.21.15.6:0/1057028468 >> 172.21.15.6:0/1057028468 conn(0x7fcd5c06afa0 msgr2=0x7fcd5c06b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:56.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.395+0000 7fcd63cc4700 1 -- 172.21.15.6:0/1057028468 shutdown_connections 2023-07-21T07:34:56.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.395+0000 7fcd63cc4700 1 -- 172.21.15.6:0/1057028468 wait complete. 2023-07-21T07:34:56.463 INFO:teuthology.run_tasks:Running task kclient... 2023-07-21T07:34:56.495 INFO:tasks.kclient:Mounting kernel clients... 2023-07-21T07:34:56.495 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-07-21T07:34:56.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:56.496 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T07:34:56.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:56.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-07-21T07:34:56.583 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-07-21T07:34:56.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T07:34:56.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:56.585 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-07-21T07:34:56.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:56.606 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2023-07-21T07:34:56.680 INFO:teuthology.orchestra.run.smithi086.stderr:Cannot find device "ceph-brx" 2023-07-21T07:34:56.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T07:34:56.682 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-07-21T07:34:56.683 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T07:34:56.683 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T07:34:56.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T07:34:56.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.756+0000 7f59d2485700 1 Processor -- start 2023-07-21T07:34:56.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.756+0000 7f59d2485700 1 -- start start 2023-07-21T07:34:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.757+0000 7f59d2485700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59cc14e0a0 0x7f59cc06c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.757+0000 7f59d2485700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59cc151700 0x7f59cc0c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.757+0000 7f59d2485700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59cc0c4ef0 con 0x7f59cc0c07e0 2023-07-21T07:34:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.757+0000 7f59d2485700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59cc151270 con 0x7f59cc151700 2023-07-21T07:34:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.757+0000 7f59d2485700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59cc0c50b0 con 0x7f59cc14e0a0 2023-07-21T07:34:56.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.757+0000 7f59cb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59cc151700 0x7f59cc0c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.757+0000 7f59cb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59cc151700 0x7f59cc0c02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33138/0 (socket says 172.21.15.6:33138) 2023-07-21T07:34:56.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.757+0000 7f59cb7fe700 1 -- 172.21.15.6:0/4242849071 learned_addr learned my addr 172.21.15.6:0/4242849071 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:56.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59cbfff700 1 --2- 172.21.15.6:0/4242849071 >> v2:172.21.15.86:3300/0 conn(0x7f59cc14e0a0 0x7f59cc06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59cb7fe700 1 -- 172.21.15.6:0/4242849071 >> v2:172.21.15.86:3300/0 conn(0x7f59cc14e0a0 msgr2=0x7f59cc06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:56.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59cb7fe700 1 --2- 172.21.15.6:0/4242849071 >> v2:172.21.15.86:3300/0 conn(0x7f59cc14e0a0 0x7f59cc06c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59cb7fe700 1 -- 172.21.15.6:0/4242849071 >> v1:172.21.15.86:6789/0 conn(0x7f59cc0c07e0 legacy=0x7f59cc0c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:56.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59cb7fe700 1 -- 172.21.15.6:0/4242849071 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc0c5390 con 0x7f59cc151700 2023-07-21T07:34:56.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59cb7fe700 1 --2- 172.21.15.6:0/4242849071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59cc151700 0x7f59cc0c02a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f59cc06d9b0 tx=0x7f59c000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7350a412194661bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:56.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59caffd700 1 -- 172.21.15.6:0/4242849071 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000dcf0 con 0x7f59cc151700 2023-07-21T07:34:56.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59caffd700 1 -- 172.21.15.6:0/4242849071 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c000de50 con 0x7f59cc151700 2023-07-21T07:34:56.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59caffd700 1 -- 172.21.15.6:0/4242849071 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0004250 con 0x7f59cc151700 2023-07-21T07:34:56.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59d2485700 1 -- 172.21.15.6:0/4242849071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59cc151700 msgr2=0x7f59cc0c02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:56.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59d2485700 1 --2- 172.21.15.6:0/4242849071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59cc151700 0x7f59cc0c02a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f59cc06d9b0 tx=0x7f59c000be70 comp rx=0 tx=0).stop 2023-07-21T07:34:56.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59d2485700 1 -- 172.21.15.6:0/4242849071 shutdown_connections 2023-07-21T07:34:56.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59d2485700 1 --2- 172.21.15.6:0/4242849071 >> v2:172.21.15.86:3300/0 conn(0x7f59cc14e0a0 0x7f59cc06c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59d2485700 1 --2- 172.21.15.6:0/4242849071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59cc151700 0x7f59cc0c02a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.758+0000 7f59d2485700 1 -- 172.21.15.6:0/4242849071 >> 172.21.15.6:0/4242849071 conn(0x7f59cc06a090 msgr2=0x7f59cc06a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:56.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.759+0000 7f59d2485700 1 -- 172.21.15.6:0/4242849071 shutdown_connections 2023-07-21T07:34:56.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.759+0000 7f59d2485700 1 -- 172.21.15.6:0/4242849071 wait complete. 2023-07-21T07:34:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.760+0000 7f59d2485700 1 Processor -- start 2023-07-21T07:34:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.760+0000 7f59d2485700 1 -- start start 2023-07-21T07:34:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.760+0000 7f59d2485700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59cc0c07e0 0x7f59cc0aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59d2485700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59cc14e0a0 0x7f59cc152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59d2485700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59cc151700 0x7f59cc1526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59d2485700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc14b350 con 0x7f59cc0c07e0 2023-07-21T07:34:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59d2485700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc152c10 con 0x7f59cc151700 2023-07-21T07:34:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59d2485700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc1e9aa0 con 0x7f59cc14e0a0 2023-07-21T07:34:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59cc0c07e0 0x7f59cc0aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59cc0c07e0 0x7f59cc0aa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33142/0 (socket says 172.21.15.6:33142) 2023-07-21T07:34:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59cbfff700 1 -- 172.21.15.6:0/13301228 learned_addr learned my addr 172.21.15.6:0/13301228 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59cb7fe700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59cc14e0a0 0x7f59cc152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59d0a22700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59cc151700 0x7f59cc1526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59cbfff700 1 -- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59cc14e0a0 msgr2=0x7f59cc152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59cbfff700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59cc14e0a0 0x7f59cc152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59cbfff700 1 -- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59cc151700 msgr2=0x7f59cc1526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59cbfff700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59cc151700 0x7f59cc1526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59cbfff700 1 -- 172.21.15.6:0/13301228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c000b7f0 con 0x7f59cc0c07e0 2023-07-21T07:34:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59d0a22700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59cc151700 0x7f59cc1526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:34:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59cbfff700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59cc0c07e0 0x7f59cc0aa2a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00c7f0 tx=0x7f59bc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59c8ff9700 1 -- 172.21.15.6:0/13301228 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc004220 con 0x7f59cc0c07e0 2023-07-21T07:34:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59c8ff9700 1 -- 172.21.15.6:0/13301228 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc004380 con 0x7f59cc0c07e0 2023-07-21T07:34:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59d2485700 1 -- 172.21.15.6:0/13301228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59cc1e8ce0 con 0x7f59cc0c07e0 2023-07-21T07:34:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59c8ff9700 1 -- 172.21.15.6:0/13301228 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc0036a0 con 0x7f59cc0c07e0 2023-07-21T07:34:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.761+0000 7f59d2485700 1 -- 172.21.15.6:0/13301228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59cc1e92a0 con 0x7f59cc0c07e0 2023-07-21T07:34:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.762+0000 7f59d2485700 1 -- 172.21.15.6:0/13301228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59cc0c0010 con 0x7f59cc0c07e0 2023-07-21T07:34:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.763+0000 7f59c8ff9700 1 -- 172.21.15.6:0/13301228 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59bc003800 con 0x7f59cc0c07e0 2023-07-21T07:34:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.763+0000 7f59c8ff9700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f59b806ace0 0x7f59b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.763+0000 7f59c8ff9700 1 -- 172.21.15.6:0/13301228 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59bc089020 con 0x7f59cc0c07e0 2023-07-21T07:34:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.763+0000 7f59cb7fe700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f59b806ace0 0x7f59b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.764+0000 7f59cb7fe700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f59b806ace0 0x7f59b806d1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f59cc151b60 tx=0x7f59c001d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:56.767+0000 7f59c8ff9700 1 -- 172.21.15.6:0/13301228 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59bc057b70 con 0x7f59cc0c07e0 2023-07-21T07:34:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.013+0000 7f59d2485700 1 -- 172.21.15.6:0/13301228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f59cc074500 con 0x7f59cc0c07e0 2023-07-21T07:34:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.013+0000 7f59c8ff9700 1 -- 172.21.15.6:0/13301228 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f59bc057700 con 0x7f59cc0c07e0 2023-07-21T07:34:57.065 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T07:34:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.015+0000 7f59d2485700 1 -- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f59b806ace0 msgr2=0x7f59b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.015+0000 7f59d2485700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f59b806ace0 0x7f59b806d1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f59cc151b60 tx=0x7f59c001d040 comp rx=0 tx=0).stop 2023-07-21T07:34:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.015+0000 7f59d2485700 1 -- 172.21.15.6:0/13301228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59cc0c07e0 msgr2=0x7f59cc0aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.015+0000 7f59d2485700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59cc0c07e0 0x7f59cc0aa2a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00c7f0 tx=0x7f59bc00cb00 comp rx=0 tx=0).stop 2023-07-21T07:34:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.015+0000 7f59d2485700 1 -- 172.21.15.6:0/13301228 shutdown_connections 2023-07-21T07:34:57.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.015+0000 7f59d2485700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f59b806ace0 0x7f59b806d1a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:57.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.015+0000 7f59d2485700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59cc151700 0x7f59cc1526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:57.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.015+0000 7f59d2485700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59cc0c07e0 0x7f59cc0aa2a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:57.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.015+0000 7f59d2485700 1 --2- 172.21.15.6:0/13301228 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59cc14e0a0 0x7f59cc152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:57.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.015+0000 7f59d2485700 1 -- 172.21.15.6:0/13301228 >> 172.21.15.6:0/13301228 conn(0x7f59cc06a090 msgr2=0x7f59cc14e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:57.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.015+0000 7f59d2485700 1 -- 172.21.15.6:0/13301228 shutdown_connections 2023-07-21T07:34:57.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:57.015+0000 7f59d2485700 1 -- 172.21.15.6:0/13301228 wait complete. 2023-07-21T07:34:57.079 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T07:34:57.079 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T07:34:57.079 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T07:34:57.079 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T07:34:57.080 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T07:34:57.080 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T07:34:57.080 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T07:34:57.080 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T07:34:57.080 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T07:34:57.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:57.081 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T07:34:57.098 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T07:34:57.098 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T07:34:57.098 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T07:34:57.098 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:34:57.099 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T07:34:57.099 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:34:57.099 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:34:57.099 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:34:57.099 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:34:57.099 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:34:57.099 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T07:34:57.099 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:34:57.100 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-21T07:34:57.100 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41912sec preferred_lft 41912sec 2023-07-21T07:34:57.100 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T07:34:57.100 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:34:57.100 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:34:57.100 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:34:57.101 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-21T07:34:57.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:57.101 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T07:34:57.102 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T07:34:57.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2023-07-21T07:34:57.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2023-07-21T07:34:57.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2023-07-21T07:34:57.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-21T07:34:57.103 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T07:34:57.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:57.273 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T07:34:57.303 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T07:34:57.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:57.305 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-21T07:34:57.377 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-21T07:34:57.378 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T07:34:57.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:57.378 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T07:34:57.379 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T07:34:57.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T07:34:57.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T07:34:57.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T07:34:57.380 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T07:34:57.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:57.633 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T07:34:57.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:57.652 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-07-21T07:34:57.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:57.709 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T07:34:57.710 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T07:34:57.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T07:34:57.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-21T07:34:57.710 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T07:34:57.805 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-21T07:34:57.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:57.806 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T07:34:57.806 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T07:34:57.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-21T07:34:57.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-21T07:34:57.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-21T07:34:57.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-21T07:34:57.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-21T07:34:57.807 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T07:34:58.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:58.019 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T07:34:58.020 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T07:34:58.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T07:34:58.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2023-07-21T07:34:58.020 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T07:34:58.124 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:34:58.124 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T07:34:58.147 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T07:34:58.147 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:34:58.148 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T07:34:58.204 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-21T07:34:58.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:58.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:34:58.310 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:34:58.311 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:34:58.442 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:34:58.442 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:34:58.442 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:34:58.442 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs=/ 2023-07-21T07:34:58.443 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:34:58.443 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:34:58.443 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:34:58.443 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:34:58.516 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:34:58.516 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:34:58.517 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:34:58.517 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs=/ 2023-07-21T07:34:58.517 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:34:58.518 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:34:58.518 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:34:58.518 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:34:58.518 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790" 2023-07-21T07:34:58.519 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2023-07-21T07:34:58.519 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=8c602ac0-17b3-4df5-8928-640a7524b3b3" will pass to kernel 2023-07-21T07:34:58.520 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T07:34:58.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:58.521 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T07:34:58.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:58.550 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T07:34:58.638 INFO:teuthology.orchestra.run.smithi006.stdout:client4490 2023-07-21T07:34:58.639 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:34:58.639 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:34:58.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:58.657 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T07:34:58.745 INFO:teuthology.orchestra.run.smithi006.stdout:client4490 2023-07-21T07:34:58.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:58.746 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T07:34:58.793 INFO:teuthology.orchestra.run.smithi006.stdout:client4490 2023-07-21T07:34:58.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:58.794 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8c602ac0-17b3-4df5-8928-640a7524b3b3.client4490/status') 2023-07-21T07:34:58.849 INFO:teuthology.orchestra.run.smithi006.stdout:instance: client.4490 (3)172.21.15.6:0/834719727 2023-07-21T07:34:58.849 INFO:teuthology.orchestra.run.smithi006.stdout:blocklisted: false 2023-07-21T07:34:58.850 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records in 2023-07-21T07:34:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records out 2023-07-21T07:34:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:68 bytes copied, 2.6379e-05 s, 2.6 MB/s 2023-07-21T07:34:58.851 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-07-21T07:34:58.852 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T07:34:58.852 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-21T07:34:58.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T07:34:58.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.926+0000 7f712337b700 1 Processor -- start 2023-07-21T07:34:58.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.926+0000 7f712337b700 1 -- start start 2023-07-21T07:34:58.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.927+0000 7f712337b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f711c0c42a0 0x7f711c0c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:58.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.927+0000 7f712337b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f711c0aa230 0x7f711c153b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:58.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.927+0000 7f712337b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711c0a95d0 con 0x7f711c0a4e10 2023-07-21T07:34:58.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.927+0000 7f712337b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c0c27e0 con 0x7f711c0c42a0 2023-07-21T07:34:58.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.927+0000 7f712337b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c0c5190 con 0x7f711c0aa230 2023-07-21T07:34:58.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.927+0000 7f7121117700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f711c0c42a0 0x7f711c0c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:58.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.927+0000 7f7121117700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f711c0c42a0 0x7f711c0c22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33156/0 (socket says 172.21.15.6:33156) 2023-07-21T07:34:58.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.927+0000 7f7121117700 1 -- 172.21.15.6:0/2287129731 learned_addr learned my addr 172.21.15.6:0/2287129731 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:58.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.928+0000 7f7121918700 1 --2- 172.21.15.6:0/2287129731 >> v2:172.21.15.86:3300/0 conn(0x7f711c0aa230 0x7f711c153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:58.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.928+0000 7f7121117700 1 -- 172.21.15.6:0/2287129731 >> v2:172.21.15.86:3300/0 conn(0x7f711c0aa230 msgr2=0x7f711c153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:34:58.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.928+0000 7f7121117700 1 --2- 172.21.15.6:0/2287129731 >> v2:172.21.15.86:3300/0 conn(0x7f711c0aa230 0x7f711c153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:58.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.928+0000 7f7121117700 1 -- 172.21.15.6:0/2287129731 >> v1:172.21.15.86:6789/0 conn(0x7f711c0a4e10 legacy=0x7f711c0a9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:58.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.928+0000 7f7121117700 1 -- 172.21.15.6:0/2287129731 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c0c5470 con 0x7f711c0c42a0 2023-07-21T07:34:58.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.928+0000 7f7121117700 1 --2- 172.21.15.6:0/2287129731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f711c0c42a0 0x7f711c0c22a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7114009e50 tx=0x7f711400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86846bf6a588ae47 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:58.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.928+0000 7f711bfff700 1 -- 172.21.15.6:0/2287129731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711400e070 con 0x7f711c0c42a0 2023-07-21T07:34:58.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.928+0000 7f711bfff700 1 -- 172.21.15.6:0/2287129731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711400b980 con 0x7f711c0c42a0 2023-07-21T07:34:58.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.928+0000 7f711bfff700 1 -- 172.21.15.6:0/2287129731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711400bd30 con 0x7f711c0c42a0 2023-07-21T07:34:58.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.929+0000 7f712337b700 1 -- 172.21.15.6:0/2287129731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f711c0c42a0 msgr2=0x7f711c0c22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:58.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.929+0000 7f712337b700 1 --2- 172.21.15.6:0/2287129731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f711c0c42a0 0x7f711c0c22a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7114009e50 tx=0x7f711400b330 comp rx=0 tx=0).stop 2023-07-21T07:34:58.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.929+0000 7f712337b700 1 -- 172.21.15.6:0/2287129731 shutdown_connections 2023-07-21T07:34:58.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.929+0000 7f712337b700 1 --2- 172.21.15.6:0/2287129731 >> v2:172.21.15.86:3300/0 conn(0x7f711c0aa230 0x7f711c153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:58.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.929+0000 7f712337b700 1 --2- 172.21.15.6:0/2287129731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f711c0c42a0 0x7f711c0c22a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:58.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.929+0000 7f712337b700 1 -- 172.21.15.6:0/2287129731 >> 172.21.15.6:0/2287129731 conn(0x7f711c06a090 msgr2=0x7f711c06a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:58.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.929+0000 7f712337b700 1 -- 172.21.15.6:0/2287129731 shutdown_connections 2023-07-21T07:34:58.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.929+0000 7f712337b700 1 -- 172.21.15.6:0/2287129731 wait complete. 2023-07-21T07:34:58.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.930+0000 7f712337b700 1 Processor -- start 2023-07-21T07:34:58.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.930+0000 7f712337b700 1 -- start start 2023-07-21T07:34:58.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f712337b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f711c0a4e10 0x7f711c1ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:58.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f712337b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f711c0aa230 0x7f711c0bef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:58.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f712337b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f711c0c42a0 0x7f711c14c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:58.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f712337b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c149db0 con 0x7f711c0a4e10 2023-07-21T07:34:58.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f712337b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c1edd20 con 0x7f711c0c42a0 2023-07-21T07:34:58.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f712337b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0a7280 con 0x7f711c0aa230 2023-07-21T07:34:58.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7121117700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f711c0a4e10 0x7f711c1ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:58.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7121117700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f711c0a4e10 0x7f711c1ed7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33162/0 (socket says 172.21.15.6:33162) 2023-07-21T07:34:58.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7121117700 1 -- 172.21.15.6:0/1584931960 learned_addr learned my addr 172.21.15.6:0/1584931960 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:34:58.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7121918700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f711c0c42a0 0x7f711c14c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:58.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7120916700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f711c0aa230 0x7f711c0bef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:58.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7121117700 1 -- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f711c0aa230 msgr2=0x7f711c0bef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7121117700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f711c0aa230 0x7f711c0bef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7121117700 1 -- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f711c0c42a0 msgr2=0x7f711c14c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7121117700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f711c0c42a0 0x7f711c14c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7121117700 1 -- 172.21.15.6:0/1584931960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114009b30 con 0x7f711c0a4e10 2023-07-21T07:34:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7121117700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f711c0a4e10 0x7f711c1ed7e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f711400b370 tx=0x7f7114004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7119ffb700 1 -- 172.21.15.6:0/1584931960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114003ea0 con 0x7f711c0a4e10 2023-07-21T07:34:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7119ffb700 1 -- 172.21.15.6:0/1584931960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71140092e0 con 0x7f711c0a4e10 2023-07-21T07:34:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f712337b700 1 -- 172.21.15.6:0/1584931960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c06ffe0 con 0x7f711c0a4e10 2023-07-21T07:34:58.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.931+0000 7f7119ffb700 1 -- 172.21.15.6:0/1584931960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711401c680 con 0x7f711c0a4e10 2023-07-21T07:34:58.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.932+0000 7f712337b700 1 -- 172.21.15.6:0/1584931960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c0a6d70 con 0x7f711c0a4e10 2023-07-21T07:34:58.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.932+0000 7f712337b700 1 -- 172.21.15.6:0/1584931960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c06fd90 con 0x7f711c0a4e10 2023-07-21T07:34:58.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.934+0000 7f7119ffb700 1 -- 172.21.15.6:0/1584931960 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f711401c7e0 con 0x7f711c0a4e10 2023-07-21T07:34:58.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.934+0000 7f7119ffb700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f710806ace0 0x7f710806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:34:58.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.934+0000 7f7119ffb700 1 -- 172.21.15.6:0/1584931960 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f711408b580 con 0x7f711c0a4e10 2023-07-21T07:34:58.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.934+0000 7f7120916700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f710806ace0 0x7f710806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:34:58.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.935+0000 7f7120916700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f710806ace0 0x7f710806d1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f711c071750 tx=0x7f7110009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:34:58.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:58.937+0000 7f7119ffb700 1 -- 172.21.15.6:0/1584931960 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f71140567a0 con 0x7f711c0a4e10 2023-07-21T07:34:59.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.182+0000 7f712337b700 1 -- 172.21.15.6:0/1584931960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f711c074500 con 0x7f711c0a4e10 2023-07-21T07:34:59.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.183+0000 7f7119ffb700 1 -- 172.21.15.6:0/1584931960 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7114059dc0 con 0x7f711c0a4e10 2023-07-21T07:34:59.234 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T07:34:59.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.184+0000 7f712337b700 1 -- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f710806ace0 msgr2=0x7f710806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:59.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.184+0000 7f712337b700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f710806ace0 0x7f710806d1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f711c071750 tx=0x7f7110009040 comp rx=0 tx=0).stop 2023-07-21T07:34:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.184+0000 7f712337b700 1 -- 172.21.15.6:0/1584931960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f711c0a4e10 msgr2=0x7f711c1ed7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:34:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.184+0000 7f712337b700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f711c0a4e10 0x7f711c1ed7e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f711400b370 tx=0x7f7114004ad0 comp rx=0 tx=0).stop 2023-07-21T07:34:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.185+0000 7f712337b700 1 -- 172.21.15.6:0/1584931960 shutdown_connections 2023-07-21T07:34:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.185+0000 7f712337b700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f710806ace0 0x7f710806d1a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:59.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.185+0000 7f712337b700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f711c0c42a0 0x7f711c14c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:59.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.185+0000 7f712337b700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f711c0a4e10 0x7f711c1ed7e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:59.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.185+0000 7f712337b700 1 --2- 172.21.15.6:0/1584931960 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f711c0aa230 0x7f711c0bef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:34:59.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.185+0000 7f712337b700 1 -- 172.21.15.6:0/1584931960 >> 172.21.15.6:0/1584931960 conn(0x7f711c06a090 msgr2=0x7f711c06b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:34:59.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.185+0000 7f712337b700 1 -- 172.21.15.6:0/1584931960 shutdown_connections 2023-07-21T07:34:59.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:34:59.185+0000 7f712337b700 1 -- 172.21.15.6:0/1584931960 wait complete. 2023-07-21T07:34:59.248 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T07:34:59.248 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T07:34:59.249 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-07-21T07:34:59.249 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-21T07:34:59.249 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-21T07:34:59.250 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T07:34:59.250 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T07:34:59.250 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T07:34:59.250 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:34:59.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:59.251 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-07-21T07:34:59.274 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T07:34:59.274 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T07:34:59.275 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T07:34:59.275 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:34:59.275 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-07-21T07:34:59.276 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:34:59.276 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:34:59.276 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:34:59.277 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:34:59.277 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:34:59.277 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:34:59.277 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:34:59.278 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T07:34:59.278 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:34:59.278 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-21T07:34:59.279 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41968sec preferred_lft 41968sec 2023-07-21T07:34:59.279 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::c182:1cf2:777e:c99f/64 scope link noprefixroute 2023-07-21T07:34:59.279 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:34:59.280 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-21T07:34:59.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:59.281 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-07-21T07:34:59.281 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-07-21T07:34:59.282 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add name ceph-brx type bridge 2023-07-21T07:34:59.283 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr flush dev ceph-brx 2023-07-21T07:34:59.283 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set ceph-brx up 2023-07-21T07:34:59.284 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-21T07:34:59.284 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-07-21T07:34:59.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:59.457 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T07:34:59.485 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-07-21T07:34:59.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:59.486 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-07-21T07:34:59.564 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-07-21T07:34:59.564 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T07:34:59.565 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T07:34:59.565 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-21T07:34:59.565 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T07:34:59.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:59.566 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-07-21T07:34:59.566 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-07-21T07:34:59.566 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T07:34:59.566 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T07:34:59.566 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T07:34:59.567 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-07-21T07:34:59.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:59.812 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-07-21T07:34:59.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:59.830 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2023-07-21T07:34:59.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:59.886 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-07-21T07:34:59.886 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-07-21T07:34:59.886 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-21T07:34:59.887 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-21T07:34:59.887 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-07-21T07:34:59.980 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-21T07:34:59.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:34:59.981 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-07-21T07:34:59.981 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-07-21T07:34:59.982 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-21T07:34:59.982 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-21T07:34:59.982 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-21T07:34:59.983 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-21T07:34:59.983 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-21T07:34:59.983 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-07-21T07:35:00.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:00.184 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-07-21T07:35:00.184 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-07-21T07:35:00.185 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-07-21T07:35:00.185 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.0 master ceph-brx 2023-07-21T07:35:00.186 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-07-21T07:35:00.285 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:35:00.285 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-21T07:35:00.306 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:35:00.307 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:35:00.307 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-21T07:35:00.362 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-21T07:35:00.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:00.362 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:00.462 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:00.462 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:35:00.578 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:00.579 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:35:00.579 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:35:00.579 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 1@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs=/ 2023-07-21T07:35:00.580 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:35:00.580 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:35:00.580 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:35:00.581 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:35:00.654 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:00.654 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:35:00.654 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:35:00.654 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 1@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs=/ 2023-07-21T07:35:00.654 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:35:00.654 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:35:00.655 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:35:00.655 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:35:00.655 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790" 2023-07-21T07:35:00.655 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2023-07-21T07:35:00.655 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=8c602ac0-17b3-4df5-8928-640a7524b3b3" will pass to kernel 2023-07-21T07:35:00.656 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T07:35:00.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:00.657 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-21T07:35:00.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:00.684 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T07:35:00.755 INFO:teuthology.orchestra.run.smithi086.stdout:client4677 2023-07-21T07:35:00.756 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:35:00.756 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:00.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:00.814 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T07:35:00.883 INFO:teuthology.orchestra.run.smithi086.stdout:client4677 2023-07-21T07:35:00.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:00.884 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T07:35:00.955 INFO:teuthology.orchestra.run.smithi086.stdout:client4677 2023-07-21T07:35:00.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:00.956 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8c602ac0-17b3-4df5-8928-640a7524b3b3.client4677/status') 2023-07-21T07:35:01.036 INFO:teuthology.orchestra.run.smithi086.stdout:instance: client.4677 (3)172.21.15.86:0/620390843 2023-07-21T07:35:01.036 INFO:teuthology.orchestra.run.smithi086.stdout:blocklisted: false 2023-07-21T07:35:01.037 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records in 2023-07-21T07:35:01.037 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records out 2023-07-21T07:35:01.037 INFO:teuthology.orchestra.run.smithi086.stderr:69 bytes copied, 2.2983e-05 s, 3.0 MB/s 2023-07-21T07:35:01.038 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-21T07:35:01.059 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:01.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.148+0000 7f01f7f40700 1 Processor -- start 2023-07-21T07:35:01.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.148+0000 7f01f7f40700 1 -- start start 2023-07-21T07:35:01.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.149+0000 7f01f7f40700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01f014fa60 0x7f01f006a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.149+0000 7f01f7f40700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01f006bf00 0x7f01f00c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.149+0000 7f01f7f40700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f0153270 con 0x7f01f006b8b0 2023-07-21T07:35:01.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.149+0000 7f01f7f40700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f0152d80 con 0x7f01f006bf00 2023-07-21T07:35:01.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.149+0000 7f01f7f40700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f00c4b00 con 0x7f01f014fa60 2023-07-21T07:35:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.149+0000 7f01f54db700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01f006bf00 0x7f01f00c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.149+0000 7f01f64dd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f01f006b8b0 0x7f01f00c5490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41196/0 (socket says 172.21.15.6:41196) 2023-07-21T07:35:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.149+0000 7f01f64dd700 1 -- 172.21.15.6:0/1709295891 learned_addr learned my addr 172.21.15.6:0/1709295891 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.149+0000 7f01f5cdc700 1 --2- 172.21.15.6:0/1709295891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01f014fa60 0x7f01f006a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.149+0000 7f01f54db700 1 -- 172.21.15.6:0/1709295891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01f014fa60 msgr2=0x7f01f006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.149+0000 7f01f54db700 1 --2- 172.21.15.6:0/1709295891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01f014fa60 0x7f01f006a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.149+0000 7f01f54db700 1 -- 172.21.15.6:0/1709295891 >> v1:172.21.15.6:6789/0 conn(0x7f01f006b8b0 legacy=0x7f01f00c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.150+0000 7f01f54db700 1 -- 172.21.15.6:0/1709295891 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f006de30 con 0x7f01f006bf00 2023-07-21T07:35:01.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.150+0000 7f01f4cda700 1 -- 172.21.15.6:0/1709295891 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548567753 0 0) 0x7f01f0153270 con 0x7f01f006b8b0 2023-07-21T07:35:01.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.150+0000 7f01f54db700 1 --2- 172.21.15.6:0/1709295891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01f006bf00 0x7f01f00c4f50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009840 tx=0x7f01ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27716f1c72a65f7f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:01.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.150+0000 7f01f4cda700 1 -- 172.21.15.6:0/1709295891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec011830 con 0x7f01f006bf00 2023-07-21T07:35:01.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.150+0000 7f01f4cda700 1 -- 172.21.15.6:0/1709295891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec011990 con 0x7f01f006bf00 2023-07-21T07:35:01.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.150+0000 7f01f4cda700 1 -- 172.21.15.6:0/1709295891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec011d20 con 0x7f01f006bf00 2023-07-21T07:35:01.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.150+0000 7f01f7f40700 1 -- 172.21.15.6:0/1709295891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01f006bf00 msgr2=0x7f01f00c4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.150+0000 7f01f7f40700 1 --2- 172.21.15.6:0/1709295891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01f006bf00 0x7f01f00c4f50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009840 tx=0x7f01ec009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.150+0000 7f01f7f40700 1 -- 172.21.15.6:0/1709295891 shutdown_connections 2023-07-21T07:35:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.150+0000 7f01f7f40700 1 --2- 172.21.15.6:0/1709295891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01f014fa60 0x7f01f006a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.150+0000 7f01f7f40700 1 --2- 172.21.15.6:0/1709295891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01f006bf00 0x7f01f00c4f50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.150+0000 7f01f7f40700 1 -- 172.21.15.6:0/1709295891 >> 172.21.15.6:0/1709295891 conn(0x7f01f00a8c90 msgr2=0x7f01f006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.151+0000 7f01f7f40700 1 -- 172.21.15.6:0/1709295891 shutdown_connections 2023-07-21T07:35:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.151+0000 7f01f7f40700 1 -- 172.21.15.6:0/1709295891 wait complete. 2023-07-21T07:35:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.152+0000 7f01f7f40700 1 Processor -- start 2023-07-21T07:35:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.152+0000 7f01f7f40700 1 -- start start 2023-07-21T07:35:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.153+0000 7f01f7f40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01f006b8b0 0x7f01f00a7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.153+0000 7f01f7f40700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01f006bf00 0x7f01f014c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.153+0000 7f01f7f40700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f014fa60 0x7f01f014c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.153+0000 7f01f7f40700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f01542a0 con 0x7f01f006b8b0 2023-07-21T07:35:01.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.153+0000 7f01f7f40700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f01e75c0 con 0x7f01f014fa60 2023-07-21T07:35:01.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.153+0000 7f01f7f40700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f014d630 con 0x7f01f006bf00 2023-07-21T07:35:01.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.153+0000 7f01f5cdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01f006b8b0 0x7f01f00a7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.153+0000 7f01f5cdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01f006b8b0 0x7f01f00a7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33178/0 (socket says 172.21.15.6:33178) 2023-07-21T07:35:01.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.153+0000 7f01f5cdc700 1 -- 172.21.15.6:0/4057988559 learned_addr learned my addr 172.21.15.6:0/4057988559 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:01.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.153+0000 7f01f54db700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01f006bf00 0x7f01f014c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.153+0000 7f01f64dd700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f014fa60 0x7f01f014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.154+0000 7f01f5cdc700 1 -- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01f006bf00 msgr2=0x7f01f014c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.154+0000 7f01f5cdc700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01f006bf00 0x7f01f014c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.154+0000 7f01f5cdc700 1 -- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f014fa60 msgr2=0x7f01f014c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.154+0000 7f01f5cdc700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f014fa60 0x7f01f014c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.154+0000 7f01f5cdc700 1 -- 172.21.15.6:0/4057988559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec0094a0 con 0x7f01f006b8b0 2023-07-21T07:35:01.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.154+0000 7f01f64dd700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f014fa60 0x7f01f014c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:01.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.154+0000 7f01f5cdc700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01f006b8b0 0x7f01f00a7e90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01e000e810 tx=0x7f01e000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.154+0000 7f01e67fc700 1 -- 172.21.15.6:0/4057988559 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0013610 con 0x7f01f006b8b0 2023-07-21T07:35:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.154+0000 7f01e67fc700 1 -- 172.21.15.6:0/4057988559 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e0013770 con 0x7f01f006b8b0 2023-07-21T07:35:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.154+0000 7f01f7f40700 1 -- 172.21.15.6:0/4057988559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f0153c10 con 0x7f01f006b8b0 2023-07-21T07:35:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.154+0000 7f01e67fc700 1 -- 172.21.15.6:0/4057988559 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0013b20 con 0x7f01f006b8b0 2023-07-21T07:35:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.154+0000 7f01f7f40700 1 -- 172.21.15.6:0/4057988559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f01e77d0 con 0x7f01f006b8b0 2023-07-21T07:35:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.155+0000 7f01f7f40700 1 -- 172.21.15.6:0/4057988559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f0074500 con 0x7f01f006b8b0 2023-07-21T07:35:01.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.155+0000 7f01e67fc700 1 -- 172.21.15.6:0/4057988559 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f01e0013c80 con 0x7f01f006b8b0 2023-07-21T07:35:01.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.156+0000 7f01e67fc700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f01d406ace0 0x7f01d406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.156+0000 7f01e67fc700 1 -- 172.21.15.6:0/4057988559 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01e0089090 con 0x7f01f006b8b0 2023-07-21T07:35:01.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.156+0000 7f01f54db700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f01d406ace0 0x7f01d406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.157+0000 7f01f54db700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f01d406ace0 0x7f01d406d1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0090b0 tx=0x7f01ec01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:01.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.160+0000 7f01e67fc700 1 -- 172.21.15.6:0/4057988559 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f01e0057b40 con 0x7f01f006b8b0 2023-07-21T07:35:01.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.360+0000 7f01f7f40700 1 -- 172.21.15.6:0/4057988559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01f006e520 con 0x7f01f006b8b0 2023-07-21T07:35:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.361+0000 7f01e67fc700 1 -- 172.21.15.6:0/4057988559 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f01e00576d0 con 0x7f01f006b8b0 2023-07-21T07:35:01.413 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:01.414 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:01.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.363+0000 7f01f7f40700 1 -- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f01d406ace0 msgr2=0x7f01d406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.363+0000 7f01f7f40700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f01d406ace0 0x7f01d406d1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0090b0 tx=0x7f01ec01c040 comp rx=0 tx=0).stop 2023-07-21T07:35:01.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.363+0000 7f01f7f40700 1 -- 172.21.15.6:0/4057988559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01f006b8b0 msgr2=0x7f01f00a7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.363+0000 7f01f7f40700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01f006b8b0 0x7f01f00a7e90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01e000e810 tx=0x7f01e000eb20 comp rx=0 tx=0).stop 2023-07-21T07:35:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.363+0000 7f01f7f40700 1 -- 172.21.15.6:0/4057988559 shutdown_connections 2023-07-21T07:35:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.363+0000 7f01f7f40700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f01d406ace0 0x7f01d406d1a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.363+0000 7f01f7f40700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01f014fa60 0x7f01f014c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.363+0000 7f01f7f40700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01f006b8b0 0x7f01f00a7e90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.363+0000 7f01f7f40700 1 --2- 172.21.15.6:0/4057988559 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01f006bf00 0x7f01f014c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.363+0000 7f01f7f40700 1 -- 172.21.15.6:0/4057988559 >> 172.21.15.6:0/4057988559 conn(0x7f01f00a8c90 msgr2=0x7f01f00b9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:01.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.364+0000 7f01f7f40700 1 -- 172.21.15.6:0/4057988559 shutdown_connections 2023-07-21T07:35:01.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.364+0000 7f01f7f40700 1 -- 172.21.15.6:0/4057988559 wait complete. 2023-07-21T07:35:01.428 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:34:38.107491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:34:39.423138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:35:01.429 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:35:01.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.505+0000 7f0b44bbd700 1 Processor -- start 2023-07-21T07:35:01.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.505+0000 7f0b44bbd700 1 -- start start 2023-07-21T07:35:01.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b44bbd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b400c18c0 0x7f0b400c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b44bbd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b40072130 0x7f0b4006a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b44bbd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b400c0b20 con 0x7f0b400703f0 2023-07-21T07:35:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b44bbd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b40151820 con 0x7f0b40072130 2023-07-21T07:35:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b44bbd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b400c0de0 con 0x7f0b400c18c0 2023-07-21T07:35:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b3ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b40072130 0x7f0b4006a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b3ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b40072130 0x7f0b4006a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33188/0 (socket says 172.21.15.6:33188) 2023-07-21T07:35:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b3ed9d700 1 -- 172.21.15.6:0/2861541706 learned_addr learned my addr 172.21.15.6:0/2861541706 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b3dd9b700 1 --2- 172.21.15.6:0/2861541706 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b400c18c0 0x7f0b400c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b3ed9d700 1 -- 172.21.15.6:0/2861541706 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b400c18c0 msgr2=0x7f0b400c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b3ed9d700 1 --2- 172.21.15.6:0/2861541706 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b400c18c0 0x7f0b400c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b3ed9d700 1 -- 172.21.15.6:0/2861541706 >> v1:172.21.15.86:6789/0 conn(0x7f0b400703f0 legacy=0x7f0b4014dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b3ed9d700 1 -- 172.21.15.6:0/2861541706 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b400c10c0 con 0x7f0b40072130 2023-07-21T07:35:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.506+0000 7f0b3d59a700 1 -- 172.21.15.6:0/2861541706 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137544495 0 0) 0x7f0b400c0b20 con 0x7f0b400703f0 2023-07-21T07:35:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.507+0000 7f0b3ed9d700 1 --2- 172.21.15.6:0/2861541706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b40072130 0x7f0b4006a090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009e50 tx=0x7f0b3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe5031568ca5add server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.507+0000 7f0b3d59a700 1 -- 172.21.15.6:0/2861541706 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800e070 con 0x7f0b40072130 2023-07-21T07:35:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.507+0000 7f0b3d59a700 1 -- 172.21.15.6:0/2861541706 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3800b910 con 0x7f0b40072130 2023-07-21T07:35:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.507+0000 7f0b3d59a700 1 -- 172.21.15.6:0/2861541706 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800bcc0 con 0x7f0b40072130 2023-07-21T07:35:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.507+0000 7f0b44bbd700 1 -- 172.21.15.6:0/2861541706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b40072130 msgr2=0x7f0b4006a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.507+0000 7f0b44bbd700 1 --2- 172.21.15.6:0/2861541706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b40072130 0x7f0b4006a090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009e50 tx=0x7f0b3800b330 comp rx=0 tx=0).stop 2023-07-21T07:35:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.507+0000 7f0b44bbd700 1 -- 172.21.15.6:0/2861541706 shutdown_connections 2023-07-21T07:35:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.507+0000 7f0b44bbd700 1 --2- 172.21.15.6:0/2861541706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b40072130 0x7f0b4006a090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.507+0000 7f0b44bbd700 1 --2- 172.21.15.6:0/2861541706 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b400c18c0 0x7f0b400c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.507+0000 7f0b44bbd700 1 -- 172.21.15.6:0/2861541706 >> 172.21.15.6:0/2861541706 conn(0x7f0b400c2c20 msgr2=0x7f0b400c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.507+0000 7f0b44bbd700 1 -- 172.21.15.6:0/2861541706 shutdown_connections 2023-07-21T07:35:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.507+0000 7f0b44bbd700 1 -- 172.21.15.6:0/2861541706 wait complete. 2023-07-21T07:35:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.509+0000 7f0b44bbd700 1 Processor -- start 2023-07-21T07:35:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.509+0000 7f0b44bbd700 1 -- start start 2023-07-21T07:35:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.510+0000 7f0b44bbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b400703f0 0x7f0b401e9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.510+0000 7f0b44bbd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b40072130 0x7f0b40149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.510+0000 7f0b44bbd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b400c18c0 0x7f0b40143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.510+0000 7f0b44bbd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b401e9e60 con 0x7f0b400703f0 2023-07-21T07:35:01.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.510+0000 7f0b44bbd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b401ea140 con 0x7f0b400c18c0 2023-07-21T07:35:01.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.510+0000 7f0b44bbd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b401ea420 con 0x7f0b40072130 2023-07-21T07:35:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.510+0000 7f0b3e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b400703f0 0x7f0b401e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.510+0000 7f0b3e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b400703f0 0x7f0b401e9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33192/0 (socket says 172.21.15.6:33192) 2023-07-21T07:35:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.510+0000 7f0b3e59c700 1 -- 172.21.15.6:0/864523689 learned_addr learned my addr 172.21.15.6:0/864523689 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.510+0000 7f0b3dd9b700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b40072130 0x7f0b40149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.510+0000 7f0b3ed9d700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b400c18c0 0x7f0b40143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.511+0000 7f0b3e59c700 1 -- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b40072130 msgr2=0x7f0b40149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.511+0000 7f0b3e59c700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b40072130 0x7f0b40149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.511+0000 7f0b3e59c700 1 -- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b400c18c0 msgr2=0x7f0b40143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.511+0000 7f0b3e59c700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b400c18c0 0x7f0b40143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.511+0000 7f0b3e59c700 1 -- 172.21.15.6:0/864523689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b38009b30 con 0x7f0b400703f0 2023-07-21T07:35:01.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.511+0000 7f0b3e59c700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b400703f0 0x7f0b401e9880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0b30001e70 tx=0x7f0b3000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:01.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.511+0000 7f0b2effd700 1 -- 172.21.15.6:0/864523689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b300054e0 con 0x7f0b400703f0 2023-07-21T07:35:01.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.511+0000 7f0b2effd700 1 -- 172.21.15.6:0/864523689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b30003680 con 0x7f0b400703f0 2023-07-21T07:35:01.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.511+0000 7f0b44bbd700 1 -- 172.21.15.6:0/864523689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b401ea700 con 0x7f0b400703f0 2023-07-21T07:35:01.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.511+0000 7f0b2effd700 1 -- 172.21.15.6:0/864523689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30003a30 con 0x7f0b400703f0 2023-07-21T07:35:01.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.511+0000 7f0b44bbd700 1 -- 172.21.15.6:0/864523689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4014fab0 con 0x7f0b400703f0 2023-07-21T07:35:01.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.512+0000 7f0b44bbd700 1 -- 172.21.15.6:0/864523689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b40074500 con 0x7f0b400703f0 2023-07-21T07:35:01.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.512+0000 7f0b2effd700 1 -- 172.21.15.6:0/864523689 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b30003b90 con 0x7f0b400703f0 2023-07-21T07:35:01.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.513+0000 7f0b2effd700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b2006ace0 0x7f0b2006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.513+0000 7f0b2effd700 1 -- 172.21.15.6:0/864523689 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b3008ada0 con 0x7f0b400703f0 2023-07-21T07:35:01.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.513+0000 7f0b3dd9b700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b2006ace0 0x7f0b2006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.513+0000 7f0b3dd9b700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b2006ace0 0x7f0b2006d1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0b401451d0 tx=0x7f0b34009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:01.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.517+0000 7f0b2effd700 1 -- 172.21.15.6:0/864523689 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0b30055ee0 con 0x7f0b400703f0 2023-07-21T07:35:01.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.713+0000 7f0b44bbd700 1 -- 172.21.15.6:0/864523689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b40144970 con 0x7f0b400703f0 2023-07-21T07:35:01.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.713+0000 7f0b2effd700 1 -- 172.21.15.6:0/864523689 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b30059500 con 0x7f0b400703f0 2023-07-21T07:35:01.765 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:35:01.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.715+0000 7f0b44bbd700 1 -- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b2006ace0 msgr2=0x7f0b2006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.715+0000 7f0b44bbd700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b2006ace0 0x7f0b2006d1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0b401451d0 tx=0x7f0b34009210 comp rx=0 tx=0).stop 2023-07-21T07:35:01.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.715+0000 7f0b44bbd700 1 -- 172.21.15.6:0/864523689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b400703f0 msgr2=0x7f0b401e9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.715+0000 7f0b44bbd700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b400703f0 0x7f0b401e9880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0b30001e70 tx=0x7f0b3000c800 comp rx=0 tx=0).stop 2023-07-21T07:35:01.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.715+0000 7f0b44bbd700 1 -- 172.21.15.6:0/864523689 shutdown_connections 2023-07-21T07:35:01.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.715+0000 7f0b44bbd700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b2006ace0 0x7f0b2006d1a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.715+0000 7f0b44bbd700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b400c18c0 0x7f0b40143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.715+0000 7f0b44bbd700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b400703f0 0x7f0b401e9880 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.715+0000 7f0b44bbd700 1 --2- 172.21.15.6:0/864523689 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b40072130 0x7f0b40149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.715+0000 7f0b44bbd700 1 -- 172.21.15.6:0/864523689 >> 172.21.15.6:0/864523689 conn(0x7f0b400c2c20 msgr2=0x7f0b400c43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:01.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.715+0000 7f0b44bbd700 1 -- 172.21.15.6:0/864523689 shutdown_connections 2023-07-21T07:35:01.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.715+0000 7f0b44bbd700 1 -- 172.21.15.6:0/864523689 wait complete. 2023-07-21T07:35:01.779 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:35:01.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.854+0000 7fbe5483b700 1 Processor -- start 2023-07-21T07:35:01.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.854+0000 7fbe5483b700 1 -- start start 2023-07-21T07:35:01.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.855+0000 7fbe5483b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe5006d680 0x7fbe501561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.855+0000 7fbe5483b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe5014f4b0 0x7fbe5014f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.855+0000 7fbe5483b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe50155d20 con 0x7fbe500abee0 2023-07-21T07:35:01.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.855+0000 7fbe5483b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe500c5de0 con 0x7fbe5006d680 2023-07-21T07:35:01.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.855+0000 7fbe5483b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5006db00 con 0x7fbe5014f4b0 2023-07-21T07:35:01.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.855+0000 7fbe4dd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe5006d680 0x7fbe501561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.855+0000 7fbe4e59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbe500abee0 0x7fbe50152da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41220/0 (socket says 172.21.15.6:41220) 2023-07-21T07:35:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.855+0000 7fbe4e59c700 1 -- 172.21.15.6:0/2699695204 learned_addr learned my addr 172.21.15.6:0/2699695204 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.855+0000 7fbe4dd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe5006d680 0x7fbe501561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33200/0 (socket says 172.21.15.6:33200) 2023-07-21T07:35:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.856+0000 7fbe4ed9d700 1 --2- 172.21.15.6:0/2699695204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe5014f4b0 0x7fbe5014f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.856+0000 7fbe4dd9b700 1 -- 172.21.15.6:0/2699695204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe5014f4b0 msgr2=0x7fbe5014f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:01.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.856+0000 7fbe4dd9b700 1 --2- 172.21.15.6:0/2699695204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe5014f4b0 0x7fbe5014f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.856+0000 7fbe4dd9b700 1 -- 172.21.15.6:0/2699695204 >> v1:172.21.15.6:6789/0 conn(0x7fbe500abee0 legacy=0x7fbe50152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.856+0000 7fbe4d59a700 1 -- 172.21.15.6:0/2699695204 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346598446 0 0) 0x7fbe50155d20 con 0x7fbe500abee0 2023-07-21T07:35:01.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.856+0000 7fbe4dd9b700 1 -- 172.21.15.6:0/2699695204 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500c4ce0 con 0x7fbe5006d680 2023-07-21T07:35:01.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.856+0000 7fbe4dd9b700 1 --2- 172.21.15.6:0/2699695204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5006d680 0x7fbe501561b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009840 tx=0x7fbe40009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753b189720ac2124 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:01.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.856+0000 7fbe4d59a700 1 -- 172.21.15.6:0/2699695204 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40011830 con 0x7fbe5006d680 2023-07-21T07:35:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.856+0000 7fbe4d59a700 1 -- 172.21.15.6:0/2699695204 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40011990 con 0x7fbe5006d680 2023-07-21T07:35:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.856+0000 7fbe4d59a700 1 -- 172.21.15.6:0/2699695204 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40011d20 con 0x7fbe5006d680 2023-07-21T07:35:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.856+0000 7fbe5483b700 1 -- 172.21.15.6:0/2699695204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5006d680 msgr2=0x7fbe501561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.856+0000 7fbe5483b700 1 --2- 172.21.15.6:0/2699695204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5006d680 0x7fbe501561b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009840 tx=0x7fbe40009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.857+0000 7fbe5483b700 1 -- 172.21.15.6:0/2699695204 shutdown_connections 2023-07-21T07:35:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.857+0000 7fbe5483b700 1 --2- 172.21.15.6:0/2699695204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe5014f4b0 0x7fbe5014f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.857+0000 7fbe5483b700 1 --2- 172.21.15.6:0/2699695204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5006d680 0x7fbe501561b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.857+0000 7fbe5483b700 1 -- 172.21.15.6:0/2699695204 >> 172.21.15.6:0/2699695204 conn(0x7fbe500a8660 msgr2=0x7fbe500a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.857+0000 7fbe5483b700 1 -- 172.21.15.6:0/2699695204 shutdown_connections 2023-07-21T07:35:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.857+0000 7fbe5483b700 1 -- 172.21.15.6:0/2699695204 wait complete. 2023-07-21T07:35:01.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.858+0000 7fbe5483b700 1 Processor -- start 2023-07-21T07:35:01.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.858+0000 7fbe5483b700 1 -- start start 2023-07-21T07:35:01.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe5483b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe5006d680 0x7fbe500c15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe5483b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500abee0 0x7fbe500a9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe5483b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe5014f4b0 0x7fbe501ec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe5483b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe501e9470 con 0x7fbe500abee0 2023-07-21T07:35:01.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe5483b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500c3b00 con 0x7fbe5014f4b0 2023-07-21T07:35:01.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe5483b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe501e9680 con 0x7fbe5006d680 2023-07-21T07:35:01.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe4dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500abee0 0x7fbe500a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe4dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500abee0 0x7fbe500a9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33208/0 (socket says 172.21.15.6:33208) 2023-07-21T07:35:01.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe4dd9b700 1 -- 172.21.15.6:0/386525568 learned_addr learned my addr 172.21.15.6:0/386525568 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:01.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe4e59c700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe5006d680 0x7fbe500c15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe4ed9d700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe5014f4b0 0x7fbe501ec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe4dd9b700 1 -- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe5006d680 msgr2=0x7fbe500c15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe4dd9b700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe5006d680 0x7fbe500c15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe4dd9b700 1 -- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe5014f4b0 msgr2=0x7fbe501ec9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:01.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe4dd9b700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe5014f4b0 0x7fbe501ec9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:01.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe4dd9b700 1 -- 172.21.15.6:0/386525568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe400094a0 con 0x7fbe500abee0 2023-07-21T07:35:01.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe4dd9b700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500abee0 0x7fbe500a9a60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe40000c00 tx=0x7fbe40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:01.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe3effd700 1 -- 172.21.15.6:0/386525568 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe400045f0 con 0x7fbe500abee0 2023-07-21T07:35:01.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe3effd700 1 -- 172.21.15.6:0/386525568 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4001f070 con 0x7fbe500abee0 2023-07-21T07:35:01.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe5483b700 1 -- 172.21.15.6:0/386525568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe500c31d0 con 0x7fbe500abee0 2023-07-21T07:35:01.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe3effd700 1 -- 172.21.15.6:0/386525568 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40003ae0 con 0x7fbe500abee0 2023-07-21T07:35:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.859+0000 7fbe5483b700 1 -- 172.21.15.6:0/386525568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe500c3790 con 0x7fbe500abee0 2023-07-21T07:35:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.860+0000 7fbe5483b700 1 -- 172.21.15.6:0/386525568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe500c3c70 con 0x7fbe500abee0 2023-07-21T07:35:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.861+0000 7fbe3effd700 1 -- 172.21.15.6:0/386525568 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe40003c40 con 0x7fbe500abee0 2023-07-21T07:35:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.861+0000 7fbe3effd700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbe3006ace0 0x7fbe3006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.861+0000 7fbe3effd700 1 -- 172.21.15.6:0/386525568 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe40021070 con 0x7fbe500abee0 2023-07-21T07:35:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.862+0000 7fbe4e59c700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbe3006ace0 0x7fbe3006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.862+0000 7fbe4e59c700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbe3006ace0 0x7fbe3006d1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe44000f60 tx=0x7fbe44007be0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:01.866+0000 7fbe3effd700 1 -- 172.21.15.6:0/386525568 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbe40056060 con 0x7fbe500abee0 2023-07-21T07:35:02.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.061+0000 7fbe5483b700 1 -- 172.21.15.6:0/386525568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbe50074500 con 0x7fbe500abee0 2023-07-21T07:35:02.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.062+0000 7fbe3effd700 1 -- 172.21.15.6:0/386525568 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbe400150a0 con 0x7fbe500abee0 2023-07-21T07:35:02.114 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:35:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.063+0000 7fbe5483b700 1 -- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbe3006ace0 msgr2=0x7fbe3006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.064+0000 7fbe5483b700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbe3006ace0 0x7fbe3006d1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe44000f60 tx=0x7fbe44007be0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.064+0000 7fbe5483b700 1 -- 172.21.15.6:0/386525568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500abee0 msgr2=0x7fbe500a9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.064+0000 7fbe5483b700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500abee0 0x7fbe500a9a60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe40000c00 tx=0x7fbe40004750 comp rx=0 tx=0).stop 2023-07-21T07:35:02.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.064+0000 7fbe5483b700 1 -- 172.21.15.6:0/386525568 shutdown_connections 2023-07-21T07:35:02.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.064+0000 7fbe5483b700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbe3006ace0 0x7fbe3006d1a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.064+0000 7fbe5483b700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe5014f4b0 0x7fbe501ec9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.064+0000 7fbe5483b700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe5006d680 0x7fbe500c15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.064+0000 7fbe5483b700 1 --2- 172.21.15.6:0/386525568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe500abee0 0x7fbe500a9a60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.064+0000 7fbe5483b700 1 -- 172.21.15.6:0/386525568 >> 172.21.15.6:0/386525568 conn(0x7fbe500a8660 msgr2=0x7fbe5014d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:02.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.064+0000 7fbe5483b700 1 -- 172.21.15.6:0/386525568 shutdown_connections 2023-07-21T07:35:02.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.064+0000 7fbe5483b700 1 -- 172.21.15.6:0/386525568 wait complete. 2023-07-21T07:35:02.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:35:02.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.208+0000 7fb056a4a700 1 Processor -- start 2023-07-21T07:35:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.208+0000 7fb056a4a700 1 -- start start 2023-07-21T07:35:02.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb056a4a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05006a300 0x7fb0501519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb056a4a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb050155530 con 0x7fb05006d8a0 2023-07-21T07:35:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb056a4a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb050154920 con 0x7fb0500ba140 2023-07-21T07:35:02.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb056a4a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500c1a30 con 0x7fb05006a300 2023-07-21T07:35:02.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb04ffff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05006a300 0x7fb0501519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb04f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb0500ba140 0x7fb0500c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:44476/0 (socket says 172.21.15.6:44476) 2023-07-21T07:35:02.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb04f7fe700 1 -- 172.21.15.6:0/1340482665 learned_addr learned my addr 172.21.15.6:0/1340482665 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:02.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb04effd700 1 -- 172.21.15.6:0/1340482665 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919141073 0 0) 0x7fb050154920 con 0x7fb0500ba140 2023-07-21T07:35:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb04effd700 1 -- 172.21.15.6:0/1340482665 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb03c0035b0 con 0x7fb0500ba140 2023-07-21T07:35:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb04effd700 1 -- 172.21.15.6:0/1340482665 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564603094 0 0) 0x7fb050155530 con 0x7fb05006d8a0 2023-07-21T07:35:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb04effd700 1 -- 172.21.15.6:0/1340482665 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb050154920 con 0x7fb05006d8a0 2023-07-21T07:35:02.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb04ffff700 1 -- 172.21.15.6:0/1340482665 >> v1:172.21.15.86:6789/0 conn(0x7fb0500ba140 legacy=0x7fb0500c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb04ffff700 1 -- 172.21.15.6:0/1340482665 >> v1:172.21.15.6:6789/0 conn(0x7fb05006d8a0 legacy=0x7fb0500c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.209+0000 7fb04ffff700 1 -- 172.21.15.6:0/1340482665 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050154c00 con 0x7fb05006a300 2023-07-21T07:35:02.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.210+0000 7fb04ffff700 1 --2- 172.21.15.6:0/1340482665 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05006a300 0x7fb0501519b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb040009870 tx=0x7fb040009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8267f566e4a2b46f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.210+0000 7fb04effd700 1 -- 172.21.15.6:0/1340482665 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040011830 con 0x7fb05006a300 2023-07-21T07:35:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.210+0000 7fb04effd700 1 -- 172.21.15.6:0/1340482665 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb040011990 con 0x7fb05006a300 2023-07-21T07:35:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.210+0000 7fb04effd700 1 -- 172.21.15.6:0/1340482665 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040011d20 con 0x7fb05006a300 2023-07-21T07:35:02.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.210+0000 7fb056a4a700 1 -- 172.21.15.6:0/1340482665 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05006a300 msgr2=0x7fb0501519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.210+0000 7fb056a4a700 1 --2- 172.21.15.6:0/1340482665 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05006a300 0x7fb0501519b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb040009870 tx=0x7fb040009b80 comp rx=0 tx=0).stop 2023-07-21T07:35:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.210+0000 7fb056a4a700 1 -- 172.21.15.6:0/1340482665 shutdown_connections 2023-07-21T07:35:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.210+0000 7fb056a4a700 1 --2- 172.21.15.6:0/1340482665 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05006a300 0x7fb0501519b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.210+0000 7fb056a4a700 1 -- 172.21.15.6:0/1340482665 >> 172.21.15.6:0/1340482665 conn(0x7fb0500a8660 msgr2=0x7fb0500a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.210+0000 7fb056a4a700 1 -- 172.21.15.6:0/1340482665 shutdown_connections 2023-07-21T07:35:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.210+0000 7fb056a4a700 1 -- 172.21.15.6:0/1340482665 wait complete. 2023-07-21T07:35:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.212+0000 7fb056a4a700 1 Processor -- start 2023-07-21T07:35:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.212+0000 7fb056a4a700 1 -- start start 2023-07-21T07:35:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.212+0000 7fb056a4a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05006a300 0x7fb0501edf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.212+0000 7fb056a4a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05006d8a0 0x7fb0501deff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.212+0000 7fb056a4a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0500ba140 0x7fb0500bc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.212+0000 7fb056a4a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500bb7f0 con 0x7fb05006a300 2023-07-21T07:35:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.212+0000 7fb056a4a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0501ee450 con 0x7fb0500ba140 2023-07-21T07:35:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.212+0000 7fb056a4a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb050071900 con 0x7fb05006d8a0 2023-07-21T07:35:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.212+0000 7fb04ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05006a300 0x7fb0501edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.212+0000 7fb04ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05006a300 0x7fb0501edf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33220/0 (socket says 172.21.15.6:33220) 2023-07-21T07:35:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.212+0000 7fb04ffff700 1 -- 172.21.15.6:0/871249754 learned_addr learned my addr 172.21.15.6:0/871249754 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.213+0000 7fb04f7fe700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05006d8a0 0x7fb0501deff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.213+0000 7fb054fe7700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0500ba140 0x7fb0500bc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.213+0000 7fb04ffff700 1 -- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05006d8a0 msgr2=0x7fb0501deff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.213+0000 7fb04ffff700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05006d8a0 0x7fb0501deff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.213+0000 7fb04ffff700 1 -- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0500ba140 msgr2=0x7fb0500bc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.213+0000 7fb04ffff700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0500ba140 0x7fb0500bc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.213+0000 7fb04ffff700 1 -- 172.21.15.6:0/871249754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0400094a0 con 0x7fb05006a300 2023-07-21T07:35:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.213+0000 7fb04ffff700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05006a300 0x7fb0501edf10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb0400090b0 tx=0x7fb040004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.213+0000 7fb04cff9700 1 -- 172.21.15.6:0/871249754 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04001a760 con 0x7fb05006a300 2023-07-21T07:35:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.213+0000 7fb04cff9700 1 -- 172.21.15.6:0/871249754 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04001a8c0 con 0x7fb05006a300 2023-07-21T07:35:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.213+0000 7fb04cff9700 1 -- 172.21.15.6:0/871249754 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04001ac70 con 0x7fb05006a300 2023-07-21T07:35:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.213+0000 7fb056a4a700 1 -- 172.21.15.6:0/871249754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0500be010 con 0x7fb05006a300 2023-07-21T07:35:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.213+0000 7fb056a4a700 1 -- 172.21.15.6:0/871249754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0500bbd00 con 0x7fb05006a300 2023-07-21T07:35:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.214+0000 7fb056a4a700 1 -- 172.21.15.6:0/871249754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0500bd210 con 0x7fb05006a300 2023-07-21T07:35:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.215+0000 7fb04cff9700 1 -- 172.21.15.6:0/871249754 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb040022070 con 0x7fb05006a300 2023-07-21T07:35:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.215+0000 7fb04cff9700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb03006ad10 0x7fb03006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.215+0000 7fb04cff9700 1 -- 172.21.15.6:0/871249754 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb04008a040 con 0x7fb05006a300 2023-07-21T07:35:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.216+0000 7fb04f7fe700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb03006ad10 0x7fb03006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.216+0000 7fb04f7fe700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb03006ad10 0x7fb03006d1d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb0500c3a70 tx=0x7fb038007e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:02.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.219+0000 7fb04cff9700 1 -- 172.21.15.6:0/871249754 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb0500bd210 con 0x7fb05006a300 2023-07-21T07:35:02.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.418+0000 7fb056a4a700 1 -- 172.21.15.6:0/871249754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0500bd210 con 0x7fb05006a300 2023-07-21T07:35:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.418+0000 7fb04cff9700 1 -- 172.21.15.6:0/871249754 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0500bd210 con 0x7fb05006a300 2023-07-21T07:35:02.470 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:35:02.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.420+0000 7fb056a4a700 1 -- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb03006ad10 msgr2=0x7fb03006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.420+0000 7fb056a4a700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb03006ad10 0x7fb03006d1d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb0500c3a70 tx=0x7fb038007e00 comp rx=0 tx=0).stop 2023-07-21T07:35:02.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.420+0000 7fb056a4a700 1 -- 172.21.15.6:0/871249754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05006a300 msgr2=0x7fb0501edf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.420+0000 7fb056a4a700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05006a300 0x7fb0501edf10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb0400090b0 tx=0x7fb040004750 comp rx=0 tx=0).stop 2023-07-21T07:35:02.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.420+0000 7fb056a4a700 1 -- 172.21.15.6:0/871249754 shutdown_connections 2023-07-21T07:35:02.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.420+0000 7fb056a4a700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb03006ad10 0x7fb03006d1d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.420+0000 7fb056a4a700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0500ba140 0x7fb0500bc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.420+0000 7fb056a4a700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05006a300 0x7fb0501edf10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.420+0000 7fb056a4a700 1 --2- 172.21.15.6:0/871249754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05006d8a0 0x7fb0501deff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.420+0000 7fb056a4a700 1 -- 172.21.15.6:0/871249754 >> 172.21.15.6:0/871249754 conn(0x7fb0500a8660 msgr2=0x7fb05014e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:02.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.420+0000 7fb056a4a700 1 -- 172.21.15.6:0/871249754 shutdown_connections 2023-07-21T07:35:02.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.420+0000 7fb056a4a700 1 -- 172.21.15.6:0/871249754 wait complete. 2023-07-21T07:35:02.484 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:35:02.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.559+0000 7f4b8d1eb700 1 Processor -- start 2023-07-21T07:35:02.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.559+0000 7f4b8d1eb700 1 -- start start 2023-07-21T07:35:02.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.560+0000 7f4b8d1eb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b8814fb30 0x7f4b8815dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.560+0000 7f4b8d1eb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b880c3c90 con 0x7f4b880a6f80 2023-07-21T07:35:02.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.560+0000 7f4b8d1eb700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b880c3680 con 0x7f4b88072160 2023-07-21T07:35:02.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.560+0000 7f4b8d1eb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880c26e0 con 0x7f4b8814fb30 2023-07-21T07:35:02.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.560+0000 7f4b86d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4b880a6f80 0x7f4b88152380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41246/0 (socket says 172.21.15.6:41246) 2023-07-21T07:35:02.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.560+0000 7f4b86d9d700 1 -- 172.21.15.6:0/3723782218 learned_addr learned my addr 172.21.15.6:0/3723782218 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:02.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.561+0000 7f4b8759e700 1 --2- 172.21.15.6:0/3723782218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b8814fb30 0x7f4b8815dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.561+0000 7f4b85d9b700 1 -- 172.21.15.6:0/3723782218 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64580931 0 0) 0x7f4b880c3c90 con 0x7f4b880a6f80 2023-07-21T07:35:02.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.561+0000 7f4b85d9b700 1 -- 172.21.15.6:0/3723782218 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b740035b0 con 0x7f4b880a6f80 2023-07-21T07:35:02.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.561+0000 7f4b85d9b700 1 -- 172.21.15.6:0/3723782218 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128623163 0 0) 0x7f4b880c3680 con 0x7f4b88072160 2023-07-21T07:35:02.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.561+0000 7f4b85d9b700 1 -- 172.21.15.6:0/3723782218 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b880c3c90 con 0x7f4b88072160 2023-07-21T07:35:02.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.561+0000 7f4b8759e700 1 -- 172.21.15.6:0/3723782218 >> v1:172.21.15.86:6789/0 conn(0x7f4b88072160 legacy=0x7f4b8814f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.561+0000 7f4b8759e700 1 -- 172.21.15.6:0/3723782218 >> v1:172.21.15.6:6789/0 conn(0x7f4b880a6f80 legacy=0x7f4b88152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.561+0000 7f4b8759e700 1 -- 172.21.15.6:0/3723782218 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b880c6fe0 con 0x7f4b8814fb30 2023-07-21T07:35:02.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.561+0000 7f4b8759e700 1 --2- 172.21.15.6:0/3723782218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b8814fb30 0x7f4b8815dd10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009dc0 tx=0x7f4b8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dde4cc67b8bfc229 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:02.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.561+0000 7f4b85d9b700 1 -- 172.21.15.6:0/3723782218 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000e070 con 0x7f4b8814fb30 2023-07-21T07:35:02.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.561+0000 7f4b85d9b700 1 -- 172.21.15.6:0/3723782218 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8000bb20 con 0x7f4b8814fb30 2023-07-21T07:35:02.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.561+0000 7f4b85d9b700 1 -- 172.21.15.6:0/3723782218 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80012430 con 0x7f4b8814fb30 2023-07-21T07:35:02.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.562+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/3723782218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b8814fb30 msgr2=0x7f4b8815dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.562+0000 7f4b8d1eb700 1 --2- 172.21.15.6:0/3723782218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b8814fb30 0x7f4b8815dd10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009dc0 tx=0x7f4b8000b330 comp rx=0 tx=0).stop 2023-07-21T07:35:02.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.562+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/3723782218 shutdown_connections 2023-07-21T07:35:02.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.562+0000 7f4b8d1eb700 1 --2- 172.21.15.6:0/3723782218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b8814fb30 0x7f4b8815dd10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.562+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/3723782218 >> 172.21.15.6:0/3723782218 conn(0x7f4b880c7b50 msgr2=0x7f4b880c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:02.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.562+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/3723782218 shutdown_connections 2023-07-21T07:35:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.562+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/3723782218 wait complete. 2023-07-21T07:35:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.563+0000 7f4b8d1eb700 1 Processor -- start 2023-07-21T07:35:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.563+0000 7f4b8d1eb700 1 -- start start 2023-07-21T07:35:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.564+0000 7f4b8d1eb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b88072160 0x7f4b880c1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.564+0000 7f4b8d1eb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b880a6f80 0x7f4b88147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.564+0000 7f4b8d1eb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b8814fb30 0x7f4b88148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.564+0000 7f4b8d1eb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8806bf20 con 0x7f4b88072160 2023-07-21T07:35:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.564+0000 7f4b8d1eb700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8806c200 con 0x7f4b8814fb30 2023-07-21T07:35:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.564+0000 7f4b8d1eb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8806c4e0 con 0x7f4b880a6f80 2023-07-21T07:35:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.564+0000 7f4b86d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b88072160 0x7f4b880c1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.564+0000 7f4b86d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b88072160 0x7f4b880c1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33232/0 (socket says 172.21.15.6:33232) 2023-07-21T07:35:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.564+0000 7f4b86d9d700 1 -- 172.21.15.6:0/1178456548 learned_addr learned my addr 172.21.15.6:0/1178456548 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.564+0000 7f4b8759e700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b8814fb30 0x7f4b88148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.564+0000 7f4b8659c700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b880a6f80 0x7f4b88147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.565+0000 7f4b86d9d700 1 -- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b880a6f80 msgr2=0x7f4b88147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.565+0000 7f4b86d9d700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b880a6f80 0x7f4b88147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.565+0000 7f4b86d9d700 1 -- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b8814fb30 msgr2=0x7f4b88148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.565+0000 7f4b86d9d700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b8814fb30 0x7f4b88148110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.565+0000 7f4b86d9d700 1 -- 172.21.15.6:0/1178456548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b80009a70 con 0x7f4b88072160 2023-07-21T07:35:02.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.565+0000 7f4b86d9d700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b88072160 0x7f4b880c1040 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c700 tx=0x7f4b7800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:02.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.565+0000 7f4b7f7fe700 1 -- 172.21.15.6:0/1178456548 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78005d70 con 0x7f4b88072160 2023-07-21T07:35:02.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.565+0000 7f4b7f7fe700 1 -- 172.21.15.6:0/1178456548 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b780070d0 con 0x7f4b88072160 2023-07-21T07:35:02.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.565+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/1178456548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b881513e0 con 0x7f4b88072160 2023-07-21T07:35:02.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.565+0000 7f4b7f7fe700 1 -- 172.21.15.6:0/1178456548 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78007480 con 0x7f4b88072160 2023-07-21T07:35:02.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.565+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/1178456548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8806bbb0 con 0x7f4b88072160 2023-07-21T07:35:02.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.566+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/1178456548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b88151240 con 0x7f4b88072160 2023-07-21T07:35:02.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.566+0000 7f4b7f7fe700 1 -- 172.21.15.6:0/1178456548 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b780075e0 con 0x7f4b88072160 2023-07-21T07:35:02.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.567+0000 7f4b7f7fe700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b6806ad10 0x7f4b6806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.567+0000 7f4b7f7fe700 1 -- 172.21.15.6:0/1178456548 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b78088a60 con 0x7f4b88072160 2023-07-21T07:35:02.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.567+0000 7f4b8659c700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b6806ad10 0x7f4b6806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.568+0000 7f4b8659c700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b6806ad10 0x7f4b6806d1d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4b8806d380 tx=0x7f4b70009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:02.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.571+0000 7f4b7f7fe700 1 -- 172.21.15.6:0/1178456548 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b88151240 con 0x7f4b88072160 2023-07-21T07:35:02.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.766+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/1178456548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b88151240 con 0x7f4b88072160 2023-07-21T07:35:02.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.767+0000 7f4b7f7fe700 1 -- 172.21.15.6:0/1178456548 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b88151240 con 0x7f4b88072160 2023-07-21T07:35:02.819 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:35:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.769+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b6806ad10 msgr2=0x7f4b6806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.769+0000 7f4b8d1eb700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b6806ad10 0x7f4b6806d1d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4b8806d380 tx=0x7f4b70009040 comp rx=0 tx=0).stop 2023-07-21T07:35:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.769+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/1178456548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b88072160 msgr2=0x7f4b880c1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.769+0000 7f4b8d1eb700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b88072160 0x7f4b880c1040 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c700 tx=0x7f4b7800cac0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.769+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/1178456548 shutdown_connections 2023-07-21T07:35:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.769+0000 7f4b8d1eb700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b6806ad10 0x7f4b6806d1d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.769+0000 7f4b8d1eb700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b8814fb30 0x7f4b88148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.769+0000 7f4b8d1eb700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b88072160 0x7f4b880c1040 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.769+0000 7f4b8d1eb700 1 --2- 172.21.15.6:0/1178456548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b880a6f80 0x7f4b88147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.769+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/1178456548 >> 172.21.15.6:0/1178456548 conn(0x7f4b880c7b50 msgr2=0x7f4b88071650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:02.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.769+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/1178456548 shutdown_connections 2023-07-21T07:35:02.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.769+0000 7f4b8d1eb700 1 -- 172.21.15.6:0/1178456548 wait complete. 2023-07-21T07:35:02.833 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:02.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.906+0000 7f42026d3700 1 Processor -- start 2023-07-21T07:35:02.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.907+0000 7f42026d3700 1 -- start start 2023-07-21T07:35:02.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.907+0000 7f42026d3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41fc14f9a0 0x7f41fc1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.907+0000 7f42026d3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41fc06f620 0x7f41fc156240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.907+0000 7f42026d3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41fc1528f0 con 0x7f41fc14fd80 2023-07-21T07:35:02.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.907+0000 7f42026d3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41fc0c2a10 con 0x7f41fc06f620 2023-07-21T07:35:02.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.907+0000 7f42026d3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41fc155db0 con 0x7f41fc14f9a0 2023-07-21T07:35:02.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.907+0000 7f41fb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41fc06f620 0x7f41fc156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.907+0000 7f41fb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41fc06f620 0x7f41fc156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33240/0 (socket says 172.21.15.6:33240) 2023-07-21T07:35:02.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.907+0000 7f41fb7fe700 1 -- 172.21.15.6:0/2359286334 learned_addr learned my addr 172.21.15.6:0/2359286334 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:02.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.908+0000 7f41fbfff700 1 --2- 172.21.15.6:0/2359286334 >> v2:172.21.15.86:3300/0 conn(0x7f41fc14f9a0 0x7f41fc1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.908+0000 7f41fb7fe700 1 -- 172.21.15.6:0/2359286334 >> v2:172.21.15.86:3300/0 conn(0x7f41fc14f9a0 msgr2=0x7f41fc1523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:02.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.908+0000 7f41fb7fe700 1 --2- 172.21.15.6:0/2359286334 >> v2:172.21.15.86:3300/0 conn(0x7f41fc14f9a0 0x7f41fc1523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.908+0000 7f41fb7fe700 1 -- 172.21.15.6:0/2359286334 >> v1:172.21.15.86:6789/0 conn(0x7f41fc14fd80 legacy=0x7f41fc0c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:02.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.908+0000 7f41fb7fe700 1 -- 172.21.15.6:0/2359286334 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc06e8c0 con 0x7f41fc06f620 2023-07-21T07:35:02.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.908+0000 7f41fb7fe700 1 --2- 172.21.15.6:0/2359286334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41fc06f620 0x7f41fc156240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f41fc071c50 tx=0x7f41e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a693589d8cf6439 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:02.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.908+0000 7f41faffd700 1 -- 172.21.15.6:0/2359286334 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4004230 con 0x7f41fc06f620 2023-07-21T07:35:02.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.908+0000 7f41faffd700 1 -- 172.21.15.6:0/2359286334 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e4004390 con 0x7f41fc06f620 2023-07-21T07:35:02.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.908+0000 7f41faffd700 1 -- 172.21.15.6:0/2359286334 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e40036a0 con 0x7f41fc06f620 2023-07-21T07:35:02.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.909+0000 7f42026d3700 1 -- 172.21.15.6:0/2359286334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41fc06f620 msgr2=0x7f41fc156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.909+0000 7f42026d3700 1 --2- 172.21.15.6:0/2359286334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41fc06f620 0x7f41fc156240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f41fc071c50 tx=0x7f41e4009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.909+0000 7f42026d3700 1 -- 172.21.15.6:0/2359286334 shutdown_connections 2023-07-21T07:35:02.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.909+0000 7f42026d3700 1 --2- 172.21.15.6:0/2359286334 >> v2:172.21.15.86:3300/0 conn(0x7f41fc14f9a0 0x7f41fc1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.909+0000 7f42026d3700 1 --2- 172.21.15.6:0/2359286334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41fc06f620 0x7f41fc156240 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.909+0000 7f42026d3700 1 -- 172.21.15.6:0/2359286334 >> 172.21.15.6:0/2359286334 conn(0x7f41fc06a480 msgr2=0x7f41fc06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:02.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.909+0000 7f42026d3700 1 -- 172.21.15.6:0/2359286334 shutdown_connections 2023-07-21T07:35:02.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.909+0000 7f42026d3700 1 -- 172.21.15.6:0/2359286334 wait complete. 2023-07-21T07:35:02.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.910+0000 7f42026d3700 1 Processor -- start 2023-07-21T07:35:02.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.910+0000 7f42026d3700 1 -- start start 2023-07-21T07:35:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f42026d3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41fc06f620 0x7f41fc0c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f42026d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41fc14f9a0 0x7f41fc1ece40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f42026d3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41fc14fd80 0x7f41fc1ed380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f42026d3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc1ea390 con 0x7f41fc14f9a0 2023-07-21T07:35:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f42026d3700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc06c600 con 0x7f41fc06f620 2023-07-21T07:35:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f42026d3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc1ed8c0 con 0x7f41fc14fd80 2023-07-21T07:35:02.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41fb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41fc14f9a0 0x7f41fc1ece40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41fb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41fc14f9a0 0x7f41fc1ece40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33248/0 (socket says 172.21.15.6:33248) 2023-07-21T07:35:02.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41fb7fe700 1 -- 172.21.15.6:0/2616341488 learned_addr learned my addr 172.21.15.6:0/2616341488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:02.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f4200c70700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41fc14fd80 0x7f41fc1ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41fbfff700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41fc06f620 0x7f41fc0c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41fb7fe700 1 -- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41fc14fd80 msgr2=0x7f41fc1ed380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41fb7fe700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41fc14fd80 0x7f41fc1ed380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41fb7fe700 1 -- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41fc06f620 msgr2=0x7f41fc0c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:02.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41fb7fe700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41fc06f620 0x7f41fc0c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:02.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41fb7fe700 1 -- 172.21.15.6:0/2616341488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e4009550 con 0x7f41fc14f9a0 2023-07-21T07:35:02.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41fbfff700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41fc06f620 0x7f41fc0c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:02.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f4200c70700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41fc14fd80 0x7f41fc1ed380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:02.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41fb7fe700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41fc14f9a0 0x7f41fc1ece40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009130 tx=0x7f41e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:02.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41f8ff9700 1 -- 172.21.15.6:0/2616341488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4003dc0 con 0x7f41fc14f9a0 2023-07-21T07:35:02.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41f8ff9700 1 -- 172.21.15.6:0/2616341488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e401f070 con 0x7f41fc14f9a0 2023-07-21T07:35:02.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f41f8ff9700 1 -- 172.21.15.6:0/2616341488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4011870 con 0x7f41fc14f9a0 2023-07-21T07:35:02.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.911+0000 7f42026d3700 1 -- 172.21.15.6:0/2616341488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41fc1ea7b0 con 0x7f41fc14f9a0 2023-07-21T07:35:02.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.912+0000 7f42026d3700 1 -- 172.21.15.6:0/2616341488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41fc1e9cd0 con 0x7f41fc14f9a0 2023-07-21T07:35:02.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.912+0000 7f42026d3700 1 -- 172.21.15.6:0/2616341488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41fc1ea4d0 con 0x7f41fc14f9a0 2023-07-21T07:35:02.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.913+0000 7f41f8ff9700 1 -- 172.21.15.6:0/2616341488 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41e4021030 con 0x7f41fc14f9a0 2023-07-21T07:35:02.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.913+0000 7f41f8ff9700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f41dc06ace0 0x7f41dc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:02.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.914+0000 7f41f8ff9700 1 -- 172.21.15.6:0/2616341488 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f41e408ab10 con 0x7f41fc14f9a0 2023-07-21T07:35:02.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.914+0000 7f41fbfff700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f41dc06ace0 0x7f41dc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:02.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.914+0000 7f41fbfff700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f41dc06ace0 0x7f41dc06d1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f41ec006fd0 tx=0x7f41ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:02.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:02.918+0000 7f41f8ff9700 1 -- 172.21.15.6:0/2616341488 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f41fc1ea4d0 con 0x7f41fc14f9a0 2023-07-21T07:35:03.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.118+0000 7f42026d3700 1 -- 172.21.15.6:0/2616341488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41fc1ea4d0 con 0x7f41fc14f9a0 2023-07-21T07:35:03.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.120+0000 7f41f8ff9700 1 -- 172.21.15.6:0/2616341488 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f41fc1ea4d0 con 0x7f41fc14f9a0 2023-07-21T07:35:03.172 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:03.172 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.122+0000 7f42026d3700 1 -- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f41dc06ace0 msgr2=0x7f41dc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.122+0000 7f42026d3700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f41dc06ace0 0x7f41dc06d1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f41ec006fd0 tx=0x7f41ec008040 comp rx=0 tx=0).stop 2023-07-21T07:35:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.122+0000 7f42026d3700 1 -- 172.21.15.6:0/2616341488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41fc14f9a0 msgr2=0x7f41fc1ece40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.122+0000 7f42026d3700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41fc14f9a0 0x7f41fc1ece40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009130 tx=0x7f41e4004750 comp rx=0 tx=0).stop 2023-07-21T07:35:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.122+0000 7f42026d3700 1 -- 172.21.15.6:0/2616341488 shutdown_connections 2023-07-21T07:35:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.122+0000 7f42026d3700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f41dc06ace0 0x7f41dc06d1a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.122+0000 7f42026d3700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41fc14fd80 0x7f41fc1ed380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.122+0000 7f42026d3700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41fc06f620 0x7f41fc0c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.122+0000 7f42026d3700 1 --2- 172.21.15.6:0/2616341488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41fc14f9a0 0x7f41fc1ece40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.122+0000 7f42026d3700 1 -- 172.21.15.6:0/2616341488 >> 172.21.15.6:0/2616341488 conn(0x7f41fc06a480 msgr2=0x7f41fc0c5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.122+0000 7f42026d3700 1 -- 172.21.15.6:0/2616341488 shutdown_connections 2023-07-21T07:35:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.122+0000 7f42026d3700 1 -- 172.21.15.6:0/2616341488 wait complete. 2023-07-21T07:35:03.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:34:38.107491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:34:39.423138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:35:03.186 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:35:03.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.263+0000 7fc3851d6700 1 Processor -- start 2023-07-21T07:35:03.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.263+0000 7fc3851d6700 1 -- start start 2023-07-21T07:35:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.263+0000 7fc3851d6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3800c18c0 0x7fc3800c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.263+0000 7fc3851d6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3800c0b20 con 0x7fc380072130 2023-07-21T07:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.263+0000 7fc3851d6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc380151820 con 0x7fc3800703f0 2023-07-21T07:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.263+0000 7fc3851d6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3800c0de0 con 0x7fc3800c18c0 2023-07-21T07:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37f59e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc380072130 0x7fc38006a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41278/0 (socket says 172.21.15.6:41278) 2023-07-21T07:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37f59e700 1 -- 172.21.15.6:0/2973792815 learned_addr learned my addr 172.21.15.6:0/2973792815 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37e59c700 1 --2- 172.21.15.6:0/2973792815 >> v2:172.21.15.86:3300/0 conn(0x7fc3800c18c0 0x7fc3800c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987870820 0 0) 0x7fc3800c0b20 con 0x7fc380072130 2023-07-21T07:35:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3680034d0 con 0x7fc380072130 2023-07-21T07:35:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2621673932 0 0) 0x7fc3680034d0 con 0x7fc380072130 2023-07-21T07:35:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 >> v2:172.21.15.86:3300/0 conn(0x7fc3800c18c0 msgr2=0x7fc3800c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 --2- 172.21.15.6:0/2973792815 >> v2:172.21.15.86:3300/0 conn(0x7fc3800c18c0 0x7fc3800c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 >> v1:172.21.15.86:6789/0 conn(0x7fc3800703f0 legacy=0x7fc38014dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3800c10c0 con 0x7fc380072130 2023-07-21T07:35:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7fc3780019f0 con 0x7fc380072130 2023-07-21T07:35:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 >> v1:172.21.15.6:6789/0 conn(0x7fc380072130 legacy=0x7fc38006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 --2- 172.21.15.6:0/2973792815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc368003af0 0x7fc368003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 --2- 172.21.15.6:0/2973792815 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3680088e0 0x7fc36800ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 --2- 172.21.15.6:0/2973792815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc36800b510 0x7fc36800d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3800c0de0 con 0x7fc368003af0 2023-07-21T07:35:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36800e2b0 con 0x7fc36800b510 2023-07-21T07:35:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36800e470 con 0x7fc3680088e0 2023-07-21T07:35:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37ed9d700 1 --2- 172.21.15.6:0/2973792815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc368003af0 0x7fc368003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.264+0000 7fc37f59e700 1 --2- 172.21.15.6:0/2973792815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc36800b510 0x7fc36800d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc37e59c700 1 --2- 172.21.15.6:0/2973792815 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3680088e0 0x7fc36800ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc37ed9d700 1 -- 172.21.15.6:0/2973792815 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3680088e0 msgr2=0x7fc36800ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc37ed9d700 1 --2- 172.21.15.6:0/2973792815 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3680088e0 0x7fc36800ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc37ed9d700 1 -- 172.21.15.6:0/2973792815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc36800b510 msgr2=0x7fc36800d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:03.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc37ed9d700 1 --2- 172.21.15.6:0/2973792815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc36800b510 0x7fc36800d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc37ed9d700 1 -- 172.21.15.6:0/2973792815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3680034d0 con 0x7fc368003af0 2023-07-21T07:35:03.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc37f59e700 1 -- 172.21.15.6:0/2973792815 reap_dead start 2023-07-21T07:35:03.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc37e59c700 1 --2- 172.21.15.6:0/2973792815 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3680088e0 0x7fc36800ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:03.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc37ed9d700 1 --2- 172.21.15.6:0/2973792815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc368003af0 0x7fc368003f10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc3700017c0 tx=0x7fc368003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc45661e8f6d624 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:03.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3700052d0 con 0x7fc368003af0 2023-07-21T07:35:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc370005450 con 0x7fc368003af0 2023-07-21T07:35:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc37dd9b700 1 -- 172.21.15.6:0/2973792815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3700038c0 con 0x7fc368003af0 2023-07-21T07:35:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc3851d6700 1 -- 172.21.15.6:0/2973792815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc368003af0 msgr2=0x7fc368003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc3851d6700 1 --2- 172.21.15.6:0/2973792815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc368003af0 0x7fc368003f10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc3700017c0 tx=0x7fc368003780 comp rx=0 tx=0).stop 2023-07-21T07:35:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc3851d6700 1 -- 172.21.15.6:0/2973792815 shutdown_connections 2023-07-21T07:35:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc3851d6700 1 --2- 172.21.15.6:0/2973792815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc368003af0 0x7fc368003f10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc3851d6700 1 -- 172.21.15.6:0/2973792815 >> 172.21.15.6:0/2973792815 conn(0x7fc3800c2c20 msgr2=0x7fc3800c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.265+0000 7fc3851d6700 1 -- 172.21.15.6:0/2973792815 shutdown_connections 2023-07-21T07:35:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.266+0000 7fc3851d6700 1 -- 172.21.15.6:0/2973792815 wait complete. 2023-07-21T07:35:03.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.267+0000 7fc3851d6700 1 Processor -- start 2023-07-21T07:35:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.267+0000 7fc3851d6700 1 -- start start 2023-07-21T07:35:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.268+0000 7fc3851d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc368003af0 0x7fc3800c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.268+0000 7fc3851d6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc380154580 0x7fc3801ed400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.268+0000 7fc3851d6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc380154ad0 0x7fc3801ed940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.268+0000 7fc3851d6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc380073920 con 0x7fc368003af0 2023-07-21T07:35:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.268+0000 7fc3851d6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3800aa050 con 0x7fc380154ad0 2023-07-21T07:35:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.268+0000 7fc3851d6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3800abff0 con 0x7fc380154580 2023-07-21T07:35:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.268+0000 7fc37ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc368003af0 0x7fc3800c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.268+0000 7fc37ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc368003af0 0x7fc3800c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33266/0 (socket says 172.21.15.6:33266) 2023-07-21T07:35:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.268+0000 7fc37ed9d700 1 -- 172.21.15.6:0/3412313099 learned_addr learned my addr 172.21.15.6:0/3412313099 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc37f59e700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc380154ad0 0x7fc3801ed940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc37e59c700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc380154580 0x7fc3801ed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc37ed9d700 1 -- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc380154580 msgr2=0x7fc3801ed400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc37ed9d700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc380154580 0x7fc3801ed400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc37ed9d700 1 -- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc380154ad0 msgr2=0x7fc3801ed940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc37ed9d700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc380154ad0 0x7fc3801ed940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc37ed9d700 1 -- 172.21.15.6:0/3412313099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3800aba30 con 0x7fc368003af0 2023-07-21T07:35:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc37e59c700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc380154580 0x7fc3801ed400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc37ed9d700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc368003af0 0x7fc3800c5390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc370001db0 tx=0x7fc370001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc3677fe700 1 -- 172.21.15.6:0/3412313099 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370001290 con 0x7fc368003af0 2023-07-21T07:35:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc3677fe700 1 -- 172.21.15.6:0/3412313099 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc370007040 con 0x7fc368003af0 2023-07-21T07:35:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc3677fe700 1 -- 172.21.15.6:0/3412313099 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3700073d0 con 0x7fc368003af0 2023-07-21T07:35:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc3851d6700 1 -- 172.21.15.6:0/3412313099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3800abd10 con 0x7fc368003af0 2023-07-21T07:35:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.269+0000 7fc3851d6700 1 -- 172.21.15.6:0/3412313099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3800c58d0 con 0x7fc368003af0 2023-07-21T07:35:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.270+0000 7fc3851d6700 1 -- 172.21.15.6:0/3412313099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc380074500 con 0x7fc368003af0 2023-07-21T07:35:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.271+0000 7fc3677fe700 1 -- 172.21.15.6:0/3412313099 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc370007530 con 0x7fc368003af0 2023-07-21T07:35:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.271+0000 7fc3677fe700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc36c06ace0 0x7fc36c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.271+0000 7fc3677fe700 1 -- 172.21.15.6:0/3412313099 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc370089d00 con 0x7fc368003af0 2023-07-21T07:35:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.271+0000 7fc37e59c700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc36c06ace0 0x7fc36c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.272+0000 7fc37e59c700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc36c06ace0 0x7fc36c06d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc380063e60 tx=0x7fc374008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.275+0000 7fc3677fe700 1 -- 172.21.15.6:0/3412313099 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc370054f60 con 0x7fc368003af0 2023-07-21T07:35:03.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.470+0000 7fc3851d6700 1 -- 172.21.15.6:0/3412313099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3801ed250 con 0x7fc368003af0 2023-07-21T07:35:03.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.470+0000 7fc3677fe700 1 -- 172.21.15.6:0/3412313099 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3700170a0 con 0x7fc368003af0 2023-07-21T07:35:03.523 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:35:03.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.472+0000 7fc3851d6700 1 -- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc36c06ace0 msgr2=0x7fc36c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.472+0000 7fc3851d6700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc36c06ace0 0x7fc36c06d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc380063e60 tx=0x7fc374008040 comp rx=0 tx=0).stop 2023-07-21T07:35:03.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.472+0000 7fc3851d6700 1 -- 172.21.15.6:0/3412313099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc368003af0 msgr2=0x7fc3800c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.472+0000 7fc3851d6700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc368003af0 0x7fc3800c5390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc370001db0 tx=0x7fc370001120 comp rx=0 tx=0).stop 2023-07-21T07:35:03.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.472+0000 7fc3851d6700 1 -- 172.21.15.6:0/3412313099 shutdown_connections 2023-07-21T07:35:03.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.472+0000 7fc3851d6700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc36c06ace0 0x7fc36c06d1a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.472+0000 7fc3851d6700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc380154ad0 0x7fc3801ed940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.472+0000 7fc3851d6700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc368003af0 0x7fc3800c5390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.472+0000 7fc3851d6700 1 --2- 172.21.15.6:0/3412313099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc380154580 0x7fc3801ed400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.472+0000 7fc3851d6700 1 -- 172.21.15.6:0/3412313099 >> 172.21.15.6:0/3412313099 conn(0x7fc3800c2c20 msgr2=0x7fc38014c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:03.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.473+0000 7fc3851d6700 1 -- 172.21.15.6:0/3412313099 shutdown_connections 2023-07-21T07:35:03.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.473+0000 7fc3851d6700 1 -- 172.21.15.6:0/3412313099 wait complete. 2023-07-21T07:35:03.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:35:03.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.612+0000 7f6ec6c36700 1 Processor -- start 2023-07-21T07:35:03.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.612+0000 7f6ec6c36700 1 -- start start 2023-07-21T07:35:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.613+0000 7f6ec6c36700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ec0072160 0x7f6ec014f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.613+0000 7f6ec6c36700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ec00c4120 0x7f6ec014f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.613+0000 7f6ec6c36700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec00c3c90 con 0x7f6ec00a6f80 2023-07-21T07:35:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.613+0000 7f6ec6c36700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec00c26e0 con 0x7f6ec00c4120 2023-07-21T07:35:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.613+0000 7f6ec6c36700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00c3680 con 0x7f6ec0072160 2023-07-21T07:35:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.613+0000 7f6ec51d3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ec00c4120 0x7f6ec014f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.613+0000 7f6ec49d2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6ec00a6f80 0x7f6ec0152380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41294/0 (socket says 172.21.15.6:41294) 2023-07-21T07:35:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.613+0000 7f6ec51d3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ec00c4120 0x7f6ec014f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33276/0 (socket says 172.21.15.6:33276) 2023-07-21T07:35:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.613+0000 7f6ec49d2700 1 -- 172.21.15.6:0/4291129524 learned_addr learned my addr 172.21.15.6:0/4291129524 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.614+0000 7f6ebffff700 1 --2- 172.21.15.6:0/4291129524 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ec0072160 0x7f6ec014f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.614+0000 7f6ec51d3700 1 -- 172.21.15.6:0/4291129524 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ec0072160 msgr2=0x7f6ec014f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.614+0000 7f6ec51d3700 1 --2- 172.21.15.6:0/4291129524 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ec0072160 0x7f6ec014f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.614+0000 7f6ec51d3700 1 -- 172.21.15.6:0/4291129524 >> v1:172.21.15.6:6789/0 conn(0x7f6ec00a6f80 legacy=0x7f6ec0152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.614+0000 7f6ebf7fe700 1 -- 172.21.15.6:0/4291129524 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273535413 0 0) 0x7f6ec00c3c90 con 0x7f6ec00a6f80 2023-07-21T07:35:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.614+0000 7f6ec51d3700 1 -- 172.21.15.6:0/4291129524 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00c6fe0 con 0x7f6ec00c4120 2023-07-21T07:35:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.614+0000 7f6ec51d3700 1 --2- 172.21.15.6:0/4291129524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec00c4120 0x7f6ec014f960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009d90 tx=0x7f6eb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2eb1679e49eddd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.614+0000 7f6ebf7fe700 1 -- 172.21.15.6:0/4291129524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800e070 con 0x7f6ec00c4120 2023-07-21T07:35:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.614+0000 7f6ebf7fe700 1 -- 172.21.15.6:0/4291129524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb800bb20 con 0x7f6ec00c4120 2023-07-21T07:35:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.614+0000 7f6ebf7fe700 1 -- 172.21.15.6:0/4291129524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8012430 con 0x7f6ec00c4120 2023-07-21T07:35:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.615+0000 7f6ec6c36700 1 -- 172.21.15.6:0/4291129524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec00c4120 msgr2=0x7f6ec014f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.615+0000 7f6ec6c36700 1 --2- 172.21.15.6:0/4291129524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec00c4120 0x7f6ec014f960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009d90 tx=0x7f6eb800b330 comp rx=0 tx=0).stop 2023-07-21T07:35:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.615+0000 7f6ec6c36700 1 -- 172.21.15.6:0/4291129524 shutdown_connections 2023-07-21T07:35:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.615+0000 7f6ec6c36700 1 --2- 172.21.15.6:0/4291129524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec00c4120 0x7f6ec014f960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.615+0000 7f6ec6c36700 1 --2- 172.21.15.6:0/4291129524 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ec0072160 0x7f6ec014f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.615+0000 7f6ec6c36700 1 -- 172.21.15.6:0/4291129524 >> 172.21.15.6:0/4291129524 conn(0x7f6ec00c7b50 msgr2=0x7f6ec00c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.615+0000 7f6ec6c36700 1 -- 172.21.15.6:0/4291129524 shutdown_connections 2023-07-21T07:35:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.615+0000 7f6ec6c36700 1 -- 172.21.15.6:0/4291129524 wait complete. 2023-07-21T07:35:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.616+0000 7f6ec6c36700 1 Processor -- start 2023-07-21T07:35:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.616+0000 7f6ec6c36700 1 -- start start 2023-07-21T07:35:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec6c36700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec0072160 0x7f6ec01e8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec6c36700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ec00a6f80 0x7f6ec01dbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec6c36700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec00c4120 0x7f6ec00a8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec6c36700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec0156660 con 0x7f6ec00c4120 2023-07-21T07:35:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec6c36700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec014b9f0 con 0x7f6ec0072160 2023-07-21T07:35:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec6c36700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec01e8550 con 0x7f6ec00a6f80 2023-07-21T07:35:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec51d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec00c4120 0x7f6ec00a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec51d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec00c4120 0x7f6ec00a8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33284/0 (socket says 172.21.15.6:33284) 2023-07-21T07:35:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec51d3700 1 -- 172.21.15.6:0/587126996 learned_addr learned my addr 172.21.15.6:0/587126996 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ebffff700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ec00a6f80 0x7f6ec01dbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec49d2700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec0072160 0x7f6ec01e8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec51d3700 1 -- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ec00a6f80 msgr2=0x7f6ec01dbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec51d3700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ec00a6f80 0x7f6ec01dbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec51d3700 1 -- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec0072160 msgr2=0x7f6ec01e8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec51d3700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec0072160 0x7f6ec01e8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec51d3700 1 -- 172.21.15.6:0/587126996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb8009a70 con 0x7f6ec00c4120 2023-07-21T07:35:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ec51d3700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec00c4120 0x7f6ec00a8370 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800b680 tx=0x7f6eb8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.617+0000 7f6ebd7fa700 1 -- 172.21.15.6:0/587126996 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8012430 con 0x7f6ec00c4120 2023-07-21T07:35:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.618+0000 7f6ebd7fa700 1 -- 172.21.15.6:0/587126996 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8020070 con 0x7f6ec00c4120 2023-07-21T07:35:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.618+0000 7f6ec6c36700 1 -- 172.21.15.6:0/587126996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec00c1f40 con 0x7f6ec00c4120 2023-07-21T07:35:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.618+0000 7f6ebd7fa700 1 -- 172.21.15.6:0/587126996 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8004280 con 0x7f6ec00c4120 2023-07-21T07:35:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.618+0000 7f6ec6c36700 1 -- 172.21.15.6:0/587126996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec014b710 con 0x7f6ec00c4120 2023-07-21T07:35:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.618+0000 7f6ec6c36700 1 -- 172.21.15.6:0/587126996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec00a94a0 con 0x7f6ec00c4120 2023-07-21T07:35:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.619+0000 7f6ebd7fa700 1 -- 172.21.15.6:0/587126996 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6eb80043e0 con 0x7f6ec00c4120 2023-07-21T07:35:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.619+0000 7f6ebd7fa700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6ea406ace0 0x7f6ea406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:03.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.619+0000 7f6ebd7fa700 1 -- 172.21.15.6:0/587126996 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6eb8022070 con 0x7f6ec00c4120 2023-07-21T07:35:03.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.620+0000 7f6ec49d2700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6ea406ace0 0x7f6ea406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:03.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.620+0000 7f6ec49d2700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6ea406ace0 0x7f6ea406d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4007fd0 tx=0x7f6eb4007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:03.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.624+0000 7f6ebd7fa700 1 -- 172.21.15.6:0/587126996 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6ec00a94a0 con 0x7f6ec00c4120 2023-07-21T07:35:03.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.822+0000 7f6ec6c36700 1 -- 172.21.15.6:0/587126996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6ec00a94a0 con 0x7f6ec00c4120 2023-07-21T07:35:03.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.822+0000 7f6ebd7fa700 1 -- 172.21.15.6:0/587126996 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6eb802c020 con 0x7f6ec00c4120 2023-07-21T07:35:03.874 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:35:03.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.824+0000 7f6ec6c36700 1 -- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6ea406ace0 msgr2=0x7f6ea406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.825+0000 7f6ec6c36700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6ea406ace0 0x7f6ea406d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4007fd0 tx=0x7f6eb4007de0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.825+0000 7f6ec6c36700 1 -- 172.21.15.6:0/587126996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec00c4120 msgr2=0x7f6ec00a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:03.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.825+0000 7f6ec6c36700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec00c4120 0x7f6ec00a8370 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800b680 tx=0x7f6eb8004ad0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.825+0000 7f6ec6c36700 1 -- 172.21.15.6:0/587126996 shutdown_connections 2023-07-21T07:35:03.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.825+0000 7f6ec6c36700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6ea406ace0 0x7f6ea406d1a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.825+0000 7f6ec6c36700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec00c4120 0x7f6ec00a8370 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.825+0000 7f6ec6c36700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec0072160 0x7f6ec01e8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.825+0000 7f6ec6c36700 1 --2- 172.21.15.6:0/587126996 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ec00a6f80 0x7f6ec01dbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.825+0000 7f6ec6c36700 1 -- 172.21.15.6:0/587126996 >> 172.21.15.6:0/587126996 conn(0x7f6ec00c7b50 msgr2=0x7f6ec014db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.825+0000 7f6ec6c36700 1 -- 172.21.15.6:0/587126996 shutdown_connections 2023-07-21T07:35:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.825+0000 7f6ec6c36700 1 -- 172.21.15.6:0/587126996 wait complete. 2023-07-21T07:35:03.888 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:35:04.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.967+0000 7f2cd52bb700 1 Processor -- start 2023-07-21T07:35:04.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.967+0000 7f2cd52bb700 1 -- start start 2023-07-21T07:35:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.968+0000 7f2cd52bb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2cd0071d10 0x7f2cd0156310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.968+0000 7f2cd52bb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd0152950 con 0x7f2cd014fb60 2023-07-21T07:35:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.968+0000 7f2cd52bb700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd00723e0 con 0x7f2cd00c3de0 2023-07-21T07:35:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.968+0000 7f2cd52bb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd00c7520 con 0x7f2cd0071d10 2023-07-21T07:35:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.968+0000 7f2cceffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2cd014fb60 0x7f2cd0152240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41308/0 (socket says 172.21.15.6:41308) 2023-07-21T07:35:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.968+0000 7f2cceffd700 1 -- 172.21.15.6:0/1477228396 learned_addr learned my addr 172.21.15.6:0/1477228396 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.968+0000 7f2ccf7fe700 1 --2- 172.21.15.6:0/1477228396 >> v2:172.21.15.6:3300/0 conn(0x7f2cd0071d10 0x7f2cd0156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.969+0000 7f2ccdffb700 1 -- 172.21.15.6:0/1477228396 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429066314 0 0) 0x7f2cd0152950 con 0x7f2cd014fb60 2023-07-21T07:35:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.969+0000 7f2ccdffb700 1 -- 172.21.15.6:0/1477228396 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cb80035b0 con 0x7f2cd014fb60 2023-07-21T07:35:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.969+0000 7f2ccf7fe700 1 -- 172.21.15.6:0/1477228396 >> v1:172.21.15.86:6789/0 conn(0x7f2cd00c3de0 legacy=0x7f2cd00c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.969+0000 7f2ccf7fe700 1 -- 172.21.15.6:0/1477228396 >> v1:172.21.15.6:6789/0 conn(0x7f2cd014fb60 legacy=0x7f2cd0152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.969+0000 7f2ccf7fe700 1 -- 172.21.15.6:0/1477228396 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd00726c0 con 0x7f2cd0071d10 2023-07-21T07:35:04.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.969+0000 7f2ccf7fe700 1 --2- 172.21.15.6:0/1477228396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd0071d10 0x7f2cd0156310 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009d90 tx=0x7f2cc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca4871798b0c462 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:04.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.969+0000 7f2ccdffb700 1 -- 172.21.15.6:0/1477228396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc800e070 con 0x7f2cd0071d10 2023-07-21T07:35:04.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.969+0000 7f2ccdffb700 1 -- 172.21.15.6:0/1477228396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc800bb20 con 0x7f2cd0071d10 2023-07-21T07:35:04.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.969+0000 7f2ccdffb700 1 -- 172.21.15.6:0/1477228396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8012430 con 0x7f2cd0071d10 2023-07-21T07:35:04.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.970+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1477228396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd0071d10 msgr2=0x7f2cd0156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.970+0000 7f2cd52bb700 1 --2- 172.21.15.6:0/1477228396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd0071d10 0x7f2cd0156310 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009d90 tx=0x7f2cc800b330 comp rx=0 tx=0).stop 2023-07-21T07:35:04.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.970+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1477228396 shutdown_connections 2023-07-21T07:35:04.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.970+0000 7f2cd52bb700 1 --2- 172.21.15.6:0/1477228396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd0071d10 0x7f2cd0156310 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.970+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1477228396 >> 172.21.15.6:0/1477228396 conn(0x7f2cd00a96e0 msgr2=0x7f2cd00a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:04.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.970+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1477228396 shutdown_connections 2023-07-21T07:35:04.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.970+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1477228396 wait complete. 2023-07-21T07:35:04.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.971+0000 7f2cd52bb700 1 Processor -- start 2023-07-21T07:35:04.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.971+0000 7f2cd52bb700 1 -- start start 2023-07-21T07:35:04.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.972+0000 7f2cd52bb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cd0071d10 0x7f2cd01e8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.972+0000 7f2cd52bb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cd00c3de0 0x7f2cd01e8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.972+0000 7f2cd52bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd014fb60 0x7f2cd00ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.972+0000 7f2cd52bb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00aaba0 con 0x7f2cd014fb60 2023-07-21T07:35:04.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.972+0000 7f2cd52bb700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd01e7a40 con 0x7f2cd0071d10 2023-07-21T07:35:04.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.972+0000 7f2cd52bb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd01eb9c0 con 0x7f2cd00c3de0 2023-07-21T07:35:04.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.972+0000 7f2ccf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd014fb60 0x7f2cd00ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.972+0000 7f2ccf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd014fb60 0x7f2cd00ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33298/0 (socket says 172.21.15.6:33298) 2023-07-21T07:35:04.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.972+0000 7f2ccf7fe700 1 -- 172.21.15.6:0/1677511805 learned_addr learned my addr 172.21.15.6:0/1677511805 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:04.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.973+0000 7f2cceffd700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cd0071d10 0x7f2cd01e8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.973+0000 7f2cce7fc700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cd00c3de0 0x7f2cd01e8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.973+0000 7f2ccf7fe700 1 -- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cd00c3de0 msgr2=0x7f2cd01e8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.973+0000 7f2ccf7fe700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cd00c3de0 0x7f2cd01e8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.973+0000 7f2ccf7fe700 1 -- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cd0071d10 msgr2=0x7f2cd01e8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.973+0000 7f2ccf7fe700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cd0071d10 0x7f2cd01e8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.973+0000 7f2ccf7fe700 1 -- 172.21.15.6:0/1677511805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc8009a70 con 0x7f2cd014fb60 2023-07-21T07:35:04.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.973+0000 7f2ccf7fe700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd014fb60 0x7f2cd00ad410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2cd006f910 tx=0x7f2cc8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:04.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.973+0000 7f2cb77fe700 1 -- 172.21.15.6:0/1677511805 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8012430 con 0x7f2cd014fb60 2023-07-21T07:35:04.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.973+0000 7f2cb77fe700 1 -- 172.21.15.6:0/1677511805 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc8020070 con 0x7f2cd014fb60 2023-07-21T07:35:04.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.973+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1677511805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd01ebca0 con 0x7f2cd014fb60 2023-07-21T07:35:04.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.973+0000 7f2cb77fe700 1 -- 172.21.15.6:0/1677511805 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8004280 con 0x7f2cd014fb60 2023-07-21T07:35:04.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.973+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1677511805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd01e7fe0 con 0x7f2cd014fb60 2023-07-21T07:35:04.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.974+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1677511805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd01ebee0 con 0x7f2cd014fb60 2023-07-21T07:35:04.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.975+0000 7f2cb77fe700 1 -- 172.21.15.6:0/1677511805 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2cc80043e0 con 0x7f2cd014fb60 2023-07-21T07:35:04.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.975+0000 7f2cb77fe700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2cbc06ace0 0x7f2cbc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.975+0000 7f2cb77fe700 1 -- 172.21.15.6:0/1677511805 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2cc8022070 con 0x7f2cd014fb60 2023-07-21T07:35:04.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.975+0000 7f2cceffd700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2cbc06ace0 0x7f2cbc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.976+0000 7f2cceffd700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2cbc06ace0 0x7f2cbc06d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4007fd0 tx=0x7f2cc4007dc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:04.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:03.979+0000 7f2cb77fe700 1 -- 172.21.15.6:0/1677511805 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2cc8056160 con 0x7f2cd014fb60 2023-07-21T07:35:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.177+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1677511805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2cd0074500 con 0x7f2cd014fb60 2023-07-21T07:35:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.177+0000 7f2cb77fe700 1 -- 172.21.15.6:0/1677511805 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2cc802c020 con 0x7f2cd014fb60 2023-07-21T07:35:04.229 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:35:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.179+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2cbc06ace0 msgr2=0x7f2cbc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.179+0000 7f2cd52bb700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2cbc06ace0 0x7f2cbc06d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4007fd0 tx=0x7f2cc4007dc0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.179+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1677511805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd014fb60 msgr2=0x7f2cd00ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.179+0000 7f2cd52bb700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd014fb60 0x7f2cd00ad410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2cd006f910 tx=0x7f2cc8004ad0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.179+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1677511805 shutdown_connections 2023-07-21T07:35:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.179+0000 7f2cd52bb700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2cbc06ace0 0x7f2cbc06d1a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.179+0000 7f2cd52bb700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd014fb60 0x7f2cd00ad410 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.179+0000 7f2cd52bb700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cd0071d10 0x7f2cd01e8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.179+0000 7f2cd52bb700 1 --2- 172.21.15.6:0/1677511805 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cd00c3de0 0x7f2cd01e8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.179+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1677511805 >> 172.21.15.6:0/1677511805 conn(0x7f2cd00a96e0 msgr2=0x7f2cd00a8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.179+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1677511805 shutdown_connections 2023-07-21T07:35:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.179+0000 7f2cd52bb700 1 -- 172.21.15.6:0/1677511805 wait complete. 2023-07-21T07:35:04.243 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:35:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.319+0000 7f58afb12700 1 Processor -- start 2023-07-21T07:35:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.319+0000 7f58afb12700 1 -- start start 2023-07-21T07:35:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58afb12700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f58a806a300 0x7f58a81519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58afb12700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a80ba140 0x7f58a8151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58afb12700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f58a806d8a0 0x7f58a80c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58afb12700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a80c1a30 con 0x7f58a806a300 2023-07-21T07:35:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58afb12700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a8155530 con 0x7f58a806d8a0 2023-07-21T07:35:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58afb12700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8154920 con 0x7f58a80ba140 2023-07-21T07:35:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58ad8ae700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f58a806a300 0x7f58a81519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58ad8ae700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f58a806a300 0x7f58a81519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33304/0 (socket says 172.21.15.6:33304) 2023-07-21T07:35:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58ad8ae700 1 -- 172.21.15.6:0/3625752611 learned_addr learned my addr 172.21.15.6:0/3625752611 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58ae0af700 1 --2- 172.21.15.6:0/3625752611 >> v2:172.21.15.86:3300/0 conn(0x7f58a806d8a0 0x7f58a80c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58ad0ad700 1 --2- 172.21.15.6:0/3625752611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a80ba140 0x7f58a8151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58ad8ae700 1 -- 172.21.15.6:0/3625752611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a80ba140 msgr2=0x7f58a8151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58ad8ae700 1 --2- 172.21.15.6:0/3625752611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a80ba140 0x7f58a8151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58ad8ae700 1 -- 172.21.15.6:0/3625752611 >> v2:172.21.15.86:3300/0 conn(0x7f58a806d8a0 msgr2=0x7f58a80c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58ad8ae700 1 --2- 172.21.15.6:0/3625752611 >> v2:172.21.15.86:3300/0 conn(0x7f58a806d8a0 0x7f58a80c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58ad8ae700 1 -- 172.21.15.6:0/3625752611 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a8154c00 con 0x7f58a806a300 2023-07-21T07:35:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58ae0af700 1 --2- 172.21.15.6:0/3625752611 >> v2:172.21.15.86:3300/0 conn(0x7f58a806d8a0 0x7f58a80c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.320+0000 7f58ad0ad700 1 --2- 172.21.15.6:0/3625752611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a80ba140 0x7f58a8151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.321+0000 7f58ad8ae700 1 --2- 172.21.15.6:0/3625752611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a806a300 0x7f58a81519b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f58a80685f0 tx=0x7f5898009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdb1a75d3e17108 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.321+0000 7f58ac8ac700 1 -- 172.21.15.6:0/3625752611 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589800b870 con 0x7f58a806a300 2023-07-21T07:35:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.321+0000 7f58ac8ac700 1 -- 172.21.15.6:0/3625752611 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589800b9d0 con 0x7f58a806a300 2023-07-21T07:35:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.321+0000 7f58ac8ac700 1 -- 172.21.15.6:0/3625752611 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589800bd60 con 0x7f58a806a300 2023-07-21T07:35:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.321+0000 7f58afb12700 1 -- 172.21.15.6:0/3625752611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a806a300 msgr2=0x7f58a81519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.321+0000 7f58afb12700 1 --2- 172.21.15.6:0/3625752611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a806a300 0x7f58a81519b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f58a80685f0 tx=0x7f5898009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.321+0000 7f58afb12700 1 -- 172.21.15.6:0/3625752611 shutdown_connections 2023-07-21T07:35:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.321+0000 7f58afb12700 1 --2- 172.21.15.6:0/3625752611 >> v2:172.21.15.86:3300/0 conn(0x7f58a806d8a0 0x7f58a80c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.321+0000 7f58afb12700 1 --2- 172.21.15.6:0/3625752611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a806a300 0x7f58a81519b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.321+0000 7f58afb12700 1 --2- 172.21.15.6:0/3625752611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a80ba140 0x7f58a8151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.321+0000 7f58afb12700 1 -- 172.21.15.6:0/3625752611 >> 172.21.15.6:0/3625752611 conn(0x7f58a80a8660 msgr2=0x7f58a80a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.321+0000 7f58afb12700 1 -- 172.21.15.6:0/3625752611 shutdown_connections 2023-07-21T07:35:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.321+0000 7f58afb12700 1 -- 172.21.15.6:0/3625752611 wait complete. 2023-07-21T07:35:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.323+0000 7f58afb12700 1 Processor -- start 2023-07-21T07:35:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.323+0000 7f58afb12700 1 -- start start 2023-07-21T07:35:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.323+0000 7f58afb12700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a806a300 0x7f58a81eb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.323+0000 7f58afb12700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a806d8a0 0x7f58a81eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.323+0000 7f58afb12700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a80ba140 0x7f58a80a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.323+0000 7f58afb12700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8070a80 con 0x7f58a806a300 2023-07-21T07:35:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.323+0000 7f58afb12700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a81eba10 con 0x7f58a806d8a0 2023-07-21T07:35:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.323+0000 7f58afb12700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8151400 con 0x7f58a80ba140 2023-07-21T07:35:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.323+0000 7f58ad8ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a806a300 0x7f58a81eb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.323+0000 7f58ad8ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a806a300 0x7f58a81eb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33310/0 (socket says 172.21.15.6:33310) 2023-07-21T07:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.323+0000 7f58ad8ae700 1 -- 172.21.15.6:0/1170165393 learned_addr learned my addr 172.21.15.6:0/1170165393 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f58ae0af700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a80ba140 0x7f58a80a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f58ad0ad700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a806d8a0 0x7f58a81eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f58ad8ae700 1 -- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a80ba140 msgr2=0x7f58a80a7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f58ad8ae700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a80ba140 0x7f58a80a7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f58ad8ae700 1 -- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a806d8a0 msgr2=0x7f58a81eaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f58ad8ae700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a806d8a0 0x7f58a81eaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f58ad8ae700 1 -- 172.21.15.6:0/1170165393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898009550 con 0x7f58a806a300 2023-07-21T07:35:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f58ad0ad700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a806d8a0 0x7f58a81eaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f58ad8ae700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a806a300 0x7f58a81eb4d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5898014040 tx=0x7f5898004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f589e7fc700 1 -- 172.21.15.6:0/1170165393 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898004520 con 0x7f58a806a300 2023-07-21T07:35:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f589e7fc700 1 -- 172.21.15.6:0/1170165393 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589801e070 con 0x7f58a806a300 2023-07-21T07:35:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f589e7fc700 1 -- 172.21.15.6:0/1170165393 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58980038e0 con 0x7f58a806a300 2023-07-21T07:35:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f58afb12700 1 -- 172.21.15.6:0/1170165393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a81eafa0 con 0x7f58a806a300 2023-07-21T07:35:04.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.324+0000 7f58afb12700 1 -- 172.21.15.6:0/1170165393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a8072140 con 0x7f58a806a300 2023-07-21T07:35:04.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.325+0000 7f58afb12700 1 -- 172.21.15.6:0/1170165393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a8070bc0 con 0x7f58a806a300 2023-07-21T07:35:04.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.325+0000 7f589e7fc700 1 -- 172.21.15.6:0/1170165393 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5898003a40 con 0x7f58a806a300 2023-07-21T07:35:04.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.326+0000 7f589e7fc700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f588c06ace0 0x7f588c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.326+0000 7f589e7fc700 1 -- 172.21.15.6:0/1170165393 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5898020070 con 0x7f58a806a300 2023-07-21T07:35:04.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.326+0000 7f58ad0ad700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f588c06ace0 0x7f588c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.326+0000 7f58ad0ad700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f588c06ace0 0x7f588c06d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f58a40089b0 tx=0x7f58a4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:04.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.330+0000 7f589e7fc700 1 -- 172.21.15.6:0/1170165393 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5898055b50 con 0x7f58a806a300 2023-07-21T07:35:04.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.526+0000 7f58afb12700 1 -- 172.21.15.6:0/1170165393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58a8074500 con 0x7f58a806a300 2023-07-21T07:35:04.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.526+0000 7f589e7fc700 1 -- 172.21.15.6:0/1170165393 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58980150a0 con 0x7f58a806a300 2023-07-21T07:35:04.578 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:35:04.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.529+0000 7f58afb12700 1 -- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f588c06ace0 msgr2=0x7f588c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.529+0000 7f58afb12700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f588c06ace0 0x7f588c06d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f58a40089b0 tx=0x7f58a4008040 comp rx=0 tx=0).stop 2023-07-21T07:35:04.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.529+0000 7f58afb12700 1 -- 172.21.15.6:0/1170165393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a806a300 msgr2=0x7f58a81eb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.529+0000 7f58afb12700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a806a300 0x7f58a81eb4d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5898014040 tx=0x7f5898004750 comp rx=0 tx=0).stop 2023-07-21T07:35:04.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.529+0000 7f58afb12700 1 -- 172.21.15.6:0/1170165393 shutdown_connections 2023-07-21T07:35:04.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.529+0000 7f58afb12700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f588c06ace0 0x7f588c06d1a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.529+0000 7f58afb12700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a80ba140 0x7f58a80a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.529+0000 7f58afb12700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a806a300 0x7f58a81eb4d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.529+0000 7f58afb12700 1 --2- 172.21.15.6:0/1170165393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a806d8a0 0x7f58a81eaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.529+0000 7f58afb12700 1 -- 172.21.15.6:0/1170165393 >> 172.21.15.6:0/1170165393 conn(0x7f58a80a8660 msgr2=0x7f58a80c32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:04.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.529+0000 7f58afb12700 1 -- 172.21.15.6:0/1170165393 shutdown_connections 2023-07-21T07:35:04.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.529+0000 7f58afb12700 1 -- 172.21.15.6:0/1170165393 wait complete. 2023-07-21T07:35:04.592 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.665+0000 7f13e52a8700 1 Processor -- start 2023-07-21T07:35:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.665+0000 7f13e52a8700 1 -- start start 2023-07-21T07:35:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.666+0000 7f13e52a8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13e0151ac0 0x7f13e00c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.666+0000 7f13e52a8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e0155390 con 0x7f13e00c4c50 2023-07-21T07:35:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.666+0000 7f13e52a8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e00c83e0 con 0x7f13e00c47d0 2023-07-21T07:35:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.666+0000 7f13e52a8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e00bd7b0 con 0x7f13e0151ac0 2023-07-21T07:35:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.666+0000 7f13deffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13e0151ac0 0x7f13e00c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.666+0000 7f13df7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f13e00c4c50 0x7f13e00c6ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41342/0 (socket says 172.21.15.6:41342) 2023-07-21T07:35:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.666+0000 7f13df7fe700 1 -- 172.21.15.6:0/2047221195 learned_addr learned my addr 172.21.15.6:0/2047221195 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.666+0000 7f13deffd700 1 -- 172.21.15.6:0/2047221195 >> v1:172.21.15.86:6789/0 conn(0x7f13e00c47d0 legacy=0x7f13e00c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.666+0000 7f13deffd700 1 -- 172.21.15.6:0/2047221195 >> v1:172.21.15.6:6789/0 conn(0x7f13e00c4c50 legacy=0x7f13e00c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.666+0000 7f13deffd700 1 -- 172.21.15.6:0/2047221195 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e0154780 con 0x7f13e0151ac0 2023-07-21T07:35:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.666+0000 7f13ddffb700 1 -- 172.21.15.6:0/2047221195 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539849590 0 0) 0x7f13e0155390 con 0x7f13e00c4c50 2023-07-21T07:35:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.666+0000 7f13deffd700 1 --2- 172.21.15.6:0/2047221195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e0151ac0 0x7f13e00c7ea0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009840 tx=0x7f13d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4df5e4695fbe75 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.667+0000 7f13ddffb700 1 -- 172.21.15.6:0/2047221195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4011830 con 0x7f13e0151ac0 2023-07-21T07:35:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.667+0000 7f13ddffb700 1 -- 172.21.15.6:0/2047221195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d4011990 con 0x7f13e0151ac0 2023-07-21T07:35:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.667+0000 7f13ddffb700 1 -- 172.21.15.6:0/2047221195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4011d20 con 0x7f13e0151ac0 2023-07-21T07:35:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.667+0000 7f13e52a8700 1 -- 172.21.15.6:0/2047221195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e0151ac0 msgr2=0x7f13e00c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.667+0000 7f13e52a8700 1 --2- 172.21.15.6:0/2047221195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e0151ac0 0x7f13e00c7ea0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009840 tx=0x7f13d4009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.667+0000 7f13e52a8700 1 -- 172.21.15.6:0/2047221195 shutdown_connections 2023-07-21T07:35:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.667+0000 7f13e52a8700 1 --2- 172.21.15.6:0/2047221195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e0151ac0 0x7f13e00c7ea0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.667+0000 7f13e52a8700 1 -- 172.21.15.6:0/2047221195 >> 172.21.15.6:0/2047221195 conn(0x7f13e00717c0 msgr2=0x7f13e0071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.667+0000 7f13e52a8700 1 -- 172.21.15.6:0/2047221195 shutdown_connections 2023-07-21T07:35:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.667+0000 7f13e52a8700 1 -- 172.21.15.6:0/2047221195 wait complete. 2023-07-21T07:35:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.669+0000 7f13e52a8700 1 Processor -- start 2023-07-21T07:35:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.669+0000 7f13e52a8700 1 -- start start 2023-07-21T07:35:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13e52a8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e00c47d0 0x7f13e00c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13e52a8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f13e00c4c50 0x7f13e01582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13e52a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e0151ac0 0x7f13e01e9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13e52a8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00c3ce0 con 0x7f13e0151ac0 2023-07-21T07:35:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13e52a8700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0150d30 con 0x7f13e00c47d0 2023-07-21T07:35:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13e52a8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00c3110 con 0x7f13e00c4c50 2023-07-21T07:35:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e0151ac0 0x7f13e01e9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e0151ac0 0x7f13e01e9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33328/0 (socket says 172.21.15.6:33328) 2023-07-21T07:35:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13df7fe700 1 -- 172.21.15.6:0/2831234106 learned_addr learned my addr 172.21.15.6:0/2831234106 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13deffd700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e00c47d0 0x7f13e00c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13de7fc700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f13e00c4c50 0x7f13e01582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13df7fe700 1 -- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f13e00c4c50 msgr2=0x7f13e01582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13df7fe700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f13e00c4c50 0x7f13e01582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13df7fe700 1 -- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e00c47d0 msgr2=0x7f13e00c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13df7fe700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e00c47d0 0x7f13e00c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13df7fe700 1 -- 172.21.15.6:0/2831234106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d40094a0 con 0x7f13e0151ac0 2023-07-21T07:35:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13de7fc700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f13e00c4c50 0x7f13e01582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.670+0000 7f13df7fe700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e0151ac0 0x7f13e01e9b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f13d800cca0 tx=0x7f13d800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.671+0000 7f13c77fe700 1 -- 172.21.15.6:0/2831234106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d800cea0 con 0x7f13e0151ac0 2023-07-21T07:35:04.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.671+0000 7f13c77fe700 1 -- 172.21.15.6:0/2831234106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d800ad80 con 0x7f13e0151ac0 2023-07-21T07:35:04.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.671+0000 7f13e52a8700 1 -- 172.21.15.6:0/2831234106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e00c3340 con 0x7f13e0151ac0 2023-07-21T07:35:04.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.671+0000 7f13c77fe700 1 -- 172.21.15.6:0/2831234106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8007310 con 0x7f13e0151ac0 2023-07-21T07:35:04.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.671+0000 7f13e52a8700 1 -- 172.21.15.6:0/2831234106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e00c3900 con 0x7f13e0151ac0 2023-07-21T07:35:04.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.672+0000 7f13e52a8700 1 -- 172.21.15.6:0/2831234106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e00c3e20 con 0x7f13e0151ac0 2023-07-21T07:35:04.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.672+0000 7f13c77fe700 1 -- 172.21.15.6:0/2831234106 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13d8007470 con 0x7f13e0151ac0 2023-07-21T07:35:04.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.672+0000 7f13c77fe700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f13cc06ace0 0x7f13cc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:04.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.673+0000 7f13c77fe700 1 -- 172.21.15.6:0/2831234106 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f13d8089350 con 0x7f13e0151ac0 2023-07-21T07:35:04.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.673+0000 7f13deffd700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f13cc06ace0 0x7f13cc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:04.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.673+0000 7f13deffd700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f13cc06ace0 0x7f13cc06d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f13d4000c00 tx=0x7f13d401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:04.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.677+0000 7f13c77fe700 1 -- 172.21.15.6:0/2831234106 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f13e00c3e20 con 0x7f13e0151ac0 2023-07-21T07:35:04.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.874+0000 7f13e52a8700 1 -- 172.21.15.6:0/2831234106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13e00c3e20 con 0x7f13e0151ac0 2023-07-21T07:35:04.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.875+0000 7f13c77fe700 1 -- 172.21.15.6:0/2831234106 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f13e00c3e20 con 0x7f13e0151ac0 2023-07-21T07:35:04.927 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:04.927 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:04.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.877+0000 7f13e52a8700 1 -- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f13cc06ace0 msgr2=0x7f13cc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.877+0000 7f13e52a8700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f13cc06ace0 0x7f13cc06d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f13d4000c00 tx=0x7f13d401c040 comp rx=0 tx=0).stop 2023-07-21T07:35:04.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.877+0000 7f13e52a8700 1 -- 172.21.15.6:0/2831234106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e0151ac0 msgr2=0x7f13e01e9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:04.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.877+0000 7f13e52a8700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e0151ac0 0x7f13e01e9b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f13d800cca0 tx=0x7f13d800a340 comp rx=0 tx=0).stop 2023-07-21T07:35:04.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.877+0000 7f13e52a8700 1 -- 172.21.15.6:0/2831234106 shutdown_connections 2023-07-21T07:35:04.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.877+0000 7f13e52a8700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f13cc06ace0 0x7f13cc06d1a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.877+0000 7f13e52a8700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e0151ac0 0x7f13e01e9b10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.877+0000 7f13e52a8700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13e00c47d0 0x7f13e00c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.877+0000 7f13e52a8700 1 --2- 172.21.15.6:0/2831234106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f13e00c4c50 0x7f13e01582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:04.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.877+0000 7f13e52a8700 1 -- 172.21.15.6:0/2831234106 >> 172.21.15.6:0/2831234106 conn(0x7f13e00717c0 msgr2=0x7f13e00c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:04.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.877+0000 7f13e52a8700 1 -- 172.21.15.6:0/2831234106 shutdown_connections 2023-07-21T07:35:04.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:04.877+0000 7f13e52a8700 1 -- 172.21.15.6:0/2831234106 wait complete. 2023-07-21T07:35:04.941 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:34:38.107491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:34:39.423138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:35:04.942 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:35:05.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.020+0000 7fcdeec3c700 1 Processor -- start 2023-07-21T07:35:05.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.020+0000 7fcdeec3c700 1 -- start start 2023-07-21T07:35:05.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcdeec3c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcde806a300 0x7fcde81519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcdeec3c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcde80ba140 0x7fcde8151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcdeec3c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcde806d8a0 0x7fcde80c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcdeec3c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde80c1a30 con 0x7fcde80ba140 2023-07-21T07:35:05.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcdeec3c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde8155530 con 0x7fcde806a300 2023-07-21T07:35:05.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcdeec3c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde8154920 con 0x7fcde806d8a0 2023-07-21T07:35:05.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcde7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcde80ba140 0x7fcde8151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcde7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcde80ba140 0x7fcde8151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33336/0 (socket says 172.21.15.6:33336) 2023-07-21T07:35:05.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcde7fff700 1 -- 172.21.15.6:0/2976900585 learned_addr learned my addr 172.21.15.6:0/2976900585 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:05.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcdec9d8700 1 --2- 172.21.15.6:0/2976900585 >> v2:172.21.15.86:3300/0 conn(0x7fcde806a300 0x7fcde81519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcded1d9700 1 --2- 172.21.15.6:0/2976900585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcde806d8a0 0x7fcde80c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcde7fff700 1 -- 172.21.15.6:0/2976900585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcde806d8a0 msgr2=0x7fcde80c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:05.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcde7fff700 1 --2- 172.21.15.6:0/2976900585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcde806d8a0 0x7fcde80c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcde7fff700 1 -- 172.21.15.6:0/2976900585 >> v2:172.21.15.86:3300/0 conn(0x7fcde806a300 msgr2=0x7fcde81519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:05.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.021+0000 7fcde7fff700 1 --2- 172.21.15.6:0/2976900585 >> v2:172.21.15.86:3300/0 conn(0x7fcde806a300 0x7fcde81519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.022+0000 7fcde7fff700 1 -- 172.21.15.6:0/2976900585 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde8154c00 con 0x7fcde80ba140 2023-07-21T07:35:05.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.022+0000 7fcde7fff700 1 --2- 172.21.15.6:0/2976900585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcde80ba140 0x7fcde8151ef0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcde80c4540 tx=0x7fcdd4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cde4aa878782a3f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:05.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.022+0000 7fcde77fe700 1 -- 172.21.15.6:0/2976900585 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4011830 con 0x7fcde80ba140 2023-07-21T07:35:05.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.022+0000 7fcde77fe700 1 -- 172.21.15.6:0/2976900585 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd4011990 con 0x7fcde80ba140 2023-07-21T07:35:05.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.022+0000 7fcde77fe700 1 -- 172.21.15.6:0/2976900585 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4011d20 con 0x7fcde80ba140 2023-07-21T07:35:05.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.022+0000 7fcdeec3c700 1 -- 172.21.15.6:0/2976900585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcde80ba140 msgr2=0x7fcde8151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.022+0000 7fcdeec3c700 1 --2- 172.21.15.6:0/2976900585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcde80ba140 0x7fcde8151ef0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcde80c4540 tx=0x7fcdd4009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.022+0000 7fcdeec3c700 1 -- 172.21.15.6:0/2976900585 shutdown_connections 2023-07-21T07:35:05.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.022+0000 7fcdeec3c700 1 --2- 172.21.15.6:0/2976900585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcde806d8a0 0x7fcde80c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.022+0000 7fcdeec3c700 1 --2- 172.21.15.6:0/2976900585 >> v2:172.21.15.86:3300/0 conn(0x7fcde806a300 0x7fcde81519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.022+0000 7fcdeec3c700 1 --2- 172.21.15.6:0/2976900585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcde80ba140 0x7fcde8151ef0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.022+0000 7fcdeec3c700 1 -- 172.21.15.6:0/2976900585 >> 172.21.15.6:0/2976900585 conn(0x7fcde80a8660 msgr2=0x7fcde80a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:05.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.023+0000 7fcdeec3c700 1 -- 172.21.15.6:0/2976900585 shutdown_connections 2023-07-21T07:35:05.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.023+0000 7fcdeec3c700 1 -- 172.21.15.6:0/2976900585 wait complete. 2023-07-21T07:35:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.024+0000 7fcdeec3c700 1 Processor -- start 2023-07-21T07:35:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.024+0000 7fcdeec3c700 1 -- start start 2023-07-21T07:35:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.024+0000 7fcdeec3c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcde806a300 0x7fcde80bfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.024+0000 7fcdeec3c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcde806d8a0 0x7fcde80717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.024+0000 7fcdeec3c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcde80ba140 0x7fcde8070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.024+0000 7fcdeec3c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde81ea540 con 0x7fcde806d8a0 2023-07-21T07:35:05.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.024+0000 7fcdeec3c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde80bde20 con 0x7fcde80ba140 2023-07-21T07:35:05.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.024+0000 7fcdeec3c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde80be690 con 0x7fcde806a300 2023-07-21T07:35:05.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcde7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcde806d8a0 0x7fcde80717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcde7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcde806d8a0 0x7fcde80717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33342/0 (socket says 172.21.15.6:33342) 2023-07-21T07:35:05.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcde7fff700 1 -- 172.21.15.6:0/724621257 learned_addr learned my addr 172.21.15.6:0/724621257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:05.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcded1d9700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcde80ba140 0x7fcde8070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcdec9d8700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcde806a300 0x7fcde80bfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcde7fff700 1 -- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcde806a300 msgr2=0x7fcde80bfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcde7fff700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcde806a300 0x7fcde80bfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcde7fff700 1 -- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcde80ba140 msgr2=0x7fcde8070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcde7fff700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcde80ba140 0x7fcde8070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcde7fff700 1 -- 172.21.15.6:0/724621257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd4009550 con 0x7fcde806d8a0 2023-07-21T07:35:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcde7fff700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcde806d8a0 0x7fcde80717b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009c10 tx=0x7fcdd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:05.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcde57fa700 1 -- 172.21.15.6:0/724621257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4004450 con 0x7fcde806d8a0 2023-07-21T07:35:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcde57fa700 1 -- 172.21.15.6:0/724621257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd40045b0 con 0x7fcde806d8a0 2023-07-21T07:35:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcdeec3c700 1 -- 172.21.15.6:0/724621257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde81e9fa0 con 0x7fcde806d8a0 2023-07-21T07:35:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcde57fa700 1 -- 172.21.15.6:0/724621257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40038e0 con 0x7fcde806d8a0 2023-07-21T07:35:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.025+0000 7fcdeec3c700 1 -- 172.21.15.6:0/724621257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde81ea260 con 0x7fcde806d8a0 2023-07-21T07:35:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.026+0000 7fcdeec3c700 1 -- 172.21.15.6:0/724621257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde80bdb60 con 0x7fcde806d8a0 2023-07-21T07:35:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.027+0000 7fcde57fa700 1 -- 172.21.15.6:0/724621257 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcdd4003a40 con 0x7fcde806d8a0 2023-07-21T07:35:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.027+0000 7fcde57fa700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcdcc06ace0 0x7fcdcc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.027+0000 7fcde57fa700 1 -- 172.21.15.6:0/724621257 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcdd408a2b0 con 0x7fcde806d8a0 2023-07-21T07:35:05.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.027+0000 7fcdec9d8700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcdcc06ace0 0x7fcdcc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.028+0000 7fcdec9d8700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcdcc06ace0 0x7fcdcc06d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009ac0 tx=0x7fcddc009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:05.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.032+0000 7fcde57fa700 1 -- 172.21.15.6:0/724621257 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcdd4055510 con 0x7fcde806d8a0 2023-07-21T07:35:05.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.229+0000 7fcdeec3c700 1 -- 172.21.15.6:0/724621257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcde8074500 con 0x7fcde806d8a0 2023-07-21T07:35:05.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.229+0000 7fcde57fa700 1 -- 172.21.15.6:0/724621257 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcdd4058b30 con 0x7fcde806d8a0 2023-07-21T07:35:05.281 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:35:05.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.231+0000 7fcdeec3c700 1 -- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcdcc06ace0 msgr2=0x7fcdcc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.231+0000 7fcdeec3c700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcdcc06ace0 0x7fcdcc06d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009ac0 tx=0x7fcddc009210 comp rx=0 tx=0).stop 2023-07-21T07:35:05.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.231+0000 7fcdeec3c700 1 -- 172.21.15.6:0/724621257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcde806d8a0 msgr2=0x7fcde80717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.231+0000 7fcdeec3c700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcde806d8a0 0x7fcde80717b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009c10 tx=0x7fcdd4004750 comp rx=0 tx=0).stop 2023-07-21T07:35:05.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.231+0000 7fcdeec3c700 1 -- 172.21.15.6:0/724621257 shutdown_connections 2023-07-21T07:35:05.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.231+0000 7fcdeec3c700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fcdcc06ace0 0x7fcdcc06d1a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.231+0000 7fcdeec3c700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcde80ba140 0x7fcde8070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.231+0000 7fcdeec3c700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcde806a300 0x7fcde80bfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.231+0000 7fcdeec3c700 1 --2- 172.21.15.6:0/724621257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcde806d8a0 0x7fcde80717b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.231+0000 7fcdeec3c700 1 -- 172.21.15.6:0/724621257 >> 172.21.15.6:0/724621257 conn(0x7fcde80a8660 msgr2=0x7fcde80c30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:05.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.231+0000 7fcdeec3c700 1 -- 172.21.15.6:0/724621257 shutdown_connections 2023-07-21T07:35:05.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.231+0000 7fcdeec3c700 1 -- 172.21.15.6:0/724621257 wait complete. 2023-07-21T07:35:05.295 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:35:05.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.370+0000 7f6b25fc1700 1 Processor -- start 2023-07-21T07:35:05.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.370+0000 7f6b25fc1700 1 -- start start 2023-07-21T07:35:05.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.371+0000 7f6b25fc1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b2006a300 0x7f6b201519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.371+0000 7f6b25fc1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b2006d8a0 0x7f6b20151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.371+0000 7f6b25fc1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b20155530 con 0x7f6b200ba140 2023-07-21T07:35:05.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.371+0000 7f6b25fc1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b200c1a30 con 0x7f6b2006d8a0 2023-07-21T07:35:05.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.371+0000 7f6b25fc1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b20154920 con 0x7f6b2006a300 2023-07-21T07:35:05.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.371+0000 7f6b1effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6b200ba140 0x7f6b200c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41370/0 (socket says 172.21.15.6:41370) 2023-07-21T07:35:05.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.371+0000 7f6b1effd700 1 -- 172.21.15.6:0/947044861 learned_addr learned my addr 172.21.15.6:0/947044861 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:05.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.371+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404319660 0 0) 0x7f6b20155530 con 0x7f6b200ba140 2023-07-21T07:35:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.371+0000 7f6b1ffff700 1 --2- 172.21.15.6:0/947044861 >> v2:172.21.15.86:3300/0 conn(0x7f6b2006d8a0 0x7f6b20151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.371+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b0c0035b0 con 0x7f6b200ba140 2023-07-21T07:35:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.371+0000 7f6b1f7fe700 1 --2- 172.21.15.6:0/947044861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b2006a300 0x7f6b201519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.371+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3934187083 0 0) 0x7f6b0c0035b0 con 0x7f6b200ba140 2023-07-21T07:35:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.371+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b2006a300 msgr2=0x7f6b201519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 --2- 172.21.15.6:0/947044861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b2006a300 0x7f6b201519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 >> v2:172.21.15.86:3300/0 conn(0x7f6b2006d8a0 msgr2=0x7f6b20151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 --2- 172.21.15.6:0/947044861 >> v2:172.21.15.86:3300/0 conn(0x7f6b2006d8a0 0x7f6b20151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b20154c00 con 0x7f6b200ba140 2023-07-21T07:35:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f6b10001670 con 0x7f6b200ba140 2023-07-21T07:35:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 >> v1:172.21.15.6:6789/0 conn(0x7f6b200ba140 legacy=0x7f6b200c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 --2- 172.21.15.6:0/947044861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0c003a00 0x7f6b0c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 --2- 172.21.15.6:0/947044861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c004850 0x7f6b0c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 --2- 172.21.15.6:0/947044861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b2006a300 0x7f6b0c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b200c1a30 con 0x7f6b0c003a00 2023-07-21T07:35:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b20154920 con 0x7f6b0c004850 2023-07-21T07:35:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c00bac0 con 0x7f6b2006a300 2023-07-21T07:35:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1f7fe700 1 --2- 172.21.15.6:0/947044861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0c003a00 0x7f6b0c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1effd700 1 --2- 172.21.15.6:0/947044861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c004850 0x7f6b0c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1ffff700 1 --2- 172.21.15.6:0/947044861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b2006a300 0x7f6b0c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1f7fe700 1 -- 172.21.15.6:0/947044861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b2006a300 msgr2=0x7f6b0c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1f7fe700 1 --2- 172.21.15.6:0/947044861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b2006a300 0x7f6b0c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1f7fe700 1 -- 172.21.15.6:0/947044861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c004850 msgr2=0x7f6b0c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1f7fe700 1 --2- 172.21.15.6:0/947044861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c004850 0x7f6b0c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1f7fe700 1 -- 172.21.15.6:0/947044861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c0035b0 con 0x7f6b0c003a00 2023-07-21T07:35:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1f7fe700 1 --2- 172.21.15.6:0/947044861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0c003a00 0x7f6b0c003e20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009860 tx=0x7f6b0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd69cb4e83aad06 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0800c070 con 0x7f6b0c003a00 2023-07-21T07:35:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b08013610 con 0x7f6b0c003a00 2023-07-21T07:35:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.372+0000 7f6b1e7fc700 1 -- 172.21.15.6:0/947044861 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080139a0 con 0x7f6b0c003a00 2023-07-21T07:35:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.373+0000 7f6b25fc1700 1 -- 172.21.15.6:0/947044861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0c003a00 msgr2=0x7f6b0c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.373+0000 7f6b25fc1700 1 --2- 172.21.15.6:0/947044861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0c003a00 0x7f6b0c003e20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009860 tx=0x7f6b0c005880 comp rx=0 tx=0).stop 2023-07-21T07:35:05.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.373+0000 7f6b1ffff700 1 -- 172.21.15.6:0/947044861 reap_dead start 2023-07-21T07:35:05.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.373+0000 7f6b25fc1700 1 -- 172.21.15.6:0/947044861 shutdown_connections 2023-07-21T07:35:05.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.373+0000 7f6b25fc1700 1 -- 172.21.15.6:0/947044861 >> 172.21.15.6:0/947044861 conn(0x7f6b200a8660 msgr2=0x7f6b200a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:05.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.373+0000 7f6b25fc1700 1 -- 172.21.15.6:0/947044861 shutdown_connections 2023-07-21T07:35:05.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.373+0000 7f6b25fc1700 1 -- 172.21.15.6:0/947044861 wait complete. 2023-07-21T07:35:05.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.374+0000 7f6b25fc1700 1 Processor -- start 2023-07-21T07:35:05.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.374+0000 7f6b25fc1700 1 -- start start 2023-07-21T07:35:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b25fc1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c003a00 0x7f6b20153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b25fc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b200be530 0x7f6b20071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b25fc1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b201ed140 0x7f6b201ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b25fc1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2014c3a0 con 0x7f6b200be530 2023-07-21T07:35:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b25fc1700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b200bfd30 con 0x7f6b0c003a00 2023-07-21T07:35:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b25fc1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b20154460 con 0x7f6b201ed140 2023-07-21T07:35:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b1effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b200be530 0x7f6b20071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b1effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b200be530 0x7f6b20071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33362/0 (socket says 172.21.15.6:33362) 2023-07-21T07:35:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b1effd700 1 -- 172.21.15.6:0/3807493319 learned_addr learned my addr 172.21.15.6:0/3807493319 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b1f7fe700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c003a00 0x7f6b20153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b1ffff700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b201ed140 0x7f6b201ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b1effd700 1 -- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b201ed140 msgr2=0x7f6b201ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b1effd700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b201ed140 0x7f6b201ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b1effd700 1 -- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c003a00 msgr2=0x7f6b20153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b1effd700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c003a00 0x7f6b20153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b1effd700 1 -- 172.21.15.6:0/3807493319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b200bff60 con 0x7f6b200be530 2023-07-21T07:35:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.375+0000 7f6b1f7fe700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c003a00 0x7f6b20153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.376+0000 7f6b1effd700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b200be530 0x7f6b20071860 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b10001aa0 tx=0x7f6b100075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.376+0000 7f6b17fff700 1 -- 172.21.15.6:0/3807493319 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100077d0 con 0x7f6b200be530 2023-07-21T07:35:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.376+0000 7f6b17fff700 1 -- 172.21.15.6:0/3807493319 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1000f8a0 con 0x7f6b200be530 2023-07-21T07:35:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.376+0000 7f6b25fc1700 1 -- 172.21.15.6:0/3807493319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b200c0240 con 0x7f6b200be530 2023-07-21T07:35:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.376+0000 7f6b17fff700 1 -- 172.21.15.6:0/3807493319 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000fc50 con 0x7f6b200be530 2023-07-21T07:35:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.376+0000 7f6b25fc1700 1 -- 172.21.15.6:0/3807493319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b200c0800 con 0x7f6b200be530 2023-07-21T07:35:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.377+0000 7f6b25fc1700 1 -- 172.21.15.6:0/3807493319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b200c09c0 con 0x7f6b200be530 2023-07-21T07:35:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.377+0000 7f6b17fff700 1 -- 172.21.15.6:0/3807493319 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b1001d460 con 0x7f6b200be530 2023-07-21T07:35:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.377+0000 7f6b17fff700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6b0006ace0 0x7f6b0006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.378+0000 7f6b17fff700 1 -- 172.21.15.6:0/3807493319 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b10089450 con 0x7f6b200be530 2023-07-21T07:35:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.378+0000 7f6b1f7fe700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6b0006ace0 0x7f6b0006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.378+0000 7f6b1f7fe700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6b0006ace0 0x7f6b0006d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b08008010 tx=0x7f6b0800c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.382+0000 7f6b17fff700 1 -- 172.21.15.6:0/3807493319 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6b10054590 con 0x7f6b200be530 2023-07-21T07:35:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.579+0000 7f6b25fc1700 1 -- 172.21.15.6:0/3807493319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6b20154eb0 con 0x7f6b200be530 2023-07-21T07:35:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.579+0000 7f6b17fff700 1 -- 172.21.15.6:0/3807493319 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6b10057bb0 con 0x7f6b200be530 2023-07-21T07:35:05.631 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:35:05.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.581+0000 7f6b25fc1700 1 -- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6b0006ace0 msgr2=0x7f6b0006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.581+0000 7f6b25fc1700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6b0006ace0 0x7f6b0006d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b08008010 tx=0x7f6b0800c000 comp rx=0 tx=0).stop 2023-07-21T07:35:05.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.581+0000 7f6b25fc1700 1 -- 172.21.15.6:0/3807493319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b200be530 msgr2=0x7f6b20071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.581+0000 7f6b25fc1700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b200be530 0x7f6b20071860 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b10001aa0 tx=0x7f6b100075f0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.581+0000 7f6b25fc1700 1 -- 172.21.15.6:0/3807493319 shutdown_connections 2023-07-21T07:35:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.581+0000 7f6b25fc1700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6b0006ace0 0x7f6b0006d1a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.581+0000 7f6b25fc1700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b201ed140 0x7f6b201ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.581+0000 7f6b25fc1700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b0c003a00 0x7f6b20153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.581+0000 7f6b25fc1700 1 --2- 172.21.15.6:0/3807493319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b200be530 0x7f6b20071860 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.581+0000 7f6b25fc1700 1 -- 172.21.15.6:0/3807493319 >> 172.21.15.6:0/3807493319 conn(0x7f6b200a8660 msgr2=0x7f6b2014d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.581+0000 7f6b25fc1700 1 -- 172.21.15.6:0/3807493319 shutdown_connections 2023-07-21T07:35:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.581+0000 7f6b25fc1700 1 -- 172.21.15.6:0/3807493319 wait complete. 2023-07-21T07:35:05.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:35:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.721+0000 7f9ddc6dd700 1 Processor -- start 2023-07-21T07:35:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.721+0000 7f9ddc6dd700 1 -- start start 2023-07-21T07:35:05.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.722+0000 7f9ddc6dd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9dd40abd40 0x7f9dd40aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.722+0000 7f9ddc6dd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd40aae10 0x7f9dd40ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.722+0000 7f9ddc6dd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd4066050 con 0x7f9dd414c580 2023-07-21T07:35:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.722+0000 7f9ddc6dd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd4066580 con 0x7f9dd40abd40 2023-07-21T07:35:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.722+0000 7f9ddc6dd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4152f50 con 0x7f9dd40aae10 2023-07-21T07:35:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.722+0000 7f9dd9c78700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9dd40abd40 0x7f9dd40aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.722+0000 7f9dd9c78700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9dd40abd40 0x7f9dd40aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33368/0 (socket says 172.21.15.6:33368) 2023-07-21T07:35:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.722+0000 7f9dd9c78700 1 -- 172.21.15.6:0/4259122839 learned_addr learned my addr 172.21.15.6:0/4259122839 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.722+0000 7f9ddac7a700 1 --2- 172.21.15.6:0/4259122839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd40aae10 0x7f9dd40ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.723+0000 7f9dd9c78700 1 -- 172.21.15.6:0/4259122839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd40aae10 msgr2=0x7f9dd40ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.723+0000 7f9dd9c78700 1 --2- 172.21.15.6:0/4259122839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd40aae10 0x7f9dd40ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.723+0000 7f9dd9c78700 1 -- 172.21.15.6:0/4259122839 >> v1:172.21.15.86:6789/0 conn(0x7f9dd414c580 legacy=0x7f9dd40c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.723+0000 7f9dd9c78700 1 -- 172.21.15.6:0/4259122839 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd414c960 con 0x7f9dd40abd40 2023-07-21T07:35:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.723+0000 7f9dd9c78700 1 --2- 172.21.15.6:0/4259122839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd40abd40 0x7f9dd40aa8d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00098f0 tx=0x7f9dd0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69517d5e24b70b72 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.723+0000 7f9dd9477700 1 -- 172.21.15.6:0/4259122839 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0011830 con 0x7f9dd40abd40 2023-07-21T07:35:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.723+0000 7f9dd9477700 1 -- 172.21.15.6:0/4259122839 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd0011990 con 0x7f9dd40abd40 2023-07-21T07:35:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.723+0000 7f9dd9477700 1 -- 172.21.15.6:0/4259122839 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0011d20 con 0x7f9dd40abd40 2023-07-21T07:35:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.724+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/4259122839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd40abd40 msgr2=0x7f9dd40aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.724+0000 7f9ddc6dd700 1 --2- 172.21.15.6:0/4259122839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd40abd40 0x7f9dd40aa8d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00098f0 tx=0x7f9dd0009c00 comp rx=0 tx=0).stop 2023-07-21T07:35:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.724+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/4259122839 shutdown_connections 2023-07-21T07:35:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.724+0000 7f9ddc6dd700 1 --2- 172.21.15.6:0/4259122839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd40aae10 0x7f9dd40ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.724+0000 7f9ddc6dd700 1 --2- 172.21.15.6:0/4259122839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd40abd40 0x7f9dd40aa8d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.724+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/4259122839 >> 172.21.15.6:0/4259122839 conn(0x7f9dd40c2c20 msgr2=0x7f9dd40c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.724+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/4259122839 shutdown_connections 2023-07-21T07:35:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.724+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/4259122839 wait complete. 2023-07-21T07:35:05.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.725+0000 7f9ddc6dd700 1 Processor -- start 2023-07-21T07:35:05.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.725+0000 7f9ddc6dd700 1 -- start start 2023-07-21T07:35:05.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.725+0000 7f9ddc6dd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd40aae10 0x7f9dd41511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.725+0000 7f9ddc6dd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd40abd40 0x7f9dd4149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.725+0000 7f9ddc6dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd414c580 0x7f9dd41e8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.725+0000 7f9ddc6dd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4149b60 con 0x7f9dd414c580 2023-07-21T07:35:05.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9ddc6dd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd41e7cb0 con 0x7f9dd40aae10 2023-07-21T07:35:05.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9ddc6dd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd414cb20 con 0x7f9dd40abd40 2023-07-21T07:35:05.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9ddac7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd414c580 0x7f9dd41e8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9ddac7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd414c580 0x7f9dd41e8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33376/0 (socket says 172.21.15.6:33376) 2023-07-21T07:35:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9ddac7a700 1 -- 172.21.15.6:0/2117369603 learned_addr learned my addr 172.21.15.6:0/2117369603 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9dda479700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd40aae10 0x7f9dd41511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9dd9c78700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd40abd40 0x7f9dd4149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9ddac7a700 1 -- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd40abd40 msgr2=0x7f9dd4149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9ddac7a700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd40abd40 0x7f9dd4149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9ddac7a700 1 -- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd40aae10 msgr2=0x7f9dd41511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9ddac7a700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd40aae10 0x7f9dd41511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9ddac7a700 1 -- 172.21.15.6:0/2117369603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd0009550 con 0x7f9dd414c580 2023-07-21T07:35:05.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9ddac7a700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd414c580 0x7f9dd41e8140 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009cb0 tx=0x7f9dcc00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:05.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9dcaffd700 1 -- 172.21.15.6:0/2117369603 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc009b20 con 0x7f9dd414c580 2023-07-21T07:35:05.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/2117369603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd414ee30 con 0x7f9dd414c580 2023-07-21T07:35:05.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9dcaffd700 1 -- 172.21.15.6:0/2117369603 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc00f040 con 0x7f9dd414c580 2023-07-21T07:35:05.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9dcaffd700 1 -- 172.21.15.6:0/2117369603 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc00cd30 con 0x7f9dd414c580 2023-07-21T07:35:05.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.726+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/2117369603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd414f3f0 con 0x7f9dd414c580 2023-07-21T07:35:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.727+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/2117369603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd404e470 con 0x7f9dd414c580 2023-07-21T07:35:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.728+0000 7f9dcaffd700 1 -- 172.21.15.6:0/2117369603 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9dcc014480 con 0x7f9dd414c580 2023-07-21T07:35:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.728+0000 7f9dcaffd700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9db806ace0 0x7f9db806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.728+0000 7f9dcaffd700 1 -- 172.21.15.6:0/2117369603 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9dcc089fd0 con 0x7f9dd414c580 2023-07-21T07:35:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.728+0000 7f9dda479700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9db806ace0 0x7f9db806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:05.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.729+0000 7f9dda479700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9db806ace0 0x7f9db806d1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4007fd0 tx=0x7f9dc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:05.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.733+0000 7f9dcaffd700 1 -- 172.21.15.6:0/2117369603 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9dcc054f70 con 0x7f9dd414c580 2023-07-21T07:35:05.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.930+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/2117369603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9dd4066270 con 0x7f9dd414c580 2023-07-21T07:35:05.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.930+0000 7f9dcaffd700 1 -- 172.21.15.6:0/2117369603 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9dcc018020 con 0x7f9dd414c580 2023-07-21T07:35:05.982 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:35:05.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.932+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9db806ace0 msgr2=0x7f9db806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.932+0000 7f9ddc6dd700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9db806ace0 0x7f9db806d1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4007fd0 tx=0x7f9dc4009040 comp rx=0 tx=0).stop 2023-07-21T07:35:05.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.932+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/2117369603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd414c580 msgr2=0x7f9dd41e8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.932+0000 7f9ddc6dd700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd414c580 0x7f9dd41e8140 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009cb0 tx=0x7f9dcc00c0c0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.932+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/2117369603 shutdown_connections 2023-07-21T07:35:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.932+0000 7f9ddc6dd700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9db806ace0 0x7f9db806d1a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.932+0000 7f9ddc6dd700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dd414c580 0x7f9dd41e8140 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.932+0000 7f9ddc6dd700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd40aae10 0x7f9dd41511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.932+0000 7f9ddc6dd700 1 --2- 172.21.15.6:0/2117369603 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd40abd40 0x7f9dd4149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.932+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/2117369603 >> 172.21.15.6:0/2117369603 conn(0x7f9dd40c2c20 msgr2=0x7f9dd406d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:05.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.932+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/2117369603 shutdown_connections 2023-07-21T07:35:05.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:05.932+0000 7f9ddc6dd700 1 -- 172.21.15.6:0/2117369603 wait complete. 2023-07-21T07:35:05.997 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:35:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.073+0000 7fadbdc3d700 1 Processor -- start 2023-07-21T07:35:06.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.073+0000 7fadbdc3d700 1 -- start start 2023-07-21T07:35:06.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadbdc3d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadb8072160 0x7fadb814f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadbdc3d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb80c3c90 con 0x7fadb80a6f80 2023-07-21T07:35:06.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadbdc3d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb80c3680 con 0x7fadb80c4120 2023-07-21T07:35:06.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadbdc3d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb80c26e0 con 0x7fadb8072160 2023-07-21T07:35:06.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadb77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fadb80a6f80 0x7fadb8152380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41400/0 (socket says 172.21.15.6:41400) 2023-07-21T07:35:06.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadb77fe700 1 -- 172.21.15.6:0/749309326 learned_addr learned my addr 172.21.15.6:0/749309326 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:06.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadb6ffd700 1 --2- 172.21.15.6:0/749309326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadb8072160 0x7fadb814f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadb67fc700 1 -- 172.21.15.6:0/749309326 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829890807 0 0) 0x7fadb80c3c90 con 0x7fadb80a6f80 2023-07-21T07:35:06.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadb67fc700 1 -- 172.21.15.6:0/749309326 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fada40035b0 con 0x7fadb80a6f80 2023-07-21T07:35:06.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadb67fc700 1 -- 172.21.15.6:0/749309326 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685976192 0 0) 0x7fadb80c3680 con 0x7fadb80c4120 2023-07-21T07:35:06.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadb67fc700 1 -- 172.21.15.6:0/749309326 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb80c3c90 con 0x7fadb80c4120 2023-07-21T07:35:06.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadb6ffd700 1 -- 172.21.15.6:0/749309326 >> v1:172.21.15.86:6789/0 conn(0x7fadb80c4120 legacy=0x7fadb815cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadb67fc700 1 -- 172.21.15.6:0/749309326 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3655951758 0 0) 0x7fada40035b0 con 0x7fadb80a6f80 2023-07-21T07:35:06.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadb6ffd700 1 -- 172.21.15.6:0/749309326 >> v1:172.21.15.6:6789/0 conn(0x7fadb80a6f80 legacy=0x7fadb8152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.074+0000 7fadb6ffd700 1 -- 172.21.15.6:0/749309326 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb80c6fe0 con 0x7fadb8072160 2023-07-21T07:35:06.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.075+0000 7fadb6ffd700 1 --2- 172.21.15.6:0/749309326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadb8072160 0x7fadb814f420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fada8009870 tx=0x7fada8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=711270f19f21f689 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:06.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.075+0000 7fadb67fc700 1 -- 172.21.15.6:0/749309326 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada0001670 con 0x7fadb8072160 2023-07-21T07:35:06.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.075+0000 7fadb67fc700 1 -- 172.21.15.6:0/749309326 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada8004030 con 0x7fadb8072160 2023-07-21T07:35:06.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.075+0000 7fadb67fc700 1 -- 172.21.15.6:0/749309326 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada80043a0 con 0x7fadb8072160 2023-07-21T07:35:06.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.075+0000 7fadbdc3d700 1 -- 172.21.15.6:0/749309326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadb8072160 msgr2=0x7fadb814f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.075+0000 7fadbdc3d700 1 --2- 172.21.15.6:0/749309326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadb8072160 0x7fadb814f420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fada8009870 tx=0x7fada8009b80 comp rx=0 tx=0).stop 2023-07-21T07:35:06.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.075+0000 7fadbdc3d700 1 -- 172.21.15.6:0/749309326 shutdown_connections 2023-07-21T07:35:06.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.075+0000 7fadbdc3d700 1 --2- 172.21.15.6:0/749309326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadb8072160 0x7fadb814f420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.075+0000 7fadbdc3d700 1 -- 172.21.15.6:0/749309326 >> 172.21.15.6:0/749309326 conn(0x7fadb80c7b50 msgr2=0x7fadb80c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:06.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.075+0000 7fadbdc3d700 1 -- 172.21.15.6:0/749309326 shutdown_connections 2023-07-21T07:35:06.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.075+0000 7fadbdc3d700 1 -- 172.21.15.6:0/749309326 wait complete. 2023-07-21T07:35:06.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.077+0000 7fadbdc3d700 1 Processor -- start 2023-07-21T07:35:06.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.077+0000 7fadbdc3d700 1 -- start start 2023-07-21T07:35:06.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.077+0000 7fadbdc3d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadb8072160 0x7fadb8153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.077+0000 7fadbdc3d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadb80a6f80 0x7fadb8152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.077+0000 7fadbdc3d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadb80c4120 0x7fadb8152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.077+0000 7fadbdc3d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb8145cb0 con 0x7fadb80c4120 2023-07-21T07:35:06.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.077+0000 7fadbdc3d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb81523c0 con 0x7fadb8072160 2023-07-21T07:35:06.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.077+0000 7fadbdc3d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb81e7560 con 0x7fadb80a6f80 2023-07-21T07:35:06.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.077+0000 7fadb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadb80c4120 0x7fadb8152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadb80c4120 0x7fadb8152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33390/0 (socket says 172.21.15.6:33390) 2023-07-21T07:35:06.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadb7fff700 1 -- 172.21.15.6:0/396774542 learned_addr learned my addr 172.21.15.6:0/396774542 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:06.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadb77fe700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadb8072160 0x7fadb8153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadb6ffd700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadb80a6f80 0x7fadb8152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadb7fff700 1 -- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadb80a6f80 msgr2=0x7fadb8152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadb7fff700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadb80a6f80 0x7fadb8152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadb7fff700 1 -- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadb8072160 msgr2=0x7fadb8153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadb7fff700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadb8072160 0x7fadb8153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadb7fff700 1 -- 172.21.15.6:0/396774542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada80094a0 con 0x7fadb80c4120 2023-07-21T07:35:06.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadb7fff700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadb80c4120 0x7fadb8152d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fadb000cc20 tx=0x7fadb000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:06.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadaffff700 1 -- 172.21.15.6:0/396774542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0003c00 con 0x7fadb80c4120 2023-07-21T07:35:06.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadaffff700 1 -- 172.21.15.6:0/396774542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb0003d60 con 0x7fadb80c4120 2023-07-21T07:35:06.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadbdc3d700 1 -- 172.21.15.6:0/396774542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb8151a90 con 0x7fadb80c4120 2023-07-21T07:35:06.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadaffff700 1 -- 172.21.15.6:0/396774542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb000aae0 con 0x7fadb80c4120 2023-07-21T07:35:06.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.078+0000 7fadbdc3d700 1 -- 172.21.15.6:0/396774542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb8152050 con 0x7fadb80c4120 2023-07-21T07:35:06.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.079+0000 7fadbdc3d700 1 -- 172.21.15.6:0/396774542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb8152530 con 0x7fadb80c4120 2023-07-21T07:35:06.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.080+0000 7fadaffff700 1 -- 172.21.15.6:0/396774542 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fadb000ac40 con 0x7fadb80c4120 2023-07-21T07:35:06.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.080+0000 7fadaffff700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fad9806ace0 0x7fad9806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.080+0000 7fadaffff700 1 -- 172.21.15.6:0/396774542 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fadb0089460 con 0x7fadb80c4120 2023-07-21T07:35:06.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.080+0000 7fadb77fe700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fad9806ace0 0x7fad9806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.081+0000 7fadb77fe700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fad9806ace0 0x7fad9806d1a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fada0001eb0 tx=0x7fada0001d60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:06.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.085+0000 7fadaffff700 1 -- 172.21.15.6:0/396774542 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fadb00545a0 con 0x7fadb80c4120 2023-07-21T07:35:06.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.283+0000 7fadbdc3d700 1 -- 172.21.15.6:0/396774542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fadb8074500 con 0x7fadb80c4120 2023-07-21T07:35:06.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.284+0000 7fadaffff700 1 -- 172.21.15.6:0/396774542 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fadb0057bc0 con 0x7fadb80c4120 2023-07-21T07:35:06.336 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:35:06.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.286+0000 7fadbdc3d700 1 -- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fad9806ace0 msgr2=0x7fad9806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.286+0000 7fadbdc3d700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fad9806ace0 0x7fad9806d1a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fada0001eb0 tx=0x7fada0001d60 comp rx=0 tx=0).stop 2023-07-21T07:35:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.286+0000 7fadbdc3d700 1 -- 172.21.15.6:0/396774542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadb80c4120 msgr2=0x7fadb8152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.286+0000 7fadbdc3d700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadb80c4120 0x7fadb8152d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fadb000cc20 tx=0x7fadb000cf30 comp rx=0 tx=0).stop 2023-07-21T07:35:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.286+0000 7fadbdc3d700 1 -- 172.21.15.6:0/396774542 shutdown_connections 2023-07-21T07:35:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.286+0000 7fadbdc3d700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fad9806ace0 0x7fad9806d1a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.286+0000 7fadbdc3d700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadb80c4120 0x7fadb8152d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.286+0000 7fadbdc3d700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadb8072160 0x7fadb8153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.286+0000 7fadbdc3d700 1 --2- 172.21.15.6:0/396774542 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadb80a6f80 0x7fadb8152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.286+0000 7fadbdc3d700 1 -- 172.21.15.6:0/396774542 >> 172.21.15.6:0/396774542 conn(0x7fadb80c7b50 msgr2=0x7fadb8148e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:06.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.286+0000 7fadbdc3d700 1 -- 172.21.15.6:0/396774542 shutdown_connections 2023-07-21T07:35:06.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.286+0000 7fadbdc3d700 1 -- 172.21.15.6:0/396774542 wait complete. 2023-07-21T07:35:06.350 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:06.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.423+0000 7f72571cc700 1 Processor -- start 2023-07-21T07:35:06.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.423+0000 7f72571cc700 1 -- start start 2023-07-21T07:35:06.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f72571cc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7250151e20 0x7f72500c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f72571cc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72500c2ab0 con 0x7f725006da20 2023-07-21T07:35:06.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f72571cc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725006e000 con 0x7f725006a300 2023-07-21T07:35:06.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f72571cc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725006e2e0 con 0x7f7250151e20 2023-07-21T07:35:06.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f724ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f725006da20 0x7f7250151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41416/0 (socket says 172.21.15.6:41416) 2023-07-21T07:35:06.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f724ffff700 1 -- 172.21.15.6:0/392945634 learned_addr learned my addr 172.21.15.6:0/392945634 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:06.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f7255769700 1 --2- 172.21.15.6:0/392945634 >> v2:172.21.15.86:3300/0 conn(0x7f7250151e20 0x7f72500c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f724f7fe700 1 -- 172.21.15.6:0/392945634 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219846589 0 0) 0x7f72500c2ab0 con 0x7f725006da20 2023-07-21T07:35:06.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f724f7fe700 1 -- 172.21.15.6:0/392945634 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72400035b0 con 0x7f725006da20 2023-07-21T07:35:06.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f724f7fe700 1 -- 172.21.15.6:0/392945634 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594537608 0 0) 0x7f725006e000 con 0x7f725006a300 2023-07-21T07:35:06.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f724f7fe700 1 -- 172.21.15.6:0/392945634 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72500c2ab0 con 0x7f725006a300 2023-07-21T07:35:06.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f724f7fe700 1 -- 172.21.15.6:0/392945634 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4096146137 0 0) 0x7f72400035b0 con 0x7f725006da20 2023-07-21T07:35:06.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f7255769700 1 -- 172.21.15.6:0/392945634 >> v1:172.21.15.86:6789/0 conn(0x7f725006a300 legacy=0x7f7250155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f7255769700 1 -- 172.21.15.6:0/392945634 >> v1:172.21.15.6:6789/0 conn(0x7f725006da20 legacy=0x7f7250151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.424+0000 7f7255769700 1 -- 172.21.15.6:0/392945634 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725006e5c0 con 0x7f7250151e20 2023-07-21T07:35:06.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.425+0000 7f7255769700 1 --2- 172.21.15.6:0/392945634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7250151e20 0x7f72500c2f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7248009dc0 tx=0x7f724800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5453027ada7df3a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:06.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.425+0000 7f724f7fe700 1 -- 172.21.15.6:0/392945634 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800e070 con 0x7f7250151e20 2023-07-21T07:35:06.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.425+0000 7f724f7fe700 1 -- 172.21.15.6:0/392945634 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7248003a20 con 0x7f7250151e20 2023-07-21T07:35:06.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.425+0000 7f724f7fe700 1 -- 172.21.15.6:0/392945634 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c001670 con 0x7f7250151e20 2023-07-21T07:35:06.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.425+0000 7f72571cc700 1 -- 172.21.15.6:0/392945634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7250151e20 msgr2=0x7f72500c2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.425+0000 7f72571cc700 1 --2- 172.21.15.6:0/392945634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7250151e20 0x7f72500c2f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7248009dc0 tx=0x7f724800b330 comp rx=0 tx=0).stop 2023-07-21T07:35:06.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.425+0000 7f72571cc700 1 -- 172.21.15.6:0/392945634 shutdown_connections 2023-07-21T07:35:06.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.425+0000 7f72571cc700 1 --2- 172.21.15.6:0/392945634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7250151e20 0x7f72500c2f40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.425+0000 7f72571cc700 1 -- 172.21.15.6:0/392945634 >> 172.21.15.6:0/392945634 conn(0x7f72500a8c90 msgr2=0x7f725006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:06.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.425+0000 7f72571cc700 1 -- 172.21.15.6:0/392945634 shutdown_connections 2023-07-21T07:35:06.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.425+0000 7f72571cc700 1 -- 172.21.15.6:0/392945634 wait complete. 2023-07-21T07:35:06.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.427+0000 7f72571cc700 1 Processor -- start 2023-07-21T07:35:06.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.427+0000 7f72571cc700 1 -- start start 2023-07-21T07:35:06.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.427+0000 7f72571cc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f725006a300 0x7f72500bb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.427+0000 7f72571cc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f725006da20 0x7f72501e9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.427+0000 7f72571cc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72501559c0 0x7f72500a7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.427+0000 7f72571cc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500bf240 con 0x7f725006da20 2023-07-21T07:35:06.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.427+0000 7f72571cc700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500bb9a0 con 0x7f725006a300 2023-07-21T07:35:06.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f72571cc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72500c0af0 con 0x7f72501559c0 2023-07-21T07:35:06.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f724ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f725006da20 0x7f72501e9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f724ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f725006da20 0x7f72501e9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33402/0 (socket says 172.21.15.6:33402) 2023-07-21T07:35:06.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f724ffff700 1 -- 172.21.15.6:0/2306916633 learned_addr learned my addr 172.21.15.6:0/2306916633 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:06.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f7254f68700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f725006a300 0x7f72500bb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f7255769700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72501559c0 0x7f72500a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f724ffff700 1 -- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72501559c0 msgr2=0x7f72500a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f724ffff700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72501559c0 0x7f72500a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f724ffff700 1 -- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f725006a300 msgr2=0x7f72500bb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f724ffff700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f725006a300 0x7f72500bb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f724ffff700 1 -- 172.21.15.6:0/2306916633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7248009a70 con 0x7f725006da20 2023-07-21T07:35:06.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f724ffff700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f725006da20 0x7f72501e9f80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f723c00c7e0 tx=0x7f723c00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:06.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f724d7fa700 1 -- 172.21.15.6:0/2306916633 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c007560 con 0x7f725006da20 2023-07-21T07:35:06.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f724d7fa700 1 -- 172.21.15.6:0/2306916633 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c0076c0 con 0x7f725006da20 2023-07-21T07:35:06.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f72571cc700 1 -- 172.21.15.6:0/2306916633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72501ea4c0 con 0x7f725006da20 2023-07-21T07:35:06.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f724d7fa700 1 -- 172.21.15.6:0/2306916633 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c004a90 con 0x7f725006da20 2023-07-21T07:35:06.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.428+0000 7f72571cc700 1 -- 172.21.15.6:0/2306916633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72501561a0 con 0x7f725006da20 2023-07-21T07:35:06.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.429+0000 7f72571cc700 1 -- 172.21.15.6:0/2306916633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7250074500 con 0x7f725006da20 2023-07-21T07:35:06.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.430+0000 7f724d7fa700 1 -- 172.21.15.6:0/2306916633 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f723c004bf0 con 0x7f725006da20 2023-07-21T07:35:06.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.430+0000 7f724d7fa700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f723406ace0 0x7f723406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.430+0000 7f724d7fa700 1 -- 172.21.15.6:0/2306916633 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f723c0891b0 con 0x7f725006da20 2023-07-21T07:35:06.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.431+0000 7f7254f68700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f723406ace0 0x7f723406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.431+0000 7f7254f68700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f723406ace0 0x7f723406d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7244001830 tx=0x7f7244009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:06.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.435+0000 7f724d7fa700 1 -- 172.21.15.6:0/2306916633 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f723c0542f0 con 0x7f725006da20 2023-07-21T07:35:06.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.632+0000 7f72571cc700 1 -- 172.21.15.6:0/2306916633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f725006d750 con 0x7f725006da20 2023-07-21T07:35:06.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.634+0000 7f724d7fa700 1 -- 172.21.15.6:0/2306916633 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f723c057910 con 0x7f725006da20 2023-07-21T07:35:06.686 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:06.686 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:06.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.636+0000 7f72571cc700 1 -- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f723406ace0 msgr2=0x7f723406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.636+0000 7f72571cc700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f723406ace0 0x7f723406d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7244001830 tx=0x7f7244009040 comp rx=0 tx=0).stop 2023-07-21T07:35:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.636+0000 7f72571cc700 1 -- 172.21.15.6:0/2306916633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f725006da20 msgr2=0x7f72501e9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.636+0000 7f72571cc700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f725006da20 0x7f72501e9f80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f723c00c7e0 tx=0x7f723c00caf0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.636+0000 7f72571cc700 1 -- 172.21.15.6:0/2306916633 shutdown_connections 2023-07-21T07:35:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.636+0000 7f72571cc700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f723406ace0 0x7f723406d1a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.636+0000 7f72571cc700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72501559c0 0x7f72500a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.636+0000 7f72571cc700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f725006a300 0x7f72500bb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.636+0000 7f72571cc700 1 --2- 172.21.15.6:0/2306916633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f725006da20 0x7f72501e9f80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.636+0000 7f72571cc700 1 -- 172.21.15.6:0/2306916633 >> 172.21.15.6:0/2306916633 conn(0x7f72500a8c90 msgr2=0x7f72501507e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.636+0000 7f72571cc700 1 -- 172.21.15.6:0/2306916633 shutdown_connections 2023-07-21T07:35:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.636+0000 7f72571cc700 1 -- 172.21.15.6:0/2306916633 wait complete. 2023-07-21T07:35:06.700 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:34:38.107491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:34:39.423138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:35:06.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:35:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.777+0000 7f96a09fd700 1 Processor -- start 2023-07-21T07:35:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.777+0000 7f96a09fd700 1 -- start start 2023-07-21T07:35:06.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.778+0000 7f96a09fd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f969c0ba140 0x7f969c0c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.778+0000 7f96a09fd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969c155530 con 0x7f969c06a300 2023-07-21T07:35:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.778+0000 7f96a09fd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969c0c5690 con 0x7f969c06d8a0 2023-07-21T07:35:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.778+0000 7f96a09fd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969c0c1a30 con 0x7f969c0ba140 2023-07-21T07:35:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.778+0000 7f9699d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f969c0ba140 0x7f969c0c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.778+0000 7f969a59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f969c06a300 0x7f969c1519b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41428/0 (socket says 172.21.15.6:41428) 2023-07-21T07:35:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.778+0000 7f969a59c700 1 -- 172.21.15.6:0/278676323 learned_addr learned my addr 172.21.15.6:0/278676323 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.779+0000 7f9699d9b700 1 -- 172.21.15.6:0/278676323 >> v1:172.21.15.86:6789/0 conn(0x7f969c06d8a0 legacy=0x7f969c0c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.779+0000 7f9699d9b700 1 -- 172.21.15.6:0/278676323 >> v1:172.21.15.6:6789/0 conn(0x7f969c06a300 legacy=0x7f969c1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.779+0000 7f9699d9b700 1 -- 172.21.15.6:0/278676323 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c154920 con 0x7f969c0ba140 2023-07-21T07:35:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.779+0000 7f969959a700 1 -- 172.21.15.6:0/278676323 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336881326 0 0) 0x7f969c155530 con 0x7f969c06a300 2023-07-21T07:35:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.779+0000 7f9699d9b700 1 --2- 172.21.15.6:0/278676323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f969c0ba140 0x7f969c0c4a40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9684009840 tx=0x7f9684009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78668af746c5a9a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.779+0000 7f969959a700 1 -- 172.21.15.6:0/278676323 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684004230 con 0x7f969c0ba140 2023-07-21T07:35:06.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.779+0000 7f969959a700 1 -- 172.21.15.6:0/278676323 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9684004390 con 0x7f969c0ba140 2023-07-21T07:35:06.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.779+0000 7f969959a700 1 -- 172.21.15.6:0/278676323 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840036a0 con 0x7f969c0ba140 2023-07-21T07:35:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.780+0000 7f96a09fd700 1 -- 172.21.15.6:0/278676323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f969c0ba140 msgr2=0x7f969c0c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.780+0000 7f96a09fd700 1 --2- 172.21.15.6:0/278676323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f969c0ba140 0x7f969c0c4a40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9684009840 tx=0x7f9684009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.780+0000 7f96a09fd700 1 -- 172.21.15.6:0/278676323 shutdown_connections 2023-07-21T07:35:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.780+0000 7f96a09fd700 1 --2- 172.21.15.6:0/278676323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f969c0ba140 0x7f969c0c4a40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.780+0000 7f96a09fd700 1 -- 172.21.15.6:0/278676323 >> 172.21.15.6:0/278676323 conn(0x7f969c0a8660 msgr2=0x7f969c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.780+0000 7f96a09fd700 1 -- 172.21.15.6:0/278676323 shutdown_connections 2023-07-21T07:35:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.780+0000 7f96a09fd700 1 -- 172.21.15.6:0/278676323 wait complete. 2023-07-21T07:35:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.781+0000 7f96a09fd700 1 Processor -- start 2023-07-21T07:35:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.781+0000 7f96a09fd700 1 -- start start 2023-07-21T07:35:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f96a09fd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f969c06a300 0x7f969c14c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f96a09fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f969c06d8a0 0x7f969c0b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f96a09fd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f969c0ba140 0x7f969c0b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f96a09fd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c0c06d0 con 0x7f969c06d8a0 2023-07-21T07:35:06.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f96a09fd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c0c03a0 con 0x7f969c06a300 2023-07-21T07:35:06.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f96a09fd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1edbf0 con 0x7f969c0ba140 2023-07-21T07:35:06.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f9699d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f969c06d8a0 0x7f969c0b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f9699d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f969c06d8a0 0x7f969c0b9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33416/0 (socket says 172.21.15.6:33416) 2023-07-21T07:35:06.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f9699d9b700 1 -- 172.21.15.6:0/2159666243 learned_addr learned my addr 172.21.15.6:0/2159666243 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:06.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f969a59c700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f969c06a300 0x7f969c14c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f969ad9d700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f969c0ba140 0x7f969c0b97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f9699d9b700 1 -- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f969c0ba140 msgr2=0x7f969c0b97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f9699d9b700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f969c0ba140 0x7f969c0b97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f9699d9b700 1 -- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f969c06a300 msgr2=0x7f969c14c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:06.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f9699d9b700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f969c06a300 0x7f969c14c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f9699d9b700 1 -- 172.21.15.6:0/2159666243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96840094a0 con 0x7f969c06d8a0 2023-07-21T07:35:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f969a59c700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f969c06a300 0x7f969c14c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f969ad9d700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f969c0ba140 0x7f969c0b97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.782+0000 7f9699d9b700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f969c06d8a0 0x7f969c0b9260 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f96840090b0 tx=0x7f9684004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.783+0000 7f9692ffd700 1 -- 172.21.15.6:0/2159666243 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684011830 con 0x7f969c06d8a0 2023-07-21T07:35:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.783+0000 7f9692ffd700 1 -- 172.21.15.6:0/2159666243 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968401e070 con 0x7f969c06d8a0 2023-07-21T07:35:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.783+0000 7f96a09fd700 1 -- 172.21.15.6:0/2159666243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c14ce40 con 0x7f969c06d8a0 2023-07-21T07:35:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.783+0000 7f9692ffd700 1 -- 172.21.15.6:0/2159666243 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684011bb0 con 0x7f969c06d8a0 2023-07-21T07:35:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.783+0000 7f96a09fd700 1 -- 172.21.15.6:0/2159666243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969c147480 con 0x7f969c06d8a0 2023-07-21T07:35:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.784+0000 7f96a09fd700 1 -- 172.21.15.6:0/2159666243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969c0c0840 con 0x7f969c06d8a0 2023-07-21T07:35:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.784+0000 7f9692ffd700 1 -- 172.21.15.6:0/2159666243 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9684011d10 con 0x7f969c06d8a0 2023-07-21T07:35:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.785+0000 7f9692ffd700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f967c06ace0 0x7f967c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.785+0000 7f9692ffd700 1 -- 172.21.15.6:0/2159666243 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f968408a7b0 con 0x7f969c06d8a0 2023-07-21T07:35:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.785+0000 7f969a59c700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f967c06ace0 0x7f967c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.785+0000 7f969a59c700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f967c06ace0 0x7f967c06d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f968c007fd0 tx=0x7f968c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.789+0000 7f9692ffd700 1 -- 172.21.15.6:0/2159666243 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f96840558f0 con 0x7f969c06d8a0 2023-07-21T07:35:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.985+0000 7f96a09fd700 1 -- 172.21.15.6:0/2159666243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f969c0c0a40 con 0x7f969c06d8a0 2023-07-21T07:35:07.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.986+0000 7f9692ffd700 1 -- 172.21.15.6:0/2159666243 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9684058f10 con 0x7f969c06d8a0 2023-07-21T07:35:07.038 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:35:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.988+0000 7f96a09fd700 1 -- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f967c06ace0 msgr2=0x7f967c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.988+0000 7f96a09fd700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f967c06ace0 0x7f967c06d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f968c007fd0 tx=0x7f968c009040 comp rx=0 tx=0).stop 2023-07-21T07:35:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.988+0000 7f96a09fd700 1 -- 172.21.15.6:0/2159666243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f969c06d8a0 msgr2=0x7f969c0b9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.988+0000 7f96a09fd700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f969c06d8a0 0x7f969c0b9260 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f96840090b0 tx=0x7f9684004750 comp rx=0 tx=0).stop 2023-07-21T07:35:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.988+0000 7f96a09fd700 1 -- 172.21.15.6:0/2159666243 shutdown_connections 2023-07-21T07:35:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.988+0000 7f96a09fd700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f967c06ace0 0x7f967c06d1a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.988+0000 7f96a09fd700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f969c0ba140 0x7f969c0b97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.988+0000 7f96a09fd700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f969c06a300 0x7f969c14c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.988+0000 7f96a09fd700 1 --2- 172.21.15.6:0/2159666243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f969c06d8a0 0x7f969c0b9260 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.988+0000 7f96a09fd700 1 -- 172.21.15.6:0/2159666243 >> 172.21.15.6:0/2159666243 conn(0x7f969c0a8660 msgr2=0x7f969c0c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.988+0000 7f96a09fd700 1 -- 172.21.15.6:0/2159666243 shutdown_connections 2023-07-21T07:35:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:06.988+0000 7f96a09fd700 1 -- 172.21.15.6:0/2159666243 wait complete. 2023-07-21T07:35:07.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:35:07.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.128+0000 7fa76cdf2700 1 Processor -- start 2023-07-21T07:35:07.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.128+0000 7fa76cdf2700 1 -- start start 2023-07-21T07:35:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa76cdf2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7680c5260 0x7fa768151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa76cdf2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7681517c0 con 0x7fa7680c1860 2023-07-21T07:35:07.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa76cdf2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7680c4e50 con 0x7fa7680c3f80 2023-07-21T07:35:07.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa76cdf2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7681519f0 con 0x7fa7680c5260 2023-07-21T07:35:07.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa76659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa7680c1860 0x7fa76806dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41442/0 (socket says 172.21.15.6:41442) 2023-07-21T07:35:07.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa76659c700 1 -- 172.21.15.6:0/1096753113 learned_addr learned my addr 172.21.15.6:0/1096753113 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:07.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa765d9b700 1 --2- 172.21.15.6:0/1096753113 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7680c5260 0x7fa768151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa76559a700 1 -- 172.21.15.6:0/1096753113 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98893584 0 0) 0x7fa7681517c0 con 0x7fa7680c1860 2023-07-21T07:35:07.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa76559a700 1 -- 172.21.15.6:0/1096753113 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7500035b0 con 0x7fa7680c1860 2023-07-21T07:35:07.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa76559a700 1 -- 172.21.15.6:0/1096753113 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079479884 0 0) 0x7fa7680c4e50 con 0x7fa7680c3f80 2023-07-21T07:35:07.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa76559a700 1 -- 172.21.15.6:0/1096753113 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7681517c0 con 0x7fa7680c3f80 2023-07-21T07:35:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa76559a700 1 -- 172.21.15.6:0/1096753113 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1682932077 0 0) 0x7fa7500035b0 con 0x7fa7680c1860 2023-07-21T07:35:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa765d9b700 1 -- 172.21.15.6:0/1096753113 >> v1:172.21.15.86:6789/0 conn(0x7fa7680c3f80 legacy=0x7fa7680c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa765d9b700 1 -- 172.21.15.6:0/1096753113 >> v1:172.21.15.6:6789/0 conn(0x7fa7680c1860 legacy=0x7fa76806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.129+0000 7fa765d9b700 1 -- 172.21.15.6:0/1096753113 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768151cd0 con 0x7fa7680c5260 2023-07-21T07:35:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.130+0000 7fa765d9b700 1 --2- 172.21.15.6:0/1096753113 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7680c5260 0x7fa768151280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa758009870 tx=0x7fa758009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56a1ba76cd2c2adc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.130+0000 7fa76559a700 1 -- 172.21.15.6:0/1096753113 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c001670 con 0x7fa7680c5260 2023-07-21T07:35:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.130+0000 7fa76559a700 1 -- 172.21.15.6:0/1096753113 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa758004030 con 0x7fa7680c5260 2023-07-21T07:35:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.130+0000 7fa76559a700 1 -- 172.21.15.6:0/1096753113 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7580043c0 con 0x7fa7680c5260 2023-07-21T07:35:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.130+0000 7fa76cdf2700 1 -- 172.21.15.6:0/1096753113 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7680c5260 msgr2=0x7fa768151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.130+0000 7fa76cdf2700 1 --2- 172.21.15.6:0/1096753113 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7680c5260 0x7fa768151280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa758009870 tx=0x7fa758009b80 comp rx=0 tx=0).stop 2023-07-21T07:35:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.130+0000 7fa76cdf2700 1 -- 172.21.15.6:0/1096753113 shutdown_connections 2023-07-21T07:35:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.130+0000 7fa76cdf2700 1 --2- 172.21.15.6:0/1096753113 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7680c5260 0x7fa768151280 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.130+0000 7fa76cdf2700 1 -- 172.21.15.6:0/1096753113 >> 172.21.15.6:0/1096753113 conn(0x7fa7680a8660 msgr2=0x7fa7680a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.131+0000 7fa76cdf2700 1 -- 172.21.15.6:0/1096753113 shutdown_connections 2023-07-21T07:35:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.131+0000 7fa76cdf2700 1 -- 172.21.15.6:0/1096753113 wait complete. 2023-07-21T07:35:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.132+0000 7fa76cdf2700 1 Processor -- start 2023-07-21T07:35:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.132+0000 7fa76cdf2700 1 -- start start 2023-07-21T07:35:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.132+0000 7fa76cdf2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7680c1860 0x7fa76814da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.132+0000 7fa76cdf2700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7680c3f80 0x7fa7681e4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76cdf2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7680c5260 0x7fa7681e50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76cdf2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7681e8770 con 0x7fa7680c1860 2023-07-21T07:35:07.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76cdf2700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7681e8220 con 0x7fa7680c3f80 2023-07-21T07:35:07.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76cdf2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7681e8490 con 0x7fa7680c5260 2023-07-21T07:35:07.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7680c1860 0x7fa76814da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7680c1860 0x7fa76814da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33428/0 (socket says 172.21.15.6:33428) 2023-07-21T07:35:07.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76659c700 1 -- 172.21.15.6:0/2739688881 learned_addr learned my addr 172.21.15.6:0/2739688881 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:07.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa765d9b700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7680c3f80 0x7fa7681e4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa766d9d700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7680c5260 0x7fa7681e50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76659c700 1 -- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7680c5260 msgr2=0x7fa7681e50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76659c700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7680c5260 0x7fa7681e50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76659c700 1 -- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7680c3f80 msgr2=0x7fa7681e4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76659c700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7680c3f80 0x7fa7681e4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76659c700 1 -- 172.21.15.6:0/2739688881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7580094a0 con 0x7fa7680c1860 2023-07-21T07:35:07.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76659c700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7680c1860 0x7fa76814da80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c730 tx=0x7fa75c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa756ffd700 1 -- 172.21.15.6:0/2739688881 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c004c80 con 0x7fa7680c1860 2023-07-21T07:35:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa756ffd700 1 -- 172.21.15.6:0/2739688881 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c004de0 con 0x7fa7680c1860 2023-07-21T07:35:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76cdf2700 1 -- 172.21.15.6:0/2739688881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7680ac0a0 con 0x7fa7680c1860 2023-07-21T07:35:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa756ffd700 1 -- 172.21.15.6:0/2739688881 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0072f0 con 0x7fa7680c1860 2023-07-21T07:35:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.133+0000 7fa76cdf2700 1 -- 172.21.15.6:0/2739688881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7680a8a40 con 0x7fa7680c1860 2023-07-21T07:35:07.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.134+0000 7fa76cdf2700 1 -- 172.21.15.6:0/2739688881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7680ac5c0 con 0x7fa7680c1860 2023-07-21T07:35:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.135+0000 7fa756ffd700 1 -- 172.21.15.6:0/2739688881 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa75c007450 con 0x7fa7680c1860 2023-07-21T07:35:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.135+0000 7fa756ffd700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa74806ace0 0x7fa74806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.135+0000 7fa756ffd700 1 -- 172.21.15.6:0/2739688881 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa75c089080 con 0x7fa7680c1860 2023-07-21T07:35:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.135+0000 7fa765d9b700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa74806ace0 0x7fa74806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.136+0000 7fa765d9b700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa74806ace0 0x7fa74806d1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa7680c5680 tx=0x7fa758008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:07.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.140+0000 7fa756ffd700 1 -- 172.21.15.6:0/2739688881 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa7680ac5c0 con 0x7fa7680c1860 2023-07-21T07:35:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.337+0000 7fa76cdf2700 1 -- 172.21.15.6:0/2739688881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa7680abf00 con 0x7fa7680c1860 2023-07-21T07:35:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.337+0000 7fa756ffd700 1 -- 172.21.15.6:0/2739688881 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa7680abf00 con 0x7fa7680c1860 2023-07-21T07:35:07.390 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:35:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.340+0000 7fa76cdf2700 1 -- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa74806ace0 msgr2=0x7fa74806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.340+0000 7fa76cdf2700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa74806ace0 0x7fa74806d1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa7680c5680 tx=0x7fa758008030 comp rx=0 tx=0).stop 2023-07-21T07:35:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.340+0000 7fa76cdf2700 1 -- 172.21.15.6:0/2739688881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7680c1860 msgr2=0x7fa76814da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.340+0000 7fa76cdf2700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7680c1860 0x7fa76814da80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c730 tx=0x7fa75c00ca40 comp rx=0 tx=0).stop 2023-07-21T07:35:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.340+0000 7fa76cdf2700 1 -- 172.21.15.6:0/2739688881 shutdown_connections 2023-07-21T07:35:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.340+0000 7fa76cdf2700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa74806ace0 0x7fa74806d1a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.340+0000 7fa76cdf2700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7680c5260 0x7fa7681e50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.340+0000 7fa76cdf2700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7680c1860 0x7fa76814da80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.340+0000 7fa76cdf2700 1 --2- 172.21.15.6:0/2739688881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7680c3f80 0x7fa7681e4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.340+0000 7fa76cdf2700 1 -- 172.21.15.6:0/2739688881 >> 172.21.15.6:0/2739688881 conn(0x7fa7680a8660 msgr2=0x7fa768071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.340+0000 7fa76cdf2700 1 -- 172.21.15.6:0/2739688881 shutdown_connections 2023-07-21T07:35:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.340+0000 7fa76cdf2700 1 -- 172.21.15.6:0/2739688881 wait complete. 2023-07-21T07:35:07.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:35:07.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.479+0000 7f3525197700 1 Processor -- start 2023-07-21T07:35:07.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.479+0000 7f3525197700 1 -- start start 2023-07-21T07:35:07.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.480+0000 7f3525197700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f352006a300 0x7f35201519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.480+0000 7f3525197700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3520155530 con 0x7f35200ba140 2023-07-21T07:35:07.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.480+0000 7f3525197700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3520154920 con 0x7f352006d8a0 2023-07-21T07:35:07.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.480+0000 7f3525197700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35200c1a30 con 0x7f352006a300 2023-07-21T07:35:07.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.480+0000 7f351e59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f35200ba140 0x7f35200c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41458/0 (socket says 172.21.15.6:41458) 2023-07-21T07:35:07.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.480+0000 7f351e59c700 1 -- 172.21.15.6:0/2923663132 learned_addr learned my addr 172.21.15.6:0/2923663132 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.480+0000 7f351ed9d700 1 --2- 172.21.15.6:0/2923663132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f352006a300 0x7f35201519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.480+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676045240 0 0) 0x7f3520155530 con 0x7f35200ba140 2023-07-21T07:35:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f350c0035b0 con 0x7f35200ba140 2023-07-21T07:35:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758559161 0 0) 0x7f3520154920 con 0x7f352006d8a0 2023-07-21T07:35:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3520155530 con 0x7f352006d8a0 2023-07-21T07:35:07.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 853884893 0 0) 0x7f350c0035b0 con 0x7f35200ba140 2023-07-21T07:35:07.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f352006a300 msgr2=0x7f35201519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:07.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 --2- 172.21.15.6:0/2923663132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f352006a300 0x7f35201519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 >> v1:172.21.15.86:6789/0 conn(0x7f352006d8a0 legacy=0x7f35200c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3520154c00 con 0x7f35200ba140 2023-07-21T07:35:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f3510001670 con 0x7f35200ba140 2023-07-21T07:35:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 >> v1:172.21.15.6:6789/0 conn(0x7f35200ba140 legacy=0x7f35200c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 --2- 172.21.15.6:0/2923663132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f350c003bc0 0x7f350c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 --2- 172.21.15.6:0/2923663132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f352006a300 0x7f350c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 --2- 172.21.15.6:0/2923663132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f350c004d90 0x7f350c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35200c1a30 con 0x7f350c004d90 2023-07-21T07:35:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c00bb10 con 0x7f350c003bc0 2023-07-21T07:35:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c00bcd0 con 0x7f352006a300 2023-07-21T07:35:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351f59e700 1 --2- 172.21.15.6:0/2923663132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f350c004d90 0x7f350c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351ed9d700 1 --2- 172.21.15.6:0/2923663132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f350c003bc0 0x7f350c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351e59c700 1 --2- 172.21.15.6:0/2923663132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f352006a300 0x7f350c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351f59e700 1 -- 172.21.15.6:0/2923663132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f352006a300 msgr2=0x7f350c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351f59e700 1 --2- 172.21.15.6:0/2923663132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f352006a300 0x7f350c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351f59e700 1 -- 172.21.15.6:0/2923663132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f350c003bc0 msgr2=0x7f350c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351f59e700 1 --2- 172.21.15.6:0/2923663132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f350c003bc0 0x7f350c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351f59e700 1 -- 172.21.15.6:0/2923663132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c0035b0 con 0x7f350c004d90 2023-07-21T07:35:07.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.481+0000 7f351f59e700 1 --2- 172.21.15.6:0/2923663132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f350c004d90 0x7f350c005210 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f351800c2f0 tx=0x7f350c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab7a5dd52f841f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:07.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.482+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518001f30 con 0x7f350c004d90 2023-07-21T07:35:07.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.482+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351800ce90 con 0x7f350c004d90 2023-07-21T07:35:07.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.482+0000 7f351dd9b700 1 -- 172.21.15.6:0/2923663132 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518003c40 con 0x7f350c004d90 2023-07-21T07:35:07.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.482+0000 7f3525197700 1 -- 172.21.15.6:0/2923663132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f350c004d90 msgr2=0x7f350c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.482+0000 7f3525197700 1 --2- 172.21.15.6:0/2923663132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f350c004d90 0x7f350c005210 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f351800c2f0 tx=0x7f350c005880 comp rx=0 tx=0).stop 2023-07-21T07:35:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.482+0000 7f351f59e700 1 -- 172.21.15.6:0/2923663132 reap_dead start 2023-07-21T07:35:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.482+0000 7f3525197700 1 -- 172.21.15.6:0/2923663132 shutdown_connections 2023-07-21T07:35:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.482+0000 7f3525197700 1 -- 172.21.15.6:0/2923663132 >> 172.21.15.6:0/2923663132 conn(0x7f35200a8660 msgr2=0x7f35200a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.482+0000 7f3525197700 1 -- 172.21.15.6:0/2923663132 shutdown_connections 2023-07-21T07:35:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.482+0000 7f3525197700 1 -- 172.21.15.6:0/2923663132 wait complete. 2023-07-21T07:35:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.484+0000 7f3525197700 1 Processor -- start 2023-07-21T07:35:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.484+0000 7f3525197700 1 -- start start 2023-07-21T07:35:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.484+0000 7f3525197700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f350c004d90 0x7f352014c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.484+0000 7f3525197700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35200bdb80 0x7f35200b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.484+0000 7f3525197700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3520150050 0x7f35200b9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.484+0000 7f3525197700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3520071cd0 con 0x7f35200bdb80 2023-07-21T07:35:07.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.484+0000 7f3525197700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35201edd60 con 0x7f350c004d90 2023-07-21T07:35:07.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.484+0000 7f3525197700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3520071f70 con 0x7f3520150050 2023-07-21T07:35:07.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f351e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35200bdb80 0x7f35200b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f351e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35200bdb80 0x7f35200b8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33450/0 (socket says 172.21.15.6:33450) 2023-07-21T07:35:07.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f351e59c700 1 -- 172.21.15.6:0/2767133063 learned_addr learned my addr 172.21.15.6:0/2767133063 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:07.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f351f59e700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3520150050 0x7f35200b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f351ed9d700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f350c004d90 0x7f352014c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f351e59c700 1 -- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3520150050 msgr2=0x7f35200b9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f351e59c700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3520150050 0x7f35200b9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f351e59c700 1 -- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f350c004d90 msgr2=0x7f352014c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f351e59c700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f350c004d90 0x7f352014c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f351e59c700 1 -- 172.21.15.6:0/2767133063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3520072250 con 0x7f35200bdb80 2023-07-21T07:35:07.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f351ed9d700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f350c004d90 0x7f352014c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:07.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f351f59e700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3520150050 0x7f35200b9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:07.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f351e59c700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35200bdb80 0x7f35200b8b50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3510007310 tx=0x7f3510007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:07.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f35177fe700 1 -- 172.21.15.6:0/2767133063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351000f660 con 0x7f35200bdb80 2023-07-21T07:35:07.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f35177fe700 1 -- 172.21.15.6:0/2767133063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351000f7c0 con 0x7f35200bdb80 2023-07-21T07:35:07.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f3525197700 1 -- 172.21.15.6:0/2767133063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35200b95d0 con 0x7f35200bdb80 2023-07-21T07:35:07.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f35177fe700 1 -- 172.21.15.6:0/2767133063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351000fb30 con 0x7f35200bdb80 2023-07-21T07:35:07.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.485+0000 7f3525197700 1 -- 172.21.15.6:0/2767133063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35201ee040 con 0x7f35200bdb80 2023-07-21T07:35:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.486+0000 7f3525197700 1 -- 172.21.15.6:0/2767133063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35201e9cb0 con 0x7f35200bdb80 2023-07-21T07:35:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.487+0000 7f35177fe700 1 -- 172.21.15.6:0/2767133063 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f351000fc90 con 0x7f35200bdb80 2023-07-21T07:35:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.487+0000 7f35177fe700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f350006ace0 0x7f350006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.487+0000 7f35177fe700 1 -- 172.21.15.6:0/2767133063 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f35100893d0 con 0x7f35200bdb80 2023-07-21T07:35:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.487+0000 7f351ed9d700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f350006ace0 0x7f350006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.488+0000 7f351ed9d700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f350006ace0 0x7f350006d1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3508009c60 tx=0x7f3508008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.491+0000 7f35177fe700 1 -- 172.21.15.6:0/2767133063 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3510054510 con 0x7f35200bdb80 2023-07-21T07:35:07.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.689+0000 7f3525197700 1 -- 172.21.15.6:0/2767133063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3520074500 con 0x7f35200bdb80 2023-07-21T07:35:07.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.689+0000 7f35177fe700 1 -- 172.21.15.6:0/2767133063 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3510057b30 con 0x7f35200bdb80 2023-07-21T07:35:07.742 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:35:07.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.691+0000 7f3525197700 1 -- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f350006ace0 msgr2=0x7f350006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.691+0000 7f3525197700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f350006ace0 0x7f350006d1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3508009c60 tx=0x7f3508008040 comp rx=0 tx=0).stop 2023-07-21T07:35:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.691+0000 7f3525197700 1 -- 172.21.15.6:0/2767133063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35200bdb80 msgr2=0x7f35200b8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.691+0000 7f3525197700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35200bdb80 0x7f35200b8b50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3510007310 tx=0x7f3510007620 comp rx=0 tx=0).stop 2023-07-21T07:35:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.691+0000 7f3525197700 1 -- 172.21.15.6:0/2767133063 shutdown_connections 2023-07-21T07:35:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.691+0000 7f3525197700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f350006ace0 0x7f350006d1a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.691+0000 7f3525197700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3520150050 0x7f35200b9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.691+0000 7f3525197700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f350c004d90 0x7f352014c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.691+0000 7f3525197700 1 --2- 172.21.15.6:0/2767133063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35200bdb80 0x7f35200b8b50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.691+0000 7f3525197700 1 -- 172.21.15.6:0/2767133063 >> 172.21.15.6:0/2767133063 conn(0x7f35200a8660 msgr2=0x7f3520150d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.692+0000 7f3525197700 1 -- 172.21.15.6:0/2767133063 shutdown_connections 2023-07-21T07:35:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.692+0000 7f3525197700 1 -- 172.21.15.6:0/2767133063 wait complete. 2023-07-21T07:35:07.756 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:35:07.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.832+0000 7f9b7cb8e700 1 Processor -- start 2023-07-21T07:35:07.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.833+0000 7f9b7cb8e700 1 -- start start 2023-07-21T07:35:07.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.833+0000 7f9b7cb8e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b7814fb30 0x7f9b7815dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.833+0000 7f9b7cb8e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b780c3c90 con 0x7f9b780a6f80 2023-07-21T07:35:07.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.833+0000 7f9b7cb8e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b780c3680 con 0x7f9b78072160 2023-07-21T07:35:07.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.833+0000 7f9b7cb8e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b780c26e0 con 0x7f9b7814fb30 2023-07-21T07:35:07.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.833+0000 7f9b7659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9b780a6f80 0x7f9b78152380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41476/0 (socket says 172.21.15.6:41476) 2023-07-21T07:35:07.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7659c700 1 -- 172.21.15.6:0/839843449 learned_addr learned my addr 172.21.15.6:0/839843449 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:07.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b76d9d700 1 --2- 172.21.15.6:0/839843449 >> v2:172.21.15.86:3300/0 conn(0x7f9b7814fb30 0x7f9b7815dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354661565 0 0) 0x7f9b780c3c90 con 0x7f9b780a6f80 2023-07-21T07:35:07.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b640035b0 con 0x7f9b780a6f80 2023-07-21T07:35:07.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 914291535 0 0) 0x7f9b640035b0 con 0x7f9b780a6f80 2023-07-21T07:35:07.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 >> v2:172.21.15.86:3300/0 conn(0x7f9b7814fb30 msgr2=0x7f9b7815dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:07.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 --2- 172.21.15.6:0/839843449 >> v2:172.21.15.86:3300/0 conn(0x7f9b7814fb30 0x7f9b7815dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 >> v1:172.21.15.86:6789/0 conn(0x7f9b78072160 legacy=0x7f9b7814f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b780c6fe0 con 0x7f9b780a6f80 2023-07-21T07:35:07.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f9b68001670 con 0x7f9b780a6f80 2023-07-21T07:35:07.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b76d9d700 1 --2- 172.21.15.6:0/839843449 >> v2:172.21.15.86:3300/0 conn(0x7f9b7814fb30 0x7f9b7815dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:07.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 >> v1:172.21.15.6:6789/0 conn(0x7f9b780a6f80 legacy=0x7f9b78152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 --2- 172.21.15.6:0/839843449 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b64003a00 0x7f9b64003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 --2- 172.21.15.6:0/839843449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b64004850 0x7f9b64004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 --2- 172.21.15.6:0/839843449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b64005210 0x7f9b6400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b780c26e0 con 0x7f9b64004850 2023-07-21T07:35:07.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6400c1b0 con 0x7f9b64005210 2023-07-21T07:35:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6400c370 con 0x7f9b64003a00 2023-07-21T07:35:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b75d9b700 1 --2- 172.21.15.6:0/839843449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b64004850 0x7f9b64004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b76d9d700 1 --2- 172.21.15.6:0/839843449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b64005210 0x7f9b6400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.834+0000 7f9b7659c700 1 --2- 172.21.15.6:0/839843449 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b64003a00 0x7f9b64003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.835+0000 7f9b75d9b700 1 -- 172.21.15.6:0/839843449 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b64003a00 msgr2=0x7f9b64003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.835+0000 7f9b75d9b700 1 --2- 172.21.15.6:0/839843449 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b64003a00 0x7f9b64003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.835+0000 7f9b75d9b700 1 -- 172.21.15.6:0/839843449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b64005210 msgr2=0x7f9b6400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.835+0000 7f9b75d9b700 1 --2- 172.21.15.6:0/839843449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b64005210 0x7f9b6400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.835+0000 7f9b75d9b700 1 -- 172.21.15.6:0/839843449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b640035b0 con 0x7f9b64004850 2023-07-21T07:35:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.835+0000 7f9b76d9d700 1 -- 172.21.15.6:0/839843449 reap_dead start 2023-07-21T07:35:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.835+0000 7f9b75d9b700 1 --2- 172.21.15.6:0/839843449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b64004850 0x7f9b64004cd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9b600017c0 tx=0x7f9b64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43f5d336705c600 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.835+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b600052d0 con 0x7f9b64004850 2023-07-21T07:35:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.835+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b60005450 con 0x7f9b64004850 2023-07-21T07:35:07.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.835+0000 7f9b7559a700 1 -- 172.21.15.6:0/839843449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b600038c0 con 0x7f9b64004850 2023-07-21T07:35:07.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.835+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/839843449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b64004850 msgr2=0x7f9b64004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.835+0000 7f9b7cb8e700 1 --2- 172.21.15.6:0/839843449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b64004850 0x7f9b64004cd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9b600017c0 tx=0x7f9b64005880 comp rx=0 tx=0).stop 2023-07-21T07:35:07.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.836+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/839843449 shutdown_connections 2023-07-21T07:35:07.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.836+0000 7f9b7cb8e700 1 --2- 172.21.15.6:0/839843449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b64004850 0x7f9b64004cd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.836+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/839843449 >> 172.21.15.6:0/839843449 conn(0x7f9b780c7b50 msgr2=0x7f9b780c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:07.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.836+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/839843449 shutdown_connections 2023-07-21T07:35:07.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.836+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/839843449 wait complete. 2023-07-21T07:35:07.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.837+0000 7f9b7cb8e700 1 Processor -- start 2023-07-21T07:35:07.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.837+0000 7f9b7cb8e700 1 -- start start 2023-07-21T07:35:07.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7cb8e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b64004850 0x7f9b780c1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7cb8e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7806cb00 0x7f9b780c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7cb8e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b78144e30 0x7f9b781452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7cb8e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7806c810 con 0x7f9b64004850 2023-07-21T07:35:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7cb8e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b780a90b0 con 0x7f9b78144e30 2023-07-21T07:35:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7cb8e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b781457f0 con 0x7f9b7806cb00 2023-07-21T07:35:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b64004850 0x7f9b780c1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b64004850 0x7f9b780c1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33466/0 (socket says 172.21.15.6:33466) 2023-07-21T07:35:07.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7659c700 1 -- 172.21.15.6:0/781302470 learned_addr learned my addr 172.21.15.6:0/781302470 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b76d9d700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b78144e30 0x7f9b781452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b75d9b700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7806cb00 0x7f9b780c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7659c700 1 -- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7806cb00 msgr2=0x7f9b780c1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7659c700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7806cb00 0x7f9b780c1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7659c700 1 -- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b78144e30 msgr2=0x7f9b781452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7659c700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b78144e30 0x7f9b781452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7659c700 1 -- 172.21.15.6:0/781302470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7806d0c0 con 0x7f9b64004850 2023-07-21T07:35:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b76d9d700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b78144e30 0x7f9b781452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b75d9b700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7806cb00 0x7f9b780c1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7659c700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b64004850 0x7f9b780c1040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9b680072f0 tx=0x7f9b680076b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b6effd700 1 -- 172.21.15.6:0/781302470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b680077d0 con 0x7f9b64004850 2023-07-21T07:35:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b6effd700 1 -- 172.21.15.6:0/781302470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6800f8d0 con 0x7f9b64004850 2023-07-21T07:35:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/781302470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7806bee0 con 0x7f9b64004850 2023-07-21T07:35:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b6effd700 1 -- 172.21.15.6:0/781302470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6800fc80 con 0x7f9b64004850 2023-07-21T07:35:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.838+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/781302470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7806c4a0 con 0x7f9b64004850 2023-07-21T07:35:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.839+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/781302470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7806c660 con 0x7f9b64004850 2023-07-21T07:35:07.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.840+0000 7f9b6effd700 1 -- 172.21.15.6:0/781302470 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b6801e3b0 con 0x7f9b64004850 2023-07-21T07:35:07.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.840+0000 7f9b6effd700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9b5806ace0 0x7f9b5806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:07.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.840+0000 7f9b6effd700 1 -- 172.21.15.6:0/781302470 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b68088fd0 con 0x7f9b64004850 2023-07-21T07:35:07.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.841+0000 7f9b75d9b700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9b5806ace0 0x7f9b5806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:07.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.841+0000 7f9b75d9b700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9b5806ace0 0x7f9b5806d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b60000c00 tx=0x7f9b60009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:07.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:07.845+0000 7f9b6effd700 1 -- 172.21.15.6:0/781302470 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9b68053ff0 con 0x7f9b64004850 2023-07-21T07:35:08.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.040+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/781302470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b78074500 con 0x7f9b64004850 2023-07-21T07:35:08.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.041+0000 7f9b6effd700 1 -- 172.21.15.6:0/781302470 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b6801a0a0 con 0x7f9b64004850 2023-07-21T07:35:08.094 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:35:08.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.043+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9b5806ace0 msgr2=0x7f9b5806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:08.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.043+0000 7f9b7cb8e700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9b5806ace0 0x7f9b5806d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b60000c00 tx=0x7f9b60009030 comp rx=0 tx=0).stop 2023-07-21T07:35:08.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.043+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/781302470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b64004850 msgr2=0x7f9b780c1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:08.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.043+0000 7f9b7cb8e700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b64004850 0x7f9b780c1040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9b680072f0 tx=0x7f9b680076b0 comp rx=0 tx=0).stop 2023-07-21T07:35:08.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.043+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/781302470 shutdown_connections 2023-07-21T07:35:08.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.043+0000 7f9b7cb8e700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9b5806ace0 0x7f9b5806d1a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:08.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.043+0000 7f9b7cb8e700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b78144e30 0x7f9b781452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:08.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.043+0000 7f9b7cb8e700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b64004850 0x7f9b780c1040 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:08.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.043+0000 7f9b7cb8e700 1 --2- 172.21.15.6:0/781302470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7806cb00 0x7f9b780c1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:08.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.043+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/781302470 >> 172.21.15.6:0/781302470 conn(0x7f9b780c7b50 msgr2=0x7f9b78148e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:08.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.043+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/781302470 shutdown_connections 2023-07-21T07:35:08.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.043+0000 7f9b7cb8e700 1 -- 172.21.15.6:0/781302470 wait complete. 2023-07-21T07:35:08.113 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-07-21T07:35:08.114 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-07-21T07:35:08.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.188+0000 7f8062e57700 1 Processor -- start 2023-07-21T07:35:08.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.189+0000 7f8062e57700 1 -- start start 2023-07-21T07:35:08.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.189+0000 7f8062e57700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f805c0c6c70 0x7f805c151840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:08.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.189+0000 7f8062e57700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f805c0c5ed0 0x7f805c158210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:08.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.189+0000 7f8062e57700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805c0c45a0 con 0x7f805c0c5a60 2023-07-21T07:35:08.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.189+0000 7f8062e57700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f805c06b0c0 con 0x7f805c0c5ed0 2023-07-21T07:35:08.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.189+0000 7f8062e57700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0c5150 con 0x7f805c0c6c70 2023-07-21T07:35:08.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.189+0000 7f805bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f805c0c5a60 0x7f805c157b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41494/0 (socket says 172.21.15.6:41494) 2023-07-21T07:35:08.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.189+0000 7f805bfff700 1 -- 172.21.15.6:0/2633088106 learned_addr learned my addr 172.21.15.6:0/2633088106 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:08.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.190+0000 7f8060bf3700 1 --2- 172.21.15.6:0/2633088106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f805c0c6c70 0x7f805c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:08.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.190+0000 7f80613f4700 1 --2- 172.21.15.6:0/2633088106 >> v2:172.21.15.86:3300/0 conn(0x7f805c0c5ed0 0x7f805c158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:08.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.190+0000 7f805b7fe700 1 -- 172.21.15.6:0/2633088106 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989743076 0 0) 0x7f805c0c45a0 con 0x7f805c0c5a60 2023-07-21T07:35:08.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.190+0000 7f805b7fe700 1 -- 172.21.15.6:0/2633088106 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f804c0035b0 con 0x7f805c0c5a60 2023-07-21T07:35:08.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.190+0000 7f8060bf3700 1 -- 172.21.15.6:0/2633088106 >> v2:172.21.15.86:3300/0 conn(0x7f805c0c5ed0 msgr2=0x7f805c158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:08.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.190+0000 7f8060bf3700 1 --2- 172.21.15.6:0/2633088106 >> v2:172.21.15.86:3300/0 conn(0x7f805c0c5ed0 0x7f805c158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:08.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.190+0000 7f8060bf3700 1 -- 172.21.15.6:0/2633088106 >> v1:172.21.15.6:6789/0 conn(0x7f805c0c5a60 legacy=0x7f805c157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:08.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.190+0000 7f8060bf3700 1 -- 172.21.15.6:0/2633088106 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805c0c55e0 con 0x7f805c0c6c70 2023-07-21T07:35:08.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.190+0000 7f8060bf3700 1 --2- 172.21.15.6:0/2633088106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f805c0c6c70 0x7f805c151840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8050009840 tx=0x7f8050009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db85190f104f5cff server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:08.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.190+0000 7f805b7fe700 1 -- 172.21.15.6:0/2633088106 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050011830 con 0x7f805c0c6c70 2023-07-21T07:35:08.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.190+0000 7f805b7fe700 1 -- 172.21.15.6:0/2633088106 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8050011990 con 0x7f805c0c6c70 2023-07-21T07:35:08.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.190+0000 7f805b7fe700 1 -- 172.21.15.6:0/2633088106 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050011d20 con 0x7f805c0c6c70 2023-07-21T07:35:08.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.191+0000 7f8062e57700 1 -- 172.21.15.6:0/2633088106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f805c0c6c70 msgr2=0x7f805c151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:08.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.191+0000 7f8062e57700 1 --2- 172.21.15.6:0/2633088106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f805c0c6c70 0x7f805c151840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8050009840 tx=0x7f8050009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:08.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.191+0000 7f8062e57700 1 -- 172.21.15.6:0/2633088106 shutdown_connections 2023-07-21T07:35:08.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.191+0000 7f8062e57700 1 --2- 172.21.15.6:0/2633088106 >> v2:172.21.15.86:3300/0 conn(0x7f805c0c5ed0 0x7f805c158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:08.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.191+0000 7f8062e57700 1 --2- 172.21.15.6:0/2633088106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f805c0c6c70 0x7f805c151840 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:08.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.191+0000 7f8062e57700 1 -- 172.21.15.6:0/2633088106 >> 172.21.15.6:0/2633088106 conn(0x7f805c0ca040 msgr2=0x7f805c0ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:08.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.191+0000 7f8062e57700 1 -- 172.21.15.6:0/2633088106 shutdown_connections 2023-07-21T07:35:08.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.191+0000 7f8062e57700 1 -- 172.21.15.6:0/2633088106 wait complete. 2023-07-21T07:35:08.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.192+0000 7f8062e57700 1 Processor -- start 2023-07-21T07:35:08.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.192+0000 7f8062e57700 1 -- start start 2023-07-21T07:35:08.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8062e57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f805c0c5a60 0x7f805c156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:08.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8062e57700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f805c0c5ed0 0x7f805c146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:08.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8062e57700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f805c0c6c70 0x7f805c147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:08.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8062e57700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0aae20 con 0x7f805c0c5a60 2023-07-21T07:35:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8062e57700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0ac270 con 0x7f805c0c5ed0 2023-07-21T07:35:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8062e57700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805c155080 con 0x7f805c0c6c70 2023-07-21T07:35:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8060bf3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f805c0c5a60 0x7f805c156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8060bf3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f805c0c5a60 0x7f805c156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33480/0 (socket says 172.21.15.6:33480) 2023-07-21T07:35:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8060bf3700 1 -- 172.21.15.6:0/1069788915 learned_addr learned my addr 172.21.15.6:0/1069788915 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f805bfff700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f805c0c5ed0 0x7f805c146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f80613f4700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f805c0c6c70 0x7f805c147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8060bf3700 1 -- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f805c0c6c70 msgr2=0x7f805c147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8060bf3700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f805c0c6c70 0x7f805c147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8060bf3700 1 -- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f805c0c5ed0 msgr2=0x7f805c146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8060bf3700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f805c0c5ed0 0x7f805c146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f8060bf3700 1 -- 172.21.15.6:0/1069788915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80500094a0 con 0x7f805c0c5a60 2023-07-21T07:35:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f805bfff700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f805c0c5ed0 0x7f805c146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.193+0000 7f80613f4700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f805c0c6c70 0x7f805c147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.194+0000 7f8060bf3700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f805c0c5a60 0x7f805c156a10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f80500090b0 tx=0x7f8050004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.194+0000 7f80597fa700 1 -- 172.21.15.6:0/1069788915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500036a0 con 0x7f805c0c5a60 2023-07-21T07:35:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.194+0000 7f80597fa700 1 -- 172.21.15.6:0/1069788915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805001f070 con 0x7f805c0c5a60 2023-07-21T07:35:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.194+0000 7f8062e57700 1 -- 172.21.15.6:0/1069788915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805c154da0 con 0x7f805c0c5a60 2023-07-21T07:35:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.194+0000 7f80597fa700 1 -- 172.21.15.6:0/1069788915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050003a40 con 0x7f805c0c5a60 2023-07-21T07:35:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.194+0000 7f8062e57700 1 -- 172.21.15.6:0/1069788915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805c1ed970 con 0x7f805c0c5a60 2023-07-21T07:35:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.195+0000 7f8062e57700 1 -- 172.21.15.6:0/1069788915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805c074500 con 0x7f805c0c5a60 2023-07-21T07:35:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.195+0000 7f80597fa700 1 -- 172.21.15.6:0/1069788915 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8050003ba0 con 0x7f805c0c5a60 2023-07-21T07:35:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.196+0000 7f80597fa700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f804006ace0 0x7f804006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.196+0000 7f80597fa700 1 -- 172.21.15.6:0/1069788915 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8050021070 con 0x7f805c0c5a60 2023-07-21T07:35:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.196+0000 7f805bfff700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f804006ace0 0x7f804006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.196+0000 7f805bfff700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f804006ace0 0x7f804006d1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f805c155510 tx=0x7f8048009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.200+0000 7f80597fa700 1 -- 172.21.15.6:0/1069788915 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8050055dc0 con 0x7f805c0c5a60 2023-07-21T07:35:08.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:08.478+0000 7f8062e57700 1 -- 172.21.15.6:0/1069788915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f805c14aeb0 con 0x7f805c0c5a60 2023-07-21T07:35:09.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:35:09.029 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:35:09.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.104+0000 7f80597fa700 1 -- 172.21.15.6:0/1069788915 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v49) v1 ==== 162+0+0 (secure 0 0 0) 0x7f80500150e0 con 0x7f805c0c5a60 2023-07-21T07:35:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.107+0000 7f8062e57700 1 -- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f804006ace0 msgr2=0x7f804006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.107+0000 7f8062e57700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f804006ace0 0x7f804006d1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f805c155510 tx=0x7f8048009040 comp rx=0 tx=0).stop 2023-07-21T07:35:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.107+0000 7f8062e57700 1 -- 172.21.15.6:0/1069788915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f805c0c5a60 msgr2=0x7f805c156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.107+0000 7f8062e57700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f805c0c5a60 0x7f805c156a10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f80500090b0 tx=0x7f8050004750 comp rx=0 tx=0).stop 2023-07-21T07:35:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.107+0000 7f8062e57700 1 -- 172.21.15.6:0/1069788915 shutdown_connections 2023-07-21T07:35:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.107+0000 7f8062e57700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f804006ace0 0x7f804006d1a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.107+0000 7f8062e57700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f805c0c6c70 0x7f805c147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.107+0000 7f8062e57700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f805c0c5a60 0x7f805c156a10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.107+0000 7f8062e57700 1 --2- 172.21.15.6:0/1069788915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f805c0c5ed0 0x7f805c146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.107+0000 7f8062e57700 1 -- 172.21.15.6:0/1069788915 >> 172.21.15.6:0/1069788915 conn(0x7f805c0ca040 msgr2=0x7f805c151610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.107+0000 7f8062e57700 1 -- 172.21.15.6:0/1069788915 shutdown_connections 2023-07-21T07:35:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.107+0000 7f8062e57700 1 -- 172.21.15.6:0/1069788915 wait complete. 2023-07-21T07:35:09.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.257+0000 7f758f696700 1 Processor -- start 2023-07-21T07:35:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.257+0000 7f758f696700 1 -- start start 2023-07-21T07:35:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.258+0000 7f758f696700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f75880c42a0 0x7f75880c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.258+0000 7f758f696700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75880a95d0 con 0x7f75880a4e10 2023-07-21T07:35:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.258+0000 7f758f696700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75880c27e0 con 0x7f75880aa230 2023-07-21T07:35:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.258+0000 7f758f696700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75880c5190 con 0x7f75880c42a0 2023-07-21T07:35:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.258+0000 7f758cc31700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f75880a4e10 0x7f75880a9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41508/0 (socket says 172.21.15.6:41508) 2023-07-21T07:35:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.258+0000 7f758cc31700 1 -- 172.21.15.6:0/1755713596 learned_addr learned my addr 172.21.15.6:0/1755713596 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f758d432700 1 --2- 172.21.15.6:0/1755713596 >> v2:172.21.15.86:3300/0 conn(0x7f75880c42a0 0x7f75880c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928955764 0 0) 0x7f75880a95d0 con 0x7f75880a4e10 2023-07-21T07:35:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75740057c0 con 0x7f75880a4e10 2023-07-21T07:35:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3568128160 0 0) 0x7f75740057c0 con 0x7f75880a4e10 2023-07-21T07:35:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 >> v2:172.21.15.86:3300/0 conn(0x7f75880c42a0 msgr2=0x7f75880c22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 --2- 172.21.15.6:0/1755713596 >> v2:172.21.15.86:3300/0 conn(0x7f75880c42a0 0x7f75880c22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 >> v1:172.21.15.86:6789/0 conn(0x7f75880aa230 legacy=0x7f7588153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75880c5470 con 0x7f75880a4e10 2023-07-21T07:35:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f7584001670 con 0x7f75880a4e10 2023-07-21T07:35:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 >> v1:172.21.15.6:6789/0 conn(0x7f75880a4e10 legacy=0x7f75880a9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 --2- 172.21.15.6:0/1755713596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7574005c10 0x7f7574006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 --2- 172.21.15.6:0/1755713596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7574006a60 0x7f7574006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 --2- 172.21.15.6:0/1755713596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7574007540 0x7f757400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75880c5190 con 0x7f7574006a60 2023-07-21T07:35:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757400e410 con 0x7f7574007540 2023-07-21T07:35:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757400e5d0 con 0x7f7574005c10 2023-07-21T07:35:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f758cc31700 1 --2- 172.21.15.6:0/1755713596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7574006a60 0x7f7574006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f758dc33700 1 --2- 172.21.15.6:0/1755713596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7574007540 0x7f757400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f758d432700 1 --2- 172.21.15.6:0/1755713596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7574005c10 0x7f7574006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f758cc31700 1 -- 172.21.15.6:0/1755713596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7574005c10 msgr2=0x7f7574006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f758cc31700 1 --2- 172.21.15.6:0/1755713596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7574005c10 0x7f7574006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f758cc31700 1 -- 172.21.15.6:0/1755713596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7574007540 msgr2=0x7f757400dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f758cc31700 1 --2- 172.21.15.6:0/1755713596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7574007540 0x7f757400dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f758cc31700 1 -- 172.21.15.6:0/1755713596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75740057c0 con 0x7f7574006a60 2023-07-21T07:35:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f758dc33700 1 --2- 172.21.15.6:0/1755713596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7574007540 0x7f757400dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.259+0000 7f758dc33700 1 -- 172.21.15.6:0/1755713596 reap_dead start 2023-07-21T07:35:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.260+0000 7f758cc31700 1 --2- 172.21.15.6:0/1755713596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7574006a60 0x7f7574006ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7584001eb0 tx=0x7f7574007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ff8748fe18c480 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.260+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758400cdd0 con 0x7f7574006a60 2023-07-21T07:35:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.260+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7584005960 con 0x7f7574006a60 2023-07-21T07:35:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.260+0000 7f757ffff700 1 -- 172.21.15.6:0/1755713596 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584005cd0 con 0x7f7574006a60 2023-07-21T07:35:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.260+0000 7f758f696700 1 -- 172.21.15.6:0/1755713596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7574006a60 msgr2=0x7f7574006ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.260+0000 7f758f696700 1 --2- 172.21.15.6:0/1755713596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7574006a60 0x7f7574006ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7584001eb0 tx=0x7f7574007a90 comp rx=0 tx=0).stop 2023-07-21T07:35:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.260+0000 7f758f696700 1 -- 172.21.15.6:0/1755713596 shutdown_connections 2023-07-21T07:35:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.260+0000 7f758f696700 1 --2- 172.21.15.6:0/1755713596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7574006a60 0x7f7574006ee0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.260+0000 7f758f696700 1 -- 172.21.15.6:0/1755713596 >> 172.21.15.6:0/1755713596 conn(0x7f758806a090 msgr2=0x7f758806a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.260+0000 7f758f696700 1 -- 172.21.15.6:0/1755713596 shutdown_connections 2023-07-21T07:35:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.260+0000 7f758f696700 1 -- 172.21.15.6:0/1755713596 wait complete. 2023-07-21T07:35:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.262+0000 7f758f696700 1 Processor -- start 2023-07-21T07:35:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.262+0000 7f758f696700 1 -- start start 2023-07-21T07:35:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758f696700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7574006a60 0x7f75881e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758f696700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f758814add0 0x7f75881e2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758f696700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75881e3090 0x7f758814d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758f696700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75881e67e0 con 0x7f7574006a60 2023-07-21T07:35:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758f696700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75881e3540 con 0x7f758814add0 2023-07-21T07:35:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758f696700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75880a6f50 con 0x7f75881e3090 2023-07-21T07:35:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758d432700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7574006a60 0x7f75881e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758d432700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7574006a60 0x7f75881e62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33500/0 (socket says 172.21.15.6:33500) 2023-07-21T07:35:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758d432700 1 -- 172.21.15.6:0/2407252794 learned_addr learned my addr 172.21.15.6:0/2407252794 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758dc33700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75881e3090 0x7f758814d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758cc31700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f758814add0 0x7f75881e2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758d432700 1 -- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75881e3090 msgr2=0x7f758814d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758d432700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75881e3090 0x7f758814d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758d432700 1 -- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f758814add0 msgr2=0x7f75881e2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758d432700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f758814add0 0x7f75881e2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758d432700 1 -- 172.21.15.6:0/2407252794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75880a7460 con 0x7f7574006a60 2023-07-21T07:35:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f758d432700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7574006a60 0x7f75881e62a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f75780116f0 tx=0x7f7578011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.263+0000 7f757dffb700 1 -- 172.21.15.6:0/2407252794 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7578015870 con 0x7f7574006a60 2023-07-21T07:35:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.264+0000 7f757dffb700 1 -- 172.21.15.6:0/2407252794 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75780159d0 con 0x7f7574006a60 2023-07-21T07:35:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.264+0000 7f758f696700 1 -- 172.21.15.6:0/2407252794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75880a66b0 con 0x7f7574006a60 2023-07-21T07:35:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.264+0000 7f757dffb700 1 -- 172.21.15.6:0/2407252794 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7578015d40 con 0x7f7574006a60 2023-07-21T07:35:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.264+0000 7f758f696700 1 -- 172.21.15.6:0/2407252794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75880a6c70 con 0x7f7574006a60 2023-07-21T07:35:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.265+0000 7f758f696700 1 -- 172.21.15.6:0/2407252794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7588074500 con 0x7f7574006a60 2023-07-21T07:35:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.265+0000 7f757dffb700 1 -- 172.21.15.6:0/2407252794 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7578013400 con 0x7f7574006a60 2023-07-21T07:35:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.266+0000 7f757dffb700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f756c06ace0 0x7f756c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.266+0000 7f757dffb700 1 -- 172.21.15.6:0/2407252794 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75780898c0 con 0x7f7574006a60 2023-07-21T07:35:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.266+0000 7f758cc31700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f756c06ace0 0x7f756c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.267+0000 7f758cc31700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f756c06ace0 0x7f756c06d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7584014000 tx=0x7f7584007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.270+0000 7f757dffb700 1 -- 172.21.15.6:0/2407252794 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7578058400 con 0x7f7574006a60 2023-07-21T07:35:09.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.470+0000 7f758f696700 1 -- 172.21.15.6:0/2407252794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75880c3e10 con 0x7f7574006a60 2023-07-21T07:35:09.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.471+0000 7f757dffb700 1 -- 172.21.15.6:0/2407252794 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f7578057f90 con 0x7f7574006a60 2023-07-21T07:35:09.523 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:09.523 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:09.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.473+0000 7f758f696700 1 -- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f756c06ace0 msgr2=0x7f756c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.473+0000 7f758f696700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f756c06ace0 0x7f756c06d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7584014000 tx=0x7f7584007000 comp rx=0 tx=0).stop 2023-07-21T07:35:09.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.473+0000 7f758f696700 1 -- 172.21.15.6:0/2407252794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7574006a60 msgr2=0x7f75881e62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.473+0000 7f758f696700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7574006a60 0x7f75881e62a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f75780116f0 tx=0x7f7578011ab0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.473+0000 7f758f696700 1 -- 172.21.15.6:0/2407252794 shutdown_connections 2023-07-21T07:35:09.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.473+0000 7f758f696700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f756c06ace0 0x7f756c06d1a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.473+0000 7f758f696700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75881e3090 0x7f758814d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.473+0000 7f758f696700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7574006a60 0x7f75881e62a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.473+0000 7f758f696700 1 --2- 172.21.15.6:0/2407252794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f758814add0 0x7f75881e2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.473+0000 7f758f696700 1 -- 172.21.15.6:0/2407252794 >> 172.21.15.6:0/2407252794 conn(0x7f758806a090 msgr2=0x7f7588152dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:09.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.473+0000 7f758f696700 1 -- 172.21.15.6:0/2407252794 shutdown_connections 2023-07-21T07:35:09.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.473+0000 7f758f696700 1 -- 172.21.15.6:0/2407252794 wait complete. 2023-07-21T07:35:09.538 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:34:38.107491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:34:39.423138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:35:09.538 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:35:09.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.614+0000 7f04cbd06700 1 Processor -- start 2023-07-21T07:35:09.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.615+0000 7f04cbd06700 1 -- start start 2023-07-21T07:35:09.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.615+0000 7f04cbd06700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04c40c1860 0x7f04c4151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.615+0000 7f04cbd06700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04c40c3f80 0x7f04c40c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.615+0000 7f04cbd06700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c41517c0 con 0x7f04c40c5260 2023-07-21T07:35:09.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.615+0000 7f04cbd06700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c40c4e50 con 0x7f04c40c3f80 2023-07-21T07:35:09.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.615+0000 7f04cbd06700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c41519f0 con 0x7f04c40c1860 2023-07-21T07:35:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.615+0000 7f04ca2a3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04c40c3f80 0x7f04c40c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.615+0000 7f04ca2a3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04c40c3f80 0x7f04c40c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33510/0 (socket says 172.21.15.6:33510) 2023-07-21T07:35:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.615+0000 7f04ca2a3700 1 -- 172.21.15.6:0/2052551166 learned_addr learned my addr 172.21.15.6:0/2052551166 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.616+0000 7f04c9aa2700 1 --2- 172.21.15.6:0/2052551166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04c40c1860 0x7f04c4151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.616+0000 7f04ca2a3700 1 -- 172.21.15.6:0/2052551166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04c40c1860 msgr2=0x7f04c4151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.616+0000 7f04ca2a3700 1 --2- 172.21.15.6:0/2052551166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04c40c1860 0x7f04c4151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.616+0000 7f04ca2a3700 1 -- 172.21.15.6:0/2052551166 >> v1:172.21.15.86:6789/0 conn(0x7f04c40c5260 legacy=0x7f04c406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:09.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.616+0000 7f04ca2a3700 1 -- 172.21.15.6:0/2052551166 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4151cd0 con 0x7f04c40c3f80 2023-07-21T07:35:09.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.616+0000 7f04c9aa2700 1 --2- 172.21.15.6:0/2052551166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04c40c1860 0x7f04c4151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:09.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.616+0000 7f04ca2a3700 1 --2- 172.21.15.6:0/2052551166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c40c3f80 0x7f04c40c3420 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00d150 tx=0x7f04bc00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6513eb23e916d2af server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:09.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.616+0000 7f04c8aa0700 1 -- 172.21.15.6:0/2052551166 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc010070 con 0x7f04c40c3f80 2023-07-21T07:35:09.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.616+0000 7f04c8aa0700 1 -- 172.21.15.6:0/2052551166 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc00dd80 con 0x7f04c40c3f80 2023-07-21T07:35:09.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.616+0000 7f04c8aa0700 1 -- 172.21.15.6:0/2052551166 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00b310 con 0x7f04c40c3f80 2023-07-21T07:35:09.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.617+0000 7f04cbd06700 1 -- 172.21.15.6:0/2052551166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c40c3f80 msgr2=0x7f04c40c3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.617+0000 7f04cbd06700 1 --2- 172.21.15.6:0/2052551166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c40c3f80 0x7f04c40c3420 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00d150 tx=0x7f04bc00d460 comp rx=0 tx=0).stop 2023-07-21T07:35:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.617+0000 7f04cbd06700 1 -- 172.21.15.6:0/2052551166 shutdown_connections 2023-07-21T07:35:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.617+0000 7f04cbd06700 1 --2- 172.21.15.6:0/2052551166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c40c3f80 0x7f04c40c3420 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.617+0000 7f04cbd06700 1 --2- 172.21.15.6:0/2052551166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04c40c1860 0x7f04c4151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.617+0000 7f04cbd06700 1 -- 172.21.15.6:0/2052551166 >> 172.21.15.6:0/2052551166 conn(0x7f04c40a8660 msgr2=0x7f04c40a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.617+0000 7f04cbd06700 1 -- 172.21.15.6:0/2052551166 shutdown_connections 2023-07-21T07:35:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.617+0000 7f04cbd06700 1 -- 172.21.15.6:0/2052551166 wait complete. 2023-07-21T07:35:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.618+0000 7f04cbd06700 1 Processor -- start 2023-07-21T07:35:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.618+0000 7f04cbd06700 1 -- start start 2023-07-21T07:35:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.618+0000 7f04cbd06700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04c40c1860 0x7f04c40bfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.618+0000 7f04cbd06700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c40c3f80 0x7f04c40beab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04cbd06700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c40c5260 0x7f04c414a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04cbd06700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40bf2e0 con 0x7f04c40c3f80 2023-07-21T07:35:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04cbd06700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40bdd30 con 0x7f04c40c5260 2023-07-21T07:35:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04cbd06700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40c3790 con 0x7f04c40c1860 2023-07-21T07:35:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04c92a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c40c3f80 0x7f04c40beab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04c92a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c40c3f80 0x7f04c40beab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33514/0 (socket says 172.21.15.6:33514) 2023-07-21T07:35:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04c9aa2700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04c40c1860 0x7f04c40bfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04c92a1700 1 -- 172.21.15.6:0/1756607005 learned_addr learned my addr 172.21.15.6:0/1756607005 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04ca2a3700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c40c5260 0x7f04c414a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04c92a1700 1 -- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04c40c1860 msgr2=0x7f04c40bfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04c92a1700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04c40c1860 0x7f04c40bfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04c92a1700 1 -- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c40c5260 msgr2=0x7f04c414a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04c92a1700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c40c5260 0x7f04c414a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04c92a1700 1 -- 172.21.15.6:0/1756607005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc00bd40 con 0x7f04c40c3f80 2023-07-21T07:35:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04c92a1700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c40c3f80 0x7f04c40beab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f04c000b480 tx=0x7f04c000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04ba7fc700 1 -- 172.21.15.6:0/1756607005 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0011830 con 0x7f04c40c3f80 2023-07-21T07:35:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04ba7fc700 1 -- 172.21.15.6:0/1756607005 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c0011990 con 0x7f04c40c3f80 2023-07-21T07:35:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04ba7fc700 1 -- 172.21.15.6:0/1756607005 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0011d40 con 0x7f04c40c3f80 2023-07-21T07:35:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04cbd06700 1 -- 172.21.15.6:0/1756607005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c40c0710 con 0x7f04c40c3f80 2023-07-21T07:35:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.619+0000 7f04cbd06700 1 -- 172.21.15.6:0/1756607005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c40c09d0 con 0x7f04c40c3f80 2023-07-21T07:35:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.620+0000 7f04cbd06700 1 -- 172.21.15.6:0/1756607005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c4074500 con 0x7f04c40c3f80 2023-07-21T07:35:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.621+0000 7f04ba7fc700 1 -- 172.21.15.6:0/1756607005 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f04c001a400 con 0x7f04c40c3f80 2023-07-21T07:35:09.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.621+0000 7f04ba7fc700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f04a806ace0 0x7f04a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:09.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.621+0000 7f04ba7fc700 1 -- 172.21.15.6:0/1756607005 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f04c0089050 con 0x7f04c40c3f80 2023-07-21T07:35:09.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.622+0000 7f04c9aa2700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f04a806ace0 0x7f04a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:09.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.622+0000 7f04c9aa2700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f04a806ace0 0x7f04a806d1a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04b4006fd0 tx=0x7f04b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:09.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.626+0000 7f04ba7fc700 1 -- 172.21.15.6:0/1756607005 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f04c0054190 con 0x7f04c40c3f80 2023-07-21T07:35:09.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.820+0000 7f04cbd06700 1 -- 172.21.15.6:0/1756607005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04c40c49b0 con 0x7f04c40c3f80 2023-07-21T07:35:09.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.820+0000 7f04ba7fc700 1 -- 172.21.15.6:0/1756607005 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04c00577b0 con 0x7f04c40c3f80 2023-07-21T07:35:09.873 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:35:09.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.822+0000 7f04cbd06700 1 -- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f04a806ace0 msgr2=0x7f04a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.822+0000 7f04cbd06700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f04a806ace0 0x7f04a806d1a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04b4006fd0 tx=0x7f04b4008040 comp rx=0 tx=0).stop 2023-07-21T07:35:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.822+0000 7f04cbd06700 1 -- 172.21.15.6:0/1756607005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c40c3f80 msgr2=0x7f04c40beab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.822+0000 7f04cbd06700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c40c3f80 0x7f04c40beab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f04c000b480 tx=0x7f04c000b790 comp rx=0 tx=0).stop 2023-07-21T07:35:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.822+0000 7f04cbd06700 1 -- 172.21.15.6:0/1756607005 shutdown_connections 2023-07-21T07:35:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.822+0000 7f04cbd06700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f04a806ace0 0x7f04a806d1a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.822+0000 7f04cbd06700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04c40c5260 0x7f04c414a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.822+0000 7f04cbd06700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04c40c1860 0x7f04c40bfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.822+0000 7f04cbd06700 1 --2- 172.21.15.6:0/1756607005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c40c3f80 0x7f04c40beab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:09.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.822+0000 7f04cbd06700 1 -- 172.21.15.6:0/1756607005 >> 172.21.15.6:0/1756607005 conn(0x7f04c40a8660 msgr2=0x7f04c40a7690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:09.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.822+0000 7f04cbd06700 1 -- 172.21.15.6:0/1756607005 shutdown_connections 2023-07-21T07:35:09.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.822+0000 7f04cbd06700 1 -- 172.21.15.6:0/1756607005 wait complete. 2023-07-21T07:35:09.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:35:10.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.963+0000 7f9a6fea8700 1 Processor -- start 2023-07-21T07:35:10.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.964+0000 7f9a6fea8700 1 -- start start 2023-07-21T07:35:10.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.964+0000 7f9a6fea8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a6806a300 0x7f9a681519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.964+0000 7f9a6fea8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a6806d8a0 0x7f9a68151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.964+0000 7f9a6fea8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a68155530 con 0x7f9a680ba140 2023-07-21T07:35:10.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.964+0000 7f9a6fea8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a680c1a30 con 0x7f9a6806d8a0 2023-07-21T07:35:10.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.964+0000 7f9a6fea8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68154920 con 0x7f9a6806a300 2023-07-21T07:35:10.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.964+0000 7f9a6e445700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a6806d8a0 0x7f9a68151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.964+0000 7f9a6d443700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9a680ba140 0x7f9a680c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41542/0 (socket says 172.21.15.6:41542) 2023-07-21T07:35:10.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.964+0000 7f9a6d443700 1 -- 172.21.15.6:0/3886961285 learned_addr learned my addr 172.21.15.6:0/3886961285 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:10.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.965+0000 7f9a6dc44700 1 --2- 172.21.15.6:0/3886961285 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a6806a300 0x7f9a681519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.965+0000 7f9a6e445700 1 -- 172.21.15.6:0/3886961285 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a6806a300 msgr2=0x7f9a681519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:10.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.965+0000 7f9a6e445700 1 --2- 172.21.15.6:0/3886961285 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a6806a300 0x7f9a681519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.965+0000 7f9a6e445700 1 -- 172.21.15.6:0/3886961285 >> v1:172.21.15.6:6789/0 conn(0x7f9a680ba140 legacy=0x7f9a680c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.965+0000 7f9a6e445700 1 -- 172.21.15.6:0/3886961285 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68154c00 con 0x7f9a6806d8a0 2023-07-21T07:35:10.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.965+0000 7f9a6cc42700 1 -- 172.21.15.6:0/3886961285 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219968502 0 0) 0x7f9a68155530 con 0x7f9a680ba140 2023-07-21T07:35:10.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.965+0000 7f9a6e445700 1 --2- 172.21.15.6:0/3886961285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6806d8a0 0x7f9a68151ef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009d90 tx=0x7f9a6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4f97b429a60607 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:10.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.965+0000 7f9a6cc42700 1 -- 172.21.15.6:0/3886961285 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000e070 con 0x7f9a6806d8a0 2023-07-21T07:35:10.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.965+0000 7f9a6cc42700 1 -- 172.21.15.6:0/3886961285 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6000bbd0 con 0x7f9a6806d8a0 2023-07-21T07:35:10.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.965+0000 7f9a6cc42700 1 -- 172.21.15.6:0/3886961285 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60012430 con 0x7f9a6806d8a0 2023-07-21T07:35:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.966+0000 7f9a6fea8700 1 -- 172.21.15.6:0/3886961285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6806d8a0 msgr2=0x7f9a68151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.966+0000 7f9a6fea8700 1 --2- 172.21.15.6:0/3886961285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6806d8a0 0x7f9a68151ef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009d90 tx=0x7f9a6000b330 comp rx=0 tx=0).stop 2023-07-21T07:35:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.966+0000 7f9a6fea8700 1 -- 172.21.15.6:0/3886961285 shutdown_connections 2023-07-21T07:35:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.966+0000 7f9a6fea8700 1 --2- 172.21.15.6:0/3886961285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6806d8a0 0x7f9a68151ef0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.966+0000 7f9a6fea8700 1 --2- 172.21.15.6:0/3886961285 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a6806a300 0x7f9a681519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.966+0000 7f9a6fea8700 1 -- 172.21.15.6:0/3886961285 >> 172.21.15.6:0/3886961285 conn(0x7f9a680a8660 msgr2=0x7f9a680a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:10.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.966+0000 7f9a6fea8700 1 -- 172.21.15.6:0/3886961285 shutdown_connections 2023-07-21T07:35:10.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.966+0000 7f9a6fea8700 1 -- 172.21.15.6:0/3886961285 wait complete. 2023-07-21T07:35:10.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.967+0000 7f9a6fea8700 1 Processor -- start 2023-07-21T07:35:10.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.967+0000 7f9a6fea8700 1 -- start start 2023-07-21T07:35:10.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6fea8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a6806a300 0x7f9a68153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6fea8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6806d8a0 0x7f9a6814be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6fea8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a680ba140 0x7f9a68070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6fea8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68154710 con 0x7f9a6806d8a0 2023-07-21T07:35:10.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6fea8700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68152e70 con 0x7f9a6806a300 2023-07-21T07:35:10.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6fea8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68153a60 con 0x7f9a680ba140 2023-07-21T07:35:10.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6d443700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6806d8a0 0x7f9a6814be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6d443700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6806d8a0 0x7f9a6814be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33528/0 (socket says 172.21.15.6:33528) 2023-07-21T07:35:10.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6dc44700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a6806a300 0x7f9a68153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6d443700 1 -- 172.21.15.6:0/2243651204 learned_addr learned my addr 172.21.15.6:0/2243651204 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:10.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6e445700 1 --2- 172.21.15.6:0/2243651204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a680ba140 0x7f9a68070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6d443700 1 -- 172.21.15.6:0/2243651204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a680ba140 msgr2=0x7f9a68070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6d443700 1 --2- 172.21.15.6:0/2243651204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a680ba140 0x7f9a68070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6d443700 1 -- 172.21.15.6:0/2243651204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a6806a300 msgr2=0x7f9a68153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6d443700 1 --2- 172.21.15.6:0/2243651204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a6806a300 0x7f9a68153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6d443700 1 -- 172.21.15.6:0/2243651204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a60009a70 con 0x7f9a6806d8a0 2023-07-21T07:35:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6d443700 1 --2- 172.21.15.6:0/2243651204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6806d8a0 0x7f9a6814be90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9a640011e0 tx=0x7f9a6400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a5e7fc700 1 -- 172.21.15.6:0/2243651204 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a64004c80 con 0x7f9a6806d8a0 2023-07-21T07:35:10.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a5e7fc700 1 -- 172.21.15.6:0/2243651204 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a64004e00 con 0x7f9a6806d8a0 2023-07-21T07:35:10.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.968+0000 7f9a6fea8700 1 -- 172.21.15.6:0/2243651204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a680a8400 con 0x7f9a6806d8a0 2023-07-21T07:35:10.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.969+0000 7f9a5e7fc700 1 -- 172.21.15.6:0/2243651204 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a64007310 con 0x7f9a6806d8a0 2023-07-21T07:35:10.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.969+0000 7f9a6fea8700 1 -- 172.21.15.6:0/2243651204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a680a8120 con 0x7f9a6806d8a0 2023-07-21T07:35:10.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.969+0000 7f9a6fea8700 1 -- 172.21.15.6:0/2243651204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a68153220 con 0x7f9a6806d8a0 2023-07-21T07:35:10.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.970+0000 7f9a5e7fc700 1 -- 172.21.15.6:0/2243651204 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a64007470 con 0x7f9a6806d8a0 2023-07-21T07:35:10.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.970+0000 7f9a5e7fc700 1 --2- 172.21.15.6:0/2243651204 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9a4c06ace0 0x7f9a4c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.970+0000 7f9a5e7fc700 1 -- 172.21.15.6:0/2243651204 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a64088f10 con 0x7f9a6806d8a0 2023-07-21T07:35:10.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.970+0000 7f9a6dc44700 1 --2- 172.21.15.6:0/2243651204 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9a4c06ace0 0x7f9a4c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.971+0000 7f9a6dc44700 1 --2- 172.21.15.6:0/2243651204 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9a4c06ace0 0x7f9a4c06d1a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9a58006fd0 tx=0x7f9a58008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:10.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:09.975+0000 7f9a5e7fc700 1 -- 172.21.15.6:0/2243651204 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9a64053fb0 con 0x7f9a6806d8a0 2023-07-21T07:35:10.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.170+0000 7f9a6fea8700 1 -- 172.21.15.6:0/2243651204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9a680c52c0 con 0x7f9a6806d8a0 2023-07-21T07:35:10.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.170+0000 7f9a5e7fc700 1 -- 172.21.15.6:0/2243651204 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9a640575d0 con 0x7f9a6806d8a0 2023-07-21T07:35:10.224 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:35:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.172+0000 7f9a6fea8700 1 -- 172.21.15.6:0/2243651204 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9a4c06ace0 msgr2=0x7f9a4c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.172+0000 7f9a6fea8700 1 --2- 172.21.15.6:0/2243651204 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9a4c06ace0 0x7f9a4c06d1a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9a58006fd0 tx=0x7f9a58008040 comp rx=0 tx=0).stop 2023-07-21T07:35:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.172+0000 7f9a6fea8700 1 -- 172.21.15.6:0/2243651204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6806d8a0 msgr2=0x7f9a6814be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.172+0000 7f9a6fea8700 1 --2- 172.21.15.6:0/2243651204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6806d8a0 0x7f9a6814be90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9a640011e0 tx=0x7f9a6400ca30 comp rx=0 tx=0).stop 2023-07-21T07:35:10.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.172+0000 7f9a6fea8700 1 -- 172.21.15.6:0/2243651204 shutdown_connections 2023-07-21T07:35:10.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.172+0000 7f9a6fea8700 1 --2- 172.21.15.6:0/2243651204 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9a4c06ace0 0x7f9a4c06d1a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.172+0000 7f9a6fea8700 1 --2- 172.21.15.6:0/2243651204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a680ba140 0x7f9a68070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.172+0000 7f9a6fea8700 1 --2- 172.21.15.6:0/2243651204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a6806a300 0x7f9a68153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.172+0000 7f9a6fea8700 1 --2- 172.21.15.6:0/2243651204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6806d8a0 0x7f9a6814be90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.172+0000 7f9a6fea8700 1 -- 172.21.15.6:0/2243651204 >> 172.21.15.6:0/2243651204 conn(0x7f9a680a8660 msgr2=0x7f9a680c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:10.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.172+0000 7f9a6fea8700 1 -- 172.21.15.6:0/2243651204 shutdown_connections 2023-07-21T07:35:10.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.173+0000 7f9a6fea8700 1 -- 172.21.15.6:0/2243651204 wait complete. 2023-07-21T07:35:10.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:35:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.312+0000 7fce73d22700 1 Processor -- start 2023-07-21T07:35:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.312+0000 7fce73d22700 1 -- start start 2023-07-21T07:35:10.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.313+0000 7fce73d22700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce6c06a300 0x7fce6c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.313+0000 7fce73d22700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fce6c0ba140 0x7fce6c151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.313+0000 7fce73d22700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6c155530 con 0x7fce6c06d8a0 2023-07-21T07:35:10.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.313+0000 7fce73d22700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6c0c1a30 con 0x7fce6c06a300 2023-07-21T07:35:10.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.313+0000 7fce73d22700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6c154920 con 0x7fce6c0ba140 2023-07-21T07:35:10.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.313+0000 7fce71abe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce6c06a300 0x7fce6c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.313+0000 7fce71abe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce6c06a300 0x7fce6c1519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33534/0 (socket says 172.21.15.6:33534) 2023-07-21T07:35:10.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.313+0000 7fce71abe700 1 -- 172.21.15.6:0/1045071736 learned_addr learned my addr 172.21.15.6:0/1045071736 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:10.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.314+0000 7fce712bd700 1 --2- 172.21.15.6:0/1045071736 >> v2:172.21.15.86:3300/0 conn(0x7fce6c0ba140 0x7fce6c151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.314+0000 7fce71abe700 1 -- 172.21.15.6:0/1045071736 >> v2:172.21.15.86:3300/0 conn(0x7fce6c0ba140 msgr2=0x7fce6c151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:10.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.314+0000 7fce71abe700 1 --2- 172.21.15.6:0/1045071736 >> v2:172.21.15.86:3300/0 conn(0x7fce6c0ba140 0x7fce6c151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.314+0000 7fce71abe700 1 -- 172.21.15.6:0/1045071736 >> v1:172.21.15.86:6789/0 conn(0x7fce6c06d8a0 legacy=0x7fce6c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.314+0000 7fce71abe700 1 -- 172.21.15.6:0/1045071736 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c154c00 con 0x7fce6c06a300 2023-07-21T07:35:10.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.314+0000 7fce71abe700 1 --2- 172.21.15.6:0/1045071736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce6c06a300 0x7fce6c1519b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0c1f00 tx=0x7fce5c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef3c168ee717469 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.314+0000 7fce70abc700 1 -- 172.21.15.6:0/1045071736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c00b870 con 0x7fce6c06a300 2023-07-21T07:35:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.314+0000 7fce70abc700 1 -- 172.21.15.6:0/1045071736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c00b9d0 con 0x7fce6c06a300 2023-07-21T07:35:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.314+0000 7fce70abc700 1 -- 172.21.15.6:0/1045071736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c00bd60 con 0x7fce6c06a300 2023-07-21T07:35:10.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.314+0000 7fce73d22700 1 -- 172.21.15.6:0/1045071736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce6c06a300 msgr2=0x7fce6c1519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.314+0000 7fce73d22700 1 --2- 172.21.15.6:0/1045071736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce6c06a300 0x7fce6c1519b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0c1f00 tx=0x7fce5c009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.315+0000 7fce73d22700 1 -- 172.21.15.6:0/1045071736 shutdown_connections 2023-07-21T07:35:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.315+0000 7fce73d22700 1 --2- 172.21.15.6:0/1045071736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce6c06a300 0x7fce6c1519b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.315+0000 7fce73d22700 1 --2- 172.21.15.6:0/1045071736 >> v2:172.21.15.86:3300/0 conn(0x7fce6c0ba140 0x7fce6c151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.315+0000 7fce73d22700 1 -- 172.21.15.6:0/1045071736 >> 172.21.15.6:0/1045071736 conn(0x7fce6c0a8660 msgr2=0x7fce6c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.315+0000 7fce73d22700 1 -- 172.21.15.6:0/1045071736 shutdown_connections 2023-07-21T07:35:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.315+0000 7fce73d22700 1 -- 172.21.15.6:0/1045071736 wait complete. 2023-07-21T07:35:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.316+0000 7fce73d22700 1 Processor -- start 2023-07-21T07:35:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.316+0000 7fce73d22700 1 -- start start 2023-07-21T07:35:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.316+0000 7fce73d22700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce6c06a300 0x7fce6c070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.316+0000 7fce73d22700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce6c06d8a0 0x7fce6c158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.316+0000 7fce73d22700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce6c0ba140 0x7fce6c150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.316+0000 7fce73d22700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c0be470 con 0x7fce6c06d8a0 2023-07-21T07:35:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.316+0000 7fce73d22700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c1ed270 con 0x7fce6c06a300 2023-07-21T07:35:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.316+0000 7fce73d22700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c0be6c0 con 0x7fce6c0ba140 2023-07-21T07:35:10.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce712bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce6c06d8a0 0x7fce6c158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce712bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce6c06d8a0 0x7fce6c158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33540/0 (socket says 172.21.15.6:33540) 2023-07-21T07:35:10.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce712bd700 1 -- 172.21.15.6:0/3190181808 learned_addr learned my addr 172.21.15.6:0/3190181808 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:10.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce71abe700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce6c06a300 0x7fce6c070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce722bf700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce6c0ba140 0x7fce6c150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce712bd700 1 -- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce6c0ba140 msgr2=0x7fce6c150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce712bd700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce6c0ba140 0x7fce6c150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce712bd700 1 -- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce6c06a300 msgr2=0x7fce6c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce712bd700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce6c06a300 0x7fce6c070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce712bd700 1 -- 172.21.15.6:0/3190181808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c009550 con 0x7fce6c06d8a0 2023-07-21T07:35:10.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce712bd700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce6c06d8a0 0x7fce6c158330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fce6800e810 tx=0x7fce6800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:10.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce627fc700 1 -- 172.21.15.6:0/3190181808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6800c070 con 0x7fce6c06d8a0 2023-07-21T07:35:10.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce627fc700 1 -- 172.21.15.6:0/3190181808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce68013610 con 0x7fce6c06d8a0 2023-07-21T07:35:10.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce627fc700 1 -- 172.21.15.6:0/3190181808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce680139c0 con 0x7fce6c06d8a0 2023-07-21T07:35:10.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce73d22700 1 -- 172.21.15.6:0/3190181808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6c0be9a0 con 0x7fce6c06d8a0 2023-07-21T07:35:10.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.317+0000 7fce73d22700 1 -- 172.21.15.6:0/3190181808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6c1512a0 con 0x7fce6c06d8a0 2023-07-21T07:35:10.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.318+0000 7fce73d22700 1 -- 172.21.15.6:0/3190181808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6c1ed700 con 0x7fce6c06d8a0 2023-07-21T07:35:10.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.319+0000 7fce627fc700 1 -- 172.21.15.6:0/3190181808 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fce68013b20 con 0x7fce6c06d8a0 2023-07-21T07:35:10.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.319+0000 7fce627fc700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fce5006ad10 0x7fce5006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.319+0000 7fce627fc700 1 -- 172.21.15.6:0/3190181808 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fce68088ea0 con 0x7fce6c06d8a0 2023-07-21T07:35:10.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.319+0000 7fce71abe700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fce5006ad10 0x7fce5006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.320+0000 7fce71abe700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fce5006ad10 0x7fce5006d1d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fce5c014040 tx=0x7fce5c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:10.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.323+0000 7fce627fc700 1 -- 172.21.15.6:0/3190181808 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fce6c1ed700 con 0x7fce6c06d8a0 2023-07-21T07:35:10.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.520+0000 7fce73d22700 1 -- 172.21.15.6:0/3190181808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce6c1ed700 con 0x7fce6c06d8a0 2023-07-21T07:35:10.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.520+0000 7fce627fc700 1 -- 172.21.15.6:0/3190181808 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce6c1ed700 con 0x7fce6c06d8a0 2023-07-21T07:35:10.573 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:35:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.522+0000 7fce73d22700 1 -- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fce5006ad10 msgr2=0x7fce5006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.522+0000 7fce73d22700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fce5006ad10 0x7fce5006d1d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fce5c014040 tx=0x7fce5c008030 comp rx=0 tx=0).stop 2023-07-21T07:35:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.522+0000 7fce73d22700 1 -- 172.21.15.6:0/3190181808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce6c06d8a0 msgr2=0x7fce6c158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.522+0000 7fce73d22700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce6c06d8a0 0x7fce6c158330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fce6800e810 tx=0x7fce6800eb20 comp rx=0 tx=0).stop 2023-07-21T07:35:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.522+0000 7fce73d22700 1 -- 172.21.15.6:0/3190181808 shutdown_connections 2023-07-21T07:35:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.522+0000 7fce73d22700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fce5006ad10 0x7fce5006d1d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.522+0000 7fce73d22700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce6c0ba140 0x7fce6c150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.522+0000 7fce73d22700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce6c06a300 0x7fce6c070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.522+0000 7fce73d22700 1 --2- 172.21.15.6:0/3190181808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce6c06d8a0 0x7fce6c158330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.522+0000 7fce73d22700 1 -- 172.21.15.6:0/3190181808 >> 172.21.15.6:0/3190181808 conn(0x7fce6c0a8660 msgr2=0x7fce6c14d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.522+0000 7fce73d22700 1 -- 172.21.15.6:0/3190181808 shutdown_connections 2023-07-21T07:35:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.522+0000 7fce73d22700 1 -- 172.21.15.6:0/3190181808 wait complete. 2023-07-21T07:35:10.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:35:10.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.662+0000 7f2da8905700 1 Processor -- start 2023-07-21T07:35:10.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.662+0000 7f2da8905700 1 -- start start 2023-07-21T07:35:10.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.663+0000 7f2da8905700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2da41518d0 0x7f2da4151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.663+0000 7f2da8905700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da40c1540 con 0x7f2da41547a0 2023-07-21T07:35:10.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.663+0000 7f2da8905700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da4065e30 con 0x7f2da406a090 2023-07-21T07:35:10.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.663+0000 7f2da8905700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da40c26b0 con 0x7f2da41518d0 2023-07-21T07:35:10.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.663+0000 7f2da259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2da41547a0 0x7f2da40c19d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41566/0 (socket says 172.21.15.6:41566) 2023-07-21T07:35:10.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.663+0000 7f2da259c700 1 -- 172.21.15.6:0/2517464041 learned_addr learned my addr 172.21.15.6:0/2517464041 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:10.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.663+0000 7f2da2d9d700 1 --2- 172.21.15.6:0/2517464041 >> v2:172.21.15.86:3300/0 conn(0x7f2da41518d0 0x7f2da4151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.663+0000 7f2da159a700 1 -- 172.21.15.6:0/2517464041 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035934228 0 0) 0x7f2da40c1540 con 0x7f2da41547a0 2023-07-21T07:35:10.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.663+0000 7f2da159a700 1 -- 172.21.15.6:0/2517464041 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d8c0035b0 con 0x7f2da41547a0 2023-07-21T07:35:10.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.664+0000 7f2da159a700 1 -- 172.21.15.6:0/2517464041 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063859981 0 0) 0x7f2da4065e30 con 0x7f2da406a090 2023-07-21T07:35:10.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.664+0000 7f2da159a700 1 -- 172.21.15.6:0/2517464041 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da40c1540 con 0x7f2da406a090 2023-07-21T07:35:10.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.664+0000 7f2da2d9d700 1 -- 172.21.15.6:0/2517464041 >> v1:172.21.15.86:6789/0 conn(0x7f2da406a090 legacy=0x7f2da40bfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.664+0000 7f2da2d9d700 1 -- 172.21.15.6:0/2517464041 >> v1:172.21.15.6:6789/0 conn(0x7f2da41547a0 legacy=0x7f2da40c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.664+0000 7f2da2d9d700 1 -- 172.21.15.6:0/2517464041 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da4066110 con 0x7f2da41518d0 2023-07-21T07:35:10.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.664+0000 7f2da2d9d700 1 --2- 172.21.15.6:0/2517464041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2da41518d0 0x7f2da4151ce0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009d90 tx=0x7f2d9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e72fe9195824eb80 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:10.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.664+0000 7f2da159a700 1 -- 172.21.15.6:0/2517464041 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c00e070 con 0x7f2da41518d0 2023-07-21T07:35:10.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.664+0000 7f2da159a700 1 -- 172.21.15.6:0/2517464041 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c00bb20 con 0x7f2da41518d0 2023-07-21T07:35:10.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.664+0000 7f2da159a700 1 -- 172.21.15.6:0/2517464041 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c00be90 con 0x7f2da41518d0 2023-07-21T07:35:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.665+0000 7f2da8905700 1 -- 172.21.15.6:0/2517464041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2da41518d0 msgr2=0x7f2da4151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.665+0000 7f2da8905700 1 --2- 172.21.15.6:0/2517464041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2da41518d0 0x7f2da4151ce0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009d90 tx=0x7f2d9c00b330 comp rx=0 tx=0).stop 2023-07-21T07:35:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.665+0000 7f2da8905700 1 -- 172.21.15.6:0/2517464041 shutdown_connections 2023-07-21T07:35:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.665+0000 7f2da8905700 1 --2- 172.21.15.6:0/2517464041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2da41518d0 0x7f2da4151ce0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.665+0000 7f2da8905700 1 -- 172.21.15.6:0/2517464041 >> 172.21.15.6:0/2517464041 conn(0x7f2da40c2c20 msgr2=0x7f2da40c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.665+0000 7f2da8905700 1 -- 172.21.15.6:0/2517464041 shutdown_connections 2023-07-21T07:35:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.665+0000 7f2da8905700 1 -- 172.21.15.6:0/2517464041 wait complete. 2023-07-21T07:35:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.666+0000 7f2da8905700 1 Processor -- start 2023-07-21T07:35:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.666+0000 7f2da8905700 1 -- start start 2023-07-21T07:35:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da8905700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2da406a090 0x7f2da41eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da8905700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2da41518d0 0x7f2da41ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da8905700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da41547a0 0x7f2da4144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da8905700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da41ea820 con 0x7f2da406a090 2023-07-21T07:35:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da8905700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da41527d0 con 0x7f2da41518d0 2023-07-21T07:35:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da8905700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da40c4040 con 0x7f2da41547a0 2023-07-21T07:35:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2da406a090 0x7f2da41eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2da406a090 0x7f2da41eacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33552/0 (socket says 172.21.15.6:33552) 2023-07-21T07:35:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da259c700 1 -- 172.21.15.6:0/2798181287 learned_addr learned my addr 172.21.15.6:0/2798181287 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da1d9b700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2da41518d0 0x7f2da41ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da2d9d700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da41547a0 0x7f2da4144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da259c700 1 -- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da41547a0 msgr2=0x7f2da4144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da259c700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da41547a0 0x7f2da4144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da259c700 1 -- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2da41518d0 msgr2=0x7f2da41ea2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da259c700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2da41518d0 0x7f2da41ea2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da259c700 1 -- 172.21.15.6:0/2798181287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c009a70 con 0x7f2da406a090 2023-07-21T07:35:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da2d9d700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da41547a0 0x7f2da4144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da259c700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2da406a090 0x7f2da41eacd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800c700 tx=0x7f2d9800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2798181287 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98005d70 con 0x7f2da406a090 2023-07-21T07:35:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2798181287 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d980070d0 con 0x7f2da406a090 2023-07-21T07:35:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2798181287 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98007460 con 0x7f2da406a090 2023-07-21T07:35:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.667+0000 7f2da8905700 1 -- 172.21.15.6:0/2798181287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da40c4320 con 0x7f2da406a090 2023-07-21T07:35:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.668+0000 7f2da8905700 1 -- 172.21.15.6:0/2798181287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da40c48e0 con 0x7f2da406a090 2023-07-21T07:35:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.668+0000 7f2da8905700 1 -- 172.21.15.6:0/2798181287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da4073aa0 con 0x7f2da406a090 2023-07-21T07:35:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.669+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2798181287 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d980075c0 con 0x7f2da406a090 2023-07-21T07:35:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.669+0000 7f2d92ffd700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2d8406ace0 0x7f2d8406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:10.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.670+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2798181287 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d98088980 con 0x7f2da406a090 2023-07-21T07:35:10.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.670+0000 7f2da1d9b700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2d8406ace0 0x7f2d8406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:10.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.670+0000 7f2da1d9b700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2d8406ace0 0x7f2d8406d1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2da414d1c0 tx=0x7f2d94009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:10.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.674+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2798181287 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2da4073aa0 con 0x7f2da406a090 2023-07-21T07:35:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.869+0000 7f2da8905700 1 -- 172.21.15.6:0/2798181287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2da4073aa0 con 0x7f2da406a090 2023-07-21T07:35:10.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.870+0000 7f2d92ffd700 1 -- 172.21.15.6:0/2798181287 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2da4073aa0 con 0x7f2da406a090 2023-07-21T07:35:10.922 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:35:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.872+0000 7f2da8905700 1 -- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2d8406ace0 msgr2=0x7f2d8406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.872+0000 7f2da8905700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2d8406ace0 0x7f2d8406d1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2da414d1c0 tx=0x7f2d94009040 comp rx=0 tx=0).stop 2023-07-21T07:35:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.872+0000 7f2da8905700 1 -- 172.21.15.6:0/2798181287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2da406a090 msgr2=0x7f2da41eacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.872+0000 7f2da8905700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2da406a090 0x7f2da41eacd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800c700 tx=0x7f2d9800ca10 comp rx=0 tx=0).stop 2023-07-21T07:35:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.872+0000 7f2da8905700 1 -- 172.21.15.6:0/2798181287 shutdown_connections 2023-07-21T07:35:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.872+0000 7f2da8905700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2d8406ace0 0x7f2d8406d1a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.872+0000 7f2da8905700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da41547a0 0x7f2da4144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.872+0000 7f2da8905700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2da406a090 0x7f2da41eacd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.872+0000 7f2da8905700 1 --2- 172.21.15.6:0/2798181287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2da41518d0 0x7f2da41ea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.872+0000 7f2da8905700 1 -- 172.21.15.6:0/2798181287 >> 172.21.15.6:0/2798181287 conn(0x7f2da40c2c20 msgr2=0x7f2da406a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.872+0000 7f2da8905700 1 -- 172.21.15.6:0/2798181287 shutdown_connections 2023-07-21T07:35:10.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:10.872+0000 7f2da8905700 1 -- 172.21.15.6:0/2798181287 wait complete. 2023-07-21T07:35:10.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T07:35:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.013+0000 7f160d841700 1 Processor -- start 2023-07-21T07:35:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.013+0000 7f160d841700 1 -- start start 2023-07-21T07:35:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f160d841700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f16080aafe0 0x7f160815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f160d841700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1608066050 con 0x7f160814c580 2023-07-21T07:35:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f160d841700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160814c960 con 0x7f16080abd40 2023-07-21T07:35:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f160d841700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1608066580 con 0x7f16080aafe0 2023-07-21T07:35:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f1606ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f160814c580 0x7f16080c2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41580/0 (socket says 172.21.15.6:41580) 2023-07-21T07:35:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f1606ffd700 1 -- 172.21.15.6:0/2819480870 learned_addr learned my addr 172.21.15.6:0/2819480870 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f16077fe700 1 --2- 172.21.15.6:0/2819480870 >> v2:172.21.15.86:3300/0 conn(0x7f16080aafe0 0x7f160815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307077945 0 0) 0x7f1608066050 con 0x7f160814c580 2023-07-21T07:35:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f00035b0 con 0x7f160814c580 2023-07-21T07:35:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3713840044 0 0) 0x7f15f00035b0 con 0x7f160814c580 2023-07-21T07:35:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 >> v2:172.21.15.86:3300/0 conn(0x7f16080aafe0 msgr2=0x7f160815dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f1605ffb700 1 --2- 172.21.15.6:0/2819480870 >> v2:172.21.15.86:3300/0 conn(0x7f16080aafe0 0x7f160815dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 >> v1:172.21.15.86:6789/0 conn(0x7f16080abd40 legacy=0x7f16080aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16080ac1f0 con 0x7f160814c580 2023-07-21T07:35:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f15f8001670 con 0x7f160814c580 2023-07-21T07:35:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 >> v1:172.21.15.6:6789/0 conn(0x7f160814c580 legacy=0x7f16080c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.014+0000 7f1605ffb700 1 --2- 172.21.15.6:0/2819480870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15f0003a00 0x7f15f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f1605ffb700 1 --2- 172.21.15.6:0/2819480870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15f0004400 0x7f15f00048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f1605ffb700 1 --2- 172.21.15.6:0/2819480870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f0005170 0x7f15f000fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1608066580 con 0x7f15f0005170 2023-07-21T07:35:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00104c0 con 0x7f15f0004400 2023-07-21T07:35:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f0007a70 con 0x7f15f0003a00 2023-07-21T07:35:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f16077fe700 1 --2- 172.21.15.6:0/2819480870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f0005170 0x7f15f000fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f1606ffd700 1 --2- 172.21.15.6:0/2819480870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15f0003a00 0x7f15f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f16067fc700 1 --2- 172.21.15.6:0/2819480870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15f0004400 0x7f15f00048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f16077fe700 1 -- 172.21.15.6:0/2819480870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15f0003a00 msgr2=0x7f15f0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f16077fe700 1 --2- 172.21.15.6:0/2819480870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15f0003a00 0x7f15f0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f16077fe700 1 -- 172.21.15.6:0/2819480870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15f0004400 msgr2=0x7f15f00048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f16077fe700 1 --2- 172.21.15.6:0/2819480870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15f0004400 0x7f15f00048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f16077fe700 1 -- 172.21.15.6:0/2819480870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00035b0 con 0x7f15f0005170 2023-07-21T07:35:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f16077fe700 1 -- 172.21.15.6:0/2819480870 reap_dead start 2023-07-21T07:35:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f16077fe700 1 --2- 172.21.15.6:0/2819480870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f0005170 0x7f15f000fe20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1600009fc0 tx=0x7f15f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed45136d6eec6bab server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600003a20 con 0x7f15f0005170 2023-07-21T07:35:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160000f040 con 0x7f15f0005170 2023-07-21T07:35:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.015+0000 7f1605ffb700 1 -- 172.21.15.6:0/2819480870 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600003de0 con 0x7f15f0005170 2023-07-21T07:35:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.016+0000 7f160d841700 1 -- 172.21.15.6:0/2819480870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f0005170 msgr2=0x7f15f000fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.016+0000 7f160d841700 1 --2- 172.21.15.6:0/2819480870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f0005170 0x7f15f000fe20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1600009fc0 tx=0x7f15f0005880 comp rx=0 tx=0).stop 2023-07-21T07:35:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.016+0000 7f160d841700 1 -- 172.21.15.6:0/2819480870 shutdown_connections 2023-07-21T07:35:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.016+0000 7f160d841700 1 --2- 172.21.15.6:0/2819480870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f0005170 0x7f15f000fe20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.016+0000 7f160d841700 1 -- 172.21.15.6:0/2819480870 >> 172.21.15.6:0/2819480870 conn(0x7f16080c2c20 msgr2=0x7f16080c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.016+0000 7f160d841700 1 -- 172.21.15.6:0/2819480870 shutdown_connections 2023-07-21T07:35:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.016+0000 7f160d841700 1 -- 172.21.15.6:0/2819480870 wait complete. 2023-07-21T07:35:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.017+0000 7f160d841700 1 Processor -- start 2023-07-21T07:35:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.017+0000 7f160d841700 1 -- start start 2023-07-21T07:35:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f160d841700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15f0005170 0x7f1608144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f160d841700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160814bad0 0x7f1608149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f160d841700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f160806fd30 0x7f16081451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f160d841700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1608152f50 con 0x7f160814bad0 2023-07-21T07:35:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f160d841700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16081448a0 con 0x7f160806fd30 2023-07-21T07:35:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f160d841700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1608071830 con 0x7f15f0005170 2023-07-21T07:35:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f16067fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160814bad0 0x7f1608149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f16067fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160814bad0 0x7f1608149da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33574/0 (socket says 172.21.15.6:33574) 2023-07-21T07:35:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f16067fc700 1 -- 172.21.15.6:0/3109680256 learned_addr learned my addr 172.21.15.6:0/3109680256 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f16077fe700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f160806fd30 0x7f16081451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f1606ffd700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15f0005170 0x7f1608144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f16067fc700 1 -- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15f0005170 msgr2=0x7f1608144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f16067fc700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15f0005170 0x7f1608144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f16067fc700 1 -- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f160806fd30 msgr2=0x7f16081451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f16067fc700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f160806fd30 0x7f16081451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.018+0000 7f16067fc700 1 -- 172.21.15.6:0/3109680256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1608071b10 con 0x7f160814bad0 2023-07-21T07:35:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.019+0000 7f16067fc700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160814bad0 0x7f1608149da0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00f780 tx=0x7f15fc00fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.019+0000 7f15effff700 1 -- 172.21.15.6:0/3109680256 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0052e0 con 0x7f160814bad0 2023-07-21T07:35:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.019+0000 7f15effff700 1 -- 172.21.15.6:0/3109680256 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc005460 con 0x7f160814bad0 2023-07-21T07:35:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.019+0000 7f160d841700 1 -- 172.21.15.6:0/3109680256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1608143880 con 0x7f160814bad0 2023-07-21T07:35:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.019+0000 7f15effff700 1 -- 172.21.15.6:0/3109680256 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0038c0 con 0x7f160814bad0 2023-07-21T07:35:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.019+0000 7f160d841700 1 -- 172.21.15.6:0/3109680256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1608143e40 con 0x7f160814bad0 2023-07-21T07:35:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.020+0000 7f160d841700 1 -- 172.21.15.6:0/3109680256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160804e470 con 0x7f160814bad0 2023-07-21T07:35:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.020+0000 7f15effff700 1 -- 172.21.15.6:0/3109680256 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15fc003a20 con 0x7f160814bad0 2023-07-21T07:35:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.020+0000 7f15effff700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f15f406ad10 0x7f15f406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.021+0000 7f15effff700 1 -- 172.21.15.6:0/3109680256 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15fc0892d0 con 0x7f160814bad0 2023-07-21T07:35:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.021+0000 7f1606ffd700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f15f406ad10 0x7f15f406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.021+0000 7f1606ffd700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f15f406ad10 0x7f15f406d1d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f15f8000c00 tx=0x7f15f8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.025+0000 7f15effff700 1 -- 172.21.15.6:0/3109680256 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f15fc054390 con 0x7f160814bad0 2023-07-21T07:35:11.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.224+0000 7f160d841700 1 -- 172.21.15.6:0/3109680256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1608066270 con 0x7f160814bad0 2023-07-21T07:35:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.228+0000 7f15effff700 1 -- 172.21.15.6:0/3109680256 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f15fc0579b0 con 0x7f160814bad0 2023-07-21T07:35:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.230+0000 7f160d841700 1 -- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f15f406ad10 msgr2=0x7f15f406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.230+0000 7f160d841700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f15f406ad10 0x7f15f406d1d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f15f8000c00 tx=0x7f15f8009040 comp rx=0 tx=0).stop 2023-07-21T07:35:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.230+0000 7f160d841700 1 -- 172.21.15.6:0/3109680256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160814bad0 msgr2=0x7f1608149da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.230+0000 7f160d841700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160814bad0 0x7f1608149da0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00f780 tx=0x7f15fc00fb40 comp rx=0 tx=0).stop 2023-07-21T07:35:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.230+0000 7f160d841700 1 -- 172.21.15.6:0/3109680256 shutdown_connections 2023-07-21T07:35:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.230+0000 7f160d841700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f15f406ad10 0x7f15f406d1d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.230+0000 7f160d841700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f160806fd30 0x7f16081451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.230+0000 7f160d841700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15f0005170 0x7f1608144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.230+0000 7f160d841700 1 --2- 172.21.15.6:0/3109680256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160814bad0 0x7f1608149da0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.230+0000 7f160d841700 1 -- 172.21.15.6:0/3109680256 >> 172.21.15.6:0/3109680256 conn(0x7f16080c2c20 msgr2=0x7f1608152270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.230+0000 7f160d841700 1 -- 172.21.15.6:0/3109680256 shutdown_connections 2023-07-21T07:35:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.230+0000 7f160d841700 1 -- 172.21.15.6:0/3109680256 wait complete. 2023-07-21T07:35:11.294 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T07:35:11.295 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T07:35:11.338 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T07:35:11.384 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T07:35:11.385 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:35:11.385 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:11.402 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:35:11.403 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:11.459 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:35:11.460 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:11.517 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.629+0000 7f49ebff8700 1 Processor -- start 2023-07-21T07:35:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.629+0000 7f49ebff8700 1 -- start start 2023-07-21T07:35:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.630+0000 7f49ebff8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f49e40c1510 0x7f49e406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.630+0000 7f49ebff8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e4152030 con 0x7f49e406d6b0 2023-07-21T07:35:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.630+0000 7f49ebff8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e40c4c50 con 0x7f49e40c3310 2023-07-21T07:35:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.630+0000 7f49ebff8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e40c4a40 con 0x7f49e40c1510 2023-07-21T07:35:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.630+0000 7f49ea595700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f49e406d6b0 0x7f49e415bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41604/0 (socket says 172.21.15.6:41604) 2023-07-21T07:35:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.630+0000 7f49ea595700 1 -- 172.21.15.6:0/67775190 learned_addr learned my addr 172.21.15.6:0/67775190 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.631+0000 7f49e9593700 1 --2- 172.21.15.6:0/67775190 >> v2:172.21.15.86:3300/0 conn(0x7f49e40c1510 0x7f49e406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.631+0000 7f49e8d92700 1 -- 172.21.15.6:0/67775190 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024376358 0 0) 0x7f49e4152030 con 0x7f49e406d6b0 2023-07-21T07:35:11.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.631+0000 7f49e8d92700 1 -- 172.21.15.6:0/67775190 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d00035b0 con 0x7f49e406d6b0 2023-07-21T07:35:11.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.631+0000 7f49e9593700 1 -- 172.21.15.6:0/67775190 >> v1:172.21.15.86:6789/0 conn(0x7f49e40c3310 legacy=0x7f49e40c36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.631+0000 7f49e9593700 1 -- 172.21.15.6:0/67775190 >> v1:172.21.15.6:6789/0 conn(0x7f49e406d6b0 legacy=0x7f49e415bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.631+0000 7f49e8d92700 1 -- 172.21.15.6:0/67775190 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2001225766 0 0) 0x7f49d00035b0 con 0x7f49e406d6b0 2023-07-21T07:35:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.631+0000 7f49e9593700 1 -- 172.21.15.6:0/67775190 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e40c4f30 con 0x7f49e40c1510 2023-07-21T07:35:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.631+0000 7f49e9593700 1 --2- 172.21.15.6:0/67775190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49e40c1510 0x7f49e406d170 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009840 tx=0x7f49d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3303c7f72e6bea06 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.631+0000 7f49e8d92700 1 -- 172.21.15.6:0/67775190 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0019f0 con 0x7f49e40c1510 2023-07-21T07:35:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.631+0000 7f49e8d92700 1 -- 172.21.15.6:0/67775190 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d8004030 con 0x7f49e40c1510 2023-07-21T07:35:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.631+0000 7f49e8d92700 1 -- 172.21.15.6:0/67775190 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d80043a0 con 0x7f49e40c1510 2023-07-21T07:35:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.632+0000 7f49ebff8700 1 -- 172.21.15.6:0/67775190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49e40c1510 msgr2=0x7f49e406d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.632+0000 7f49ebff8700 1 --2- 172.21.15.6:0/67775190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49e40c1510 0x7f49e406d170 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009840 tx=0x7f49d8009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:11.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.632+0000 7f49ebff8700 1 -- 172.21.15.6:0/67775190 shutdown_connections 2023-07-21T07:35:11.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.632+0000 7f49ebff8700 1 --2- 172.21.15.6:0/67775190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49e40c1510 0x7f49e406d170 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.632+0000 7f49ebff8700 1 -- 172.21.15.6:0/67775190 >> 172.21.15.6:0/67775190 conn(0x7f49e40a8510 msgr2=0x7f49e40a88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.632+0000 7f49ebff8700 1 -- 172.21.15.6:0/67775190 shutdown_connections 2023-07-21T07:35:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.632+0000 7f49ebff8700 1 -- 172.21.15.6:0/67775190 wait complete. 2023-07-21T07:35:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.633+0000 7f49ebff8700 1 Processor -- start 2023-07-21T07:35:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.633+0000 7f49ebff8700 1 -- start start 2023-07-21T07:35:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ebff8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49e406d6b0 0x7f49e41e7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ebff8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49e40c1510 0x7f49e40bf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ebff8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e40c3310 0x7f49e4154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ebff8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40bf9b0 con 0x7f49e40c3310 2023-07-21T07:35:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ebff8700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40c70f0 con 0x7f49e406d6b0 2023-07-21T07:35:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ebff8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40c64e0 con 0x7f49e40c1510 2023-07-21T07:35:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ea595700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e40c3310 0x7f49e4154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ea595700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e40c3310 0x7f49e4154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33590/0 (socket says 172.21.15.6:33590) 2023-07-21T07:35:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ea595700 1 -- 172.21.15.6:0/3266696889 learned_addr learned my addr 172.21.15.6:0/3266696889 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49e9d94700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49e406d6b0 0x7f49e41e7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49e9593700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49e40c1510 0x7f49e40bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ea595700 1 -- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49e40c1510 msgr2=0x7f49e40bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ea595700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49e40c1510 0x7f49e40bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ea595700 1 -- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49e406d6b0 msgr2=0x7f49e41e7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ea595700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49e406d6b0 0x7f49e41e7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49ea595700 1 -- 172.21.15.6:0/3266696889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d80094a0 con 0x7f49e40c3310 2023-07-21T07:35:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.634+0000 7f49e9593700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49e40c1510 0x7f49e40bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.635+0000 7f49ea595700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e40c3310 0x7f49e4154bb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f49dc001ba0 tx=0x7f49dc00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.635+0000 7f49d67fc700 1 -- 172.21.15.6:0/3266696889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc00ab70 con 0x7f49e40c3310 2023-07-21T07:35:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.635+0000 7f49d67fc700 1 -- 172.21.15.6:0/3266696889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc00acd0 con 0x7f49e40c3310 2023-07-21T07:35:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.635+0000 7f49ebff8700 1 -- 172.21.15.6:0/3266696889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e40c67c0 con 0x7f49e40c3310 2023-07-21T07:35:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.635+0000 7f49d67fc700 1 -- 172.21.15.6:0/3266696889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc007310 con 0x7f49e40c3310 2023-07-21T07:35:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.635+0000 7f49ebff8700 1 -- 172.21.15.6:0/3266696889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e40c6d80 con 0x7f49e40c3310 2023-07-21T07:35:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.636+0000 7f49ebff8700 1 -- 172.21.15.6:0/3266696889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e40bf740 con 0x7f49e40c3310 2023-07-21T07:35:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.636+0000 7f49d67fc700 1 -- 172.21.15.6:0/3266696889 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49dc007470 con 0x7f49e40c3310 2023-07-21T07:35:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.637+0000 7f49d67fc700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f49c806ace0 0x7f49c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.637+0000 7f49d67fc700 1 -- 172.21.15.6:0/3266696889 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49dc0892f0 con 0x7f49e40c3310 2023-07-21T07:35:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.637+0000 7f49e9d94700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f49c806ace0 0x7f49c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.637+0000 7f49e9d94700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f49c806ace0 0x7f49c806d1a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f49e0007fd0 tx=0x7f49e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.641+0000 7f49d67fc700 1 -- 172.21.15.6:0/3266696889 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49e40bf740 con 0x7f49e40c3310 2023-07-21T07:35:11.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.838+0000 7f49ebff8700 1 -- 172.21.15.6:0/3266696889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49e40bf740 con 0x7f49e40c3310 2023-07-21T07:35:11.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.839+0000 7f49d67fc700 1 -- 172.21.15.6:0/3266696889 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f49e40bf740 con 0x7f49e40c3310 2023-07-21T07:35:11.892 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:11.892 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:11.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.841+0000 7f49ebff8700 1 -- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f49c806ace0 msgr2=0x7f49c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.841+0000 7f49ebff8700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f49c806ace0 0x7f49c806d1a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f49e0007fd0 tx=0x7f49e0009040 comp rx=0 tx=0).stop 2023-07-21T07:35:11.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.841+0000 7f49ebff8700 1 -- 172.21.15.6:0/3266696889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e40c3310 msgr2=0x7f49e4154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:11.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.841+0000 7f49ebff8700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e40c3310 0x7f49e4154bb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f49dc001ba0 tx=0x7f49dc00cf50 comp rx=0 tx=0).stop 2023-07-21T07:35:11.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.841+0000 7f49ebff8700 1 -- 172.21.15.6:0/3266696889 shutdown_connections 2023-07-21T07:35:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.841+0000 7f49ebff8700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f49c806ace0 0x7f49c806d1a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.841+0000 7f49ebff8700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e40c3310 0x7f49e4154bb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.841+0000 7f49ebff8700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49e406d6b0 0x7f49e41e7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.841+0000 7f49ebff8700 1 --2- 172.21.15.6:0/3266696889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49e40c1510 0x7f49e40bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.841+0000 7f49ebff8700 1 -- 172.21.15.6:0/3266696889 >> 172.21.15.6:0/3266696889 conn(0x7f49e40a8510 msgr2=0x7f49e40a6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.842+0000 7f49ebff8700 1 -- 172.21.15.6:0/3266696889 shutdown_connections 2023-07-21T07:35:11.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.842+0000 7f49ebff8700 1 -- 172.21.15.6:0/3266696889 wait complete. 2023-07-21T07:35:11.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:34:38.107491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:34:39.423138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:35:11.907 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:35:12.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.982+0000 7f41db6d3700 1 Processor -- start 2023-07-21T07:35:12.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.983+0000 7f41db6d3700 1 -- start start 2023-07-21T07:35:12.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41db6d3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41d406d680 0x7f41d41561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41db6d3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41d414f4b0 0x7f41d414f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41db6d3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d4155d20 con 0x7f41d40abee0 2023-07-21T07:35:12.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41db6d3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d40c5de0 con 0x7f41d406d680 2023-07-21T07:35:12.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41db6d3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d406db00 con 0x7f41d414f4b0 2023-07-21T07:35:12.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41d9c70700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41d414f4b0 0x7f41d414f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41d8c6e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41d406d680 0x7f41d41561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41d946f700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f41d40abee0 0x7f41d4152da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:44856/0 (socket says 172.21.15.6:44856) 2023-07-21T07:35:12.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41d9c70700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41d414f4b0 0x7f41d414f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:59224/0 (socket says 172.21.15.6:59224) 2023-07-21T07:35:12.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41d946f700 1 -- 172.21.15.6:0/3244717820 learned_addr learned my addr 172.21.15.6:0/3244717820 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:12.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41d9c70700 1 -- 172.21.15.6:0/3244717820 >> v2:172.21.15.86:3300/0 conn(0x7f41d406d680 msgr2=0x7f41d41561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:12.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41d9c70700 1 --2- 172.21.15.6:0/3244717820 >> v2:172.21.15.86:3300/0 conn(0x7f41d406d680 0x7f41d41561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41d9c70700 1 -- 172.21.15.6:0/3244717820 >> v1:172.21.15.86:6789/0 conn(0x7f41d40abee0 legacy=0x7f41d4152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41d9c70700 1 -- 172.21.15.6:0/3244717820 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d40c4ce0 con 0x7f41d414f4b0 2023-07-21T07:35:12.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41c7fff700 1 -- 172.21.15.6:0/3244717820 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533191186 0 0) 0x7f41d4155d20 con 0x7f41d40abee0 2023-07-21T07:35:12.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.984+0000 7f41d8c6e700 1 --2- 172.21.15.6:0/3244717820 >> v2:172.21.15.86:3300/0 conn(0x7f41d406d680 0x7f41d41561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:12.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.985+0000 7f41d9c70700 1 --2- 172.21.15.6:0/3244717820 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41d414f4b0 0x7f41d414f940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009d90 tx=0x7f41cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7cbd39eae38f6ce server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:12.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.985+0000 7f41c7fff700 1 -- 172.21.15.6:0/3244717820 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00e070 con 0x7f41d414f4b0 2023-07-21T07:35:12.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.985+0000 7f41c7fff700 1 -- 172.21.15.6:0/3244717820 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc00bb20 con 0x7f41d414f4b0 2023-07-21T07:35:12.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.985+0000 7f41c7fff700 1 -- 172.21.15.6:0/3244717820 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc012430 con 0x7f41d414f4b0 2023-07-21T07:35:12.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.985+0000 7f41db6d3700 1 -- 172.21.15.6:0/3244717820 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41d414f4b0 msgr2=0x7f41d414f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.985+0000 7f41db6d3700 1 --2- 172.21.15.6:0/3244717820 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41d414f4b0 0x7f41d414f940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009d90 tx=0x7f41cc00b330 comp rx=0 tx=0).stop 2023-07-21T07:35:12.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.985+0000 7f41db6d3700 1 -- 172.21.15.6:0/3244717820 shutdown_connections 2023-07-21T07:35:12.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.985+0000 7f41db6d3700 1 --2- 172.21.15.6:0/3244717820 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41d414f4b0 0x7f41d414f940 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.985+0000 7f41db6d3700 1 --2- 172.21.15.6:0/3244717820 >> v2:172.21.15.86:3300/0 conn(0x7f41d406d680 0x7f41d41561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.985+0000 7f41db6d3700 1 -- 172.21.15.6:0/3244717820 >> 172.21.15.6:0/3244717820 conn(0x7f41d40a8660 msgr2=0x7f41d40a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.985+0000 7f41db6d3700 1 -- 172.21.15.6:0/3244717820 shutdown_connections 2023-07-21T07:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.985+0000 7f41db6d3700 1 -- 172.21.15.6:0/3244717820 wait complete. 2023-07-21T07:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.987+0000 7f41db6d3700 1 Processor -- start 2023-07-21T07:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.987+0000 7f41db6d3700 1 -- start start 2023-07-21T07:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.987+0000 7f41db6d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d406d680 0x7f41d40be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.987+0000 7f41db6d3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41d40abee0 0x7f41d41e87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.987+0000 7f41db6d3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41d414f4b0 0x7f41d414a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.987+0000 7f41db6d3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40bf370 con 0x7f41d406d680 2023-07-21T07:35:12.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.987+0000 7f41db6d3700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40bf0d0 con 0x7f41d414f4b0 2023-07-21T07:35:12.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.987+0000 7f41db6d3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d41e7510 con 0x7f41d40abee0 2023-07-21T07:35:12.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.987+0000 7f41d946f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d406d680 0x7f41d40be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.987+0000 7f41d946f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d406d680 0x7f41d40be890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33600/0 (socket says 172.21.15.6:33600) 2023-07-21T07:35:12.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41d946f700 1 -- 172.21.15.6:0/648229071 learned_addr learned my addr 172.21.15.6:0/648229071 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:12.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41d8c6e700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41d40abee0 0x7f41d41e87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41d9c70700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41d414f4b0 0x7f41d414a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41d946f700 1 -- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41d40abee0 msgr2=0x7f41d41e87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41d946f700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41d40abee0 0x7f41d41e87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41d946f700 1 -- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41d414f4b0 msgr2=0x7f41d414a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41d946f700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41d414f4b0 0x7f41d414a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41d946f700 1 -- 172.21.15.6:0/648229071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c80094a0 con 0x7f41d406d680 2023-07-21T07:35:12.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41d946f700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d406d680 0x7f41d40be890 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f41d000c520 tx=0x7f41d000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41c5ffb700 1 -- 172.21.15.6:0/648229071 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0004c80 con 0x7f41d406d680 2023-07-21T07:35:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41c5ffb700 1 -- 172.21.15.6:0/648229071 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d0004e00 con 0x7f41d406d680 2023-07-21T07:35:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41db6d3700 1 -- 172.21.15.6:0/648229071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc009a70 con 0x7f41d406d680 2023-07-21T07:35:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41c5ffb700 1 -- 172.21.15.6:0/648229071 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0007310 con 0x7f41d406d680 2023-07-21T07:35:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.988+0000 7f41db6d3700 1 -- 172.21.15.6:0/648229071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d41e7ad0 con 0x7f41d406d680 2023-07-21T07:35:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.989+0000 7f41db6d3700 1 -- 172.21.15.6:0/648229071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d41e7370 con 0x7f41d406d680 2023-07-21T07:35:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.990+0000 7f41c5ffb700 1 -- 172.21.15.6:0/648229071 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41d0007470 con 0x7f41d406d680 2023-07-21T07:35:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.990+0000 7f41c5ffb700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f41b806ace0 0x7f41b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.990+0000 7f41c5ffb700 1 -- 172.21.15.6:0/648229071 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f41d0089070 con 0x7f41d406d680 2023-07-21T07:35:12.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.990+0000 7f41d8c6e700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f41b806ace0 0x7f41b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.991+0000 7f41d8c6e700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f41b806ace0 0x7f41b806d1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f41d40ba1d0 tx=0x7f41c8009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:12.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:11.994+0000 7f41c5ffb700 1 -- 172.21.15.6:0/648229071 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f41d41e7370 con 0x7f41d406d680 2023-07-21T07:35:12.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.191+0000 7f41db6d3700 1 -- 172.21.15.6:0/648229071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41d41e7370 con 0x7f41d406d680 2023-07-21T07:35:12.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.192+0000 7f41c5ffb700 1 -- 172.21.15.6:0/648229071 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41d41e7370 con 0x7f41d406d680 2023-07-21T07:35:12.245 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:35:12.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.194+0000 7f41db6d3700 1 -- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f41b806ace0 msgr2=0x7f41b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.194+0000 7f41db6d3700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f41b806ace0 0x7f41b806d1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f41d40ba1d0 tx=0x7f41c8009210 comp rx=0 tx=0).stop 2023-07-21T07:35:12.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.194+0000 7f41db6d3700 1 -- 172.21.15.6:0/648229071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d406d680 msgr2=0x7f41d40be890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.194+0000 7f41db6d3700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d406d680 0x7f41d40be890 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f41d000c520 tx=0x7f41d000c830 comp rx=0 tx=0).stop 2023-07-21T07:35:12.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.194+0000 7f41db6d3700 1 -- 172.21.15.6:0/648229071 shutdown_connections 2023-07-21T07:35:12.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.194+0000 7f41db6d3700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f41b806ace0 0x7f41b806d1a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.194+0000 7f41db6d3700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41d414f4b0 0x7f41d414a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.194+0000 7f41db6d3700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d406d680 0x7f41d40be890 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.194+0000 7f41db6d3700 1 --2- 172.21.15.6:0/648229071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41d40abee0 0x7f41d41e87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.194+0000 7f41db6d3700 1 -- 172.21.15.6:0/648229071 >> 172.21.15.6:0/648229071 conn(0x7f41d40a8660 msgr2=0x7f41d40a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:12.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.194+0000 7f41db6d3700 1 -- 172.21.15.6:0/648229071 shutdown_connections 2023-07-21T07:35:12.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.194+0000 7f41db6d3700 1 -- 172.21.15.6:0/648229071 wait complete. 2023-07-21T07:35:12.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:35:12.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.335+0000 7f9162be9700 1 Processor -- start 2023-07-21T07:35:12.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.335+0000 7f9162be9700 1 -- start start 2023-07-21T07:35:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.336+0000 7f9162be9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f915c06b4c0 0x7f915c0c1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.336+0000 7f9162be9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915c06bfb0 con 0x7f915c0c1a90 2023-07-21T07:35:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.336+0000 7f9162be9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915c06c250 con 0x7f915c0c0ac0 2023-07-21T07:35:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.336+0000 7f9162be9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f915c1517e0 con 0x7f915c06b4c0 2023-07-21T07:35:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.336+0000 7f9160985700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f915c06b4c0 0x7f915c0c1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.336+0000 7f9161186700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f915c0c1a90 0x7f915c15b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41630/0 (socket says 172.21.15.6:41630) 2023-07-21T07:35:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.336+0000 7f9161186700 1 -- 172.21.15.6:0/2847741815 learned_addr learned my addr 172.21.15.6:0/2847741815 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.337+0000 7f9160985700 1 -- 172.21.15.6:0/2847741815 >> v1:172.21.15.86:6789/0 conn(0x7f915c0c0ac0 legacy=0x7f915c14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.337+0000 7f9160985700 1 -- 172.21.15.6:0/2847741815 >> v1:172.21.15.6:6789/0 conn(0x7f915c0c1a90 legacy=0x7f915c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.337+0000 7f9160985700 1 -- 172.21.15.6:0/2847741815 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c1514d0 con 0x7f915c06b4c0 2023-07-21T07:35:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.337+0000 7f9160985700 1 --2- 172.21.15.6:0/2847741815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f915c06b4c0 0x7f915c0c1550 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f915000a9e0 tx=0x7f915000acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5f4276128e561c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.337+0000 7f915b7fe700 1 -- 172.21.15.6:0/2847741815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915000cb70 con 0x7f915c06b4c0 2023-07-21T07:35:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.337+0000 7f915b7fe700 1 -- 172.21.15.6:0/2847741815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915000ccd0 con 0x7f915c06b4c0 2023-07-21T07:35:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.337+0000 7f915b7fe700 1 -- 172.21.15.6:0/2847741815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150018620 con 0x7f915c06b4c0 2023-07-21T07:35:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.337+0000 7f9162be9700 1 -- 172.21.15.6:0/2847741815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f915c06b4c0 msgr2=0x7f915c0c1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.337+0000 7f9162be9700 1 --2- 172.21.15.6:0/2847741815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f915c06b4c0 0x7f915c0c1550 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f915000a9e0 tx=0x7f915000acf0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.338+0000 7f9162be9700 1 -- 172.21.15.6:0/2847741815 shutdown_connections 2023-07-21T07:35:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.338+0000 7f9162be9700 1 --2- 172.21.15.6:0/2847741815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f915c06b4c0 0x7f915c0c1550 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.338+0000 7f9162be9700 1 -- 172.21.15.6:0/2847741815 >> 172.21.15.6:0/2847741815 conn(0x7f915c0a7750 msgr2=0x7f915c0a7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.338+0000 7f9162be9700 1 -- 172.21.15.6:0/2847741815 shutdown_connections 2023-07-21T07:35:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.338+0000 7f9162be9700 1 -- 172.21.15.6:0/2847741815 wait complete. 2023-07-21T07:35:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.339+0000 7f9162be9700 1 Processor -- start 2023-07-21T07:35:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.339+0000 7f9162be9700 1 -- start start 2023-07-21T07:35:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f9162be9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f915c06b4c0 0x7f915c1d6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f9162be9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f915c0c0ac0 0x7f915c0c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f9162be9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f915c0c1a90 0x7f915c14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f9162be9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915c0a64f0 con 0x7f915c0c0ac0 2023-07-21T07:35:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f9162be9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915c1eda10 con 0x7f915c06b4c0 2023-07-21T07:35:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f9162be9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915c1edcf0 con 0x7f915c0c1a90 2023-07-21T07:35:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f915bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f915c0c0ac0 0x7f915c0c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f915bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f915c0c0ac0 0x7f915c0c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33614/0 (socket says 172.21.15.6:33614) 2023-07-21T07:35:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f915bfff700 1 -- 172.21.15.6:0/3541540098 learned_addr learned my addr 172.21.15.6:0/3541540098 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f9160985700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f915c06b4c0 0x7f915c1d6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f9161186700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f915c0c1a90 0x7f915c14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f915bfff700 1 -- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f915c0c1a90 msgr2=0x7f915c14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f915bfff700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f915c0c1a90 0x7f915c14ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f915bfff700 1 -- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f915c06b4c0 msgr2=0x7f915c1d6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f915bfff700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f915c06b4c0 0x7f915c1d6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f915bfff700 1 -- 172.21.15.6:0/3541540098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915000a640 con 0x7f915c0c0ac0 2023-07-21T07:35:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f9161186700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f915c0c1a90 0x7f915c14ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f915bfff700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f915c0c0ac0 0x7f915c0c5b50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f914800c4b0 tx=0x7f914800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f91597fa700 1 -- 172.21.15.6:0/3541540098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91480052d0 con 0x7f915c0c0ac0 2023-07-21T07:35:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f91597fa700 1 -- 172.21.15.6:0/3541540098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9148005430 con 0x7f915c0c0ac0 2023-07-21T07:35:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f9162be9700 1 -- 172.21.15.6:0/3541540098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915c0c0800 con 0x7f915c0c0ac0 2023-07-21T07:35:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f91597fa700 1 -- 172.21.15.6:0/3541540098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91480038c0 con 0x7f915c0c0ac0 2023-07-21T07:35:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.340+0000 7f9162be9700 1 -- 172.21.15.6:0/3541540098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915c0c6090 con 0x7f915c0c0ac0 2023-07-21T07:35:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.342+0000 7f9162be9700 1 -- 172.21.15.6:0/3541540098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915c1edf30 con 0x7f915c0c0ac0 2023-07-21T07:35:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.342+0000 7f91597fa700 1 -- 172.21.15.6:0/3541540098 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9148003a20 con 0x7f915c0c0ac0 2023-07-21T07:35:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.342+0000 7f91597fa700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f914006ace0 0x7f914006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.342+0000 7f91597fa700 1 -- 172.21.15.6:0/3541540098 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91480887f0 con 0x7f915c0c0ac0 2023-07-21T07:35:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.342+0000 7f9160985700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f914006ace0 0x7f914006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.343+0000 7f9160985700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f914006ace0 0x7f914006d1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f915000a1c0 tx=0x7f9150012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.346+0000 7f91597fa700 1 -- 172.21.15.6:0/3541540098 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9148053930 con 0x7f915c0c0ac0 2023-07-21T07:35:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.544+0000 7f9162be9700 1 -- 172.21.15.6:0/3541540098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f915c074500 con 0x7f915c0c0ac0 2023-07-21T07:35:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.544+0000 7f91597fa700 1 -- 172.21.15.6:0/3541540098 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9148056f50 con 0x7f915c0c0ac0 2023-07-21T07:35:12.597 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:35:12.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.546+0000 7f9162be9700 1 -- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f914006ace0 msgr2=0x7f914006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.546+0000 7f9162be9700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f914006ace0 0x7f914006d1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f915000a1c0 tx=0x7f9150012000 comp rx=0 tx=0).stop 2023-07-21T07:35:12.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.546+0000 7f9162be9700 1 -- 172.21.15.6:0/3541540098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f915c0c0ac0 msgr2=0x7f915c0c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.546+0000 7f9162be9700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f915c0c0ac0 0x7f915c0c5b50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f914800c4b0 tx=0x7f914800c7c0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.546+0000 7f9162be9700 1 -- 172.21.15.6:0/3541540098 shutdown_connections 2023-07-21T07:35:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.546+0000 7f9162be9700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f914006ace0 0x7f914006d1a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.546+0000 7f9162be9700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f915c0c1a90 0x7f915c14ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.546+0000 7f9162be9700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f915c06b4c0 0x7f915c1d6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.546+0000 7f9162be9700 1 --2- 172.21.15.6:0/3541540098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f915c0c0ac0 0x7f915c0c5b50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.546+0000 7f9162be9700 1 -- 172.21.15.6:0/3541540098 >> 172.21.15.6:0/3541540098 conn(0x7f915c0a7750 msgr2=0x7f915c0a7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:12.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.546+0000 7f9162be9700 1 -- 172.21.15.6:0/3541540098 shutdown_connections 2023-07-21T07:35:12.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.546+0000 7f9162be9700 1 -- 172.21.15.6:0/3541540098 wait complete. 2023-07-21T07:35:12.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:35:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.687+0000 7f35aae92700 1 Processor -- start 2023-07-21T07:35:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.687+0000 7f35aae92700 1 -- start start 2023-07-21T07:35:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35aae92700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35a414c580 0x7f35a40abd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35aae92700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35a40c2260 0x7f35a40aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35aae92700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f35a40aae10 0x7f35a40ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35aae92700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a4066580 con 0x7f35a414c580 2023-07-21T07:35:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35aae92700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a4152f50 con 0x7f35a40aae10 2023-07-21T07:35:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35aae92700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40a9ac0 con 0x7f35a40c2260 2023-07-21T07:35:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35a8c2e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35a414c580 0x7f35a40abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35a8c2e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35a414c580 0x7f35a40abd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33620/0 (socket says 172.21.15.6:33620) 2023-07-21T07:35:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35a8c2e700 1 -- 172.21.15.6:0/3506228303 learned_addr learned my addr 172.21.15.6:0/3506228303 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35a942f700 1 --2- 172.21.15.6:0/3506228303 >> v2:172.21.15.86:3300/0 conn(0x7f35a40aae10 0x7f35a40ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35a3fff700 1 --2- 172.21.15.6:0/3506228303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35a40c2260 0x7f35a40aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35a8c2e700 1 -- 172.21.15.6:0/3506228303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35a40c2260 msgr2=0x7f35a40aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35a8c2e700 1 --2- 172.21.15.6:0/3506228303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35a40c2260 0x7f35a40aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35a8c2e700 1 -- 172.21.15.6:0/3506228303 >> v2:172.21.15.86:3300/0 conn(0x7f35a40aae10 msgr2=0x7f35a40ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35a8c2e700 1 --2- 172.21.15.6:0/3506228303 >> v2:172.21.15.86:3300/0 conn(0x7f35a40aae10 0x7f35a40ab2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.688+0000 7f35a8c2e700 1 -- 172.21.15.6:0/3506228303 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40ac280 con 0x7f35a414c580 2023-07-21T07:35:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.689+0000 7f35a8c2e700 1 --2- 172.21.15.6:0/3506228303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a414c580 0x7f35a40abd40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f35a406ba60 tx=0x7f3598009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93a7799761cea0f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.689+0000 7f35a37fe700 1 -- 172.21.15.6:0/3506228303 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800b870 con 0x7f35a414c580 2023-07-21T07:35:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.689+0000 7f35a37fe700 1 -- 172.21.15.6:0/3506228303 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800b9d0 con 0x7f35a414c580 2023-07-21T07:35:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.689+0000 7f35a37fe700 1 -- 172.21.15.6:0/3506228303 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800bd60 con 0x7f35a414c580 2023-07-21T07:35:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.689+0000 7f35aae92700 1 -- 172.21.15.6:0/3506228303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a414c580 msgr2=0x7f35a40abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.689+0000 7f35aae92700 1 --2- 172.21.15.6:0/3506228303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a414c580 0x7f35a40abd40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f35a406ba60 tx=0x7f3598009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.689+0000 7f35aae92700 1 -- 172.21.15.6:0/3506228303 shutdown_connections 2023-07-21T07:35:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.689+0000 7f35aae92700 1 --2- 172.21.15.6:0/3506228303 >> v2:172.21.15.86:3300/0 conn(0x7f35a40aae10 0x7f35a40ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.689+0000 7f35aae92700 1 --2- 172.21.15.6:0/3506228303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a414c580 0x7f35a40abd40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.689+0000 7f35aae92700 1 --2- 172.21.15.6:0/3506228303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35a40c2260 0x7f35a40aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.689+0000 7f35aae92700 1 -- 172.21.15.6:0/3506228303 >> 172.21.15.6:0/3506228303 conn(0x7f35a40c2c20 msgr2=0x7f35a40c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.689+0000 7f35aae92700 1 -- 172.21.15.6:0/3506228303 shutdown_connections 2023-07-21T07:35:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.689+0000 7f35aae92700 1 -- 172.21.15.6:0/3506228303 wait complete. 2023-07-21T07:35:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.691+0000 7f35aae92700 1 Processor -- start 2023-07-21T07:35:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.691+0000 7f35aae92700 1 -- start start 2023-07-21T07:35:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.691+0000 7f35aae92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a40aae10 0x7f35a40bf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.691+0000 7f35aae92700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35a40c2260 0x7f35a41ecd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35aae92700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35a414c580 0x7f35a41ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35aae92700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4070d40 con 0x7f35a40aae10 2023-07-21T07:35:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35aae92700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40c4c30 con 0x7f35a40c2260 2023-07-21T07:35:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35aae92700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4071160 con 0x7f35a414c580 2023-07-21T07:35:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a8c2e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a40aae10 0x7f35a40bf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a8c2e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a40aae10 0x7f35a40bf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33626/0 (socket says 172.21.15.6:33626) 2023-07-21T07:35:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a8c2e700 1 -- 172.21.15.6:0/2139532681 learned_addr learned my addr 172.21.15.6:0/2139532681 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a3fff700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35a40c2260 0x7f35a41ecd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a942f700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35a414c580 0x7f35a41ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a8c2e700 1 -- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35a414c580 msgr2=0x7f35a41ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a8c2e700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35a414c580 0x7f35a41ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a8c2e700 1 -- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35a40c2260 msgr2=0x7f35a41ecd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a8c2e700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35a40c2260 0x7f35a41ecd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a8c2e700 1 -- 172.21.15.6:0/2139532681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009550 con 0x7f35a40aae10 2023-07-21T07:35:12.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a8c2e700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a40aae10 0x7f35a40bf690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3598014040 tx=0x7f3598004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:12.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a17fa700 1 -- 172.21.15.6:0/2139532681 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980129c0 con 0x7f35a40aae10 2023-07-21T07:35:12.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a17fa700 1 -- 172.21.15.6:0/2139532681 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359801e070 con 0x7f35a40aae10 2023-07-21T07:35:12.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35aae92700 1 -- 172.21.15.6:0/2139532681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a40c4950 con 0x7f35a40aae10 2023-07-21T07:35:12.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35a17fa700 1 -- 172.21.15.6:0/2139532681 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598012d80 con 0x7f35a40aae10 2023-07-21T07:35:12.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.692+0000 7f35aae92700 1 -- 172.21.15.6:0/2139532681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a4070960 con 0x7f35a40aae10 2023-07-21T07:35:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.693+0000 7f35aae92700 1 -- 172.21.15.6:0/2139532681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a4070e80 con 0x7f35a40aae10 2023-07-21T07:35:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.694+0000 7f35a17fa700 1 -- 172.21.15.6:0/2139532681 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f359802d450 con 0x7f35a40aae10 2023-07-21T07:35:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.694+0000 7f35a17fa700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f358806ad10 0x7f358806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.694+0000 7f35a17fa700 1 -- 172.21.15.6:0/2139532681 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f359808a3a0 con 0x7f35a40aae10 2023-07-21T07:35:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.694+0000 7f35a3fff700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f358806ad10 0x7f358806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.695+0000 7f35a3fff700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f358806ad10 0x7f358806d1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f35a40c4220 tx=0x7f3590008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.698+0000 7f35a17fa700 1 -- 172.21.15.6:0/2139532681 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f35a4070e80 con 0x7f35a40aae10 2023-07-21T07:35:12.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.893+0000 7f35aae92700 1 -- 172.21.15.6:0/2139532681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f35a40ac280 con 0x7f35a40aae10 2023-07-21T07:35:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.894+0000 7f35a17fa700 1 -- 172.21.15.6:0/2139532681 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f35a40ac280 con 0x7f35a40aae10 2023-07-21T07:35:12.946 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:35:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.896+0000 7f35aae92700 1 -- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f358806ad10 msgr2=0x7f358806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.896+0000 7f35aae92700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f358806ad10 0x7f358806d1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f35a40c4220 tx=0x7f3590008040 comp rx=0 tx=0).stop 2023-07-21T07:35:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.896+0000 7f35aae92700 1 -- 172.21.15.6:0/2139532681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a40aae10 msgr2=0x7f35a40bf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.896+0000 7f35aae92700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a40aae10 0x7f35a40bf690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3598014040 tx=0x7f3598004750 comp rx=0 tx=0).stop 2023-07-21T07:35:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.896+0000 7f35aae92700 1 -- 172.21.15.6:0/2139532681 shutdown_connections 2023-07-21T07:35:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.896+0000 7f35aae92700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f358806ad10 0x7f358806d1d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.896+0000 7f35aae92700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35a414c580 0x7f35a41ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.896+0000 7f35aae92700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a40aae10 0x7f35a40bf690 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.896+0000 7f35aae92700 1 --2- 172.21.15.6:0/2139532681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35a40c2260 0x7f35a41ecd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.896+0000 7f35aae92700 1 -- 172.21.15.6:0/2139532681 >> 172.21.15.6:0/2139532681 conn(0x7f35a40c2c20 msgr2=0x7f35a406cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.896+0000 7f35aae92700 1 -- 172.21.15.6:0/2139532681 shutdown_connections 2023-07-21T07:35:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:12.896+0000 7f35aae92700 1 -- 172.21.15.6:0/2139532681 wait complete. 2023-07-21T07:35:12.960 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:35:13.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.038+0000 7fb080e57700 1 Processor -- start 2023-07-21T07:35:13.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.038+0000 7fb080e57700 1 -- start start 2023-07-21T07:35:13.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb080e57700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb07c14c580 0x7fb07c0abd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:13.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb080e57700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb07c0c2260 0x7fb07c0aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:13.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb080e57700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb07c0aae10 0x7fb07c0ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:13.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb080e57700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c066580 con 0x7fb07c0c2260 2023-07-21T07:35:13.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb080e57700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c152f50 con 0x7fb07c14c580 2023-07-21T07:35:13.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb080e57700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0a9ac0 con 0x7fb07c0aae10 2023-07-21T07:35:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb079d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb07c0c2260 0x7fb07c0aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb079d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb07c0c2260 0x7fb07c0aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33634/0 (socket says 172.21.15.6:33634) 2023-07-21T07:35:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb079d9b700 1 -- 172.21.15.6:0/3503356062 learned_addr learned my addr 172.21.15.6:0/3503356062 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb07a59c700 1 --2- 172.21.15.6:0/3503356062 >> v2:172.21.15.86:3300/0 conn(0x7fb07c14c580 0x7fb07c0abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb07ad9d700 1 --2- 172.21.15.6:0/3503356062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb07c0aae10 0x7fb07c0ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb079d9b700 1 -- 172.21.15.6:0/3503356062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb07c0aae10 msgr2=0x7fb07c0ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb079d9b700 1 --2- 172.21.15.6:0/3503356062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb07c0aae10 0x7fb07c0ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb079d9b700 1 -- 172.21.15.6:0/3503356062 >> v2:172.21.15.86:3300/0 conn(0x7fb07c14c580 msgr2=0x7fb07c0abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb079d9b700 1 --2- 172.21.15.6:0/3503356062 >> v2:172.21.15.86:3300/0 conn(0x7fb07c14c580 0x7fb07c0abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb079d9b700 1 -- 172.21.15.6:0/3503356062 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0ac280 con 0x7fb07c0c2260 2023-07-21T07:35:13.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.039+0000 7fb07ad9d700 1 --2- 172.21.15.6:0/3503356062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb07c0aae10 0x7fb07c0ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:13.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.040+0000 7fb079d9b700 1 --2- 172.21.15.6:0/3503356062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb07c0c2260 0x7fb07c0aa8d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0684b0 tx=0x7fb06c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a70e104a7ffc46 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:13.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.040+0000 7fb07959a700 1 -- 172.21.15.6:0/3503356062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00b870 con 0x7fb07c0c2260 2023-07-21T07:35:13.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.040+0000 7fb07959a700 1 -- 172.21.15.6:0/3503356062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c00b9d0 con 0x7fb07c0c2260 2023-07-21T07:35:13.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.040+0000 7fb07959a700 1 -- 172.21.15.6:0/3503356062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00bd60 con 0x7fb07c0c2260 2023-07-21T07:35:13.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.040+0000 7fb080e57700 1 -- 172.21.15.6:0/3503356062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb07c0c2260 msgr2=0x7fb07c0aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:13.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.040+0000 7fb080e57700 1 --2- 172.21.15.6:0/3503356062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb07c0c2260 0x7fb07c0aa8d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0684b0 tx=0x7fb06c009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.040+0000 7fb080e57700 1 -- 172.21.15.6:0/3503356062 shutdown_connections 2023-07-21T07:35:13.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.040+0000 7fb080e57700 1 --2- 172.21.15.6:0/3503356062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb07c0aae10 0x7fb07c0ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.040+0000 7fb080e57700 1 --2- 172.21.15.6:0/3503356062 >> v2:172.21.15.86:3300/0 conn(0x7fb07c14c580 0x7fb07c0abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.040+0000 7fb080e57700 1 --2- 172.21.15.6:0/3503356062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb07c0c2260 0x7fb07c0aa8d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.040+0000 7fb080e57700 1 -- 172.21.15.6:0/3503356062 >> 172.21.15.6:0/3503356062 conn(0x7fb07c0c2c20 msgr2=0x7fb07c0c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:13.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.040+0000 7fb080e57700 1 -- 172.21.15.6:0/3503356062 shutdown_connections 2023-07-21T07:35:13.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.040+0000 7fb080e57700 1 -- 172.21.15.6:0/3503356062 wait complete. 2023-07-21T07:35:13.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.042+0000 7fb080e57700 1 Processor -- start 2023-07-21T07:35:13.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.042+0000 7fb080e57700 1 -- start start 2023-07-21T07:35:13.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.042+0000 7fb080e57700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb07c0aae10 0x7fb07c14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:13.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.042+0000 7fb080e57700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb07c0c2260 0x7fb07c0bf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:13.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.042+0000 7fb080e57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb07c14c580 0x7fb07c1e9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:13.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.042+0000 7fb080e57700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c14e600 con 0x7fb07c14c580 2023-07-21T07:35:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.042+0000 7fb080e57700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c14e9c0 con 0x7fb07c0c2260 2023-07-21T07:35:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.042+0000 7fb080e57700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c14eca0 con 0x7fb07c0aae10 2023-07-21T07:35:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb07ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb07c14c580 0x7fb07c1e9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb079d9b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb07c0c2260 0x7fb07c0bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb07ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb07c14c580 0x7fb07c1e9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33644/0 (socket says 172.21.15.6:33644) 2023-07-21T07:35:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb07a59c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb07c0aae10 0x7fb07c14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb07ad9d700 1 -- 172.21.15.6:0/1936488330 learned_addr learned my addr 172.21.15.6:0/1936488330 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb07ad9d700 1 -- 172.21.15.6:0/1936488330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb07c0aae10 msgr2=0x7fb07c14e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb07ad9d700 1 --2- 172.21.15.6:0/1936488330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb07c0aae10 0x7fb07c14e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb07ad9d700 1 -- 172.21.15.6:0/1936488330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb07c0c2260 msgr2=0x7fb07c0bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb07ad9d700 1 --2- 172.21.15.6:0/1936488330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb07c0c2260 0x7fb07c0bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb07ad9d700 1 -- 172.21.15.6:0/1936488330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c009550 con 0x7fb07c14c580 2023-07-21T07:35:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb07a59c700 1 --2- 172.21.15.6:0/1936488330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb07c0aae10 0x7fb07c14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb07ad9d700 1 --2- 172.21.15.6:0/1936488330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb07c14c580 0x7fb07c1e9940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb07400ccc0 tx=0x7fb07400a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb06affd700 1 -- 172.21.15.6:0/1936488330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400ad20 con 0x7fb07c14c580 2023-07-21T07:35:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb06affd700 1 -- 172.21.15.6:0/1936488330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07400ae80 con 0x7fb07c14c580 2023-07-21T07:35:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb080e57700 1 -- 172.21.15.6:0/1936488330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c14ef80 con 0x7fb07c14c580 2023-07-21T07:35:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb06affd700 1 -- 172.21.15.6:0/1936488330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400f6c0 con 0x7fb07c14c580 2023-07-21T07:35:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.043+0000 7fb080e57700 1 -- 172.21.15.6:0/1936488330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c14f540 con 0x7fb07c14c580 2023-07-21T07:35:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.044+0000 7fb080e57700 1 -- 172.21.15.6:0/1936488330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c074500 con 0x7fb07c14c580 2023-07-21T07:35:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.045+0000 7fb06affd700 1 -- 172.21.15.6:0/1936488330 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb07400b040 con 0x7fb07c14c580 2023-07-21T07:35:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.045+0000 7fb06affd700 1 --2- 172.21.15.6:0/1936488330 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb05c06ace0 0x7fb05c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.045+0000 7fb06affd700 1 -- 172.21.15.6:0/1936488330 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb074089a30 con 0x7fb07c14c580 2023-07-21T07:35:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.045+0000 7fb07a59c700 1 --2- 172.21.15.6:0/1936488330 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb05c06ace0 0x7fb05c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.046+0000 7fb07a59c700 1 --2- 172.21.15.6:0/1936488330 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb05c06ace0 0x7fb05c06d1a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb070006b20 tx=0x7fb070008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.050+0000 7fb06affd700 1 -- 172.21.15.6:0/1936488330 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb074054b70 con 0x7fb07c14c580 2023-07-21T07:35:13.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.247+0000 7fb080e57700 1 -- 172.21.15.6:0/1936488330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb07c0abf00 con 0x7fb07c14c580 2023-07-21T07:35:13.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.247+0000 7fb06affd700 1 -- 172.21.15.6:0/1936488330 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb074058190 con 0x7fb07c14c580 2023-07-21T07:35:13.300 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:35:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.249+0000 7fb080e57700 1 -- 172.21.15.6:0/1936488330 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb05c06ace0 msgr2=0x7fb05c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.249+0000 7fb080e57700 1 --2- 172.21.15.6:0/1936488330 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb05c06ace0 0x7fb05c06d1a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb070006b20 tx=0x7fb070008040 comp rx=0 tx=0).stop 2023-07-21T07:35:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.249+0000 7fb080e57700 1 -- 172.21.15.6:0/1936488330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb07c14c580 msgr2=0x7fb07c1e9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.249+0000 7fb080e57700 1 --2- 172.21.15.6:0/1936488330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb07c14c580 0x7fb07c1e9940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb07400ccc0 tx=0x7fb07400a280 comp rx=0 tx=0).stop 2023-07-21T07:35:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.249+0000 7fb080e57700 1 -- 172.21.15.6:0/1936488330 shutdown_connections 2023-07-21T07:35:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.249+0000 7fb080e57700 1 --2- 172.21.15.6:0/1936488330 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb05c06ace0 0x7fb05c06d1a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.249+0000 7fb080e57700 1 --2- 172.21.15.6:0/1936488330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb07c14c580 0x7fb07c1e9940 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.249+0000 7fb080e57700 1 --2- 172.21.15.6:0/1936488330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb07c0aae10 0x7fb07c14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.249+0000 7fb080e57700 1 --2- 172.21.15.6:0/1936488330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb07c0c2260 0x7fb07c0bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.249+0000 7fb080e57700 1 -- 172.21.15.6:0/1936488330 >> 172.21.15.6:0/1936488330 conn(0x7fb07c0c2c20 msgr2=0x7fb07c14b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:13.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.249+0000 7fb080e57700 1 -- 172.21.15.6:0/1936488330 shutdown_connections 2023-07-21T07:35:13.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.249+0000 7fb080e57700 1 -- 172.21.15.6:0/1936488330 wait complete. 2023-07-21T07:35:13.313 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T07:35:13.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.387+0000 7f1e687e4700 1 Processor -- start 2023-07-21T07:35:13.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.387+0000 7f1e687e4700 1 -- start start 2023-07-21T07:35:13.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.388+0000 7f1e687e4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e6014e9c0 0x7f1e600bc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.388+0000 7f1e687e4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6006db60 con 0x7f1e60071270 2023-07-21T07:35:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.388+0000 7f1e687e4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e60151e80 con 0x7f1e600bc660 2023-07-21T07:35:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.388+0000 7f1e687e4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e600bcc50 con 0x7f1e6014e9c0 2023-07-21T07:35:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.388+0000 7f1e66580700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e6014e9c0 0x7f1e600bc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.388+0000 7f1e66d81700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1e60071270 0x7f1e600bdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41672/0 (socket says 172.21.15.6:41672) 2023-07-21T07:35:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.388+0000 7f1e66d81700 1 -- 172.21.15.6:0/1894962775 learned_addr learned my addr 172.21.15.6:0/1894962775 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.388+0000 7f1e66580700 1 -- 172.21.15.6:0/1894962775 >> v1:172.21.15.86:6789/0 conn(0x7f1e600bc660 legacy=0x7f1e600bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:13.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.388+0000 7f1e66580700 1 -- 172.21.15.6:0/1894962775 >> v1:172.21.15.6:6789/0 conn(0x7f1e60071270 legacy=0x7f1e600bdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:13.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.388+0000 7f1e66580700 1 -- 172.21.15.6:0/1894962775 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e60151270 con 0x7f1e6014e9c0 2023-07-21T07:35:13.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.388+0000 7f1e6557e700 1 -- 172.21.15.6:0/1894962775 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268486538 0 0) 0x7f1e6006db60 con 0x7f1e60071270 2023-07-21T07:35:13.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.389+0000 7f1e66580700 1 --2- 172.21.15.6:0/1894962775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e6014e9c0 0x7f1e600bc120 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009840 tx=0x7f1e50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b37adce7c0f3d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:13.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.389+0000 7f1e6557e700 1 -- 172.21.15.6:0/1894962775 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50011830 con 0x7f1e6014e9c0 2023-07-21T07:35:13.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.389+0000 7f1e6557e700 1 -- 172.21.15.6:0/1894962775 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e50011990 con 0x7f1e6014e9c0 2023-07-21T07:35:13.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.389+0000 7f1e6557e700 1 -- 172.21.15.6:0/1894962775 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50011d20 con 0x7f1e6014e9c0 2023-07-21T07:35:13.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.389+0000 7f1e687e4700 1 -- 172.21.15.6:0/1894962775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e6014e9c0 msgr2=0x7f1e600bc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:13.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.389+0000 7f1e687e4700 1 --2- 172.21.15.6:0/1894962775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e6014e9c0 0x7f1e600bc120 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009840 tx=0x7f1e50009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:13.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.389+0000 7f1e687e4700 1 -- 172.21.15.6:0/1894962775 shutdown_connections 2023-07-21T07:35:13.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.389+0000 7f1e687e4700 1 --2- 172.21.15.6:0/1894962775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e6014e9c0 0x7f1e600bc120 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.389+0000 7f1e687e4700 1 -- 172.21.15.6:0/1894962775 >> 172.21.15.6:0/1894962775 conn(0x7f1e600c09f0 msgr2=0x7f1e600c0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:13.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.389+0000 7f1e687e4700 1 -- 172.21.15.6:0/1894962775 shutdown_connections 2023-07-21T07:35:13.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.389+0000 7f1e687e4700 1 -- 172.21.15.6:0/1894962775 wait complete. 2023-07-21T07:35:13.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.391+0000 7f1e687e4700 1 Processor -- start 2023-07-21T07:35:13.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.391+0000 7f1e687e4700 1 -- start start 2023-07-21T07:35:13.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.391+0000 7f1e687e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e60071270 0x7f1e60153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:13.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.391+0000 7f1e687e4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e600bc660 0x7f1e600c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:13.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.391+0000 7f1e687e4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e6014e9c0 0x7f1e60154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:13.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.391+0000 7f1e687e4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e60152de0 con 0x7f1e60071270 2023-07-21T07:35:13.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.391+0000 7f1e687e4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6006b590 con 0x7f1e600bc660 2023-07-21T07:35:13.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.391+0000 7f1e687e4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6006c190 con 0x7f1e6014e9c0 2023-07-21T07:35:13.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.391+0000 7f1e66580700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e60071270 0x7f1e60153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:13.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.391+0000 7f1e66580700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e60071270 0x7f1e60153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33654/0 (socket says 172.21.15.6:33654) 2023-07-21T07:35:13.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.391+0000 7f1e66580700 1 -- 172.21.15.6:0/801961986 learned_addr learned my addr 172.21.15.6:0/801961986 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:13.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e65d7f700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e600bc660 0x7f1e600c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:13.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e66d81700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e6014e9c0 0x7f1e60154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:13.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e66580700 1 -- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e6014e9c0 msgr2=0x7f1e60154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:13.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e66580700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e6014e9c0 0x7f1e60154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e66580700 1 -- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e600bc660 msgr2=0x7f1e600c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:13.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e66580700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e600bc660 0x7f1e600c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e66580700 1 -- 172.21.15.6:0/801961986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e500094a0 con 0x7f1e60071270 2023-07-21T07:35:13.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e66d81700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e6014e9c0 0x7f1e60154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:13.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e65d7f700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e600bc660 0x7f1e600c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:13.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e66580700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e60071270 0x7f1e60153230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1e500090b0 tx=0x7f1e50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:13.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e56ffd700 1 -- 172.21.15.6:0/801961986 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5001a8c0 con 0x7f1e60071270 2023-07-21T07:35:13.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e56ffd700 1 -- 172.21.15.6:0/801961986 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5001aa20 con 0x7f1e60071270 2023-07-21T07:35:13.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e687e4700 1 -- 172.21.15.6:0/801961986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6006b7e0 con 0x7f1e60071270 2023-07-21T07:35:13.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e56ffd700 1 -- 172.21.15.6:0/801961986 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5001ad90 con 0x7f1e60071270 2023-07-21T07:35:13.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.392+0000 7f1e687e4700 1 -- 172.21.15.6:0/801961986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e600c5780 con 0x7f1e60071270 2023-07-21T07:35:13.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.393+0000 7f1e687e4700 1 -- 172.21.15.6:0/801961986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e60153080 con 0x7f1e60071270 2023-07-21T07:35:13.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.393+0000 7f1e56ffd700 1 -- 172.21.15.6:0/801961986 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e50022070 con 0x7f1e60071270 2023-07-21T07:35:13.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.394+0000 7f1e56ffd700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1e4406ace0 0x7f1e4406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:13.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.394+0000 7f1e56ffd700 1 -- 172.21.15.6:0/801961986 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e5008a5c0 con 0x7f1e60071270 2023-07-21T07:35:13.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.394+0000 7f1e65d7f700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1e4406ace0 0x7f1e4406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:13.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.395+0000 7f1e65d7f700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1e4406ace0 0x7f1e4406d1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1e601501b0 tx=0x7f1e5c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:13.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.398+0000 7f1e56ffd700 1 -- 172.21.15.6:0/801961986 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1e500557f0 con 0x7f1e60071270 2023-07-21T07:35:13.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.614+0000 7f1e687e4700 1 -- 172.21.15.6:0/801961986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1e600bc120 con 0x7f1e60071270 2023-07-21T07:35:13.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.614+0000 7f1e56ffd700 1 -- 172.21.15.6:0/801961986 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1e50006cc0 con 0x7f1e60071270 2023-07-21T07:35:13.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.616+0000 7f1e687e4700 1 -- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1e4406ace0 msgr2=0x7f1e4406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.616+0000 7f1e687e4700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1e4406ace0 0x7f1e4406d1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1e601501b0 tx=0x7f1e5c009040 comp rx=0 tx=0).stop 2023-07-21T07:35:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.616+0000 7f1e687e4700 1 -- 172.21.15.6:0/801961986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e60071270 msgr2=0x7f1e60153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.616+0000 7f1e687e4700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e60071270 0x7f1e60153230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1e500090b0 tx=0x7f1e50004750 comp rx=0 tx=0).stop 2023-07-21T07:35:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.616+0000 7f1e687e4700 1 -- 172.21.15.6:0/801961986 shutdown_connections 2023-07-21T07:35:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.616+0000 7f1e687e4700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1e4406ace0 0x7f1e4406d1a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.616+0000 7f1e687e4700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e6014e9c0 0x7f1e60154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.616+0000 7f1e687e4700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e60071270 0x7f1e60153230 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.616+0000 7f1e687e4700 1 --2- 172.21.15.6:0/801961986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e600bc660 0x7f1e600c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.616+0000 7f1e687e4700 1 -- 172.21.15.6:0/801961986 >> 172.21.15.6:0/801961986 conn(0x7f1e600c09f0 msgr2=0x7f1e6014c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:13.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.616+0000 7f1e687e4700 1 -- 172.21.15.6:0/801961986 shutdown_connections 2023-07-21T07:35:13.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.616+0000 7f1e687e4700 1 -- 172.21.15.6:0/801961986 wait complete. 2023-07-21T07:35:13.671 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-21T07:35:13.681 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-21T07:35:13.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:13.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-21T07:35:13.728 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T07:35:13.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:13.729 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T07:35:13.755 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:35:13.755 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:13.777 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:35:13.777 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:13.836 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:35:13.837 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:13.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.970+0000 7fdb62a42700 1 Processor -- start 2023-07-21T07:35:14.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.970+0000 7fdb62a42700 1 -- start start 2023-07-21T07:35:14.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.970+0000 7fdb62a42700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdb5c0c6170 0x7fdb5c14ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.970+0000 7fdb62a42700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5c0ba440 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.970+0000 7fdb62a42700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5c0c15d0 con 0x7fdb5c0c3750 2023-07-21T07:35:14.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.970+0000 7fdb62a42700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5c0c57c0 con 0x7fdb5c0c6170 2023-07-21T07:35:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.970+0000 7fdb5b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdb5c0c6170 0x7fdb5c14ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.970+0000 7fdb60fdf700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdb5c0c53e0 0x7fdb5c154c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41686/0 (socket says 172.21.15.6:41686) 2023-07-21T07:35:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.971+0000 7fdb60fdf700 1 -- 172.21.15.6:0/3405126809 learned_addr learned my addr 172.21.15.6:0/3405126809 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.971+0000 7fdb5b7fe700 1 -- 172.21.15.6:0/3405126809 >> v1:172.21.15.86:6789/0 conn(0x7fdb5c0c3750 legacy=0x7fdb5c14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.971+0000 7fdb5b7fe700 1 -- 172.21.15.6:0/3405126809 >> v1:172.21.15.6:6789/0 conn(0x7fdb5c0c53e0 legacy=0x7fdb5c154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.971+0000 7fdb5b7fe700 1 -- 172.21.15.6:0/3405126809 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c0c18b0 con 0x7fdb5c0c6170 2023-07-21T07:35:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.971+0000 7fdb5b7fe700 1 --2- 172.21.15.6:0/3405126809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5c0c6170 0x7fdb5c14ed60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009840 tx=0x7fdb50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bdae5caf0e6539 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:14.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.971+0000 7fdb5affd700 1 -- 172.21.15.6:0/3405126809 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000f8a0 con 0x7fdb5c0c6170 2023-07-21T07:35:14.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.971+0000 7fdb5affd700 1 -- 172.21.15.6:0/3405126809 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5000fa00 con 0x7fdb5c0c6170 2023-07-21T07:35:14.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.971+0000 7fdb5affd700 1 -- 172.21.15.6:0/3405126809 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000fd90 con 0x7fdb5c0c6170 2023-07-21T07:35:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.972+0000 7fdb62a42700 1 -- 172.21.15.6:0/3405126809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5c0c6170 msgr2=0x7fdb5c14ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.972+0000 7fdb62a42700 1 --2- 172.21.15.6:0/3405126809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5c0c6170 0x7fdb5c14ed60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009840 tx=0x7fdb50009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.972+0000 7fdb62a42700 1 -- 172.21.15.6:0/3405126809 shutdown_connections 2023-07-21T07:35:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.972+0000 7fdb62a42700 1 --2- 172.21.15.6:0/3405126809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5c0c6170 0x7fdb5c14ed60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.972+0000 7fdb62a42700 1 -- 172.21.15.6:0/3405126809 >> 172.21.15.6:0/3405126809 conn(0x7fdb5c0a8c90 msgr2=0x7fdb5c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.972+0000 7fdb62a42700 1 -- 172.21.15.6:0/3405126809 shutdown_connections 2023-07-21T07:35:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.972+0000 7fdb62a42700 1 -- 172.21.15.6:0/3405126809 wait complete. 2023-07-21T07:35:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.973+0000 7fdb62a42700 1 Processor -- start 2023-07-21T07:35:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.973+0000 7fdb62a42700 1 -- start start 2023-07-21T07:35:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb62a42700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb5c0c3750 0x7fdb5c153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb62a42700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5c0c53e0 0x7fdb5c151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb62a42700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb5c0c6170 0x7fdb5c1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb62a42700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c151e90 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb62a42700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c151ae0 con 0x7fdb5c0c6170 2023-07-21T07:35:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb62a42700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c1e8cd0 con 0x7fdb5c0c3750 2023-07-21T07:35:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5c0c53e0 0x7fdb5c151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5c0c53e0 0x7fdb5c151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33670/0 (socket says 172.21.15.6:33670) 2023-07-21T07:35:14.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb5b7fe700 1 -- 172.21.15.6:0/2877956897 learned_addr learned my addr 172.21.15.6:0/2877956897 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:14.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb60fdf700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb5c0c6170 0x7fdb5c1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb5bfff700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb5c0c3750 0x7fdb5c153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb5b7fe700 1 -- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb5c0c3750 msgr2=0x7fdb5c153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb5b7fe700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb5c0c3750 0x7fdb5c153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb5b7fe700 1 -- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb5c0c6170 msgr2=0x7fdb5c1515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb5b7fe700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb5c0c6170 0x7fdb5c1515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb5b7fe700 1 -- 172.21.15.6:0/2877956897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb500094a0 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb5bfff700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb5c0c3750 0x7fdb5c153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb5b7fe700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5c0c53e0 0x7fdb5c151060 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdb50000c00 tx=0x7fdb50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb58ff9700 1 -- 172.21.15.6:0/2877956897 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50003ab0 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb58ff9700 1 -- 172.21.15.6:0/2877956897 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50003c10 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb62a42700 1 -- 172.21.15.6:0/2877956897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5c1e9b30 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.974+0000 7fdb58ff9700 1 -- 172.21.15.6:0/2877956897 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb500045d0 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.975+0000 7fdb62a42700 1 -- 172.21.15.6:0/2877956897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5c1e8f20 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.975+0000 7fdb62a42700 1 -- 172.21.15.6:0/2877956897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5c0c3b30 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.976+0000 7fdb58ff9700 1 -- 172.21.15.6:0/2877956897 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb5002c430 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.976+0000 7fdb58ff9700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdb4806ace0 0x7fdb4806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.976+0000 7fdb58ff9700 1 -- 172.21.15.6:0/2877956897 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb5008ab10 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.976+0000 7fdb5bfff700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdb4806ace0 0x7fdb4806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.977+0000 7fdb5bfff700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdb4806ace0 0x7fdb4806d1a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c000f60 tx=0x7fdb4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:13.981+0000 7fdb58ff9700 1 -- 172.21.15.6:0/2877956897 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdb50055c50 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.178+0000 7fdb62a42700 1 -- 172.21.15.6:0/2877956897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb5c074500 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.179+0000 7fdb58ff9700 1 -- 172.21.15.6:0/2877956897 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7fdb50059270 con 0x7fdb5c0c53e0 2023-07-21T07:35:14.233 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:14.234 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:14.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.181+0000 7fdb62a42700 1 -- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdb4806ace0 msgr2=0x7fdb4806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.181+0000 7fdb62a42700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdb4806ace0 0x7fdb4806d1a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c000f60 tx=0x7fdb4c009040 comp rx=0 tx=0).stop 2023-07-21T07:35:14.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.181+0000 7fdb62a42700 1 -- 172.21.15.6:0/2877956897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5c0c53e0 msgr2=0x7fdb5c151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.181+0000 7fdb62a42700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5c0c53e0 0x7fdb5c151060 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdb50000c00 tx=0x7fdb50004750 comp rx=0 tx=0).stop 2023-07-21T07:35:14.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.181+0000 7fdb62a42700 1 -- 172.21.15.6:0/2877956897 shutdown_connections 2023-07-21T07:35:14.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.181+0000 7fdb62a42700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdb4806ace0 0x7fdb4806d1a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.181+0000 7fdb62a42700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb5c0c6170 0x7fdb5c1515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.181+0000 7fdb62a42700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb5c0c3750 0x7fdb5c153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.181+0000 7fdb62a42700 1 --2- 172.21.15.6:0/2877956897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb5c0c53e0 0x7fdb5c151060 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.181+0000 7fdb62a42700 1 -- 172.21.15.6:0/2877956897 >> 172.21.15.6:0/2877956897 conn(0x7fdb5c0a8c90 msgr2=0x7fdb5c071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:14.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.181+0000 7fdb62a42700 1 -- 172.21.15.6:0/2877956897 shutdown_connections 2023-07-21T07:35:14.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.181+0000 7fdb62a42700 1 -- 172.21.15.6:0/2877956897 wait complete. 2023-07-21T07:35:14.246 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:34:38.107491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:34:39.423138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:35:14.246 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:35:14.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.323+0000 7f3c42afb700 1 Processor -- start 2023-07-21T07:35:14.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.323+0000 7f3c42afb700 1 -- start start 2023-07-21T07:35:14.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.324+0000 7f3c42afb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c06a300 0x7f3c3c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.324+0000 7f3c42afb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c3c0ba140 0x7f3c3c151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.324+0000 7f3c42afb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3c155530 con 0x7f3c3c06d8a0 2023-07-21T07:35:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.324+0000 7f3c42afb700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3c0c1a30 con 0x7f3c3c0ba140 2023-07-21T07:35:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.324+0000 7f3c42afb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c154920 con 0x7f3c3c06a300 2023-07-21T07:35:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.324+0000 7f3c41098700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3c3c06d8a0 0x7f3c3c0c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41698/0 (socket says 172.21.15.6:41698) 2023-07-21T07:35:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.324+0000 7f3c41098700 1 -- 172.21.15.6:0/593746520 learned_addr learned my addr 172.21.15.6:0/593746520 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.324+0000 7f3c3bfff700 1 --2- 172.21.15.6:0/593746520 >> v2:172.21.15.86:3300/0 conn(0x7f3c3c0ba140 0x7f3c3c151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.324+0000 7f3c40897700 1 --2- 172.21.15.6:0/593746520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c06a300 0x7f3c3c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.324+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782021830 0 0) 0x7f3c3c155530 con 0x7f3c3c06d8a0 2023-07-21T07:35:14.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.324+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c2c0035b0 con 0x7f3c3c06d8a0 2023-07-21T07:35:14.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 181864773 0 0) 0x7f3c2c0035b0 con 0x7f3c3c06d8a0 2023-07-21T07:35:14.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c06a300 msgr2=0x7f3c3c1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:14.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 --2- 172.21.15.6:0/593746520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c06a300 0x7f3c3c1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 >> v2:172.21.15.86:3300/0 conn(0x7f3c3c0ba140 msgr2=0x7f3c3c151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:14.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 --2- 172.21.15.6:0/593746520 >> v2:172.21.15.86:3300/0 conn(0x7f3c3c0ba140 0x7f3c3c151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c154c00 con 0x7f3c3c06d8a0 2023-07-21T07:35:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f3c340019f0 con 0x7f3c3c06d8a0 2023-07-21T07:35:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 >> v1:172.21.15.6:6789/0 conn(0x7f3c3c06d8a0 legacy=0x7f3c3c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 --2- 172.21.15.6:0/593746520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c06a300 0x7f3c2c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 --2- 172.21.15.6:0/593746520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c2c003f80 0x7f3c2c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 --2- 172.21.15.6:0/593746520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2c004d90 0x7f3c2c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0c1a30 con 0x7f3c2c003f80 2023-07-21T07:35:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c154920 con 0x7f3c2c004d90 2023-07-21T07:35:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c00ba60 con 0x7f3c3c06a300 2023-07-21T07:35:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3bfff700 1 --2- 172.21.15.6:0/593746520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c2c003f80 0x7f3c2c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c40897700 1 --2- 172.21.15.6:0/593746520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c06a300 0x7f3c2c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c41098700 1 --2- 172.21.15.6:0/593746520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2c004d90 0x7f3c2c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3bfff700 1 -- 172.21.15.6:0/593746520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c06a300 msgr2=0x7f3c2c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3bfff700 1 --2- 172.21.15.6:0/593746520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c06a300 0x7f3c2c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3bfff700 1 -- 172.21.15.6:0/593746520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2c004d90 msgr2=0x7f3c2c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3bfff700 1 --2- 172.21.15.6:0/593746520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2c004d90 0x7f3c2c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3bfff700 1 -- 172.21.15.6:0/593746520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c0035b0 con 0x7f3c2c003f80 2023-07-21T07:35:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c41098700 1 --2- 172.21.15.6:0/593746520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2c004d90 0x7f3c2c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3bfff700 1 --2- 172.21.15.6:0/593746520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c2c003f80 0x7f3c2c004850 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009b90 tx=0x7f3c2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab4516d1dcd0ccc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2800e6c0 con 0x7f3c2c003f80 2023-07-21T07:35:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2800e820 con 0x7f3c2c003f80 2023-07-21T07:35:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.325+0000 7f3c3b7fe700 1 -- 172.21.15.6:0/593746520 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2800eb90 con 0x7f3c2c003f80 2023-07-21T07:35:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.326+0000 7f3c42afb700 1 -- 172.21.15.6:0/593746520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c2c003f80 msgr2=0x7f3c2c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.326+0000 7f3c42afb700 1 --2- 172.21.15.6:0/593746520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c2c003f80 0x7f3c2c004850 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009b90 tx=0x7f3c2c005880 comp rx=0 tx=0).stop 2023-07-21T07:35:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.326+0000 7f3c41098700 1 -- 172.21.15.6:0/593746520 reap_dead start 2023-07-21T07:35:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.326+0000 7f3c42afb700 1 -- 172.21.15.6:0/593746520 shutdown_connections 2023-07-21T07:35:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.326+0000 7f3c42afb700 1 -- 172.21.15.6:0/593746520 >> 172.21.15.6:0/593746520 conn(0x7f3c3c0a8660 msgr2=0x7f3c3c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:14.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.326+0000 7f3c42afb700 1 -- 172.21.15.6:0/593746520 shutdown_connections 2023-07-21T07:35:14.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.326+0000 7f3c42afb700 1 -- 172.21.15.6:0/593746520 wait complete. 2023-07-21T07:35:14.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.328+0000 7f3c42afb700 1 Processor -- start 2023-07-21T07:35:14.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.328+0000 7f3c42afb700 1 -- start start 2023-07-21T07:35:14.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c42afb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2c003f80 0x7f3c3c14afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c42afb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c070f10 0x7f3c3c0bfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c42afb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c3c0c0530 0x7f3c3c1e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c42afb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c14bb80 con 0x7f3c3c0c0530 2023-07-21T07:35:14.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c42afb700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c14cc00 con 0x7f3c2c003f80 2023-07-21T07:35:14.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c42afb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0c3d00 con 0x7f3c3c070f10 2023-07-21T07:35:14.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c41098700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c3c0c0530 0x7f3c3c1e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c41098700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c3c0c0530 0x7f3c3c1e9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33690/0 (socket says 172.21.15.6:33690) 2023-07-21T07:35:14.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c41098700 1 -- 172.21.15.6:0/3750219084 learned_addr learned my addr 172.21.15.6:0/3750219084 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:14.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c3bfff700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c070f10 0x7f3c3c0bfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c40897700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2c003f80 0x7f3c3c14afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c41098700 1 -- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c070f10 msgr2=0x7f3c3c0bfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c41098700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c070f10 0x7f3c3c0bfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c41098700 1 -- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2c003f80 msgr2=0x7f3c3c14afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c41098700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2c003f80 0x7f3c3c14afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c41098700 1 -- 172.21.15.6:0/3750219084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c14c920 con 0x7f3c3c0c0530 2023-07-21T07:35:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c3bfff700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c070f10 0x7f3c3c0bfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c41098700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c3c0c0530 0x7f3c3c1e9bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3c34000f80 tx=0x7f3c3400e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.329+0000 7f3c397fa700 1 -- 172.21.15.6:0/3750219084 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400ed80 con 0x7f3c3c0c0530 2023-07-21T07:35:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.330+0000 7f3c397fa700 1 -- 172.21.15.6:0/3750219084 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c34013420 con 0x7f3c3c0c0530 2023-07-21T07:35:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.330+0000 7f3c397fa700 1 -- 172.21.15.6:0/3750219084 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c340137d0 con 0x7f3c3c0c0530 2023-07-21T07:35:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.330+0000 7f3c42afb700 1 -- 172.21.15.6:0/3750219084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3c14c240 con 0x7f3c3c0c0530 2023-07-21T07:35:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.330+0000 7f3c42afb700 1 -- 172.21.15.6:0/3750219084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3c14b4f0 con 0x7f3c3c0c0530 2023-07-21T07:35:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.330+0000 7f3c42afb700 1 -- 172.21.15.6:0/3750219084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3c074500 con 0x7f3c3c0c0530 2023-07-21T07:35:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.331+0000 7f3c397fa700 1 -- 172.21.15.6:0/3750219084 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c34013930 con 0x7f3c3c0c0530 2023-07-21T07:35:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.331+0000 7f3c397fa700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3c2006ace0 0x7f3c2006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.332+0000 7f3c397fa700 1 -- 172.21.15.6:0/3750219084 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c34089b00 con 0x7f3c3c0c0530 2023-07-21T07:35:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.332+0000 7f3c40897700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3c2006ace0 0x7f3c2006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.332+0000 7f3c40897700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3c2006ace0 0x7f3c2006d1a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009ac0 tx=0x7f3c30008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:14.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.336+0000 7f3c397fa700 1 -- 172.21.15.6:0/3750219084 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3c34054c40 con 0x7f3c3c0c0530 2023-07-21T07:35:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.531+0000 7f3c42afb700 1 -- 172.21.15.6:0/3750219084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c3c1e98a0 con 0x7f3c3c0c0530 2023-07-21T07:35:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.532+0000 7f3c397fa700 1 -- 172.21.15.6:0/3750219084 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c34058260 con 0x7f3c3c0c0530 2023-07-21T07:35:14.584 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:35:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.534+0000 7f3c42afb700 1 -- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3c2006ace0 msgr2=0x7f3c2006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.534+0000 7f3c42afb700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3c2006ace0 0x7f3c2006d1a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009ac0 tx=0x7f3c30008040 comp rx=0 tx=0).stop 2023-07-21T07:35:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.534+0000 7f3c42afb700 1 -- 172.21.15.6:0/3750219084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c3c0c0530 msgr2=0x7f3c3c1e9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.534+0000 7f3c42afb700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c3c0c0530 0x7f3c3c1e9bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3c34000f80 tx=0x7f3c3400e4f0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.534+0000 7f3c42afb700 1 -- 172.21.15.6:0/3750219084 shutdown_connections 2023-07-21T07:35:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.534+0000 7f3c42afb700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3c2006ace0 0x7f3c2006d1a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.534+0000 7f3c42afb700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c3c0c0530 0x7f3c3c1e9bf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.534+0000 7f3c42afb700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c2c003f80 0x7f3c3c14afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.534+0000 7f3c42afb700 1 --2- 172.21.15.6:0/3750219084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c3c070f10 0x7f3c3c0bfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.534+0000 7f3c42afb700 1 -- 172.21.15.6:0/3750219084 >> 172.21.15.6:0/3750219084 conn(0x7f3c3c0a8660 msgr2=0x7f3c3c14ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:14.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.534+0000 7f3c42afb700 1 -- 172.21.15.6:0/3750219084 shutdown_connections 2023-07-21T07:35:14.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.534+0000 7f3c42afb700 1 -- 172.21.15.6:0/3750219084 wait complete. 2023-07-21T07:35:14.598 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:35:14.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.674+0000 7fc74fb68700 1 Processor -- start 2023-07-21T07:35:14.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.674+0000 7fc74fb68700 1 -- start start 2023-07-21T07:35:14.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74fb68700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7480a6f80 0x7fc748152380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74fb68700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc748072160 0x7fc74814f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74fb68700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7480c3c90 con 0x7fc7480c4120 2023-07-21T07:35:14.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74fb68700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7480c26e0 con 0x7fc7480a6f80 2023-07-21T07:35:14.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74fb68700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7480c3680 con 0x7fc748072160 2023-07-21T07:35:14.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74d904700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7480a6f80 0x7fc748152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74d904700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7480a6f80 0x7fc748152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33694/0 (socket says 172.21.15.6:33694) 2023-07-21T07:35:14.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74d904700 1 -- 172.21.15.6:0/2927527537 learned_addr learned my addr 172.21.15.6:0/2927527537 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:14.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74d103700 1 --2- 172.21.15.6:0/2927527537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc748072160 0x7fc74814f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74d904700 1 -- 172.21.15.6:0/2927527537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc748072160 msgr2=0x7fc74814f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:14.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74d904700 1 --2- 172.21.15.6:0/2927527537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc748072160 0x7fc74814f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74d904700 1 -- 172.21.15.6:0/2927527537 >> v1:172.21.15.86:6789/0 conn(0x7fc7480c4120 legacy=0x7fc7480c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:14.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74d904700 1 -- 172.21.15.6:0/2927527537 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480c6fe0 con 0x7fc7480a6f80 2023-07-21T07:35:14.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74d904700 1 --2- 172.21.15.6:0/2927527537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7480a6f80 0x7fc748152380 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc7440098f0 tx=0x7fc744009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a724f78e3b5ff1af server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:14.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74c902700 1 -- 172.21.15.6:0/2927527537 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744004230 con 0x7fc7480a6f80 2023-07-21T07:35:14.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.675+0000 7fc74c902700 1 -- 172.21.15.6:0/2927527537 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc744004390 con 0x7fc7480a6f80 2023-07-21T07:35:14.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.676+0000 7fc74c902700 1 -- 172.21.15.6:0/2927527537 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7440036a0 con 0x7fc7480a6f80 2023-07-21T07:35:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.676+0000 7fc74fb68700 1 -- 172.21.15.6:0/2927527537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7480a6f80 msgr2=0x7fc748152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.676+0000 7fc74fb68700 1 --2- 172.21.15.6:0/2927527537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7480a6f80 0x7fc748152380 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc7440098f0 tx=0x7fc744009c00 comp rx=0 tx=0).stop 2023-07-21T07:35:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.676+0000 7fc74fb68700 1 -- 172.21.15.6:0/2927527537 shutdown_connections 2023-07-21T07:35:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.676+0000 7fc74fb68700 1 --2- 172.21.15.6:0/2927527537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7480a6f80 0x7fc748152380 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.676+0000 7fc74fb68700 1 --2- 172.21.15.6:0/2927527537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc748072160 0x7fc74814f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.676+0000 7fc74fb68700 1 -- 172.21.15.6:0/2927527537 >> 172.21.15.6:0/2927527537 conn(0x7fc7480c7b50 msgr2=0x7fc7480c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:14.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.676+0000 7fc74fb68700 1 -- 172.21.15.6:0/2927527537 shutdown_connections 2023-07-21T07:35:14.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.676+0000 7fc74fb68700 1 -- 172.21.15.6:0/2927527537 wait complete. 2023-07-21T07:35:14.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.678+0000 7fc74fb68700 1 Processor -- start 2023-07-21T07:35:14.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.678+0000 7fc74fb68700 1 -- start start 2023-07-21T07:35:14.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74fb68700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc748072160 0x7fc7481525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74fb68700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7480a6f80 0x7fc748152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74fb68700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7480c4120 0x7fc7481eb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74fb68700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc748153f80 con 0x7fc748072160 2023-07-21T07:35:14.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74fb68700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc748153050 con 0x7fc7480c4120 2023-07-21T07:35:14.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74fb68700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc748153770 con 0x7fc7480a6f80 2023-07-21T07:35:14.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74d904700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc748072160 0x7fc7481525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74d904700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc748072160 0x7fc7481525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33698/0 (socket says 172.21.15.6:33698) 2023-07-21T07:35:14.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74d904700 1 -- 172.21.15.6:0/587688616 learned_addr learned my addr 172.21.15.6:0/587688616 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:14.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74d103700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7480a6f80 0x7fc748152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74e105700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7480c4120 0x7fc7481eb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74d904700 1 -- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7480a6f80 msgr2=0x7fc748152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74d904700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7480a6f80 0x7fc748152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74d904700 1 -- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7480c4120 msgr2=0x7fc7481eb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74d904700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7480c4120 0x7fc7481eb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74d904700 1 -- 172.21.15.6:0/587688616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744009550 con 0x7fc748072160 2023-07-21T07:35:14.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74d904700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc748072160 0x7fc7481525d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc744009130 tx=0x7fc744004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:14.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc73e7fc700 1 -- 172.21.15.6:0/587688616 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744003e70 con 0x7fc748072160 2023-07-21T07:35:14.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc73e7fc700 1 -- 172.21.15.6:0/587688616 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74401f070 con 0x7fc748072160 2023-07-21T07:35:14.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74fb68700 1 -- 172.21.15.6:0/587688616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc748148480 con 0x7fc748072160 2023-07-21T07:35:14.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc73e7fc700 1 -- 172.21.15.6:0/587688616 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74400b8a0 con 0x7fc748072160 2023-07-21T07:35:14.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.679+0000 7fc74fb68700 1 -- 172.21.15.6:0/587688616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc748153ca0 con 0x7fc748072160 2023-07-21T07:35:14.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.680+0000 7fc74fb68700 1 -- 172.21.15.6:0/587688616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc748072810 con 0x7fc748072160 2023-07-21T07:35:14.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.681+0000 7fc73e7fc700 1 -- 172.21.15.6:0/587688616 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc744021030 con 0x7fc748072160 2023-07-21T07:35:14.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.681+0000 7fc73e7fc700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc72c06ace0 0x7fc72c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:14.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.681+0000 7fc73e7fc700 1 -- 172.21.15.6:0/587688616 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc74408aba0 con 0x7fc748072160 2023-07-21T07:35:14.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.681+0000 7fc74d103700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc72c06ace0 0x7fc72c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:14.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.682+0000 7fc74d103700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc72c06ace0 0x7fc72c06d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc74804e650 tx=0x7fc738008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:14.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.686+0000 7fc73e7fc700 1 -- 172.21.15.6:0/587688616 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc744055ce0 con 0x7fc748072160 2023-07-21T07:35:14.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.883+0000 7fc74fb68700 1 -- 172.21.15.6:0/587688616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc748072810 con 0x7fc748072160 2023-07-21T07:35:14.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.884+0000 7fc73e7fc700 1 -- 172.21.15.6:0/587688616 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc744059300 con 0x7fc748072160 2023-07-21T07:35:14.936 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:35:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.886+0000 7fc74fb68700 1 -- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc72c06ace0 msgr2=0x7fc72c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.886+0000 7fc74fb68700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc72c06ace0 0x7fc72c06d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc74804e650 tx=0x7fc738008040 comp rx=0 tx=0).stop 2023-07-21T07:35:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.886+0000 7fc74fb68700 1 -- 172.21.15.6:0/587688616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc748072160 msgr2=0x7fc7481525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.886+0000 7fc74fb68700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc748072160 0x7fc7481525d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc744009130 tx=0x7fc744004750 comp rx=0 tx=0).stop 2023-07-21T07:35:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.886+0000 7fc74fb68700 1 -- 172.21.15.6:0/587688616 shutdown_connections 2023-07-21T07:35:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.886+0000 7fc74fb68700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc72c06ace0 0x7fc72c06d1a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.886+0000 7fc74fb68700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7480c4120 0x7fc7481eb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.886+0000 7fc74fb68700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc748072160 0x7fc7481525d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.886+0000 7fc74fb68700 1 --2- 172.21.15.6:0/587688616 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7480a6f80 0x7fc748152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.886+0000 7fc74fb68700 1 -- 172.21.15.6:0/587688616 >> 172.21.15.6:0/587688616 conn(0x7fc7480c7b50 msgr2=0x7fc7480c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.886+0000 7fc74fb68700 1 -- 172.21.15.6:0/587688616 shutdown_connections 2023-07-21T07:35:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:14.886+0000 7fc74fb68700 1 -- 172.21.15.6:0/587688616 wait complete. 2023-07-21T07:35:14.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:35:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.027+0000 7f7bd20c7700 1 Processor -- start 2023-07-21T07:35:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.027+0000 7f7bd20c7700 1 -- start start 2023-07-21T07:35:15.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bd20c7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bcc072160 0x7f7bcc14f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bd20c7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7bcc0c4120 0x7f7bcc14f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bd20c7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bcc0c3c90 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bd20c7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bcc0c26e0 con 0x7f7bcc072160 2023-07-21T07:35:15.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bd20c7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bcc0c3680 con 0x7f7bcc0c4120 2023-07-21T07:35:15.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bcaffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bcc072160 0x7f7bcc14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bcb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7bcc0a6f80 0x7f7bcc152380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41726/0 (socket says 172.21.15.6:41726) 2023-07-21T07:35:15.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bcb7fe700 1 -- 172.21.15.6:0/3592987407 learned_addr learned my addr 172.21.15.6:0/3592987407 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:15.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bcbfff700 1 --2- 172.21.15.6:0/3592987407 >> v2:172.21.15.86:3300/0 conn(0x7f7bcc0c4120 0x7f7bcc14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bcaffd700 1 -- 172.21.15.6:0/3592987407 >> v2:172.21.15.86:3300/0 conn(0x7f7bcc0c4120 msgr2=0x7f7bcc14f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:15.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bcaffd700 1 --2- 172.21.15.6:0/3592987407 >> v2:172.21.15.86:3300/0 conn(0x7f7bcc0c4120 0x7f7bcc14f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bcaffd700 1 -- 172.21.15.6:0/3592987407 >> v1:172.21.15.6:6789/0 conn(0x7f7bcc0a6f80 legacy=0x7f7bcc152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bca7fc700 1 -- 172.21.15.6:0/3592987407 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932721283 0 0) 0x7f7bcc0c3c90 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.028+0000 7f7bcaffd700 1 -- 172.21.15.6:0/3592987407 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc0c6fe0 con 0x7f7bcc072160 2023-07-21T07:35:15.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.029+0000 7f7bcaffd700 1 --2- 172.21.15.6:0/3592987407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bcc072160 0x7f7bcc14f420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc070e20 tx=0x7f7bb4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b83640d5045157 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:15.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.029+0000 7f7bca7fc700 1 -- 172.21.15.6:0/3592987407 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4011830 con 0x7f7bcc072160 2023-07-21T07:35:15.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.029+0000 7f7bca7fc700 1 -- 172.21.15.6:0/3592987407 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb4011990 con 0x7f7bcc072160 2023-07-21T07:35:15.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.029+0000 7f7bca7fc700 1 -- 172.21.15.6:0/3592987407 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4011d20 con 0x7f7bcc072160 2023-07-21T07:35:15.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.029+0000 7f7bd20c7700 1 -- 172.21.15.6:0/3592987407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bcc072160 msgr2=0x7f7bcc14f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.029+0000 7f7bd20c7700 1 --2- 172.21.15.6:0/3592987407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bcc072160 0x7f7bcc14f420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc070e20 tx=0x7f7bb4009b20 comp rx=0 tx=0).stop 2023-07-21T07:35:15.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.029+0000 7f7bd20c7700 1 -- 172.21.15.6:0/3592987407 shutdown_connections 2023-07-21T07:35:15.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.029+0000 7f7bd20c7700 1 --2- 172.21.15.6:0/3592987407 >> v2:172.21.15.86:3300/0 conn(0x7f7bcc0c4120 0x7f7bcc14f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.029+0000 7f7bd20c7700 1 --2- 172.21.15.6:0/3592987407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bcc072160 0x7f7bcc14f420 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.029+0000 7f7bd20c7700 1 -- 172.21.15.6:0/3592987407 >> 172.21.15.6:0/3592987407 conn(0x7f7bcc0c7b50 msgr2=0x7f7bcc0c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:15.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.029+0000 7f7bd20c7700 1 -- 172.21.15.6:0/3592987407 shutdown_connections 2023-07-21T07:35:15.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.029+0000 7f7bd20c7700 1 -- 172.21.15.6:0/3592987407 wait complete. 2023-07-21T07:35:15.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.031+0000 7f7bd20c7700 1 Processor -- start 2023-07-21T07:35:15.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.031+0000 7f7bd20c7700 1 -- start start 2023-07-21T07:35:15.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bd20c7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bcc072160 0x7f7bcc0a86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bd20c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bcc0a6f80 0x7f7bcc0a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bd20c7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0c4120 0x7f7bcc1eb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bd20c7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc153770 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bd20c7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc1eb480 con 0x7f7bcc072160 2023-07-21T07:35:15.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bd20c7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc1458c0 con 0x7f7bcc0c4120 2023-07-21T07:35:15.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bcaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bcc0a6f80 0x7f7bcc0a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bcaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bcc0a6f80 0x7f7bcc0a8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33714/0 (socket says 172.21.15.6:33714) 2023-07-21T07:35:15.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bcaffd700 1 -- 172.21.15.6:0/518978339 learned_addr learned my addr 172.21.15.6:0/518978339 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:15.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bcb7fe700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bcc072160 0x7f7bcc0a86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bcbfff700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0c4120 0x7f7bcc1eb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bcaffd700 1 -- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0c4120 msgr2=0x7f7bcc1eb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bcaffd700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0c4120 0x7f7bcc1eb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bcaffd700 1 -- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bcc072160 msgr2=0x7f7bcc0a86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bcaffd700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bcc072160 0x7f7bcc0a86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bcaffd700 1 -- 172.21.15.6:0/518978339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb40094a0 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bcb7fe700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bcc072160 0x7f7bcc0a86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.032+0000 7f7bcbfff700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0c4120 0x7f7bcc1eb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.033+0000 7f7bcaffd700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bcc0a6f80 0x7f7bcc0a8c00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4014040 tx=0x7f7bb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.033+0000 7f7bc3fff700 1 -- 172.21.15.6:0/518978339 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb40038a0 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.033+0000 7f7bc3fff700 1 -- 172.21.15.6:0/518978339 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb401e070 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.033+0000 7f7bd20c7700 1 -- 172.21.15.6:0/518978339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bcc153980 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.033+0000 7f7bc3fff700 1 -- 172.21.15.6:0/518978339 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4003c20 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.033+0000 7f7bd20c7700 1 -- 172.21.15.6:0/518978339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bcc156660 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.034+0000 7f7bd20c7700 1 -- 172.21.15.6:0/518978339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bcc156850 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.034+0000 7f7bc3fff700 1 -- 172.21.15.6:0/518978339 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7bb402d450 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.035+0000 7f7bc3fff700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7bac06ace0 0x7f7bac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.035+0000 7f7bc3fff700 1 -- 172.21.15.6:0/518978339 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7bb408a4c0 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.035+0000 7f7bcb7fe700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7bac06ace0 0x7f7bac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.036+0000 7f7bcb7fe700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7bac06ace0 0x7f7bac06d1a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc000f60 tx=0x7f7bbc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:15.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.039+0000 7f7bc3fff700 1 -- 172.21.15.6:0/518978339 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7bcc156850 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.236+0000 7f7bd20c7700 1 -- 172.21.15.6:0/518978339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7bcc156850 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.236+0000 7f7bc3fff700 1 -- 172.21.15.6:0/518978339 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7bcc156850 con 0x7f7bcc0a6f80 2023-07-21T07:35:15.289 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:35:15.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.238+0000 7f7bd20c7700 1 -- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7bac06ace0 msgr2=0x7f7bac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.238+0000 7f7bd20c7700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7bac06ace0 0x7f7bac06d1a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc000f60 tx=0x7f7bbc009040 comp rx=0 tx=0).stop 2023-07-21T07:35:15.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.238+0000 7f7bd20c7700 1 -- 172.21.15.6:0/518978339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bcc0a6f80 msgr2=0x7f7bcc0a8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.238+0000 7f7bd20c7700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bcc0a6f80 0x7f7bcc0a8c00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4014040 tx=0x7f7bb4004750 comp rx=0 tx=0).stop 2023-07-21T07:35:15.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.238+0000 7f7bd20c7700 1 -- 172.21.15.6:0/518978339 shutdown_connections 2023-07-21T07:35:15.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.238+0000 7f7bd20c7700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7bac06ace0 0x7f7bac06d1a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.238+0000 7f7bd20c7700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0c4120 0x7f7bcc1eb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.238+0000 7f7bd20c7700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bcc072160 0x7f7bcc0a86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.238+0000 7f7bd20c7700 1 --2- 172.21.15.6:0/518978339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bcc0a6f80 0x7f7bcc0a8c00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.238+0000 7f7bd20c7700 1 -- 172.21.15.6:0/518978339 >> 172.21.15.6:0/518978339 conn(0x7f7bcc0c7b50 msgr2=0x7f7bcc071650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:15.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.238+0000 7f7bd20c7700 1 -- 172.21.15.6:0/518978339 shutdown_connections 2023-07-21T07:35:15.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.238+0000 7f7bd20c7700 1 -- 172.21.15.6:0/518978339 wait complete. 2023-07-21T07:35:15.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:35:15.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.380+0000 7f5c1c0b6700 1 Processor -- start 2023-07-21T07:35:15.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.380+0000 7f5c1c0b6700 1 -- start start 2023-07-21T07:35:15.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.380+0000 7f5c1c0b6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c1406a300 0x7f5c141519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c1c0b6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1406d8a0 0x7f5c14151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c1c0b6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c14155530 con 0x7f5c140ba140 2023-07-21T07:35:15.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c1c0b6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c140c1a30 con 0x7f5c1406a300 2023-07-21T07:35:15.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c1c0b6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c14154920 con 0x7f5c1406d8a0 2023-07-21T07:35:15.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c19e52700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c1406a300 0x7f5c141519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c19e52700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c1406a300 0x7f5c141519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33720/0 (socket says 172.21.15.6:33720) 2023-07-21T07:35:15.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c19e52700 1 -- 172.21.15.6:0/52952521 learned_addr learned my addr 172.21.15.6:0/52952521 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:15.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c1a653700 1 --2- 172.21.15.6:0/52952521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1406d8a0 0x7f5c14151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c19e52700 1 -- 172.21.15.6:0/52952521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1406d8a0 msgr2=0x7f5c14151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:15.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c19e52700 1 --2- 172.21.15.6:0/52952521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1406d8a0 0x7f5c14151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c19e52700 1 -- 172.21.15.6:0/52952521 >> v1:172.21.15.86:6789/0 conn(0x7f5c140ba140 legacy=0x7f5c140c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:15.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c19e52700 1 -- 172.21.15.6:0/52952521 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c14154c00 con 0x7f5c1406a300 2023-07-21T07:35:15.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c19e52700 1 --2- 172.21.15.6:0/52952521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c1406a300 0x7f5c141519b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5c100098f0 tx=0x7f5c10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95303d664f5f97b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:15.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c18e50700 1 -- 172.21.15.6:0/52952521 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1000b8a0 con 0x7f5c1406a300 2023-07-21T07:35:15.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c18e50700 1 -- 172.21.15.6:0/52952521 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1000ba00 con 0x7f5c1406a300 2023-07-21T07:35:15.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.381+0000 7f5c18e50700 1 -- 172.21.15.6:0/52952521 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1000bd90 con 0x7f5c1406a300 2023-07-21T07:35:15.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.382+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/52952521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c1406a300 msgr2=0x7f5c141519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.382+0000 7f5c1c0b6700 1 --2- 172.21.15.6:0/52952521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c1406a300 0x7f5c141519b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5c100098f0 tx=0x7f5c10009c00 comp rx=0 tx=0).stop 2023-07-21T07:35:15.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.382+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/52952521 shutdown_connections 2023-07-21T07:35:15.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.382+0000 7f5c1c0b6700 1 --2- 172.21.15.6:0/52952521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1406d8a0 0x7f5c14151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.382+0000 7f5c1c0b6700 1 --2- 172.21.15.6:0/52952521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c1406a300 0x7f5c141519b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.382+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/52952521 >> 172.21.15.6:0/52952521 conn(0x7f5c140a8660 msgr2=0x7f5c140a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:15.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.382+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/52952521 shutdown_connections 2023-07-21T07:35:15.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.382+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/52952521 wait complete. 2023-07-21T07:35:15.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.383+0000 7f5c1c0b6700 1 Processor -- start 2023-07-21T07:35:15.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.383+0000 7f5c1c0b6700 1 -- start start 2023-07-21T07:35:15.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c1c0b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c1406a300 0x7f5c140c0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c1c0b6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1406d8a0 0x7f5c140be660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c1c0b6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c140ba140 0x7f5c140b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c1c0b6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c140bf140 con 0x7f5c1406a300 2023-07-21T07:35:15.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c1c0b6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c140bdc60 con 0x7f5c140ba140 2023-07-21T07:35:15.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c1c0b6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1414d030 con 0x7f5c1406d8a0 2023-07-21T07:35:15.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c19e52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c1406a300 0x7f5c140c0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c19e52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c1406a300 0x7f5c140c0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33726/0 (socket says 172.21.15.6:33726) 2023-07-21T07:35:15.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c19e52700 1 -- 172.21.15.6:0/3572003383 learned_addr learned my addr 172.21.15.6:0/3572003383 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:15.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c19651700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1406d8a0 0x7f5c140be660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c1a653700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c140ba140 0x7f5c140b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c19e52700 1 -- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1406d8a0 msgr2=0x7f5c140be660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c19e52700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1406d8a0 0x7f5c140be660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c19e52700 1 -- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c140ba140 msgr2=0x7f5c140b8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c19e52700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c140ba140 0x7f5c140b8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c19e52700 1 -- 172.21.15.6:0/3572003383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c10009550 con 0x7f5c1406a300 2023-07-21T07:35:15.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c1a653700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c140ba140 0x7f5c140b8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:15.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c19e52700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c1406a300 0x7f5c140c0530 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009c40 tx=0x7f5c10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:15.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.384+0000 7f5c0a7fc700 1 -- 172.21.15.6:0/3572003383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c100036a0 con 0x7f5c1406a300 2023-07-21T07:35:15.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.385+0000 7f5c0a7fc700 1 -- 172.21.15.6:0/3572003383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1001e070 con 0x7f5c1406a300 2023-07-21T07:35:15.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.385+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/3572003383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c140bfe10 con 0x7f5c1406a300 2023-07-21T07:35:15.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.385+0000 7f5c0a7fc700 1 -- 172.21.15.6:0/3572003383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c10003a40 con 0x7f5c1406a300 2023-07-21T07:35:15.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.385+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/3572003383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1414ccc0 con 0x7f5c1406a300 2023-07-21T07:35:15.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.386+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/3572003383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c140be4b0 con 0x7f5c1406a300 2023-07-21T07:35:15.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.386+0000 7f5c0a7fc700 1 -- 172.21.15.6:0/3572003383 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5c10003ba0 con 0x7f5c1406a300 2023-07-21T07:35:15.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.387+0000 7f5c0a7fc700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5bf806ace0 0x7f5bf806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.387+0000 7f5c0a7fc700 1 -- 172.21.15.6:0/3572003383 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5c10020070 con 0x7f5c1406a300 2023-07-21T07:35:15.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.387+0000 7f5c19651700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5bf806ace0 0x7f5bf806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.387+0000 7f5c19651700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5bf806ace0 0x7f5bf806d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5c1414d6d0 tx=0x7f5c04009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:15.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.391+0000 7f5c0a7fc700 1 -- 172.21.15.6:0/3572003383 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5c10055a30 con 0x7f5c1406a300 2023-07-21T07:35:15.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.587+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/3572003383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c14074500 con 0x7f5c1406a300 2023-07-21T07:35:15.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.587+0000 7f5c0a7fc700 1 -- 172.21.15.6:0/3572003383 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c10059050 con 0x7f5c1406a300 2023-07-21T07:35:15.640 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:35:15.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.589+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5bf806ace0 msgr2=0x7f5bf806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.589+0000 7f5c1c0b6700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5bf806ace0 0x7f5bf806d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5c1414d6d0 tx=0x7f5c04009040 comp rx=0 tx=0).stop 2023-07-21T07:35:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.589+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/3572003383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c1406a300 msgr2=0x7f5c140c0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.589+0000 7f5c1c0b6700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c1406a300 0x7f5c140c0530 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009c40 tx=0x7f5c10004750 comp rx=0 tx=0).stop 2023-07-21T07:35:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.589+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/3572003383 shutdown_connections 2023-07-21T07:35:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.589+0000 7f5c1c0b6700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5bf806ace0 0x7f5bf806d1a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.589+0000 7f5c1c0b6700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c140ba140 0x7f5c140b8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.589+0000 7f5c1c0b6700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c1406a300 0x7f5c140c0530 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.589+0000 7f5c1c0b6700 1 --2- 172.21.15.6:0/3572003383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1406d8a0 0x7f5c140be660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.589+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/3572003383 >> 172.21.15.6:0/3572003383 conn(0x7f5c140a8660 msgr2=0x7f5c14150b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.589+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/3572003383 shutdown_connections 2023-07-21T07:35:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.589+0000 7f5c1c0b6700 1 -- 172.21.15.6:0/3572003383 wait complete. 2023-07-21T07:35:15.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T07:35:15.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.727+0000 7f9dacd24700 1 Processor -- start 2023-07-21T07:35:15.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.727+0000 7f9dacd24700 1 -- start start 2023-07-21T07:35:15.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9dacd24700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9da8151b70 0x7f9da80bea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9dacd24700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9da8158660 0x7f9da815ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9dacd24700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da81581d0 con 0x7f9da80c7260 2023-07-21T07:35:15.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9dacd24700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da80c98e0 con 0x7f9da8158660 2023-07-21T07:35:15.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9dacd24700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da8155360 con 0x7f9da8151b70 2023-07-21T07:35:15.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9da5d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9da80c7260 0x7f9da80c8ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41754/0 (socket says 172.21.15.6:41754) 2023-07-21T07:35:15.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9da5d9b700 1 -- 172.21.15.6:0/1158128079 learned_addr learned my addr 172.21.15.6:0/1158128079 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:15.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9da6d9d700 1 --2- 172.21.15.6:0/1158128079 >> v2:172.21.15.6:3300/0 conn(0x7f9da8158660 0x7f9da815ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9da659c700 1 --2- 172.21.15.6:0/1158128079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9da8151b70 0x7f9da80bea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9da559a700 1 -- 172.21.15.6:0/1158128079 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500916320 0 0) 0x7f9da81581d0 con 0x7f9da80c7260 2023-07-21T07:35:15.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9da559a700 1 -- 172.21.15.6:0/1158128079 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d940035b0 con 0x7f9da80c7260 2023-07-21T07:35:15.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9da6d9d700 1 -- 172.21.15.6:0/1158128079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9da8151b70 msgr2=0x7f9da80bea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:15.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9da6d9d700 1 --2- 172.21.15.6:0/1158128079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9da8151b70 0x7f9da80bea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9da6d9d700 1 -- 172.21.15.6:0/1158128079 >> v1:172.21.15.6:6789/0 conn(0x7f9da80c7260 legacy=0x7f9da80c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.728+0000 7f9da6d9d700 1 -- 172.21.15.6:0/1158128079 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8155080 con 0x7f9da8158660 2023-07-21T07:35:15.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.729+0000 7f9da6d9d700 1 --2- 172.21.15.6:0/1158128079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da8158660 0x7f9da815ede0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009d90 tx=0x7f9da000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8f97c9a831af2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:15.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.729+0000 7f9da559a700 1 -- 172.21.15.6:0/1158128079 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da000e070 con 0x7f9da8158660 2023-07-21T07:35:15.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.729+0000 7f9da559a700 1 -- 172.21.15.6:0/1158128079 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da000bb20 con 0x7f9da8158660 2023-07-21T07:35:15.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.729+0000 7f9da559a700 1 -- 172.21.15.6:0/1158128079 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0012430 con 0x7f9da8158660 2023-07-21T07:35:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.729+0000 7f9dacd24700 1 -- 172.21.15.6:0/1158128079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da8158660 msgr2=0x7f9da815ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.729+0000 7f9dacd24700 1 --2- 172.21.15.6:0/1158128079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da8158660 0x7f9da815ede0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009d90 tx=0x7f9da000b330 comp rx=0 tx=0).stop 2023-07-21T07:35:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.729+0000 7f9dacd24700 1 -- 172.21.15.6:0/1158128079 shutdown_connections 2023-07-21T07:35:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.729+0000 7f9dacd24700 1 --2- 172.21.15.6:0/1158128079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da8158660 0x7f9da815ede0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.729+0000 7f9dacd24700 1 --2- 172.21.15.6:0/1158128079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9da8151b70 0x7f9da80bea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.729+0000 7f9dacd24700 1 -- 172.21.15.6:0/1158128079 >> 172.21.15.6:0/1158128079 conn(0x7f9da80c6620 msgr2=0x7f9da80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.730+0000 7f9dacd24700 1 -- 172.21.15.6:0/1158128079 shutdown_connections 2023-07-21T07:35:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.730+0000 7f9dacd24700 1 -- 172.21.15.6:0/1158128079 wait complete. 2023-07-21T07:35:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.731+0000 7f9dacd24700 1 Processor -- start 2023-07-21T07:35:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.731+0000 7f9dacd24700 1 -- start start 2023-07-21T07:35:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.732+0000 7f9dacd24700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9da80c7260 0x7f9da81522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.732+0000 7f9dacd24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da8151b70 0x7f9da81e99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.732+0000 7f9dacd24700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9da8158660 0x7f9da806c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.732+0000 7f9dacd24700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da8147560 con 0x7f9da8151b70 2023-07-21T07:35:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.732+0000 7f9dacd24700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da80c1cd0 con 0x7f9da8158660 2023-07-21T07:35:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.732+0000 7f9dacd24700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da80c3580 con 0x7f9da80c7260 2023-07-21T07:35:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.732+0000 7f9da5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da8151b70 0x7f9da81e99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.732+0000 7f9da5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da8151b70 0x7f9da81e99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33742/0 (socket says 172.21.15.6:33742) 2023-07-21T07:35:15.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.732+0000 7f9da5d9b700 1 -- 172.21.15.6:0/4170048318 learned_addr learned my addr 172.21.15.6:0/4170048318 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:15.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.732+0000 7f9da659c700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9da80c7260 0x7f9da81522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.732+0000 7f9da6d9d700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9da8158660 0x7f9da806c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.733+0000 7f9da5d9b700 1 -- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9da80c7260 msgr2=0x7f9da81522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.733+0000 7f9da5d9b700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9da80c7260 0x7f9da81522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.733+0000 7f9da5d9b700 1 -- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9da8158660 msgr2=0x7f9da806c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.733+0000 7f9da5d9b700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9da8158660 0x7f9da806c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.733+0000 7f9da5d9b700 1 -- 172.21.15.6:0/4170048318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da0009a70 con 0x7f9da8151b70 2023-07-21T07:35:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.733+0000 7f9da6d9d700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9da8158660 0x7f9da806c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.733+0000 7f9da659c700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9da80c7260 0x7f9da81522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.733+0000 7f9da5d9b700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da8151b70 0x7f9da81e99e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800c700 tx=0x7f9d9800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.733+0000 7f9d9effd700 1 -- 172.21.15.6:0/4170048318 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98005d70 con 0x7f9da8151b70 2023-07-21T07:35:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.733+0000 7f9d9effd700 1 -- 172.21.15.6:0/4170048318 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d980070d0 con 0x7f9da8151b70 2023-07-21T07:35:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.733+0000 7f9dacd24700 1 -- 172.21.15.6:0/4170048318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da806abd0 con 0x7f9da8151b70 2023-07-21T07:35:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.733+0000 7f9d9effd700 1 -- 172.21.15.6:0/4170048318 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98007460 con 0x7f9da8151b70 2023-07-21T07:35:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.733+0000 7f9dacd24700 1 -- 172.21.15.6:0/4170048318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da81e94c0 con 0x7f9da8151b70 2023-07-21T07:35:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.734+0000 7f9dacd24700 1 -- 172.21.15.6:0/4170048318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da804ecc0 con 0x7f9da8151b70 2023-07-21T07:35:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.734+0000 7f9d9effd700 1 -- 172.21.15.6:0/4170048318 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9d980075c0 con 0x7f9da8151b70 2023-07-21T07:35:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.735+0000 7f9d9effd700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9d8806ace0 0x7f9d8806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.735+0000 7f9d9effd700 1 -- 172.21.15.6:0/4170048318 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d98088a90 con 0x7f9da8151b70 2023-07-21T07:35:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.735+0000 7f9da659c700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9d8806ace0 0x7f9d8806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:15.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.736+0000 7f9da659c700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9d8806ace0 0x7f9d8806d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9d900099f0 tx=0x7f9d90008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:15.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.739+0000 7f9d9effd700 1 -- 172.21.15.6:0/4170048318 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9d98053b50 con 0x7f9da8151b70 2023-07-21T07:35:16.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.955+0000 7f9dacd24700 1 -- 172.21.15.6:0/4170048318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9da80c94c0 con 0x7f9da8151b70 2023-07-21T07:35:16.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.955+0000 7f9d9effd700 1 -- 172.21.15.6:0/4170048318 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9d98057170 con 0x7f9da8151b70 2023-07-21T07:35:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.957+0000 7f9dacd24700 1 -- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9d8806ace0 msgr2=0x7f9d8806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.957+0000 7f9dacd24700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9d8806ace0 0x7f9d8806d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9d900099f0 tx=0x7f9d90008040 comp rx=0 tx=0).stop 2023-07-21T07:35:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.957+0000 7f9dacd24700 1 -- 172.21.15.6:0/4170048318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da8151b70 msgr2=0x7f9da81e99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.957+0000 7f9dacd24700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da8151b70 0x7f9da81e99e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800c700 tx=0x7f9d9800cac0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.957+0000 7f9dacd24700 1 -- 172.21.15.6:0/4170048318 shutdown_connections 2023-07-21T07:35:16.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.957+0000 7f9dacd24700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9d8806ace0 0x7f9d8806d1a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.957+0000 7f9dacd24700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9da8158660 0x7f9da806c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.957+0000 7f9dacd24700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9da80c7260 0x7f9da81522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.957+0000 7f9dacd24700 1 --2- 172.21.15.6:0/4170048318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9da8151b70 0x7f9da81e99e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.957+0000 7f9dacd24700 1 -- 172.21.15.6:0/4170048318 >> 172.21.15.6:0/4170048318 conn(0x7f9da80c6620 msgr2=0x7f9da8150cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:16.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.957+0000 7f9dacd24700 1 -- 172.21.15.6:0/4170048318 shutdown_connections 2023-07-21T07:35:16.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:15.957+0000 7f9dacd24700 1 -- 172.21.15.6:0/4170048318 wait complete. 2023-07-21T07:35:16.013 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-21T07:35:16.021 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-21T07:35:16.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:16.022 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-21T07:35:16.077 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-07-21T07:35:16.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:16.078 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-21T07:35:16.107 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-07-21T07:35:16.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:35:16.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.181+0000 7f924dabf700 1 Processor -- start 2023-07-21T07:35:16.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.181+0000 7f924dabf700 1 -- start start 2023-07-21T07:35:16.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f924dabf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f924806a300 0x7f924806da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f924dabf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92480c6640 0x7f92480c3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f924dabf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92480c2be0 con 0x7f9248155050 2023-07-21T07:35:16.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f924dabf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924806e6e0 con 0x7f92480c6640 2023-07-21T07:35:16.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f924dabf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9248155500 con 0x7f924806a300 2023-07-21T07:35:16.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f9247fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92480c6640 0x7f92480c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f9247fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92480c6640 0x7f92480c3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33752/0 (socket says 172.21.15.6:33752) 2023-07-21T07:35:16.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f9247fff700 1 -- 172.21.15.6:0/3844494360 learned_addr learned my addr 172.21.15.6:0/3844494360 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:16.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f92477fe700 1 --2- 172.21.15.6:0/3844494360 >> v2:172.21.15.86:3300/0 conn(0x7f924806a300 0x7f924806da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f9247fff700 1 -- 172.21.15.6:0/3844494360 >> v2:172.21.15.86:3300/0 conn(0x7f924806a300 msgr2=0x7f924806da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:16.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f9247fff700 1 --2- 172.21.15.6:0/3844494360 >> v2:172.21.15.86:3300/0 conn(0x7f924806a300 0x7f924806da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f9247fff700 1 -- 172.21.15.6:0/3844494360 >> v1:172.21.15.86:6789/0 conn(0x7f9248155050 legacy=0x7f92480c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:16.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f9247fff700 1 -- 172.21.15.6:0/3844494360 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924806e120 con 0x7f92480c6640 2023-07-21T07:35:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.182+0000 7f9247fff700 1 --2- 172.21.15.6:0/3844494360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92480c6640 0x7f92480c3070 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9240009e50 tx=0x7f924000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bcf172cc2d674f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.183+0000 7f92467fc700 1 -- 172.21.15.6:0/3844494360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000e070 con 0x7f92480c6640 2023-07-21T07:35:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.183+0000 7f92467fc700 1 -- 172.21.15.6:0/3844494360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9240003a20 con 0x7f92480c6640 2023-07-21T07:35:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.183+0000 7f92467fc700 1 -- 172.21.15.6:0/3844494360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240003dd0 con 0x7f92480c6640 2023-07-21T07:35:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.183+0000 7f924dabf700 1 -- 172.21.15.6:0/3844494360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92480c6640 msgr2=0x7f92480c3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.183+0000 7f924dabf700 1 --2- 172.21.15.6:0/3844494360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92480c6640 0x7f92480c3070 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9240009e50 tx=0x7f924000b330 comp rx=0 tx=0).stop 2023-07-21T07:35:16.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.183+0000 7f924dabf700 1 -- 172.21.15.6:0/3844494360 shutdown_connections 2023-07-21T07:35:16.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.183+0000 7f924dabf700 1 --2- 172.21.15.6:0/3844494360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92480c6640 0x7f92480c3070 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.183+0000 7f924dabf700 1 --2- 172.21.15.6:0/3844494360 >> v2:172.21.15.86:3300/0 conn(0x7f924806a300 0x7f924806da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.183+0000 7f924dabf700 1 -- 172.21.15.6:0/3844494360 >> 172.21.15.6:0/3844494360 conn(0x7f92480a8c90 msgr2=0x7f924806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:16.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.183+0000 7f924dabf700 1 -- 172.21.15.6:0/3844494360 shutdown_connections 2023-07-21T07:35:16.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.183+0000 7f924dabf700 1 -- 172.21.15.6:0/3844494360 wait complete. 2023-07-21T07:35:16.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.184+0000 7f924dabf700 1 Processor -- start 2023-07-21T07:35:16.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.184+0000 7f924dabf700 1 -- start start 2023-07-21T07:35:16.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.185+0000 7f924dabf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f924806a300 0x7f9248153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.185+0000 7f924dabf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9248155050 0x7f92481e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.185+0000 7f924dabf700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92481ea680 0x7f92481e7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.185+0000 7f924dabf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92481e7950 con 0x7f9248155050 2023-07-21T07:35:16.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.185+0000 7f924dabf700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92480bea90 con 0x7f92481ea680 2023-07-21T07:35:16.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.185+0000 7f924dabf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92481eab40 con 0x7f924806a300 2023-07-21T07:35:16.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.185+0000 7f9246ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9248155050 0x7f92481e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.185+0000 7f9246ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9248155050 0x7f92481e6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33756/0 (socket says 172.21.15.6:33756) 2023-07-21T07:35:16.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.185+0000 7f9246ffd700 1 -- 172.21.15.6:0/2691075162 learned_addr learned my addr 172.21.15.6:0/2691075162 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:16.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.185+0000 7f92477fe700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f924806a300 0x7f9248153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.185+0000 7f9247fff700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92481ea680 0x7f92481e7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.186+0000 7f9246ffd700 1 -- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f924806a300 msgr2=0x7f9248153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.186+0000 7f9246ffd700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f924806a300 0x7f9248153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.186+0000 7f9246ffd700 1 -- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92481ea680 msgr2=0x7f92481e7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.186+0000 7f9246ffd700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92481ea680 0x7f92481e7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.186+0000 7f9246ffd700 1 -- 172.21.15.6:0/2691075162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9240009b30 con 0x7f9248155050 2023-07-21T07:35:16.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.186+0000 7f9246ffd700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9248155050 0x7f92481e6ed0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f923000b4a0 tx=0x7f923000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:16.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.186+0000 7f923ffff700 1 -- 172.21.15.6:0/2691075162 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230011830 con 0x7f9248155050 2023-07-21T07:35:16.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.186+0000 7f923ffff700 1 -- 172.21.15.6:0/2691075162 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92300119b0 con 0x7f9248155050 2023-07-21T07:35:16.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.186+0000 7f924dabf700 1 -- 172.21.15.6:0/2691075162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92480be600 con 0x7f9248155050 2023-07-21T07:35:16.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.186+0000 7f923ffff700 1 -- 172.21.15.6:0/2691075162 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230011d60 con 0x7f9248155050 2023-07-21T07:35:16.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.186+0000 7f924dabf700 1 -- 172.21.15.6:0/2691075162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92480bdfb0 con 0x7f9248155050 2023-07-21T07:35:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.187+0000 7f924dabf700 1 -- 172.21.15.6:0/2691075162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92480be790 con 0x7f9248155050 2023-07-21T07:35:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.187+0000 7f923ffff700 1 -- 172.21.15.6:0/2691075162 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f923001a400 con 0x7f9248155050 2023-07-21T07:35:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.188+0000 7f923ffff700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f922806ace0 0x7f922806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.188+0000 7f923ffff700 1 -- 172.21.15.6:0/2691075162 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f92300892d0 con 0x7f9248155050 2023-07-21T07:35:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.188+0000 7f92477fe700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f922806ace0 0x7f922806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.188+0000 7f92477fe700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f922806ace0 0x7f922806d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9248154b90 tx=0x7f9238008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.192+0000 7f923ffff700 1 -- 172.21.15.6:0/2691075162 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9230054410 con 0x7f9248155050 2023-07-21T07:35:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.435+0000 7f924dabf700 1 -- 172.21.15.6:0/2691075162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9248070500 con 0x7f9248155050 2023-07-21T07:35:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.435+0000 7f923ffff700 1 -- 172.21.15.6:0/2691075162 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f9230057a30 con 0x7f9248155050 2023-07-21T07:35:16.487 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:16.487 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3052758988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3052758988},{"type":"v1","addr":"172.21.15.6:6833","nonce":3052758988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3514948644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3514948644},{"type":"v1","addr":"172.21.15.6:6835","nonce":3514948644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/3188395603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3188395603},{"type":"v1","addr":"172.21.15.86:6836","nonce":3188395603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:34:40.418961+0000","modified":"2023-07-21T07:34:44.014954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6837/815488925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":815488925},{"type":"v1","addr":"172.21.15.86:6837","nonce":815488925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T07:35:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.437+0000 7f924dabf700 1 -- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f922806ace0 msgr2=0x7f922806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.437+0000 7f924dabf700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f922806ace0 0x7f922806d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9248154b90 tx=0x7f9238008040 comp rx=0 tx=0).stop 2023-07-21T07:35:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.437+0000 7f924dabf700 1 -- 172.21.15.6:0/2691075162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9248155050 msgr2=0x7f92481e6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.437+0000 7f924dabf700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9248155050 0x7f92481e6ed0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f923000b4a0 tx=0x7f923000b7b0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.437+0000 7f924dabf700 1 -- 172.21.15.6:0/2691075162 shutdown_connections 2023-07-21T07:35:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.437+0000 7f924dabf700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f922806ace0 0x7f922806d1a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.437+0000 7f924dabf700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92481ea680 0x7f92481e7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.437+0000 7f924dabf700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f924806a300 0x7f9248153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.437+0000 7f924dabf700 1 --2- 172.21.15.6:0/2691075162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9248155050 0x7f92481e6ed0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.437+0000 7f924dabf700 1 -- 172.21.15.6:0/2691075162 >> 172.21.15.6:0/2691075162 conn(0x7f92480a8c90 msgr2=0x7f9248151990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.437+0000 7f924dabf700 1 -- 172.21.15.6:0/2691075162 shutdown_connections 2023-07-21T07:35:16.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.437+0000 7f924dabf700 1 -- 172.21.15.6:0/2691075162 wait complete. 2023-07-21T07:35:16.491 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T07:35:16.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:16.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.574+0000 7f6b402e8700 1 Processor -- start 2023-07-21T07:35:16.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.574+0000 7f6b402e8700 1 -- start start 2023-07-21T07:35:16.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b402e8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b3814e870 0x7f6b3814ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b402e8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b380c4930 0x7f6b38151330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b402e8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b380c4ef0 con 0x7f6b380a5f00 2023-07-21T07:35:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b402e8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b380c1df0 con 0x7f6b380c4930 2023-07-21T07:35:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b402e8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b380c1450 con 0x7f6b3814e870 2023-07-21T07:35:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b3d883700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6b380a5f00 0x7f6b380c3440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41782/0 (socket says 172.21.15.6:41782) 2023-07-21T07:35:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b3d883700 1 -- 172.21.15.6:0/2685921058 learned_addr learned my addr 172.21.15.6:0/2685921058 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b3e885700 1 --2- 172.21.15.6:0/2685921058 >> v2:172.21.15.86:3300/0 conn(0x7f6b380c4930 0x7f6b38151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b3e084700 1 --2- 172.21.15.6:0/2685921058 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b3814e870 0x7f6b3814ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b3d082700 1 -- 172.21.15.6:0/2685921058 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334225277 0 0) 0x7f6b380c4ef0 con 0x7f6b380a5f00 2023-07-21T07:35:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b3d082700 1 -- 172.21.15.6:0/2685921058 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b240035b0 con 0x7f6b380a5f00 2023-07-21T07:35:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b3e885700 1 -- 172.21.15.6:0/2685921058 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b3814e870 msgr2=0x7f6b3814ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b3e885700 1 --2- 172.21.15.6:0/2685921058 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b3814e870 0x7f6b3814ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b3e885700 1 -- 172.21.15.6:0/2685921058 >> v1:172.21.15.6:6789/0 conn(0x7f6b380a5f00 legacy=0x7f6b380c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b3e885700 1 -- 172.21.15.6:0/2685921058 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b380c1730 con 0x7f6b380c4930 2023-07-21T07:35:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.575+0000 7f6b3e084700 1 --2- 172.21.15.6:0/2685921058 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b3814e870 0x7f6b3814ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:16.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.576+0000 7f6b3e885700 1 --2- 172.21.15.6:0/2685921058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b380c4930 0x7f6b38151330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009d90 tx=0x7f6b3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4aef146a00c8e96 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.576+0000 7f6b3d082700 1 -- 172.21.15.6:0/2685921058 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3000e070 con 0x7f6b380c4930 2023-07-21T07:35:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.576+0000 7f6b3d082700 1 -- 172.21.15.6:0/2685921058 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3000bb20 con 0x7f6b380c4930 2023-07-21T07:35:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.576+0000 7f6b3d082700 1 -- 172.21.15.6:0/2685921058 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30012430 con 0x7f6b380c4930 2023-07-21T07:35:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.576+0000 7f6b402e8700 1 -- 172.21.15.6:0/2685921058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b380c4930 msgr2=0x7f6b38151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.576+0000 7f6b402e8700 1 --2- 172.21.15.6:0/2685921058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b380c4930 0x7f6b38151330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009d90 tx=0x7f6b3000b330 comp rx=0 tx=0).stop 2023-07-21T07:35:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.576+0000 7f6b402e8700 1 -- 172.21.15.6:0/2685921058 shutdown_connections 2023-07-21T07:35:16.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.576+0000 7f6b402e8700 1 --2- 172.21.15.6:0/2685921058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b380c4930 0x7f6b38151330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.576+0000 7f6b402e8700 1 --2- 172.21.15.6:0/2685921058 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b3814e870 0x7f6b3814ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.576+0000 7f6b402e8700 1 -- 172.21.15.6:0/2685921058 >> 172.21.15.6:0/2685921058 conn(0x7f6b380a8660 msgr2=0x7f6b380a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:16.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.576+0000 7f6b402e8700 1 -- 172.21.15.6:0/2685921058 shutdown_connections 2023-07-21T07:35:16.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.576+0000 7f6b402e8700 1 -- 172.21.15.6:0/2685921058 wait complete. 2023-07-21T07:35:16.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.577+0000 7f6b402e8700 1 Processor -- start 2023-07-21T07:35:16.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.577+0000 7f6b402e8700 1 -- start start 2023-07-21T07:35:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.578+0000 7f6b402e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b380a5f00 0x7f6b381d74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.578+0000 7f6b402e8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b380c4930 0x7f6b38148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.578+0000 7f6b402e8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b3814e870 0x7f6b38148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.578+0000 7f6b402e8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b381d7cb0 con 0x7f6b380a5f00 2023-07-21T07:35:16.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.578+0000 7f6b402e8700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b380be370 con 0x7f6b3814e870 2023-07-21T07:35:16.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.578+0000 7f6b402e8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b380be650 con 0x7f6b380c4930 2023-07-21T07:35:16.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.578+0000 7f6b3e084700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b380a5f00 0x7f6b381d74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.578+0000 7f6b3e084700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b380a5f00 0x7f6b381d74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33768/0 (socket says 172.21.15.6:33768) 2023-07-21T07:35:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.578+0000 7f6b3e084700 1 -- 172.21.15.6:0/854898726 learned_addr learned my addr 172.21.15.6:0/854898726 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.578+0000 7f6b3d883700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b380c4930 0x7f6b38148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.579+0000 7f6b3e885700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b3814e870 0x7f6b38148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.579+0000 7f6b3e084700 1 -- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b380c4930 msgr2=0x7f6b38148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.579+0000 7f6b3e084700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b380c4930 0x7f6b38148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.579+0000 7f6b3e084700 1 -- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b3814e870 msgr2=0x7f6b38148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.579+0000 7f6b3e084700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b3814e870 0x7f6b38148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.579+0000 7f6b3e084700 1 -- 172.21.15.6:0/854898726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b340094a0 con 0x7f6b380a5f00 2023-07-21T07:35:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.579+0000 7f6b3e885700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b3814e870 0x7f6b38148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.579+0000 7f6b3e084700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b380a5f00 0x7f6b381d74b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400ebe0 tx=0x7f6b34009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.579+0000 7f6b2effd700 1 -- 172.21.15.6:0/854898726 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400c910 con 0x7f6b380a5f00 2023-07-21T07:35:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.579+0000 7f6b2effd700 1 -- 172.21.15.6:0/854898726 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3400ca70 con 0x7f6b380a5f00 2023-07-21T07:35:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.579+0000 7f6b402e8700 1 -- 172.21.15.6:0/854898726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b30009a70 con 0x7f6b380a5f00 2023-07-21T07:35:16.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.579+0000 7f6b2effd700 1 -- 172.21.15.6:0/854898726 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400cde0 con 0x7f6b380a5f00 2023-07-21T07:35:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.579+0000 7f6b402e8700 1 -- 172.21.15.6:0/854898726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b380c0e50 con 0x7f6b380a5f00 2023-07-21T07:35:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.580+0000 7f6b402e8700 1 -- 172.21.15.6:0/854898726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b380be930 con 0x7f6b380a5f00 2023-07-21T07:35:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.580+0000 7f6b2effd700 1 -- 172.21.15.6:0/854898726 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b34013470 con 0x7f6b380a5f00 2023-07-21T07:35:16.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.581+0000 7f6b2effd700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6b1c06ace0 0x7f6b1c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.581+0000 7f6b2effd700 1 -- 172.21.15.6:0/854898726 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b340895d0 con 0x7f6b380a5f00 2023-07-21T07:35:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.581+0000 7f6b3d883700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6b1c06ace0 0x7f6b1c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.581+0000 7f6b3d883700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6b1c06ace0 0x7f6b1c06d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6b3806c480 tx=0x7f6b28009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.585+0000 7f6b2effd700 1 -- 172.21.15.6:0/854898726 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6b34054710 con 0x7f6b380a5f00 2023-07-21T07:35:16.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.784+0000 7f6b402e8700 1 -- 172.21.15.6:0/854898726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b38074500 con 0x7f6b380a5f00 2023-07-21T07:35:16.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.786+0000 7f6b2effd700 1 -- 172.21.15.6:0/854898726 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f6b34057d30 con 0x7f6b380a5f00 2023-07-21T07:35:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:16.839 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.788+0000 7f6b402e8700 1 -- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6b1c06ace0 msgr2=0x7f6b1c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.788+0000 7f6b402e8700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6b1c06ace0 0x7f6b1c06d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6b3806c480 tx=0x7f6b28009040 comp rx=0 tx=0).stop 2023-07-21T07:35:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.788+0000 7f6b402e8700 1 -- 172.21.15.6:0/854898726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b380a5f00 msgr2=0x7f6b381d74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.788+0000 7f6b402e8700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b380a5f00 0x7f6b381d74b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400ebe0 tx=0x7f6b34009ec0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.788+0000 7f6b402e8700 1 -- 172.21.15.6:0/854898726 shutdown_connections 2023-07-21T07:35:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.788+0000 7f6b402e8700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6b1c06ace0 0x7f6b1c06d1a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.788+0000 7f6b402e8700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b3814e870 0x7f6b38148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.788+0000 7f6b402e8700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b380a5f00 0x7f6b381d74b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.788+0000 7f6b402e8700 1 --2- 172.21.15.6:0/854898726 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b380c4930 0x7f6b38148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.788+0000 7f6b402e8700 1 -- 172.21.15.6:0/854898726 >> 172.21.15.6:0/854898726 conn(0x7f6b380a8660 msgr2=0x7f6b380a7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.788+0000 7f6b402e8700 1 -- 172.21.15.6:0/854898726 shutdown_connections 2023-07-21T07:35:16.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.788+0000 7f6b402e8700 1 -- 172.21.15.6:0/854898726 wait complete. 2023-07-21T07:35:16.853 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:34:38.107491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:34:39.423138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:35:16.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:35:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.929+0000 7f0b6ea49700 1 Processor -- start 2023-07-21T07:35:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.929+0000 7f0b6ea49700 1 -- start start 2023-07-21T07:35:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b6ea49700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b680703f0 0x7f0b680c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b6ea49700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b68072130 0x7f0b6806a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b6ea49700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b680c0b20 con 0x7f0b680c18c0 2023-07-21T07:35:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b6ea49700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b68151820 con 0x7f0b68072130 2023-07-21T07:35:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b6ea49700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680c0de0 con 0x7f0b680703f0 2023-07-21T07:35:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b6cfe6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b68072130 0x7f0b6806a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b6cfe6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b68072130 0x7f0b6806a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33780/0 (socket says 172.21.15.6:33780) 2023-07-21T07:35:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b677fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0b680c18c0 0x7f0b6814dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41796/0 (socket says 172.21.15.6:41796) 2023-07-21T07:35:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b6cfe6700 1 -- 172.21.15.6:0/3669107822 learned_addr learned my addr 172.21.15.6:0/3669107822 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b67fff700 1 --2- 172.21.15.6:0/3669107822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b680703f0 0x7f0b680c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b6cfe6700 1 -- 172.21.15.6:0/3669107822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b680703f0 msgr2=0x7f0b680c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b6cfe6700 1 --2- 172.21.15.6:0/3669107822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b680703f0 0x7f0b680c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b6cfe6700 1 -- 172.21.15.6:0/3669107822 >> v1:172.21.15.6:6789/0 conn(0x7f0b680c18c0 legacy=0x7f0b6814dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b66ffd700 1 -- 172.21.15.6:0/3669107822 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267858281 0 0) 0x7f0b680c0b20 con 0x7f0b680c18c0 2023-07-21T07:35:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.930+0000 7f0b6cfe6700 1 -- 172.21.15.6:0/3669107822 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b680c10c0 con 0x7f0b68072130 2023-07-21T07:35:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.931+0000 7f0b6cfe6700 1 --2- 172.21.15.6:0/3669107822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b68072130 0x7f0b6806a090 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009e50 tx=0x7f0b6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e26d54dd6615599 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.931+0000 7f0b66ffd700 1 -- 172.21.15.6:0/3669107822 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000e070 con 0x7f0b68072130 2023-07-21T07:35:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.931+0000 7f0b66ffd700 1 -- 172.21.15.6:0/3669107822 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6000b910 con 0x7f0b68072130 2023-07-21T07:35:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.931+0000 7f0b66ffd700 1 -- 172.21.15.6:0/3669107822 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000bcc0 con 0x7f0b68072130 2023-07-21T07:35:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.931+0000 7f0b6ea49700 1 -- 172.21.15.6:0/3669107822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b68072130 msgr2=0x7f0b6806a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.931+0000 7f0b6ea49700 1 --2- 172.21.15.6:0/3669107822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b68072130 0x7f0b6806a090 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009e50 tx=0x7f0b6000b330 comp rx=0 tx=0).stop 2023-07-21T07:35:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.931+0000 7f0b6ea49700 1 -- 172.21.15.6:0/3669107822 shutdown_connections 2023-07-21T07:35:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.931+0000 7f0b6ea49700 1 --2- 172.21.15.6:0/3669107822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b68072130 0x7f0b6806a090 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.931+0000 7f0b6ea49700 1 --2- 172.21.15.6:0/3669107822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b680703f0 0x7f0b680c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.931+0000 7f0b6ea49700 1 -- 172.21.15.6:0/3669107822 >> 172.21.15.6:0/3669107822 conn(0x7f0b680c2c20 msgr2=0x7f0b680c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.931+0000 7f0b6ea49700 1 -- 172.21.15.6:0/3669107822 shutdown_connections 2023-07-21T07:35:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.932+0000 7f0b6ea49700 1 -- 172.21.15.6:0/3669107822 wait complete. 2023-07-21T07:35:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.933+0000 7f0b6ea49700 1 Processor -- start 2023-07-21T07:35:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.933+0000 7f0b6ea49700 1 -- start start 2023-07-21T07:35:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.933+0000 7f0b6ea49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b680703f0 0x7f0b680c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.933+0000 7f0b6ea49700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b68072130 0x7f0b680aa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.933+0000 7f0b6ea49700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b680c18c0 0x7f0b680aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.933+0000 7f0b6ea49700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680a9bb0 con 0x7f0b680703f0 2023-07-21T07:35:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.933+0000 7f0b6ea49700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b68150ab0 con 0x7f0b680c18c0 2023-07-21T07:35:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.933+0000 7f0b6ea49700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6814fca0 con 0x7f0b68072130 2023-07-21T07:35:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b67fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b680703f0 0x7f0b680c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b67fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b680703f0 0x7f0b680c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33782/0 (socket says 172.21.15.6:33782) 2023-07-21T07:35:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b67fff700 1 -- 172.21.15.6:0/521532926 learned_addr learned my addr 172.21.15.6:0/521532926 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b677fe700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b68072130 0x7f0b680aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b6cfe6700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b680c18c0 0x7f0b680aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b67fff700 1 -- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b68072130 msgr2=0x7f0b680aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b67fff700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b68072130 0x7f0b680aa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b67fff700 1 -- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b680c18c0 msgr2=0x7f0b680aa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b67fff700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b680c18c0 0x7f0b680aa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b67fff700 1 -- 172.21.15.6:0/521532926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60009b30 con 0x7f0b680703f0 2023-07-21T07:35:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b677fe700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b68072130 0x7f0b680aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b67fff700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b680703f0 0x7f0b680c4ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000e9b0 tx=0x7f0b5000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b64ff9700 1 -- 172.21.15.6:0/521532926 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50009710 con 0x7f0b680703f0 2023-07-21T07:35:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b64ff9700 1 -- 172.21.15.6:0/521532926 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5000c850 con 0x7f0b680703f0 2023-07-21T07:35:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b6ea49700 1 -- 172.21.15.6:0/521532926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6814ff80 con 0x7f0b680703f0 2023-07-21T07:35:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b64ff9700 1 -- 172.21.15.6:0/521532926 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5000cbc0 con 0x7f0b680703f0 2023-07-21T07:35:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.934+0000 7f0b6ea49700 1 -- 172.21.15.6:0/521532926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b680c4ff0 con 0x7f0b680703f0 2023-07-21T07:35:16.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.935+0000 7f0b6ea49700 1 -- 172.21.15.6:0/521532926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b680a9db0 con 0x7f0b680703f0 2023-07-21T07:35:16.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.936+0000 7f0b64ff9700 1 -- 172.21.15.6:0/521532926 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b5000cd20 con 0x7f0b680703f0 2023-07-21T07:35:16.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.936+0000 7f0b64ff9700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b4806ace0 0x7f0b4806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:16.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.936+0000 7f0b64ff9700 1 -- 172.21.15.6:0/521532926 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b50089560 con 0x7f0b680703f0 2023-07-21T07:35:16.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.936+0000 7f0b677fe700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b4806ace0 0x7f0b4806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:16.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.937+0000 7f0b677fe700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b4806ace0 0x7f0b4806d1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0b58000f60 tx=0x7f0b58007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:16.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:16.941+0000 7f0b64ff9700 1 -- 172.21.15.6:0/521532926 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0b680a9db0 con 0x7f0b680703f0 2023-07-21T07:35:17.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.137+0000 7f0b6ea49700 1 -- 172.21.15.6:0/521532926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b680a9db0 con 0x7f0b680703f0 2023-07-21T07:35:17.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.137+0000 7f0b64ff9700 1 -- 172.21.15.6:0/521532926 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b50058130 con 0x7f0b680703f0 2023-07-21T07:35:17.190 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:35:17.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.140+0000 7f0b6ea49700 1 -- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b4806ace0 msgr2=0x7f0b4806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.140+0000 7f0b6ea49700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b4806ace0 0x7f0b4806d1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0b58000f60 tx=0x7f0b58007d30 comp rx=0 tx=0).stop 2023-07-21T07:35:17.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.140+0000 7f0b6ea49700 1 -- 172.21.15.6:0/521532926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b680703f0 msgr2=0x7f0b680c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.140+0000 7f0b6ea49700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b680703f0 0x7f0b680c4ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000e9b0 tx=0x7f0b5000ed70 comp rx=0 tx=0).stop 2023-07-21T07:35:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.140+0000 7f0b6ea49700 1 -- 172.21.15.6:0/521532926 shutdown_connections 2023-07-21T07:35:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.140+0000 7f0b6ea49700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b4806ace0 0x7f0b4806d1a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.140+0000 7f0b6ea49700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b680c18c0 0x7f0b680aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.140+0000 7f0b6ea49700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b680703f0 0x7f0b680c4ab0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.140+0000 7f0b6ea49700 1 --2- 172.21.15.6:0/521532926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b68072130 0x7f0b680aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.140+0000 7f0b6ea49700 1 -- 172.21.15.6:0/521532926 >> 172.21.15.6:0/521532926 conn(0x7f0b680c2c20 msgr2=0x7f0b680730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.140+0000 7f0b6ea49700 1 -- 172.21.15.6:0/521532926 shutdown_connections 2023-07-21T07:35:17.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.140+0000 7f0b6ea49700 1 -- 172.21.15.6:0/521532926 wait complete. 2023-07-21T07:35:17.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:35:17.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.280+0000 7f03ab77c700 1 Processor -- start 2023-07-21T07:35:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.281+0000 7f03ab77c700 1 -- start start 2023-07-21T07:35:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.281+0000 7f03ab77c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03a40ba140 0x7f03a40c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.281+0000 7f03ab77c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f03a406d8a0 0x7f03a40c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.281+0000 7f03ab77c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a4155530 con 0x7f03a406a300 2023-07-21T07:35:17.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.281+0000 7f03ab77c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a40c1a30 con 0x7f03a406d8a0 2023-07-21T07:35:17.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.281+0000 7f03ab77c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4154920 con 0x7f03a40ba140 2023-07-21T07:35:17.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.281+0000 7f03a9518700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f03a406a300 0x7f03a41519b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41810/0 (socket says 172.21.15.6:41810) 2023-07-21T07:35:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f03a9518700 1 -- 172.21.15.6:0/2895386430 learned_addr learned my addr 172.21.15.6:0/2895386430 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f03a8d17700 1 --2- 172.21.15.6:0/2895386430 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03a40ba140 0x7f03a40c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f03a9d19700 1 --2- 172.21.15.6:0/2895386430 >> v2:172.21.15.86:3300/0 conn(0x7f03a406d8a0 0x7f03a40c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690511983 0 0) 0x7f03a4155530 con 0x7f03a406a300 2023-07-21T07:35:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03900035b0 con 0x7f03a406a300 2023-07-21T07:35:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 699017269 0 0) 0x7f03900035b0 con 0x7f03a406a300 2023-07-21T07:35:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03a40ba140 msgr2=0x7f03a40c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 --2- 172.21.15.6:0/2895386430 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03a40ba140 0x7f03a40c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 >> v2:172.21.15.86:3300/0 conn(0x7f03a406d8a0 msgr2=0x7f03a40c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 --2- 172.21.15.6:0/2895386430 >> v2:172.21.15.86:3300/0 conn(0x7f03a406d8a0 0x7f03a40c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a4154c00 con 0x7f03a406a300 2023-07-21T07:35:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f0394001670 con 0x7f03a406a300 2023-07-21T07:35:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 >> v1:172.21.15.6:6789/0 conn(0x7f03a406a300 legacy=0x7f03a41519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 --2- 172.21.15.6:0/2895386430 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03a40ba140 0x7f0390003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 --2- 172.21.15.6:0/2895386430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0390003f80 0x7f0390004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 --2- 172.21.15.6:0/2895386430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0390004d90 0x7f0390005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a40c1a30 con 0x7f0390004d90 2023-07-21T07:35:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4154920 con 0x7f0390003f80 2023-07-21T07:35:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039000ba60 con 0x7f03a40ba140 2023-07-21T07:35:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f03a9d19700 1 --2- 172.21.15.6:0/2895386430 >> v2:172.21.15.86:3300/0 conn(0x7f03a406d8a0 0x7f03a40c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f03a8d17700 1 --2- 172.21.15.6:0/2895386430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0390003f80 0x7f0390004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f03a9518700 1 --2- 172.21.15.6:0/2895386430 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03a40ba140 0x7f0390003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.282+0000 7f03a9d19700 1 --2- 172.21.15.6:0/2895386430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0390004d90 0x7f0390005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.283+0000 7f03a9d19700 1 -- 172.21.15.6:0/2895386430 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03a40ba140 msgr2=0x7f0390003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:17.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.283+0000 7f03a9d19700 1 --2- 172.21.15.6:0/2895386430 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03a40ba140 0x7f0390003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.283+0000 7f03a9d19700 1 -- 172.21.15.6:0/2895386430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0390003f80 msgr2=0x7f0390004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:17.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.283+0000 7f03a9d19700 1 --2- 172.21.15.6:0/2895386430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0390003f80 0x7f0390004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.283+0000 7f03a9d19700 1 -- 172.21.15.6:0/2895386430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03900035b0 con 0x7f0390004d90 2023-07-21T07:35:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.283+0000 7f03a9d19700 1 --2- 172.21.15.6:0/2895386430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0390004d90 0x7f0390005210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f039c00e380 tx=0x7f0390005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3bf2224a3e02ea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.283+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c00ee40 con 0x7f0390004d90 2023-07-21T07:35:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.283+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039c00f040 con 0x7f0390004d90 2023-07-21T07:35:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.283+0000 7f039bfff700 1 -- 172.21.15.6:0/2895386430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c003c40 con 0x7f0390004d90 2023-07-21T07:35:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.283+0000 7f03ab77c700 1 -- 172.21.15.6:0/2895386430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0390004d90 msgr2=0x7f0390005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.283+0000 7f03ab77c700 1 --2- 172.21.15.6:0/2895386430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0390004d90 0x7f0390005210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f039c00e380 tx=0x7f0390005880 comp rx=0 tx=0).stop 2023-07-21T07:35:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.283+0000 7f03a9d19700 1 -- 172.21.15.6:0/2895386430 reap_dead start 2023-07-21T07:35:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.284+0000 7f03ab77c700 1 -- 172.21.15.6:0/2895386430 shutdown_connections 2023-07-21T07:35:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.284+0000 7f03ab77c700 1 -- 172.21.15.6:0/2895386430 >> 172.21.15.6:0/2895386430 conn(0x7f03a40a8660 msgr2=0x7f03a40a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.284+0000 7f03ab77c700 1 -- 172.21.15.6:0/2895386430 shutdown_connections 2023-07-21T07:35:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.284+0000 7f03ab77c700 1 -- 172.21.15.6:0/2895386430 wait complete. 2023-07-21T07:35:17.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.285+0000 7f03ab77c700 1 Processor -- start 2023-07-21T07:35:17.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.285+0000 7f03ab77c700 1 -- start start 2023-07-21T07:35:17.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.286+0000 7f03ab77c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03a40b8b30 0x7f03a40b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.286+0000 7f03ab77c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a4070710 0x7f03a40b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.286+0000 7f03ab77c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03a4152a40 0x7f03a40a6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.286+0000 7f03ab77c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a414a6a0 con 0x7f03a4070710 2023-07-21T07:35:17.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.286+0000 7f03ab77c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4153be0 con 0x7f03a4152a40 2023-07-21T07:35:17.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.286+0000 7f03ab77c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4152fd0 con 0x7f03a40b8b30 2023-07-21T07:35:17.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.286+0000 7f03a8d17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a4070710 0x7f03a40b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.286+0000 7f03a8d17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a4070710 0x7f03a40b8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33804/0 (socket says 172.21.15.6:33804) 2023-07-21T07:35:17.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.286+0000 7f03a8d17700 1 -- 172.21.15.6:0/3350664017 learned_addr learned my addr 172.21.15.6:0/3350664017 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:17.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.287+0000 7f03a9518700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03a40b8b30 0x7f03a40b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.287+0000 7f03a9d19700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03a4152a40 0x7f03a40a6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.287+0000 7f03a8d17700 1 -- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03a40b8b30 msgr2=0x7f03a40b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.287+0000 7f03a8d17700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03a40b8b30 0x7f03a40b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.287+0000 7f03a8d17700 1 -- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03a4152a40 msgr2=0x7f03a40a6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.287+0000 7f03a8d17700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03a4152a40 0x7f03a40a6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.287+0000 7f03a8d17700 1 -- 172.21.15.6:0/3350664017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a41532b0 con 0x7f03a4070710 2023-07-21T07:35:17.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.287+0000 7f03a8d17700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a4070710 0x7f03a40b8040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f03a0011aa0 tx=0x7f03a0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:17.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.287+0000 7f0399ffb700 1 -- 172.21.15.6:0/3350664017 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000f920 con 0x7f03a4070710 2023-07-21T07:35:17.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.287+0000 7f0399ffb700 1 -- 172.21.15.6:0/3350664017 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a000fa80 con 0x7f03a4070710 2023-07-21T07:35:17.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.287+0000 7f03ab77c700 1 -- 172.21.15.6:0/3350664017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a4153590 con 0x7f03a4070710 2023-07-21T07:35:17.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.287+0000 7f0399ffb700 1 -- 172.21.15.6:0/3350664017 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000fe30 con 0x7f03a4070710 2023-07-21T07:35:17.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.287+0000 7f03ab77c700 1 -- 172.21.15.6:0/3350664017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a40b8580 con 0x7f03a4070710 2023-07-21T07:35:17.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.288+0000 7f03ab77c700 1 -- 172.21.15.6:0/3350664017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a4074500 con 0x7f03a4070710 2023-07-21T07:35:17.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.289+0000 7f0399ffb700 1 -- 172.21.15.6:0/3350664017 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03a0014440 con 0x7f03a4070710 2023-07-21T07:35:17.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.289+0000 7f0399ffb700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f038806ace0 0x7f038806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.289+0000 7f0399ffb700 1 -- 172.21.15.6:0/3350664017 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03a0089ba0 con 0x7f03a4070710 2023-07-21T07:35:17.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.289+0000 7f03a9518700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f038806ace0 0x7f038806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.290+0000 7f03a9518700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f038806ace0 0x7f038806d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f03940048d0 tx=0x7f0394009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:17.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.293+0000 7f0399ffb700 1 -- 172.21.15.6:0/3350664017 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03a00587a0 con 0x7f03a4070710 2023-07-21T07:35:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.491+0000 7f03ab77c700 1 -- 172.21.15.6:0/3350664017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f03a414fae0 con 0x7f03a4070710 2023-07-21T07:35:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.492+0000 7f0399ffb700 1 -- 172.21.15.6:0/3350664017 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f03a0058330 con 0x7f03a4070710 2023-07-21T07:35:17.544 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:35:17.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.494+0000 7f03ab77c700 1 -- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f038806ace0 msgr2=0x7f038806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.494+0000 7f03ab77c700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f038806ace0 0x7f038806d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f03940048d0 tx=0x7f0394009040 comp rx=0 tx=0).stop 2023-07-21T07:35:17.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.494+0000 7f03ab77c700 1 -- 172.21.15.6:0/3350664017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a4070710 msgr2=0x7f03a40b8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.494+0000 7f03ab77c700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a4070710 0x7f03a40b8040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f03a0011aa0 tx=0x7f03a0011e60 comp rx=0 tx=0).stop 2023-07-21T07:35:17.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.494+0000 7f03ab77c700 1 -- 172.21.15.6:0/3350664017 shutdown_connections 2023-07-21T07:35:17.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.494+0000 7f03ab77c700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f038806ace0 0x7f038806d1a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.494+0000 7f03ab77c700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03a4152a40 0x7f03a40a6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.494+0000 7f03ab77c700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03a40b8b30 0x7f03a40b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.494+0000 7f03ab77c700 1 --2- 172.21.15.6:0/3350664017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a4070710 0x7f03a40b8040 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.494+0000 7f03ab77c700 1 -- 172.21.15.6:0/3350664017 >> 172.21.15.6:0/3350664017 conn(0x7f03a40a8660 msgr2=0x7f03a40c7010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.494+0000 7f03ab77c700 1 -- 172.21.15.6:0/3350664017 shutdown_connections 2023-07-21T07:35:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.494+0000 7f03ab77c700 1 -- 172.21.15.6:0/3350664017 wait complete. 2023-07-21T07:35:17.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:35:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.634+0000 7fc90b508700 1 Processor -- start 2023-07-21T07:35:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.634+0000 7fc90b508700 1 -- start start 2023-07-21T07:35:17.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.635+0000 7fc90b508700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc904072160 0x7fc90414f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.635+0000 7fc90b508700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9040c4120 0x7fc90414f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.635+0000 7fc90b508700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9040c3c90 con 0x7fc9040a6f80 2023-07-21T07:35:17.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.635+0000 7fc90b508700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9040c26e0 con 0x7fc9040c4120 2023-07-21T07:35:17.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.635+0000 7fc90b508700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9040c3680 con 0x7fc904072160 2023-07-21T07:35:17.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.635+0000 7fc909aa5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9040c4120 0x7fc90414f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.635+0000 7fc909aa5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9040c4120 0x7fc90414f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33814/0 (socket says 172.21.15.6:33814) 2023-07-21T07:35:17.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.635+0000 7fc909aa5700 1 -- 172.21.15.6:0/9370773 learned_addr learned my addr 172.21.15.6:0/9370773 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:17.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.635+0000 7fc908aa3700 1 --2- 172.21.15.6:0/9370773 >> v2:172.21.15.86:3300/0 conn(0x7fc904072160 0x7fc90414f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.636+0000 7fc909aa5700 1 -- 172.21.15.6:0/9370773 >> v2:172.21.15.86:3300/0 conn(0x7fc904072160 msgr2=0x7fc90414f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:17.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.636+0000 7fc909aa5700 1 --2- 172.21.15.6:0/9370773 >> v2:172.21.15.86:3300/0 conn(0x7fc904072160 0x7fc90414f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.636+0000 7fc909aa5700 1 -- 172.21.15.6:0/9370773 >> v1:172.21.15.86:6789/0 conn(0x7fc9040a6f80 legacy=0x7fc904152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.636+0000 7fc909aa5700 1 -- 172.21.15.6:0/9370773 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9040c6fe0 con 0x7fc9040c4120 2023-07-21T07:35:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.636+0000 7fc909aa5700 1 --2- 172.21.15.6:0/9370773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9040c4120 0x7fc90414f960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc9040c5670 tx=0x7fc8fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc449bf627a75920 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.636+0000 7fc8fbfff700 1 -- 172.21.15.6:0/9370773 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc00e070 con 0x7fc9040c4120 2023-07-21T07:35:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.636+0000 7fc8fbfff700 1 -- 172.21.15.6:0/9370773 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8fc00b910 con 0x7fc9040c4120 2023-07-21T07:35:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.636+0000 7fc8fbfff700 1 -- 172.21.15.6:0/9370773 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc00bcc0 con 0x7fc9040c4120 2023-07-21T07:35:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.637+0000 7fc90b508700 1 -- 172.21.15.6:0/9370773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9040c4120 msgr2=0x7fc90414f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.637+0000 7fc90b508700 1 --2- 172.21.15.6:0/9370773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9040c4120 0x7fc90414f960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc9040c5670 tx=0x7fc8fc00b330 comp rx=0 tx=0).stop 2023-07-21T07:35:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.637+0000 7fc90b508700 1 -- 172.21.15.6:0/9370773 shutdown_connections 2023-07-21T07:35:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.637+0000 7fc90b508700 1 --2- 172.21.15.6:0/9370773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9040c4120 0x7fc90414f960 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.637+0000 7fc90b508700 1 --2- 172.21.15.6:0/9370773 >> v2:172.21.15.86:3300/0 conn(0x7fc904072160 0x7fc90414f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.637+0000 7fc90b508700 1 -- 172.21.15.6:0/9370773 >> 172.21.15.6:0/9370773 conn(0x7fc9040c7b50 msgr2=0x7fc9040c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.637+0000 7fc90b508700 1 -- 172.21.15.6:0/9370773 shutdown_connections 2023-07-21T07:35:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.637+0000 7fc90b508700 1 -- 172.21.15.6:0/9370773 wait complete. 2023-07-21T07:35:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.638+0000 7fc90b508700 1 Processor -- start 2023-07-21T07:35:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.638+0000 7fc90b508700 1 -- start start 2023-07-21T07:35:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc90b508700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc904072160 0x7fc9040abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc90b508700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9040a6f80 0x7fc9041524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc90b508700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9040c4120 0x7fc9041eb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc90b508700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040ac4b0 con 0x7fc9040c4120 2023-07-21T07:35:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc90b508700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc904152a30 con 0x7fc904072160 2023-07-21T07:35:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc90b508700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc904153a30 con 0x7fc9040a6f80 2023-07-21T07:35:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc909aa5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9040c4120 0x7fc9041eb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc909aa5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9040c4120 0x7fc9041eb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33820/0 (socket says 172.21.15.6:33820) 2023-07-21T07:35:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc909aa5700 1 -- 172.21.15.6:0/2472684872 learned_addr learned my addr 172.21.15.6:0/2472684872 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc9092a4700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc904072160 0x7fc9040abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc908aa3700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9040a6f80 0x7fc9041524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc909aa5700 1 -- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9040a6f80 msgr2=0x7fc9041524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc909aa5700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9040a6f80 0x7fc9041524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc909aa5700 1 -- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc904072160 msgr2=0x7fc9040abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc909aa5700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc904072160 0x7fc9040abf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc909aa5700 1 -- 172.21.15.6:0/2472684872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc009b30 con 0x7fc9040c4120 2023-07-21T07:35:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc909aa5700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9040c4120 0x7fc9041eb0e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc9040685a0 tx=0x7fc8fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc8f9ffb700 1 -- 172.21.15.6:0/2472684872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc004880 con 0x7fc9040c4120 2023-07-21T07:35:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc8f9ffb700 1 -- 172.21.15.6:0/2472684872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8fc0099b0 con 0x7fc9040c4120 2023-07-21T07:35:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc90b508700 1 -- 172.21.15.6:0/2472684872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc904153d10 con 0x7fc9040c4120 2023-07-21T07:35:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.639+0000 7fc8f9ffb700 1 -- 172.21.15.6:0/2472684872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc01c680 con 0x7fc9040c4120 2023-07-21T07:35:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.640+0000 7fc90b508700 1 -- 172.21.15.6:0/2472684872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc904151fd0 con 0x7fc9040c4120 2023-07-21T07:35:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.640+0000 7fc90b508700 1 -- 172.21.15.6:0/2472684872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc904074500 con 0x7fc9040c4120 2023-07-21T07:35:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.642+0000 7fc8f9ffb700 1 -- 172.21.15.6:0/2472684872 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc8fc01c7e0 con 0x7fc9040c4120 2023-07-21T07:35:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.643+0000 7fc8f9ffb700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc8e806ace0 0x7fc8e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.643+0000 7fc8f9ffb700 1 -- 172.21.15.6:0/2472684872 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8fc08b0e0 con 0x7fc9040c4120 2023-07-21T07:35:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.643+0000 7fc9092a4700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc8e806ace0 0x7fc8e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.643+0000 7fc9092a4700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc8e806ace0 0x7fc8e806d1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4007fd0 tx=0x7fc8f4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.646+0000 7fc8f9ffb700 1 -- 172.21.15.6:0/2472684872 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc8fc056320 con 0x7fc9040c4120 2023-07-21T07:35:17.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.846+0000 7fc90b508700 1 -- 172.21.15.6:0/2472684872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc90406fe90 con 0x7fc9040c4120 2023-07-21T07:35:17.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.847+0000 7fc8f9ffb700 1 -- 172.21.15.6:0/2472684872 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc8fc059940 con 0x7fc9040c4120 2023-07-21T07:35:17.899 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:35:17.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.849+0000 7fc90b508700 1 -- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc8e806ace0 msgr2=0x7fc8e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.849+0000 7fc90b508700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc8e806ace0 0x7fc8e806d1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4007fd0 tx=0x7fc8f4009040 comp rx=0 tx=0).stop 2023-07-21T07:35:17.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.849+0000 7fc90b508700 1 -- 172.21.15.6:0/2472684872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9040c4120 msgr2=0x7fc9041eb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.849+0000 7fc90b508700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9040c4120 0x7fc9041eb0e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc9040685a0 tx=0x7fc8fc004ad0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.849+0000 7fc90b508700 1 -- 172.21.15.6:0/2472684872 shutdown_connections 2023-07-21T07:35:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.849+0000 7fc90b508700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc8e806ace0 0x7fc8e806d1a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.849+0000 7fc90b508700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9040c4120 0x7fc9041eb0e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.849+0000 7fc90b508700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc904072160 0x7fc9040abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.849+0000 7fc90b508700 1 --2- 172.21.15.6:0/2472684872 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9040a6f80 0x7fc9041524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.849+0000 7fc90b508700 1 -- 172.21.15.6:0/2472684872 >> 172.21.15.6:0/2472684872 conn(0x7fc9040c7b50 msgr2=0x7fc90414d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:17.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.849+0000 7fc90b508700 1 -- 172.21.15.6:0/2472684872 shutdown_connections 2023-07-21T07:35:17.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.849+0000 7fc90b508700 1 -- 172.21.15.6:0/2472684872 wait complete. 2023-07-21T07:35:17.913 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:35:18.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.989+0000 7f03cd620700 1 Processor -- start 2023-07-21T07:35:18.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.989+0000 7f03cd620700 1 -- start start 2023-07-21T07:35:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.990+0000 7f03cd620700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03c80bd360 0x7f03c806b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.990+0000 7f03cd620700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c8154dc0 con 0x7f03c8151d80 2023-07-21T07:35:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.990+0000 7f03cd620700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c806ad50 con 0x7f03c80c7bd0 2023-07-21T07:35:18.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.990+0000 7f03cd620700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c81552f0 con 0x7f03c80bd360 2023-07-21T07:35:18.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.990+0000 7f03c6ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f03c8151d80 0x7f03c80c4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41844/0 (socket says 172.21.15.6:41844) 2023-07-21T07:35:18.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.990+0000 7f03c6ffd700 1 -- 172.21.15.6:0/149785428 learned_addr learned my addr 172.21.15.6:0/149785428 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:18.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.991+0000 7f03c77fe700 1 --2- 172.21.15.6:0/149785428 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03c80bd360 0x7f03c806b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.991+0000 7f03c5ffb700 1 -- 172.21.15.6:0/149785428 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507557867 0 0) 0x7f03c8154dc0 con 0x7f03c8151d80 2023-07-21T07:35:18.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.991+0000 7f03c5ffb700 1 -- 172.21.15.6:0/149785428 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03b00035b0 con 0x7f03c8151d80 2023-07-21T07:35:18.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.991+0000 7f03c5ffb700 1 -- 172.21.15.6:0/149785428 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783812271 0 0) 0x7f03c806ad50 con 0x7f03c80c7bd0 2023-07-21T07:35:18.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.991+0000 7f03c5ffb700 1 -- 172.21.15.6:0/149785428 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c8154dc0 con 0x7f03c80c7bd0 2023-07-21T07:35:18.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.991+0000 7f03c5ffb700 1 -- 172.21.15.6:0/149785428 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3902203938 0 0) 0x7f03b00035b0 con 0x7f03c8151d80 2023-07-21T07:35:18.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.991+0000 7f03c77fe700 1 -- 172.21.15.6:0/149785428 >> v1:172.21.15.86:6789/0 conn(0x7f03c80c7bd0 legacy=0x7f03c806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.991+0000 7f03c77fe700 1 -- 172.21.15.6:0/149785428 >> v1:172.21.15.6:6789/0 conn(0x7f03c8151d80 legacy=0x7f03c80c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.991+0000 7f03c77fe700 1 -- 172.21.15.6:0/149785428 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c8155010 con 0x7f03c80bd360 2023-07-21T07:35:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.991+0000 7f03c77fe700 1 --2- 172.21.15.6:0/149785428 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03c80bd360 0x7f03c806b8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009dc0 tx=0x7f03c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=787aa0e393c8b016 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.991+0000 7f03c5ffb700 1 -- 172.21.15.6:0/149785428 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c000e070 con 0x7f03c80bd360 2023-07-21T07:35:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.991+0000 7f03c5ffb700 1 -- 172.21.15.6:0/149785428 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c0003a20 con 0x7f03c80bd360 2023-07-21T07:35:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.991+0000 7f03c5ffb700 1 -- 172.21.15.6:0/149785428 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc001670 con 0x7f03c80bd360 2023-07-21T07:35:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.992+0000 7f03cd620700 1 -- 172.21.15.6:0/149785428 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03c80bd360 msgr2=0x7f03c806b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.992+0000 7f03cd620700 1 --2- 172.21.15.6:0/149785428 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03c80bd360 0x7f03c806b8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009dc0 tx=0x7f03c000b330 comp rx=0 tx=0).stop 2023-07-21T07:35:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.992+0000 7f03cd620700 1 -- 172.21.15.6:0/149785428 shutdown_connections 2023-07-21T07:35:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.992+0000 7f03cd620700 1 --2- 172.21.15.6:0/149785428 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03c80bd360 0x7f03c806b8f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.992+0000 7f03cd620700 1 -- 172.21.15.6:0/149785428 >> 172.21.15.6:0/149785428 conn(0x7f03c80c9cd0 msgr2=0x7f03c80ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.992+0000 7f03cd620700 1 -- 172.21.15.6:0/149785428 shutdown_connections 2023-07-21T07:35:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.992+0000 7f03cd620700 1 -- 172.21.15.6:0/149785428 wait complete. 2023-07-21T07:35:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.993+0000 7f03cd620700 1 Processor -- start 2023-07-21T07:35:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.993+0000 7f03cd620700 1 -- start start 2023-07-21T07:35:18.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03cd620700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c80bd360 0x7f03c80c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03cd620700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03c80c7bd0 0x7f03c81529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03cd620700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8151d80 0x7f03c80c2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03cd620700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c80bf5c0 con 0x7f03c8151d80 2023-07-21T07:35:18.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03cd620700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c8157e50 con 0x7f03c80bd360 2023-07-21T07:35:18.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03cd620700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c81581a0 con 0x7f03c80c7bd0 2023-07-21T07:35:18.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8151d80 0x7f03c80c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8151d80 0x7f03c80c2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33834/0 (socket says 172.21.15.6:33834) 2023-07-21T07:35:18.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03c77fe700 1 -- 172.21.15.6:0/11996803 learned_addr learned my addr 172.21.15.6:0/11996803 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:18.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03c6ffd700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c80bd360 0x7f03c80c01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03c67fc700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03c80c7bd0 0x7f03c81529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03c77fe700 1 -- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03c80c7bd0 msgr2=0x7f03c81529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03c77fe700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03c80c7bd0 0x7f03c81529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03c77fe700 1 -- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c80bd360 msgr2=0x7f03c80c01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03c77fe700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c80bd360 0x7f03c80c01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03c77fe700 1 -- 172.21.15.6:0/11996803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c0009a70 con 0x7f03c8151d80 2023-07-21T07:35:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03c6ffd700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c80bd360 0x7f03c80c01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.994+0000 7f03c77fe700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8151d80 0x7f03c80c2910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f03c0004000 tx=0x7f03c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.995+0000 7f03af7fe700 1 -- 172.21.15.6:0/11996803 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c00042c0 con 0x7f03c8151d80 2023-07-21T07:35:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.995+0000 7f03af7fe700 1 -- 172.21.15.6:0/11996803 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c0004440 con 0x7f03c8151d80 2023-07-21T07:35:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.995+0000 7f03cd620700 1 -- 172.21.15.6:0/11996803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c80be980 con 0x7f03c8151d80 2023-07-21T07:35:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.995+0000 7f03af7fe700 1 -- 172.21.15.6:0/11996803 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c00047f0 con 0x7f03c8151d80 2023-07-21T07:35:18.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.995+0000 7f03cd620700 1 -- 172.21.15.6:0/11996803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c80becd0 con 0x7f03c8151d80 2023-07-21T07:35:18.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.996+0000 7f03cd620700 1 -- 172.21.15.6:0/11996803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c80bf700 con 0x7f03c8151d80 2023-07-21T07:35:18.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.996+0000 7f03af7fe700 1 -- 172.21.15.6:0/11996803 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03c001c460 con 0x7f03c8151d80 2023-07-21T07:35:18.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.996+0000 7f03af7fe700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f03b406ace0 0x7f03b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.997+0000 7f03af7fe700 1 -- 172.21.15.6:0/11996803 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03c008aa00 con 0x7f03c8151d80 2023-07-21T07:35:18.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.997+0000 7f03c6ffd700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f03b406ace0 0x7f03b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:17.997+0000 7f03c6ffd700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f03b406ace0 0x7f03b406d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f03bc001eb0 tx=0x7f03bc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:18.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.001+0000 7f03af7fe700 1 -- 172.21.15.6:0/11996803 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03c80bf700 con 0x7f03c8151d80 2023-07-21T07:35:18.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.196+0000 7f03cd620700 1 -- 172.21.15.6:0/11996803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03c80bf700 con 0x7f03c8151d80 2023-07-21T07:35:18.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.197+0000 7f03af7fe700 1 -- 172.21.15.6:0/11996803 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f03c80bf700 con 0x7f03c8151d80 2023-07-21T07:35:18.249 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:35:18.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.198+0000 7f03cd620700 1 -- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f03b406ace0 msgr2=0x7f03b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.198+0000 7f03cd620700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f03b406ace0 0x7f03b406d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f03bc001eb0 tx=0x7f03bc009040 comp rx=0 tx=0).stop 2023-07-21T07:35:18.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.198+0000 7f03cd620700 1 -- 172.21.15.6:0/11996803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8151d80 msgr2=0x7f03c80c2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.198+0000 7f03cd620700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8151d80 0x7f03c80c2910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f03c0004000 tx=0x7f03c0004ad0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.199+0000 7f03cd620700 1 -- 172.21.15.6:0/11996803 shutdown_connections 2023-07-21T07:35:18.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.199+0000 7f03cd620700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f03b406ace0 0x7f03b406d1a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.199+0000 7f03cd620700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03c8151d80 0x7f03c80c2910 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.199+0000 7f03cd620700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c80bd360 0x7f03c80c01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.199+0000 7f03cd620700 1 --2- 172.21.15.6:0/11996803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03c80c7bd0 0x7f03c81529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.199+0000 7f03cd620700 1 -- 172.21.15.6:0/11996803 >> 172.21.15.6:0/11996803 conn(0x7f03c80c9cd0 msgr2=0x7f03c806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:18.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.199+0000 7f03cd620700 1 -- 172.21.15.6:0/11996803 shutdown_connections 2023-07-21T07:35:18.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.199+0000 7f03cd620700 1 -- 172.21.15.6:0/11996803 wait complete. 2023-07-21T07:35:18.264 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:35:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.338+0000 7fe95a88e700 1 Processor -- start 2023-07-21T07:35:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.338+0000 7fe95a88e700 1 -- start start 2023-07-21T07:35:18.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.339+0000 7fe95a88e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9540c0f60 0x7fe9541550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.339+0000 7fe95a88e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9540664d0 con 0x7fe95406a090 2023-07-21T07:35:18.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.339+0000 7fe95a88e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe954155600 con 0x7fe954151b50 2023-07-21T07:35:18.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.339+0000 7fe95a88e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9540bf550 con 0x7fe9540c0f60 2023-07-21T07:35:18.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.339+0000 7fe958e2b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe95406a090 0x7fe95406a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41862/0 (socket says 172.21.15.6:41862) 2023-07-21T07:35:18.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.339+0000 7fe958e2b700 1 -- 172.21.15.6:0/183542270 learned_addr learned my addr 172.21.15.6:0/183542270 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:18.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.339+0000 7fe9537fe700 1 --2- 172.21.15.6:0/183542270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9540c0f60 0x7fe9541550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381657788 0 0) 0x7fe9540664d0 con 0x7fe95406a090 2023-07-21T07:35:18.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9400035b0 con 0x7fe95406a090 2023-07-21T07:35:18.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269794891 0 0) 0x7fe944001110 con 0x7fe954151b50 2023-07-21T07:35:18.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9540664d0 con 0x7fe954151b50 2023-07-21T07:35:18.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548632898 0 0) 0x7fe9400035b0 con 0x7fe95406a090 2023-07-21T07:35:18.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9540c0f60 msgr2=0x7fe9541550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 --2- 172.21.15.6:0/183542270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9540c0f60 0x7fe9541550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 >> v1:172.21.15.86:6789/0 conn(0x7fe954151b50 legacy=0x7fe9540c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9540bf830 con 0x7fe95406a090 2023-07-21T07:35:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7fe94c0019f0 con 0x7fe95406a090 2023-07-21T07:35:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 >> v1:172.21.15.6:6789/0 conn(0x7fe95406a090 legacy=0x7fe95406a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 --2- 172.21.15.6:0/183542270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe940003bc0 0x7fe940003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 --2- 172.21.15.6:0/183542270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940004850 0x7fe940004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 --2- 172.21.15.6:0/183542270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9540c0f60 0x7fe940005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9540bf550 con 0x7fe940004850 2023-07-21T07:35:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94000bac0 con 0x7fe940003bc0 2023-07-21T07:35:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94000bc80 con 0x7fe9540c0f60 2023-07-21T07:35:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe9537fe700 1 --2- 172.21.15.6:0/183542270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940004850 0x7fe940004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe953fff700 1 --2- 172.21.15.6:0/183542270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe940003bc0 0x7fe940003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe958e2b700 1 --2- 172.21.15.6:0/183542270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9540c0f60 0x7fe940005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe9537fe700 1 -- 172.21.15.6:0/183542270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9540c0f60 msgr2=0x7fe940005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe9537fe700 1 --2- 172.21.15.6:0/183542270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9540c0f60 0x7fe940005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe9537fe700 1 -- 172.21.15.6:0/183542270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe940003bc0 msgr2=0x7fe940003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe9537fe700 1 --2- 172.21.15.6:0/183542270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe940003bc0 0x7fe940003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.340+0000 7fe9537fe700 1 -- 172.21.15.6:0/183542270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9400035b0 con 0x7fe940004850 2023-07-21T07:35:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.341+0000 7fe9537fe700 1 --2- 172.21.15.6:0/183542270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940004850 0x7fe940004cd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009b30 tx=0x7fe940005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156b8b213948b3cf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.341+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c00e6c0 con 0x7fe940004850 2023-07-21T07:35:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.341+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c00e820 con 0x7fe940004850 2023-07-21T07:35:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.341+0000 7fe952ffd700 1 -- 172.21.15.6:0/183542270 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c00eb90 con 0x7fe940004850 2023-07-21T07:35:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.341+0000 7fe95a88e700 1 -- 172.21.15.6:0/183542270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940004850 msgr2=0x7fe940004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.341+0000 7fe95a88e700 1 --2- 172.21.15.6:0/183542270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940004850 0x7fe940004cd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009b30 tx=0x7fe940005880 comp rx=0 tx=0).stop 2023-07-21T07:35:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.341+0000 7fe958e2b700 1 -- 172.21.15.6:0/183542270 reap_dead start 2023-07-21T07:35:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.341+0000 7fe95a88e700 1 -- 172.21.15.6:0/183542270 shutdown_connections 2023-07-21T07:35:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.341+0000 7fe95a88e700 1 -- 172.21.15.6:0/183542270 >> 172.21.15.6:0/183542270 conn(0x7fe9540c6140 msgr2=0x7fe9540c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.341+0000 7fe95a88e700 1 -- 172.21.15.6:0/183542270 shutdown_connections 2023-07-21T07:35:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.341+0000 7fe95a88e700 1 -- 172.21.15.6:0/183542270 wait complete. 2023-07-21T07:35:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.343+0000 7fe95a88e700 1 Processor -- start 2023-07-21T07:35:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.343+0000 7fe95a88e700 1 -- start start 2023-07-21T07:35:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe95a88e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940004850 0x7fe9541451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe95a88e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9540716b0 0x7fe954154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe95a88e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe954152bd0 0x7fe954154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe95a88e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9540abe30 con 0x7fe940004850 2023-07-21T07:35:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe95a88e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe954154db0 con 0x7fe9540716b0 2023-07-21T07:35:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe95a88e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9541ea9a0 con 0x7fe954152bd0 2023-07-21T07:35:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe953fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940004850 0x7fe9541451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe953fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940004850 0x7fe9541451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33850/0 (socket says 172.21.15.6:33850) 2023-07-21T07:35:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe953fff700 1 -- 172.21.15.6:0/2800646086 learned_addr learned my addr 172.21.15.6:0/2800646086 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe9537fe700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9540716b0 0x7fe954154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe958e2b700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe954152bd0 0x7fe954154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe953fff700 1 -- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe954152bd0 msgr2=0x7fe954154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe953fff700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe954152bd0 0x7fe954154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe953fff700 1 -- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9540716b0 msgr2=0x7fe954154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe953fff700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9540716b0 0x7fe954154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.344+0000 7fe953fff700 1 -- 172.21.15.6:0/2800646086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9540aba50 con 0x7fe940004850 2023-07-21T07:35:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.345+0000 7fe953fff700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940004850 0x7fe9541451b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe94400f810 tx=0x7fe94400fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.345+0000 7fe950ff9700 1 -- 172.21.15.6:0/2800646086 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9440052e0 con 0x7fe940004850 2023-07-21T07:35:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.345+0000 7fe950ff9700 1 -- 172.21.15.6:0/2800646086 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe944005440 con 0x7fe940004850 2023-07-21T07:35:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.345+0000 7fe95a88e700 1 -- 172.21.15.6:0/2800646086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9541456f0 con 0x7fe940004850 2023-07-21T07:35:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.345+0000 7fe950ff9700 1 -- 172.21.15.6:0/2800646086 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9440038c0 con 0x7fe940004850 2023-07-21T07:35:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.345+0000 7fe95a88e700 1 -- 172.21.15.6:0/2800646086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9541524b0 con 0x7fe940004850 2023-07-21T07:35:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.346+0000 7fe95a88e700 1 -- 172.21.15.6:0/2800646086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe954074500 con 0x7fe940004850 2023-07-21T07:35:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.346+0000 7fe950ff9700 1 -- 172.21.15.6:0/2800646086 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe944003a20 con 0x7fe940004850 2023-07-21T07:35:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.347+0000 7fe950ff9700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe93406ace0 0x7fe93406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.347+0000 7fe950ff9700 1 -- 172.21.15.6:0/2800646086 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe944089070 con 0x7fe940004850 2023-07-21T07:35:18.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.351+0000 7fe950ff9700 1 -- 172.21.15.6:0/2800646086 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe9440541b0 con 0x7fe940004850 2023-07-21T07:35:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.352+0000 7fe9537fe700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe93406ace0 0x7fe93406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.352+0000 7fe9537fe700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe93406ace0 0x7fe93406d1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe93c000c00 tx=0x7fe93c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:18.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.591+0000 7fe95a88e700 1 -- 172.21.15.6:0/2800646086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe954155600 con 0x7fe940004850 2023-07-21T07:35:18.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.592+0000 7fe950ff9700 1 -- 172.21.15.6:0/2800646086 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7fe954155600 con 0x7fe940004850 2023-07-21T07:35:18.644 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:18.644 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3052758988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3052758988},{"type":"v1","addr":"172.21.15.6:6833","nonce":3052758988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3514948644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3514948644},{"type":"v1","addr":"172.21.15.6:6835","nonce":3514948644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/3188395603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3188395603},{"type":"v1","addr":"172.21.15.86:6836","nonce":3188395603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:34:40.418961+0000","modified":"2023-07-21T07:34:44.014954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6837/815488925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":815488925},{"type":"v1","addr":"172.21.15.86:6837","nonce":815488925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T07:35:18.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.594+0000 7fe95a88e700 1 -- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe93406ace0 msgr2=0x7fe93406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.594+0000 7fe95a88e700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe93406ace0 0x7fe93406d1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe93c000c00 tx=0x7fe93c008030 comp rx=0 tx=0).stop 2023-07-21T07:35:18.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.594+0000 7fe95a88e700 1 -- 172.21.15.6:0/2800646086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940004850 msgr2=0x7fe9541451b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.594+0000 7fe95a88e700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940004850 0x7fe9541451b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe94400f810 tx=0x7fe94400fb20 comp rx=0 tx=0).stop 2023-07-21T07:35:18.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.594+0000 7fe95a88e700 1 -- 172.21.15.6:0/2800646086 shutdown_connections 2023-07-21T07:35:18.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.594+0000 7fe95a88e700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe93406ace0 0x7fe93406d1a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.594+0000 7fe95a88e700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe954152bd0 0x7fe954154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.594+0000 7fe95a88e700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940004850 0x7fe9541451b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.594+0000 7fe95a88e700 1 --2- 172.21.15.6:0/2800646086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9540716b0 0x7fe954154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.594+0000 7fe95a88e700 1 -- 172.21.15.6:0/2800646086 >> 172.21.15.6:0/2800646086 conn(0x7fe9540c6140 msgr2=0x7fe9540c1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:18.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.594+0000 7fe95a88e700 1 -- 172.21.15.6:0/2800646086 shutdown_connections 2023-07-21T07:35:18.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.594+0000 7fe95a88e700 1 -- 172.21.15.6:0/2800646086 wait complete. 2023-07-21T07:35:18.648 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T07:35:18.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:18.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.731+0000 7f231dabc700 1 Processor -- start 2023-07-21T07:35:18.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.731+0000 7f231dabc700 1 -- start start 2023-07-21T07:35:18.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.731+0000 7f231dabc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23180c4030 0x7f2318155220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.731+0000 7f231dabc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f231806f240 0x7f23180c7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.731+0000 7f231dabc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231806ee60 con 0x7f23180c6f50 2023-07-21T07:35:18.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.731+0000 7f231dabc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2318151ff0 con 0x7f23180c4030 2023-07-21T07:35:18.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.731+0000 7f231dabc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231806eb80 con 0x7f231806f240 2023-07-21T07:35:18.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f2316ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23180c4030 0x7f2318155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f2317fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f231806f240 0x7f23180c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f23177fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f23180c6f50 0x7f2318157bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:45120/0 (socket says 172.21.15.6:45120) 2023-07-21T07:35:18.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f2316ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23180c4030 0x7f2318155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:55664/0 (socket says 172.21.15.6:55664) 2023-07-21T07:35:18.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f23177fe700 1 -- 172.21.15.6:0/3612304750 learned_addr learned my addr 172.21.15.6:0/3612304750 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:18.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f2316ffd700 1 -- 172.21.15.6:0/3612304750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f231806f240 msgr2=0x7f23180c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:18.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f2316ffd700 1 --2- 172.21.15.6:0/3612304750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f231806f240 0x7f23180c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f2316ffd700 1 -- 172.21.15.6:0/3612304750 >> v1:172.21.15.86:6789/0 conn(0x7f23180c6f50 legacy=0x7f2318157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f2316ffd700 1 -- 172.21.15.6:0/3612304750 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318154740 con 0x7f23180c4030 2023-07-21T07:35:18.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f23167fc700 1 -- 172.21.15.6:0/3612304750 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876771197 0 0) 0x7f231806ee60 con 0x7f23180c6f50 2023-07-21T07:35:18.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f2317fff700 1 --2- 172.21.15.6:0/3612304750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f231806f240 0x7f23180c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:18.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f2316ffd700 1 --2- 172.21.15.6:0/3612304750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180c4030 0x7f2318155220 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f230c009840 tx=0x7f230c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23d8be1445ebd5d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:18.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f23167fc700 1 -- 172.21.15.6:0/3612304750 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c011830 con 0x7f23180c4030 2023-07-21T07:35:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f23167fc700 1 -- 172.21.15.6:0/3612304750 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c011990 con 0x7f23180c4030 2023-07-21T07:35:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.732+0000 7f23167fc700 1 -- 172.21.15.6:0/3612304750 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c011d20 con 0x7f23180c4030 2023-07-21T07:35:18.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.733+0000 7f231dabc700 1 -- 172.21.15.6:0/3612304750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180c4030 msgr2=0x7f2318155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.733+0000 7f231dabc700 1 --2- 172.21.15.6:0/3612304750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180c4030 0x7f2318155220 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f230c009840 tx=0x7f230c009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:18.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.733+0000 7f231dabc700 1 -- 172.21.15.6:0/3612304750 shutdown_connections 2023-07-21T07:35:18.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.733+0000 7f231dabc700 1 --2- 172.21.15.6:0/3612304750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f231806f240 0x7f23180c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.733+0000 7f231dabc700 1 --2- 172.21.15.6:0/3612304750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180c4030 0x7f2318155220 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.733+0000 7f231dabc700 1 -- 172.21.15.6:0/3612304750 >> 172.21.15.6:0/3612304750 conn(0x7f231806a480 msgr2=0x7f231806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:18.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.733+0000 7f231dabc700 1 -- 172.21.15.6:0/3612304750 shutdown_connections 2023-07-21T07:35:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.733+0000 7f231dabc700 1 -- 172.21.15.6:0/3612304750 wait complete. 2023-07-21T07:35:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.734+0000 7f231dabc700 1 Processor -- start 2023-07-21T07:35:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.734+0000 7f231dabc700 1 -- start start 2023-07-21T07:35:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.735+0000 7f231dabc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f231806f240 0x7f23180c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.735+0000 7f231dabc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180c4030 0x7f23181ed250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.735+0000 7f231dabc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23180c6f50 0x7f231814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.735+0000 7f231dabc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318158130 con 0x7f231806f240 2023-07-21T07:35:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.735+0000 7f231dabc700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318150d00 con 0x7f23180c4030 2023-07-21T07:35:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.735+0000 7f231dabc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2318150a20 con 0x7f23180c6f50 2023-07-21T07:35:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.735+0000 7f23177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f231806f240 0x7f23180c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.735+0000 7f23177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f231806f240 0x7f23180c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33864/0 (socket says 172.21.15.6:33864) 2023-07-21T07:35:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.735+0000 7f23177fe700 1 -- 172.21.15.6:0/2054641531 learned_addr learned my addr 172.21.15.6:0/2054641531 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:18.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.735+0000 7f2316ffd700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180c4030 0x7f23181ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.735+0000 7f2317fff700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23180c6f50 0x7f231814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.735+0000 7f23177fe700 1 -- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23180c6f50 msgr2=0x7f231814fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.735+0000 7f23177fe700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23180c6f50 0x7f231814fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.736+0000 7f23177fe700 1 -- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180c4030 msgr2=0x7f23181ed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.736+0000 7f23177fe700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180c4030 0x7f23181ed250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.736+0000 7f23177fe700 1 -- 172.21.15.6:0/2054641531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2310009a70 con 0x7f231806f240 2023-07-21T07:35:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.736+0000 7f23177fe700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f231806f240 0x7f23180c5bd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f230800c550 tx=0x7f230800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.736+0000 7f22fffff700 1 -- 172.21.15.6:0/2054641531 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308004c80 con 0x7f231806f240 2023-07-21T07:35:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.736+0000 7f22fffff700 1 -- 172.21.15.6:0/2054641531 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308004e00 con 0x7f231806f240 2023-07-21T07:35:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.736+0000 7f231dabc700 1 -- 172.21.15.6:0/2054641531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c0094a0 con 0x7f231806f240 2023-07-21T07:35:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.736+0000 7f22fffff700 1 -- 172.21.15.6:0/2054641531 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308007310 con 0x7f231806f240 2023-07-21T07:35:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.736+0000 7f231dabc700 1 -- 172.21.15.6:0/2054641531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2318157e50 con 0x7f231806f240 2023-07-21T07:35:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.737+0000 7f231dabc700 1 -- 172.21.15.6:0/2054641531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23180c5730 con 0x7f231806f240 2023-07-21T07:35:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.737+0000 7f22fffff700 1 -- 172.21.15.6:0/2054641531 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2308007470 con 0x7f231806f240 2023-07-21T07:35:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.738+0000 7f22fffff700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f230406ace0 0x7f230406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.738+0000 7f22fffff700 1 -- 172.21.15.6:0/2054641531 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2308088ff0 con 0x7f231806f240 2023-07-21T07:35:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.738+0000 7f2316ffd700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f230406ace0 0x7f230406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.738+0000 7f2316ffd700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f230406ace0 0x7f230406d1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f230c0090b0 tx=0x7f230c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.742+0000 7f22fffff700 1 -- 172.21.15.6:0/2054641531 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f23080bb310 con 0x7f231806f240 2023-07-21T07:35:18.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.942+0000 7f231dabc700 1 -- 172.21.15.6:0/2054641531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2318074500 con 0x7f231806f240 2023-07-21T07:35:18.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.943+0000 7f22fffff700 1 -- 172.21.15.6:0/2054641531 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f23080540b0 con 0x7f231806f240 2023-07-21T07:35:18.996 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:18.996 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:18.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.946+0000 7f231dabc700 1 -- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f230406ace0 msgr2=0x7f230406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.946+0000 7f231dabc700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f230406ace0 0x7f230406d1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f230c0090b0 tx=0x7f230c008030 comp rx=0 tx=0).stop 2023-07-21T07:35:18.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.946+0000 7f231dabc700 1 -- 172.21.15.6:0/2054641531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f231806f240 msgr2=0x7f23180c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.946+0000 7f231dabc700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f231806f240 0x7f23180c5bd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f230800c550 tx=0x7f230800c860 comp rx=0 tx=0).stop 2023-07-21T07:35:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.946+0000 7f231dabc700 1 -- 172.21.15.6:0/2054641531 shutdown_connections 2023-07-21T07:35:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.946+0000 7f231dabc700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f230406ace0 0x7f230406d1a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.946+0000 7f231dabc700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23180c6f50 0x7f231814fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.946+0000 7f231dabc700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f231806f240 0x7f23180c5bd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.946+0000 7f231dabc700 1 --2- 172.21.15.6:0/2054641531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180c4030 0x7f23181ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.946+0000 7f231dabc700 1 -- 172.21.15.6:0/2054641531 >> 172.21.15.6:0/2054641531 conn(0x7f231806a480 msgr2=0x7f2318073160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:19.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.946+0000 7f231dabc700 1 -- 172.21.15.6:0/2054641531 shutdown_connections 2023-07-21T07:35:19.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:18.946+0000 7f231dabc700 1 -- 172.21.15.6:0/2054641531 wait complete. 2023-07-21T07:35:19.010 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T07:35:19.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:35:19.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.083+0000 7f26ddc21700 1 Processor -- start 2023-07-21T07:35:19.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.083+0000 7f26ddc21700 1 -- start start 2023-07-21T07:35:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.084+0000 7f26ddc21700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26d806a300 0x7f26d806da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.084+0000 7f26ddc21700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26d8155050 0x7f26d8151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.084+0000 7f26ddc21700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d80c2ab0 con 0x7f26d8151c50 2023-07-21T07:35:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.084+0000 7f26ddc21700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d806e000 con 0x7f26d806a300 2023-07-21T07:35:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.084+0000 7f26ddc21700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d806e2e0 con 0x7f26d8155050 2023-07-21T07:35:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.084+0000 7f26d77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26d806a300 0x7f26d806da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.084+0000 7f26d77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26d806a300 0x7f26d806da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33872/0 (socket says 172.21.15.6:33872) 2023-07-21T07:35:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.084+0000 7f26d77fe700 1 -- 172.21.15.6:0/66371674 learned_addr learned my addr 172.21.15.6:0/66371674 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.085+0000 7f26d77fe700 1 -- 172.21.15.6:0/66371674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26d8155050 msgr2=0x7f26d8151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.085+0000 7f26d6ffd700 1 --2- 172.21.15.6:0/66371674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26d8155050 0x7f26d8151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.085+0000 7f26d77fe700 1 --2- 172.21.15.6:0/66371674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26d8155050 0x7f26d8151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.085+0000 7f26d77fe700 1 -- 172.21.15.6:0/66371674 >> v1:172.21.15.86:6789/0 conn(0x7f26d8151c50 legacy=0x7f26d80c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.085+0000 7f26d77fe700 1 -- 172.21.15.6:0/66371674 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d806e5c0 con 0x7f26d806a300 2023-07-21T07:35:19.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.085+0000 7f26d77fe700 1 --2- 172.21.15.6:0/66371674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26d806a300 0x7f26d806da20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f26c00098f0 tx=0x7f26c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69287dea9e251965 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:19.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.085+0000 7f26d67fc700 1 -- 172.21.15.6:0/66371674 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0004230 con 0x7f26d806a300 2023-07-21T07:35:19.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.085+0000 7f26d67fc700 1 -- 172.21.15.6:0/66371674 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c0004390 con 0x7f26d806a300 2023-07-21T07:35:19.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.085+0000 7f26d67fc700 1 -- 172.21.15.6:0/66371674 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00036a0 con 0x7f26d806a300 2023-07-21T07:35:19.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.085+0000 7f26ddc21700 1 -- 172.21.15.6:0/66371674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26d806a300 msgr2=0x7f26d806da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.085+0000 7f26ddc21700 1 --2- 172.21.15.6:0/66371674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26d806a300 0x7f26d806da20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f26c00098f0 tx=0x7f26c0009c00 comp rx=0 tx=0).stop 2023-07-21T07:35:19.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.086+0000 7f26ddc21700 1 -- 172.21.15.6:0/66371674 shutdown_connections 2023-07-21T07:35:19.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.086+0000 7f26ddc21700 1 --2- 172.21.15.6:0/66371674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26d806a300 0x7f26d806da20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.086+0000 7f26ddc21700 1 --2- 172.21.15.6:0/66371674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26d8155050 0x7f26d8151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.086+0000 7f26ddc21700 1 -- 172.21.15.6:0/66371674 >> 172.21.15.6:0/66371674 conn(0x7f26d80a8c90 msgr2=0x7f26d806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:19.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.086+0000 7f26ddc21700 1 -- 172.21.15.6:0/66371674 shutdown_connections 2023-07-21T07:35:19.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.086+0000 7f26ddc21700 1 -- 172.21.15.6:0/66371674 wait complete. 2023-07-21T07:35:19.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.087+0000 7f26ddc21700 1 Processor -- start 2023-07-21T07:35:19.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.087+0000 7f26ddc21700 1 -- start start 2023-07-21T07:35:19.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26ddc21700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26d806a300 0x7f26d80c0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26ddc21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26d8151c50 0x7f26d8158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26ddc21700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26d8155050 0x7f26d81eb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26ddc21700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d814f430 con 0x7f26d8151c50 2023-07-21T07:35:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26ddc21700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d81eb220 con 0x7f26d806a300 2023-07-21T07:35:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26ddc21700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d80bf400 con 0x7f26d8155050 2023-07-21T07:35:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26d8151c50 0x7f26d8158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26d8151c50 0x7f26d8158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33880/0 (socket says 172.21.15.6:33880) 2023-07-21T07:35:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26d6ffd700 1 -- 172.21.15.6:0/4008565697 learned_addr learned my addr 172.21.15.6:0/4008565697 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26d77fe700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26d806a300 0x7f26d80c0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26d7fff700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26d8155050 0x7f26d81eb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26d6ffd700 1 -- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26d8155050 msgr2=0x7f26d81eb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26d6ffd700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26d8155050 0x7f26d81eb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26d6ffd700 1 -- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26d806a300 msgr2=0x7f26d80c0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26d6ffd700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26d806a300 0x7f26d80c0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26d6ffd700 1 -- 172.21.15.6:0/4008565697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c0009550 con 0x7f26d8151c50 2023-07-21T07:35:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26d6ffd700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26d8151c50 0x7f26d8158240 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f26c800c7f0 tx=0x7f26c800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26cffff700 1 -- 172.21.15.6:0/4008565697 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8011800 con 0x7f26d8151c50 2023-07-21T07:35:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26cffff700 1 -- 172.21.15.6:0/4008565697 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c8011960 con 0x7f26d8151c50 2023-07-21T07:35:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.088+0000 7f26ddc21700 1 -- 172.21.15.6:0/4008565697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d80bee40 con 0x7f26d8151c50 2023-07-21T07:35:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.089+0000 7f26cffff700 1 -- 172.21.15.6:0/4008565697 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8011cf0 con 0x7f26d8151c50 2023-07-21T07:35:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.089+0000 7f26ddc21700 1 -- 172.21.15.6:0/4008565697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d81eaeb0 con 0x7f26d8151c50 2023-07-21T07:35:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.089+0000 7f26ddc21700 1 -- 172.21.15.6:0/4008565697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d8074500 con 0x7f26d8151c50 2023-07-21T07:35:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.090+0000 7f26cffff700 1 -- 172.21.15.6:0/4008565697 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f26c8018360 con 0x7f26d8151c50 2023-07-21T07:35:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.090+0000 7f26cffff700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f26b806ace0 0x7f26b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.090+0000 7f26cffff700 1 -- 172.21.15.6:0/4008565697 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26c8089460 con 0x7f26d8151c50 2023-07-21T07:35:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.090+0000 7f26d77fe700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f26b806ace0 0x7f26b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.091+0000 7f26d77fe700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f26b806ace0 0x7f26b806d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009130 tx=0x7f26c0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.095+0000 7f26cffff700 1 -- 172.21.15.6:0/4008565697 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f26c8054510 con 0x7f26d8151c50 2023-07-21T07:35:19.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.339+0000 7f26ddc21700 1 -- 172.21.15.6:0/4008565697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26d81eb360 con 0x7f26d8151c50 2023-07-21T07:35:19.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.339+0000 7f26cffff700 1 -- 172.21.15.6:0/4008565697 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f26c8057b30 con 0x7f26d8151c50 2023-07-21T07:35:19.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:19.392 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3052758988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3052758988},{"type":"v1","addr":"172.21.15.6:6833","nonce":3052758988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3514948644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3514948644},{"type":"v1","addr":"172.21.15.6:6835","nonce":3514948644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/3188395603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3188395603},{"type":"v1","addr":"172.21.15.86:6836","nonce":3188395603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:34:40.418961+0000","modified":"2023-07-21T07:34:44.014954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6837/815488925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":815488925},{"type":"v1","addr":"172.21.15.86:6837","nonce":815488925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T07:35:19.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.341+0000 7f26ddc21700 1 -- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f26b806ace0 msgr2=0x7f26b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.341+0000 7f26ddc21700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f26b806ace0 0x7f26b806d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009130 tx=0x7f26c0008030 comp rx=0 tx=0).stop 2023-07-21T07:35:19.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.341+0000 7f26ddc21700 1 -- 172.21.15.6:0/4008565697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26d8151c50 msgr2=0x7f26d8158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.341+0000 7f26ddc21700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26d8151c50 0x7f26d8158240 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f26c800c7f0 tx=0x7f26c800cbb0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.341+0000 7f26ddc21700 1 -- 172.21.15.6:0/4008565697 shutdown_connections 2023-07-21T07:35:19.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.341+0000 7f26ddc21700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f26b806ace0 0x7f26b806d1a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.341+0000 7f26ddc21700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26d8155050 0x7f26d81eb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.341+0000 7f26ddc21700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26d806a300 0x7f26d80c0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.341+0000 7f26ddc21700 1 --2- 172.21.15.6:0/4008565697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26d8151c50 0x7f26d8158240 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.341+0000 7f26ddc21700 1 -- 172.21.15.6:0/4008565697 >> 172.21.15.6:0/4008565697 conn(0x7f26d80a8c90 msgr2=0x7f26d806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.341+0000 7f26ddc21700 1 -- 172.21.15.6:0/4008565697 shutdown_connections 2023-07-21T07:35:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.341+0000 7f26ddc21700 1 -- 172.21.15.6:0/4008565697 wait complete. 2023-07-21T07:35:19.396 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T07:35:19.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:35:19.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.479+0000 7fbac3d9f700 1 Processor -- start 2023-07-21T07:35:19.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.479+0000 7fbac3d9f700 1 -- start start 2023-07-21T07:35:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.479+0000 7fbac3d9f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbabc06f620 0x7fbabc1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac3d9f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbabc14fd80 0x7fbabc0c8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac3d9f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbabc1528f0 con 0x7fbabc14f9a0 2023-07-21T07:35:19.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac3d9f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbabc0c2a10 con 0x7fbabc14fd80 2023-07-21T07:35:19.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac3d9f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbabc156950 con 0x7fbabc06f620 2023-07-21T07:35:19.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac1b3b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbabc14f9a0 0x7fbabc156240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41906/0 (socket says 172.21.15.6:41906) 2023-07-21T07:35:19.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac1b3b700 1 -- 172.21.15.6:0/633705947 learned_addr learned my addr 172.21.15.6:0/633705947 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:19.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac233c700 1 --2- 172.21.15.6:0/633705947 >> v2:172.21.15.6:3300/0 conn(0x7fbabc14fd80 0x7fbabc0c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac133a700 1 --2- 172.21.15.6:0/633705947 >> v2:172.21.15.86:3300/0 conn(0x7fbabc06f620 0x7fbabc1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac233c700 1 -- 172.21.15.6:0/633705947 >> v2:172.21.15.86:3300/0 conn(0x7fbabc06f620 msgr2=0x7fbabc1523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac233c700 1 --2- 172.21.15.6:0/633705947 >> v2:172.21.15.86:3300/0 conn(0x7fbabc06f620 0x7fbabc1523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac233c700 1 -- 172.21.15.6:0/633705947 >> v1:172.21.15.6:6789/0 conn(0x7fbabc14f9a0 legacy=0x7fbabc156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac0b39700 1 -- 172.21.15.6:0/633705947 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357010540 0 0) 0x7fbabc1528f0 con 0x7fbabc14f9a0 2023-07-21T07:35:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac233c700 1 -- 172.21.15.6:0/633705947 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc155db0 con 0x7fbabc14fd80 2023-07-21T07:35:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac133a700 1 --2- 172.21.15.6:0/633705947 >> v2:172.21.15.86:3300/0 conn(0x7fbabc06f620 0x7fbabc1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac233c700 1 --2- 172.21.15.6:0/633705947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbabc14fd80 0x7fbabc0c8080 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0add30 tx=0x7fbab4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b816c67ae19497 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac0b39700 1 -- 172.21.15.6:0/633705947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4011830 con 0x7fbabc14fd80 2023-07-21T07:35:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac0b39700 1 -- 172.21.15.6:0/633705947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab4011990 con 0x7fbabc14fd80 2023-07-21T07:35:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.480+0000 7fbac0b39700 1 -- 172.21.15.6:0/633705947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4011d20 con 0x7fbabc14fd80 2023-07-21T07:35:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.481+0000 7fbac3d9f700 1 -- 172.21.15.6:0/633705947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbabc14fd80 msgr2=0x7fbabc0c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.481+0000 7fbac3d9f700 1 --2- 172.21.15.6:0/633705947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbabc14fd80 0x7fbabc0c8080 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0add30 tx=0x7fbab4009b20 comp rx=0 tx=0).stop 2023-07-21T07:35:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.481+0000 7fbac3d9f700 1 -- 172.21.15.6:0/633705947 shutdown_connections 2023-07-21T07:35:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.481+0000 7fbac3d9f700 1 --2- 172.21.15.6:0/633705947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbabc14fd80 0x7fbabc0c8080 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.481+0000 7fbac3d9f700 1 --2- 172.21.15.6:0/633705947 >> v2:172.21.15.86:3300/0 conn(0x7fbabc06f620 0x7fbabc1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.481+0000 7fbac3d9f700 1 -- 172.21.15.6:0/633705947 >> 172.21.15.6:0/633705947 conn(0x7fbabc06a480 msgr2=0x7fbabc06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.481+0000 7fbac3d9f700 1 -- 172.21.15.6:0/633705947 shutdown_connections 2023-07-21T07:35:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.481+0000 7fbac3d9f700 1 -- 172.21.15.6:0/633705947 wait complete. 2023-07-21T07:35:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.482+0000 7fbac3d9f700 1 Processor -- start 2023-07-21T07:35:19.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.482+0000 7fbac3d9f700 1 -- start start 2023-07-21T07:35:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac3d9f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbabc06f620 0x7fbabc06bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac3d9f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbabc14f9a0 0x7fbabc06c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac3d9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbabc14fd80 0x7fbabc0bce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac3d9f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc0be990 con 0x7fbabc14fd80 2023-07-21T07:35:19.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac3d9f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc0be3d0 con 0x7fbabc14f9a0 2023-07-21T07:35:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac3d9f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc0be6b0 con 0x7fbabc06f620 2023-07-21T07:35:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac233c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbabc14fd80 0x7fbabc0bce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac233c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbabc14fd80 0x7fbabc0bce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33896/0 (socket says 172.21.15.6:33896) 2023-07-21T07:35:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac233c700 1 -- 172.21.15.6:0/1034694218 learned_addr learned my addr 172.21.15.6:0/1034694218 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac133a700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbabc14f9a0 0x7fbabc06c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac1b3b700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbabc06f620 0x7fbabc06bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac233c700 1 -- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbabc06f620 msgr2=0x7fbabc06bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac233c700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbabc06f620 0x7fbabc06bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac233c700 1 -- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbabc14f9a0 msgr2=0x7fbabc06c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac233c700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbabc14f9a0 0x7fbabc06c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac233c700 1 -- 172.21.15.6:0/1034694218 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab40094a0 con 0x7fbabc14fd80 2023-07-21T07:35:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.483+0000 7fbac1b3b700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbabc06f620 0x7fbabc06bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.484+0000 7fbac233c700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbabc14fd80 0x7fbabc0bce90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbab4014040 tx=0x7fbab4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.484+0000 7fbaba7fc700 1 -- 172.21.15.6:0/1034694218 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40036a0 con 0x7fbabc14fd80 2023-07-21T07:35:19.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.484+0000 7fbaba7fc700 1 -- 172.21.15.6:0/1034694218 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab401e070 con 0x7fbabc14fd80 2023-07-21T07:35:19.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.484+0000 7fbac3d9f700 1 -- 172.21.15.6:0/1034694218 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbabc06b340 con 0x7fbabc14fd80 2023-07-21T07:35:19.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.484+0000 7fbaba7fc700 1 -- 172.21.15.6:0/1034694218 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4003a80 con 0x7fbabc14fd80 2023-07-21T07:35:19.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.484+0000 7fbac3d9f700 1 -- 172.21.15.6:0/1034694218 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbabc0bd3d0 con 0x7fbabc14fd80 2023-07-21T07:35:19.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.485+0000 7fbac3d9f700 1 -- 172.21.15.6:0/1034694218 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbabc06b1a0 con 0x7fbabc14fd80 2023-07-21T07:35:19.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.485+0000 7fbaba7fc700 1 -- 172.21.15.6:0/1034694218 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbab4003be0 con 0x7fbabc14fd80 2023-07-21T07:35:19.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.486+0000 7fbaba7fc700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbaa806ad10 0x7fbaa806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.486+0000 7fbaba7fc700 1 -- 172.21.15.6:0/1034694218 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbab408a510 con 0x7fbabc14fd80 2023-07-21T07:35:19.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.486+0000 7fbac1b3b700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbaa806ad10 0x7fbaa806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.486+0000 7fbac1b3b700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbaa806ad10 0x7fbaa806d1d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0012e0 tx=0x7fbaac001a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:19.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.490+0000 7fbaba7fc700 1 -- 172.21.15.6:0/1034694218 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbabc06b1a0 con 0x7fbabc14fd80 2023-07-21T07:35:19.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.735+0000 7fbac3d9f700 1 -- 172.21.15.6:0/1034694218 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbabc06b860 con 0x7fbabc14fd80 2023-07-21T07:35:19.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.735+0000 7fbaba7fc700 1 -- 172.21.15.6:0/1034694218 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7fbabc06b860 con 0x7fbabc14fd80 2023-07-21T07:35:19.788 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:19.788 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3052758988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3052758988},{"type":"v1","addr":"172.21.15.6:6833","nonce":3052758988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3514948644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3514948644},{"type":"v1","addr":"172.21.15.6:6835","nonce":3514948644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/3188395603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3188395603},{"type":"v1","addr":"172.21.15.86:6836","nonce":3188395603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:34:40.418961+0000","modified":"2023-07-21T07:34:44.014954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6837/815488925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":815488925},{"type":"v1","addr":"172.21.15.86:6837","nonce":815488925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T07:35:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.737+0000 7fbac3d9f700 1 -- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbaa806ad10 msgr2=0x7fbaa806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.737+0000 7fbac3d9f700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbaa806ad10 0x7fbaa806d1d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0012e0 tx=0x7fbaac001a30 comp rx=0 tx=0).stop 2023-07-21T07:35:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.737+0000 7fbac3d9f700 1 -- 172.21.15.6:0/1034694218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbabc14fd80 msgr2=0x7fbabc0bce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.737+0000 7fbac3d9f700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbabc14fd80 0x7fbabc0bce90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbab4014040 tx=0x7fbab4004750 comp rx=0 tx=0).stop 2023-07-21T07:35:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.738+0000 7fbac3d9f700 1 -- 172.21.15.6:0/1034694218 shutdown_connections 2023-07-21T07:35:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.738+0000 7fbac3d9f700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbaa806ad10 0x7fbaa806d1d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.738+0000 7fbac3d9f700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbabc14fd80 0x7fbabc0bce90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.738+0000 7fbac3d9f700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbabc06f620 0x7fbabc06bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.738+0000 7fbac3d9f700 1 --2- 172.21.15.6:0/1034694218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbabc14f9a0 0x7fbabc06c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.738+0000 7fbac3d9f700 1 -- 172.21.15.6:0/1034694218 >> 172.21.15.6:0/1034694218 conn(0x7fbabc06a480 msgr2=0x7fbabc14abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.738+0000 7fbac3d9f700 1 -- 172.21.15.6:0/1034694218 shutdown_connections 2023-07-21T07:35:19.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.738+0000 7fbac3d9f700 1 -- 172.21.15.6:0/1034694218 wait complete. 2023-07-21T07:35:19.792 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T07:35:19.802 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.875+0000 7f823a378700 1 Processor -- start 2023-07-21T07:35:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.875+0000 7f823a378700 1 -- start start 2023-07-21T07:35:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.876+0000 7f823a378700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f82340c4060 0x7f8234152280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.876+0000 7f823a378700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82340a72f0 con 0x7f82340c72f0 2023-07-21T07:35:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.876+0000 7f823a378700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823414fd00 con 0x7f82340a9c80 2023-07-21T07:35:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.876+0000 7f823a378700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82341527c0 con 0x7f82340c4060 2023-07-21T07:35:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.876+0000 7f8233fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f82340c72f0 0x7f8234156180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41920/0 (socket says 172.21.15.6:41920) 2023-07-21T07:35:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.876+0000 7f8233fff700 1 -- 172.21.15.6:0/1839805078 learned_addr learned my addr 172.21.15.6:0/1839805078 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.876+0000 7f82337fe700 1 --2- 172.21.15.6:0/1839805078 >> v2:172.21.15.86:3300/0 conn(0x7f82340c4060 0x7f8234152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.876+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870667218 0 0) 0x7f82340a72f0 con 0x7f82340c72f0 2023-07-21T07:35:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.876+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82200035b0 con 0x7f82340c72f0 2023-07-21T07:35:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1980059625 0 0) 0x7f82200035b0 con 0x7f82340c72f0 2023-07-21T07:35:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 >> v2:172.21.15.86:3300/0 conn(0x7f82340c4060 msgr2=0x7f8234152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 --2- 172.21.15.6:0/1839805078 >> v2:172.21.15.86:3300/0 conn(0x7f82340c4060 0x7f8234152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 >> v1:172.21.15.86:6789/0 conn(0x7f82340a9c80 legacy=0x7f823415cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823406ed00 con 0x7f82340c72f0 2023-07-21T07:35:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f8224001670 con 0x7f82340c72f0 2023-07-21T07:35:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 >> v1:172.21.15.6:6789/0 conn(0x7f82340c72f0 legacy=0x7f8234156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 --2- 172.21.15.6:0/1839805078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8220003a00 0x7f8220003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 --2- 172.21.15.6:0/1839805078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8220004420 0x7f82200048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 --2- 172.21.15.6:0/1839805078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8220005190 0x7f822000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82341527c0 con 0x7f8220003a00 2023-07-21T07:35:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822000c0e0 con 0x7f8220005190 2023-07-21T07:35:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822000c2a0 con 0x7f8220004420 2023-07-21T07:35:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f82337fe700 1 --2- 172.21.15.6:0/1839805078 >> v2:172.21.15.86:3300/0 conn(0x7f82340c4060 0x7f8234152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8233fff700 1 --2- 172.21.15.6:0/1839805078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8220003a00 0x7f8220003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8238915700 1 --2- 172.21.15.6:0/1839805078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8220005190 0x7f822000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f82337fe700 1 --2- 172.21.15.6:0/1839805078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8220004420 0x7f82200048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8233fff700 1 -- 172.21.15.6:0/1839805078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8220004420 msgr2=0x7f82200048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8233fff700 1 --2- 172.21.15.6:0/1839805078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8220004420 0x7f82200048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8233fff700 1 -- 172.21.15.6:0/1839805078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8220005190 msgr2=0x7f822000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8233fff700 1 --2- 172.21.15.6:0/1839805078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8220005190 0x7f822000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8233fff700 1 -- 172.21.15.6:0/1839805078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200035b0 con 0x7f8220003a00 2023-07-21T07:35:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8238915700 1 -- 172.21.15.6:0/1839805078 reap_dead start 2023-07-21T07:35:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f82337fe700 1 --2- 172.21.15.6:0/1839805078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8220004420 0x7f82200048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8233fff700 1 --2- 172.21.15.6:0/1839805078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8220003a00 0x7f8220003e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f822400c2f0 tx=0x7f8220005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de28b44a0c09b168 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.877+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822400ce30 con 0x7f8220003a00 2023-07-21T07:35:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.878+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8224005960 con 0x7f8220003a00 2023-07-21T07:35:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.878+0000 7f8232ffd700 1 -- 172.21.15.6:0/1839805078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224005d10 con 0x7f8220003a00 2023-07-21T07:35:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.878+0000 7f823a378700 1 -- 172.21.15.6:0/1839805078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8220003a00 msgr2=0x7f8220003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.878+0000 7f823a378700 1 --2- 172.21.15.6:0/1839805078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8220003a00 0x7f8220003e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f822400c2f0 tx=0x7f8220005880 comp rx=0 tx=0).stop 2023-07-21T07:35:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.878+0000 7f823a378700 1 -- 172.21.15.6:0/1839805078 shutdown_connections 2023-07-21T07:35:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.878+0000 7f823a378700 1 --2- 172.21.15.6:0/1839805078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8220003a00 0x7f8220003e00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.878+0000 7f823a378700 1 -- 172.21.15.6:0/1839805078 >> 172.21.15.6:0/1839805078 conn(0x7f82340c4780 msgr2=0x7f82340c4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.878+0000 7f823a378700 1 -- 172.21.15.6:0/1839805078 shutdown_connections 2023-07-21T07:35:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.878+0000 7f823a378700 1 -- 172.21.15.6:0/1839805078 wait complete. 2023-07-21T07:35:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.879+0000 7f823a378700 1 Processor -- start 2023-07-21T07:35:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.880+0000 7f823a378700 1 -- start start 2023-07-21T07:35:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.880+0000 7f823a378700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8220003a00 0x7f82340bd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.880+0000 7f823a378700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82340bcac0 0x7f8234150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.880+0000 7f823a378700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82340bcf20 0x7f82341ecbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.880+0000 7f823a378700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340a6320 con 0x7f82340bcf20 2023-07-21T07:35:19.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.880+0000 7f823a378700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82341520b0 con 0x7f8220003a00 2023-07-21T07:35:19.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.880+0000 7f823a378700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8234152350 con 0x7f82340bcac0 2023-07-21T07:35:19.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.880+0000 7f8238915700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82340bcf20 0x7f82341ecbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.880+0000 7f8238915700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82340bcf20 0x7f82341ecbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33916/0 (socket says 172.21.15.6:33916) 2023-07-21T07:35:19.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.880+0000 7f8238915700 1 -- 172.21.15.6:0/2684726664 learned_addr learned my addr 172.21.15.6:0/2684726664 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:19.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f82337fe700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82340bcac0 0x7f8234150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f8233fff700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8220003a00 0x7f82340bd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f8238915700 1 -- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82340bcac0 msgr2=0x7f8234150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f8238915700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82340bcac0 0x7f8234150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f8238915700 1 -- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8220003a00 msgr2=0x7f82340bd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f8238915700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8220003a00 0x7f82340bd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f8238915700 1 -- 172.21.15.6:0/2684726664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340ad720 con 0x7f82340bcf20 2023-07-21T07:35:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f82337fe700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82340bcac0 0x7f8234150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f8238915700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82340bcf20 0x7f82341ecbd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f823406e450 tx=0x7f822c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f8230ff9700 1 -- 172.21.15.6:0/2684726664 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c003c10 con 0x7f82340bcf20 2023-07-21T07:35:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f8230ff9700 1 -- 172.21.15.6:0/2684726664 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c003d70 con 0x7f82340bcf20 2023-07-21T07:35:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f823a378700 1 -- 172.21.15.6:0/2684726664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82340ad990 con 0x7f82340bcf20 2023-07-21T07:35:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f8230ff9700 1 -- 172.21.15.6:0/2684726664 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c00c900 con 0x7f82340bcf20 2023-07-21T07:35:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.881+0000 7f823a378700 1 -- 172.21.15.6:0/2684726664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82340a9570 con 0x7f82340bcf20 2023-07-21T07:35:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.882+0000 7f823a378700 1 -- 172.21.15.6:0/2684726664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82341524e0 con 0x7f82340bcf20 2023-07-21T07:35:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.882+0000 7f8230ff9700 1 -- 172.21.15.6:0/2684726664 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f822c00ca60 con 0x7f82340bcf20 2023-07-21T07:35:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.883+0000 7f8230ff9700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f821406ad10 0x7f821406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.883+0000 7f8230ff9700 1 -- 172.21.15.6:0/2684726664 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f822c0896b0 con 0x7f82340bcf20 2023-07-21T07:35:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.883+0000 7f8233fff700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f821406ad10 0x7f821406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.883+0000 7f8233fff700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f821406ad10 0x7f821406d1d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8224015040 tx=0x7f8224007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:19.887+0000 7f8230ff9700 1 -- 172.21.15.6:0/2684726664 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f822c0546e0 con 0x7f82340bcf20 2023-07-21T07:35:20.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.087+0000 7f823a378700 1 -- 172.21.15.6:0/2684726664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8234074500 con 0x7f82340bcf20 2023-07-21T07:35:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.088+0000 7f8230ff9700 1 -- 172.21.15.6:0/2684726664 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18171 (secure 0 0 0) 0x7f822c057d00 con 0x7f82340bcf20 2023-07-21T07:35:20.140 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:20.140 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:34:41.984742+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:34:38.107491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T07:34:39.423138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.090+0000 7f823a378700 1 -- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f821406ad10 msgr2=0x7f821406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.090+0000 7f823a378700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f821406ad10 0x7f821406d1d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8224015040 tx=0x7f8224007000 comp rx=0 tx=0).stop 2023-07-21T07:35:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.090+0000 7f823a378700 1 -- 172.21.15.6:0/2684726664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82340bcf20 msgr2=0x7f82341ecbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.090+0000 7f823a378700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82340bcf20 0x7f82341ecbd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f823406e450 tx=0x7f822c00ef00 comp rx=0 tx=0).stop 2023-07-21T07:35:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.090+0000 7f823a378700 1 -- 172.21.15.6:0/2684726664 shutdown_connections 2023-07-21T07:35:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.090+0000 7f823a378700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f821406ad10 0x7f821406d1d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.090+0000 7f823a378700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82340bcf20 0x7f82341ecbd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.090+0000 7f823a378700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8220003a00 0x7f82340bd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.090+0000 7f823a378700 1 --2- 172.21.15.6:0/2684726664 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82340bcac0 0x7f8234150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.090+0000 7f823a378700 1 -- 172.21.15.6:0/2684726664 >> 172.21.15.6:0/2684726664 conn(0x7f82340c4780 msgr2=0x7f82340c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.090+0000 7f823a378700 1 -- 172.21.15.6:0/2684726664 shutdown_connections 2023-07-21T07:35:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.090+0000 7f823a378700 1 -- 172.21.15.6:0/2684726664 wait complete. 2023-07-21T07:35:20.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T07:35:20.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.228+0000 7f3116027700 1 Processor -- start 2023-07-21T07:35:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.228+0000 7f3116027700 1 -- start start 2023-07-21T07:35:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.229+0000 7f3116027700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f311006d2d0 0x7f311006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.229+0000 7f3116027700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31100bc950 con 0x7f31101583d0 2023-07-21T07:35:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.229+0000 7f3116027700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3110072300 con 0x7f31100bcb50 2023-07-21T07:35:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.229+0000 7f3116027700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31100705d0 con 0x7f311006d2d0 2023-07-21T07:35:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.229+0000 7f310effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f31101583d0 0x7f31100708d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41940/0 (socket says 172.21.15.6:41940) 2023-07-21T07:35:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.229+0000 7f310effd700 1 -- 172.21.15.6:0/718128816 learned_addr learned my addr 172.21.15.6:0/718128816 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.229+0000 7f310f7fe700 1 --2- 172.21.15.6:0/718128816 >> v2:172.21.15.86:3300/0 conn(0x7f311006d2d0 0x7f311006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.229+0000 7f310e7fc700 1 -- 172.21.15.6:0/718128816 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491652368 0 0) 0x7f31100bc950 con 0x7f31101583d0 2023-07-21T07:35:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.229+0000 7f310e7fc700 1 -- 172.21.15.6:0/718128816 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30fc0035b0 con 0x7f31101583d0 2023-07-21T07:35:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.230+0000 7f310e7fc700 1 -- 172.21.15.6:0/718128816 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332154930 0 0) 0x7f3110072300 con 0x7f31100bcb50 2023-07-21T07:35:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.230+0000 7f310e7fc700 1 -- 172.21.15.6:0/718128816 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31100bc950 con 0x7f31100bcb50 2023-07-21T07:35:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.230+0000 7f310e7fc700 1 -- 172.21.15.6:0/718128816 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1280847120 0 0) 0x7f30fc0035b0 con 0x7f31101583d0 2023-07-21T07:35:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.230+0000 7f310f7fe700 1 -- 172.21.15.6:0/718128816 >> v1:172.21.15.86:6789/0 conn(0x7f31100bcb50 legacy=0x7f311015ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.230+0000 7f310f7fe700 1 -- 172.21.15.6:0/718128816 >> v1:172.21.15.6:6789/0 conn(0x7f31101583d0 legacy=0x7f31100708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.230+0000 7f310f7fe700 1 -- 172.21.15.6:0/718128816 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3110158860 con 0x7f311006d2d0 2023-07-21T07:35:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.230+0000 7f310f7fe700 1 --2- 172.21.15.6:0/718128816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311006d2d0 0x7f311006d6b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3100009840 tx=0x7f3100009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73b4e7f7050386d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.230+0000 7f310e7fc700 1 -- 172.21.15.6:0/718128816 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f80017f0 con 0x7f311006d2d0 2023-07-21T07:35:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.230+0000 7f310e7fc700 1 -- 172.21.15.6:0/718128816 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3100004030 con 0x7f311006d2d0 2023-07-21T07:35:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.230+0000 7f310e7fc700 1 -- 172.21.15.6:0/718128816 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31000043c0 con 0x7f311006d2d0 2023-07-21T07:35:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.231+0000 7f3116027700 1 -- 172.21.15.6:0/718128816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311006d2d0 msgr2=0x7f311006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.231+0000 7f3116027700 1 --2- 172.21.15.6:0/718128816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311006d2d0 0x7f311006d6b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3100009840 tx=0x7f3100009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.231+0000 7f3116027700 1 -- 172.21.15.6:0/718128816 shutdown_connections 2023-07-21T07:35:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.231+0000 7f3116027700 1 --2- 172.21.15.6:0/718128816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311006d2d0 0x7f311006d6b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.231+0000 7f3116027700 1 -- 172.21.15.6:0/718128816 >> 172.21.15.6:0/718128816 conn(0x7f31100c09f0 msgr2=0x7f31100c0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.231+0000 7f3116027700 1 -- 172.21.15.6:0/718128816 shutdown_connections 2023-07-21T07:35:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.231+0000 7f3116027700 1 -- 172.21.15.6:0/718128816 wait complete. 2023-07-21T07:35:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.232+0000 7f3116027700 1 Processor -- start 2023-07-21T07:35:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.232+0000 7f3116027700 1 -- start start 2023-07-21T07:35:20.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f3116027700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f311006d2d0 0x7f311014a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:20.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f3116027700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31100bcb50 0x7f311014c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f3116027700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311006a3c0 0x7f31101ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f3116027700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311006cef0 con 0x7f31100bcb50 2023-07-21T07:35:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f3116027700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311006c080 con 0x7f311006a3c0 2023-07-21T07:35:20.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f3116027700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311006b7e0 con 0x7f311006d2d0 2023-07-21T07:35:20.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f310effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31100bcb50 0x7f311014c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:20.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f310effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31100bcb50 0x7f311014c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33928/0 (socket says 172.21.15.6:33928) 2023-07-21T07:35:20.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f310effd700 1 -- 172.21.15.6:0/1313158012 learned_addr learned my addr 172.21.15.6:0/1313158012 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:20.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f310ffff700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311006a3c0 0x7f31101ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:20.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f310f7fe700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f311006d2d0 0x7f311014a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:20.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f310effd700 1 -- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f311006d2d0 msgr2=0x7f311014a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f310effd700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f311006d2d0 0x7f311014a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f310effd700 1 -- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311006a3c0 msgr2=0x7f31101ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f310effd700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311006a3c0 0x7f31101ed7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f310effd700 1 -- 172.21.15.6:0/1313158012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000094a0 con 0x7f31100bcb50 2023-07-21T07:35:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f310effd700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31100bcb50 0x7f311014c4a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f30f8001150 tx=0x7f30f800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.233+0000 7f3107fff700 1 -- 172.21.15.6:0/1313158012 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f80074e0 con 0x7f31100bcb50 2023-07-21T07:35:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.234+0000 7f3107fff700 1 -- 172.21.15.6:0/1313158012 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f8007640 con 0x7f31100bcb50 2023-07-21T07:35:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.234+0000 7f3107fff700 1 -- 172.21.15.6:0/1313158012 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8005a30 con 0x7f31100bcb50 2023-07-21T07:35:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.234+0000 7f3116027700 1 -- 172.21.15.6:0/1313158012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311006bac0 con 0x7f31100bcb50 2023-07-21T07:35:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.234+0000 7f3116027700 1 -- 172.21.15.6:0/1313158012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31101ed2a0 con 0x7f31100bcb50 2023-07-21T07:35:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.235+0000 7f3116027700 1 -- 172.21.15.6:0/1313158012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3110074500 con 0x7f31100bcb50 2023-07-21T07:35:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.235+0000 7f3107fff700 1 -- 172.21.15.6:0/1313158012 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f30f8005b90 con 0x7f31100bcb50 2023-07-21T07:35:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.235+0000 7f3107fff700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f30f006ace0 0x7f30f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.236+0000 7f3107fff700 1 -- 172.21.15.6:0/1313158012 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30f80887c0 con 0x7f31100bcb50 2023-07-21T07:35:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.236+0000 7f310f7fe700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f30f006ace0 0x7f30f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:20.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.236+0000 7f310f7fe700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f30f006ace0 0x7f30f006d1a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f31000090b0 tx=0x7f3100008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:20.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.240+0000 7f3107fff700 1 -- 172.21.15.6:0/1313158012 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f30f80539b0 con 0x7f31100bcb50 2023-07-21T07:35:20.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.482+0000 7f3116027700 1 -- 172.21.15.6:0/1313158012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f311004ecc0 con 0x7f31100bcb50 2023-07-21T07:35:20.535 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T07:35:20.483+0000 7f4b07aab700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T07:35:20.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.487+0000 7f3107fff700 1 -- 172.21.15.6:0/1313158012 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f30f8056fd0 con 0x7f31100bcb50 2023-07-21T07:35:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.489+0000 7f3116027700 1 -- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f30f006ace0 msgr2=0x7f30f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.489+0000 7f3116027700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f30f006ace0 0x7f30f006d1a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f31000090b0 tx=0x7f3100008030 comp rx=0 tx=0).stop 2023-07-21T07:35:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.489+0000 7f3116027700 1 -- 172.21.15.6:0/1313158012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31100bcb50 msgr2=0x7f311014c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:20.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.489+0000 7f3116027700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31100bcb50 0x7f311014c4a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f30f8001150 tx=0x7f30f800c8d0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.489+0000 7f3116027700 1 -- 172.21.15.6:0/1313158012 shutdown_connections 2023-07-21T07:35:20.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.489+0000 7f3116027700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f30f006ace0 0x7f30f006d1a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.489+0000 7f3116027700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f311006a3c0 0x7f31101ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.489+0000 7f3116027700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f311006d2d0 0x7f311014a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.489+0000 7f3116027700 1 --2- 172.21.15.6:0/1313158012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31100bcb50 0x7f311014c4a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.489+0000 7f3116027700 1 -- 172.21.15.6:0/1313158012 >> 172.21.15.6:0/1313158012 conn(0x7f31100c09f0 msgr2=0x7f3110151390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:20.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.489+0000 7f3116027700 1 -- 172.21.15.6:0/1313158012 shutdown_connections 2023-07-21T07:35:20.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.489+0000 7f3116027700 1 -- 172.21.15.6:0/1313158012 wait complete. 2023-07-21T07:35:20.544 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T07:35:20.553 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T07:35:20.580 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2023-07-21T07:35:20.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.628+0000 7f6fd2964700 1 Processor -- start 2023-07-21T07:35:20.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.628+0000 7f6fd2964700 1 -- start start 2023-07-21T07:35:20.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.629+0000 7f6fd2964700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6fcc072160 0x7f6fcc14f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:20.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.629+0000 7f6fd2964700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fcc0c4120 0x7f6fcc14f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.629+0000 7f6fd2964700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc0c3c90 con 0x7f6fcc0a6f80 2023-07-21T07:35:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.629+0000 7f6fd2964700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c26e0 con 0x7f6fcc072160 2023-07-21T07:35:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.629+0000 7f6fd2964700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c3680 con 0x7f6fcc0c4120 2023-07-21T07:35:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.629+0000 7f6fcb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6fcc072160 0x7f6fcc14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.629+0000 7f6fcb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6fcc072160 0x7f6fcc14f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33936/0 (socket says 172.21.15.6:33936) 2023-07-21T07:35:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.629+0000 7f6fcb7fe700 1 -- 172.21.15.6:0/1041925170 learned_addr learned my addr 172.21.15.6:0/1041925170 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.629+0000 7f6fd0f01700 1 --2- 172.21.15.6:0/1041925170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fcc0c4120 0x7f6fcc14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.629+0000 7f6fcb7fe700 1 -- 172.21.15.6:0/1041925170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fcc0c4120 msgr2=0x7f6fcc14f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.629+0000 7f6fcb7fe700 1 --2- 172.21.15.6:0/1041925170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fcc0c4120 0x7f6fcc14f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.629+0000 7f6fcb7fe700 1 -- 172.21.15.6:0/1041925170 >> v1:172.21.15.86:6789/0 conn(0x7f6fcc0a6f80 legacy=0x7f6fcc152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.629+0000 7f6fcb7fe700 1 -- 172.21.15.6:0/1041925170 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc0c6fe0 con 0x7f6fcc072160 2023-07-21T07:35:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.630+0000 7f6fcb7fe700 1 --2- 172.21.15.6:0/1041925170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc072160 0x7f6fcc14f420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40098f0 tx=0x7f6fb4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359fdde44ec2cbdb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.630+0000 7f6fcaffd700 1 -- 172.21.15.6:0/1041925170 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4011830 con 0x7f6fcc072160 2023-07-21T07:35:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.630+0000 7f6fcaffd700 1 -- 172.21.15.6:0/1041925170 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb4011990 con 0x7f6fcc072160 2023-07-21T07:35:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.630+0000 7f6fcaffd700 1 -- 172.21.15.6:0/1041925170 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4011d20 con 0x7f6fcc072160 2023-07-21T07:35:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.630+0000 7f6fd2964700 1 -- 172.21.15.6:0/1041925170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc072160 msgr2=0x7f6fcc14f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.630+0000 7f6fd2964700 1 --2- 172.21.15.6:0/1041925170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc072160 0x7f6fcc14f420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40098f0 tx=0x7f6fb4009c00 comp rx=0 tx=0).stop 2023-07-21T07:35:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.630+0000 7f6fd2964700 1 -- 172.21.15.6:0/1041925170 shutdown_connections 2023-07-21T07:35:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.630+0000 7f6fd2964700 1 --2- 172.21.15.6:0/1041925170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fcc0c4120 0x7f6fcc14f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.630+0000 7f6fd2964700 1 --2- 172.21.15.6:0/1041925170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc072160 0x7f6fcc14f420 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.630+0000 7f6fd2964700 1 -- 172.21.15.6:0/1041925170 >> 172.21.15.6:0/1041925170 conn(0x7f6fcc0c7b50 msgr2=0x7f6fcc0c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.630+0000 7f6fd2964700 1 -- 172.21.15.6:0/1041925170 shutdown_connections 2023-07-21T07:35:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.630+0000 7f6fd2964700 1 -- 172.21.15.6:0/1041925170 wait complete. 2023-07-21T07:35:20.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.632+0000 7f6fd2964700 1 Processor -- start 2023-07-21T07:35:20.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.632+0000 7f6fd2964700 1 -- start start 2023-07-21T07:35:20.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fd2964700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fcc072160 0x7f6fcc1501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:20.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fd2964700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc0a6f80 0x7f6fcc14ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:20.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fd2964700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fcc0c4120 0x7f6fcc1eaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fd2964700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc1453d0 con 0x7f6fcc0a6f80 2023-07-21T07:35:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fd2964700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0ab210 con 0x7f6fcc0c4120 2023-07-21T07:35:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fd2964700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0ab6a0 con 0x7f6fcc072160 2023-07-21T07:35:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fcb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc0a6f80 0x7f6fcc14ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fcb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc0a6f80 0x7f6fcc14ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33942/0 (socket says 172.21.15.6:33942) 2023-07-21T07:35:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fcb7fe700 1 -- 172.21.15.6:0/2153793303 learned_addr learned my addr 172.21.15.6:0/2153793303 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fd0f01700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fcc0c4120 0x7f6fcc1eaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fcbfff700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fcc072160 0x7f6fcc1501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fcb7fe700 1 -- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fcc072160 msgr2=0x7f6fcc1501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fcb7fe700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fcc072160 0x7f6fcc1501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fcb7fe700 1 -- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fcc0c4120 msgr2=0x7f6fcc1eaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fcb7fe700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fcc0c4120 0x7f6fcc1eaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fcb7fe700 1 -- 172.21.15.6:0/2153793303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb4009550 con 0x7f6fcc0a6f80 2023-07-21T07:35:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.633+0000 7f6fcbfff700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fcc072160 0x7f6fcc1501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.634+0000 7f6fcb7fe700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc0a6f80 0x7f6fcc14ab50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4014040 tx=0x7f6fb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.634+0000 7f6fc8ff9700 1 -- 172.21.15.6:0/2153793303 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4004590 con 0x7f6fcc0a6f80 2023-07-21T07:35:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.634+0000 7f6fc8ff9700 1 -- 172.21.15.6:0/2153793303 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb401e070 con 0x7f6fcc0a6f80 2023-07-21T07:35:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.634+0000 7f6fd2964700 1 -- 172.21.15.6:0/2153793303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc1450f0 con 0x7f6fcc0a6f80 2023-07-21T07:35:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.634+0000 7f6fc8ff9700 1 -- 172.21.15.6:0/2153793303 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb40038e0 con 0x7f6fcc0a6f80 2023-07-21T07:35:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.634+0000 7f6fd2964700 1 -- 172.21.15.6:0/2153793303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc1ebcc0 con 0x7f6fcc0a6f80 2023-07-21T07:35:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.635+0000 7f6fd2964700 1 -- 172.21.15.6:0/2153793303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fcc074500 con 0x7f6fcc0a6f80 2023-07-21T07:35:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.635+0000 7f6fc8ff9700 1 -- 172.21.15.6:0/2153793303 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6fb4003a40 con 0x7f6fcc0a6f80 2023-07-21T07:35:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.636+0000 7f6fc8ff9700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6fac06ad10 0x7f6fac06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.636+0000 7f6fc8ff9700 1 -- 172.21.15.6:0/2153793303 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6fb408a420 con 0x7f6fcc0a6f80 2023-07-21T07:35:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.636+0000 7f6fcbfff700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6fac06ad10 0x7f6fac06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.636+0000 7f6fcbfff700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6fac06ad10 0x7f6fac06d1d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc000f60 tx=0x7f6fbc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.640+0000 7f6fc8ff9700 1 -- 172.21.15.6:0/2153793303 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6fb4055460 con 0x7f6fcc0a6f80 2023-07-21T07:35:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:20.887+0000 7f6fd2964700 1 -- 172.21.15.6:0/2153793303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6fcc0ab350 con 0x7f6fcc0a6f80 2023-07-21T07:35:21.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.491+0000 7f6fc8ff9700 1 -- 172.21.15.6:0/2153793303 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6fb4058a80 con 0x7f6fcc0a6f80 2023-07-21T07:35:21.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.494+0000 7f6fd2964700 1 -- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6fac06ad10 msgr2=0x7f6fac06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:21.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.494+0000 7f6fd2964700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6fac06ad10 0x7f6fac06d1d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc000f60 tx=0x7f6fbc009040 comp rx=0 tx=0).stop 2023-07-21T07:35:21.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.494+0000 7f6fd2964700 1 -- 172.21.15.6:0/2153793303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc0a6f80 msgr2=0x7f6fcc14ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:21.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.494+0000 7f6fd2964700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc0a6f80 0x7f6fcc14ab50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4014040 tx=0x7f6fb4004750 comp rx=0 tx=0).stop 2023-07-21T07:35:21.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.494+0000 7f6fd2964700 1 -- 172.21.15.6:0/2153793303 shutdown_connections 2023-07-21T07:35:21.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.494+0000 7f6fd2964700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6fac06ad10 0x7f6fac06d1d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:21.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.494+0000 7f6fd2964700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fcc0c4120 0x7f6fcc1eaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:21.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.494+0000 7f6fd2964700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fcc072160 0x7f6fcc1501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:21.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.494+0000 7f6fd2964700 1 --2- 172.21.15.6:0/2153793303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc0a6f80 0x7f6fcc14ab50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:21.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.494+0000 7f6fd2964700 1 -- 172.21.15.6:0/2153793303 >> 172.21.15.6:0/2153793303 conn(0x7f6fcc0c7b50 msgr2=0x7f6fcc071650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:21.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.494+0000 7f6fd2964700 1 -- 172.21.15.6:0/2153793303 shutdown_connections 2023-07-21T07:35:21.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.494+0000 7f6fd2964700 1 -- 172.21.15.6:0/2153793303 wait complete. 2023-07-21T07:35:21.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T07:35:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.646+0000 7fa6424b0700 1 Processor -- start 2023-07-21T07:35:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.646+0000 7fa6424b0700 1 -- start start 2023-07-21T07:35:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa6424b0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa63c0c5300 0x7fa63c151d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa6424b0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0c13c0 0x7fa63c0c3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa6424b0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c0c1850 con 0x7fa63c14e930 2023-07-21T07:35:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa6424b0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63c1518f0 con 0x7fa63c0c5300 2023-07-21T07:35:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa6424b0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c06d7d0 con 0x7fa63c0c13c0 2023-07-21T07:35:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa63b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa63c0c5300 0x7fa63c151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa63b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa63c0c5300 0x7fa63c151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33950/0 (socket says 172.21.15.6:33950) 2023-07-21T07:35:21.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa63b7fe700 1 -- 172.21.15.6:0/2365864858 learned_addr learned my addr 172.21.15.6:0/2365864858 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:21.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa640a4d700 1 --2- 172.21.15.6:0/2365864858 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0c13c0 0x7fa63c0c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:21.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa63b7fe700 1 -- 172.21.15.6:0/2365864858 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0c13c0 msgr2=0x7fa63c0c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:21.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa63b7fe700 1 --2- 172.21.15.6:0/2365864858 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0c13c0 0x7fa63c0c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:21.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa63b7fe700 1 -- 172.21.15.6:0/2365864858 >> v1:172.21.15.86:6789/0 conn(0x7fa63c14e930 legacy=0x7fa63c06d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:21.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa63b7fe700 1 -- 172.21.15.6:0/2365864858 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c0c1a80 con 0x7fa63c0c5300 2023-07-21T07:35:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa640a4d700 1 --2- 172.21.15.6:0/2365864858 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0c13c0 0x7fa63c0c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.647+0000 7fa63b7fe700 1 --2- 172.21.15.6:0/2365864858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c0c5300 0x7fa63c151d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0098f0 tx=0x7fa62c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a3f597a811dc24 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.648+0000 7fa63affd700 1 -- 172.21.15.6:0/2365864858 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c00b8a0 con 0x7fa63c0c5300 2023-07-21T07:35:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.648+0000 7fa63affd700 1 -- 172.21.15.6:0/2365864858 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c00ba00 con 0x7fa63c0c5300 2023-07-21T07:35:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.648+0000 7fa63affd700 1 -- 172.21.15.6:0/2365864858 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c00bd90 con 0x7fa63c0c5300 2023-07-21T07:35:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.648+0000 7fa6424b0700 1 -- 172.21.15.6:0/2365864858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c0c5300 msgr2=0x7fa63c151d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.648+0000 7fa6424b0700 1 --2- 172.21.15.6:0/2365864858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c0c5300 0x7fa63c151d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0098f0 tx=0x7fa62c009c00 comp rx=0 tx=0).stop 2023-07-21T07:35:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.648+0000 7fa6424b0700 1 -- 172.21.15.6:0/2365864858 shutdown_connections 2023-07-21T07:35:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.648+0000 7fa6424b0700 1 --2- 172.21.15.6:0/2365864858 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0c13c0 0x7fa63c0c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.648+0000 7fa6424b0700 1 --2- 172.21.15.6:0/2365864858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c0c5300 0x7fa63c151d80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.648+0000 7fa6424b0700 1 -- 172.21.15.6:0/2365864858 >> 172.21.15.6:0/2365864858 conn(0x7fa63c0a85f0 msgr2=0x7fa63c0a8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.648+0000 7fa6424b0700 1 -- 172.21.15.6:0/2365864858 shutdown_connections 2023-07-21T07:35:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.648+0000 7fa6424b0700 1 -- 172.21.15.6:0/2365864858 wait complete. 2023-07-21T07:35:21.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.650+0000 7fa6424b0700 1 Processor -- start 2023-07-21T07:35:21.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.650+0000 7fa6424b0700 1 -- start start 2023-07-21T07:35:21.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa6424b0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0c13c0 0x7fa63c1551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:21.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa6424b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c0c5300 0x7fa63c0c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:21.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa6424b0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa63c14e930 0x7fa63c154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:21.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa6424b0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c1e9590 con 0x7fa63c0c5300 2023-07-21T07:35:21.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa6424b0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c1541c0 con 0x7fa63c14e930 2023-07-21T07:35:21.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa6424b0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c1e9010 con 0x7fa63c0c13c0 2023-07-21T07:35:21.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa63b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c0c5300 0x7fa63c0c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:21.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa63b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c0c5300 0x7fa63c0c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33958/0 (socket says 172.21.15.6:33958) 2023-07-21T07:35:21.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa63b7fe700 1 -- 172.21.15.6:0/1643607975 learned_addr learned my addr 172.21.15.6:0/1643607975 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:21.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa63bfff700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0c13c0 0x7fa63c1551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:21.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa640a4d700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa63c14e930 0x7fa63c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa63b7fe700 1 -- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0c13c0 msgr2=0x7fa63c1551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa63b7fe700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0c13c0 0x7fa63c1551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa63b7fe700 1 -- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa63c14e930 msgr2=0x7fa63c154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa63b7fe700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa63c14e930 0x7fa63c154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa63b7fe700 1 -- 172.21.15.6:0/1643607975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c009550 con 0x7fa63c0c5300 2023-07-21T07:35:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa640a4d700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa63c14e930 0x7fa63c154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa63bfff700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0c13c0 0x7fa63c1551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.651+0000 7fa63b7fe700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c0c5300 0x7fa63c0c6c20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa62c000c00 tx=0x7fa62c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.652+0000 7fa638ff9700 1 -- 172.21.15.6:0/1643607975 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c004570 con 0x7fa63c0c5300 2023-07-21T07:35:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.652+0000 7fa638ff9700 1 -- 172.21.15.6:0/1643607975 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c01f070 con 0x7fa63c0c5300 2023-07-21T07:35:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.652+0000 7fa6424b0700 1 -- 172.21.15.6:0/1643607975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c1e92b0 con 0x7fa63c0c5300 2023-07-21T07:35:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.652+0000 7fa638ff9700 1 -- 172.21.15.6:0/1643607975 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c0038e0 con 0x7fa63c0c5300 2023-07-21T07:35:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.652+0000 7fa6424b0700 1 -- 172.21.15.6:0/1643607975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c0c7160 con 0x7fa63c0c5300 2023-07-21T07:35:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.653+0000 7fa6424b0700 1 -- 172.21.15.6:0/1643607975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63c153cb0 con 0x7fa63c0c5300 2023-07-21T07:35:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.653+0000 7fa638ff9700 1 -- 172.21.15.6:0/1643607975 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa62c021030 con 0x7fa63c0c5300 2023-07-21T07:35:21.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.653+0000 7fa638ff9700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa61c06ace0 0x7fa61c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:21.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.654+0000 7fa638ff9700 1 -- 172.21.15.6:0/1643607975 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fa62c08aac0 con 0x7fa63c0c5300 2023-07-21T07:35:21.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.654+0000 7fa63bfff700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa61c06ace0 0x7fa61c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:21.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.654+0000 7fa63bfff700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa61c06ace0 0x7fa61c06d1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa624000f60 tx=0x7fa624009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:21.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.658+0000 7fa638ff9700 1 -- 172.21.15.6:0/1643607975 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa63c153cb0 con 0x7fa63c0c5300 2023-07-21T07:35:21.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:21.854+0000 7fa6424b0700 1 -- 172.21.15.6:0/1643607975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa63c153cb0 con 0x7fa63c0c5300 2023-07-21T07:35:22.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.499+0000 7fa638ff9700 1 -- 172.21.15.6:0/1643607975 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa63c153cb0 con 0x7fa63c0c5300 2023-07-21T07:35:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.505+0000 7fa6424b0700 1 -- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa61c06ace0 msgr2=0x7fa61c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.505+0000 7fa6424b0700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa61c06ace0 0x7fa61c06d1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa624000f60 tx=0x7fa624009040 comp rx=0 tx=0).stop 2023-07-21T07:35:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.505+0000 7fa6424b0700 1 -- 172.21.15.6:0/1643607975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c0c5300 msgr2=0x7fa63c0c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.505+0000 7fa6424b0700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c0c5300 0x7fa63c0c6c20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa62c000c00 tx=0x7fa62c004750 comp rx=0 tx=0).stop 2023-07-21T07:35:22.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.505+0000 7fa6424b0700 1 -- 172.21.15.6:0/1643607975 shutdown_connections 2023-07-21T07:35:22.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.505+0000 7fa6424b0700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa61c06ace0 0x7fa61c06d1a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.505+0000 7fa6424b0700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa63c14e930 0x7fa63c154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.505+0000 7fa6424b0700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0c13c0 0x7fa63c1551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.505+0000 7fa6424b0700 1 --2- 172.21.15.6:0/1643607975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c0c5300 0x7fa63c0c6c20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.505+0000 7fa6424b0700 1 -- 172.21.15.6:0/1643607975 >> 172.21.15.6:0/1643607975 conn(0x7fa63c0a85f0 msgr2=0x7fa63c14cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.505+0000 7fa6424b0700 1 -- 172.21.15.6:0/1643607975 shutdown_connections 2023-07-21T07:35:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.505+0000 7fa6424b0700 1 -- 172.21.15.6:0/1643607975 wait complete. 2023-07-21T07:35:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-21T07:35:22.573 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T07:35:22.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.656+0000 7fad4d434700 1 Processor -- start 2023-07-21T07:35:22.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.656+0000 7fad4d434700 1 -- start start 2023-07-21T07:35:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.656+0000 7fad4d434700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad48154f40 0x7fad480717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.656+0000 7fad4d434700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad48071d00 0x7fad4815ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.656+0000 7fad4d434700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad481553d0 con 0x7fad481519c0 2023-07-21T07:35:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.656+0000 7fad4d434700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad480c6150 con 0x7fad48154f40 2023-07-21T07:35:22.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.656+0000 7fad4d434700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4806ec70 con 0x7fad48071d00 2023-07-21T07:35:22.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.657+0000 7fad467fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad48154f40 0x7fad480717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:22.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.657+0000 7fad467fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad48154f40 0x7fad480717c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33966/0 (socket says 172.21.15.6:33966) 2023-07-21T07:35:22.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.657+0000 7fad467fc700 1 -- 172.21.15.6:0/640285236 learned_addr learned my addr 172.21.15.6:0/640285236 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:22.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.657+0000 7fad467fc700 1 -- 172.21.15.6:0/640285236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad48071d00 msgr2=0x7fad4815ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:22.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.657+0000 7fad467fc700 1 --2- 172.21.15.6:0/640285236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad48071d00 0x7fad4815ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:22.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.657+0000 7fad467fc700 1 -- 172.21.15.6:0/640285236 >> v1:172.21.15.86:6789/0 conn(0x7fad481519c0 legacy=0x7fad480c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.657+0000 7fad467fc700 1 -- 172.21.15.6:0/640285236 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad480c18c0 con 0x7fad48154f40 2023-07-21T07:35:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.657+0000 7fad467fc700 1 --2- 172.21.15.6:0/640285236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad48154f40 0x7fad480717c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0098f0 tx=0x7fad3c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df322f75b2ce8f8b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.657+0000 7fad45ffb700 1 -- 172.21.15.6:0/640285236 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c004230 con 0x7fad48154f40 2023-07-21T07:35:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.657+0000 7fad45ffb700 1 -- 172.21.15.6:0/640285236 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c004390 con 0x7fad48154f40 2023-07-21T07:35:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.657+0000 7fad45ffb700 1 -- 172.21.15.6:0/640285236 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0036a0 con 0x7fad48154f40 2023-07-21T07:35:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.658+0000 7fad4d434700 1 -- 172.21.15.6:0/640285236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad48154f40 msgr2=0x7fad480717c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.658+0000 7fad4d434700 1 --2- 172.21.15.6:0/640285236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad48154f40 0x7fad480717c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0098f0 tx=0x7fad3c009c00 comp rx=0 tx=0).stop 2023-07-21T07:35:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.658+0000 7fad4d434700 1 -- 172.21.15.6:0/640285236 shutdown_connections 2023-07-21T07:35:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.658+0000 7fad4d434700 1 --2- 172.21.15.6:0/640285236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad48071d00 0x7fad4815ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.658+0000 7fad4d434700 1 --2- 172.21.15.6:0/640285236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad48154f40 0x7fad480717c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.658+0000 7fad4d434700 1 -- 172.21.15.6:0/640285236 >> 172.21.15.6:0/640285236 conn(0x7fad480c7b60 msgr2=0x7fad480c7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.658+0000 7fad4d434700 1 -- 172.21.15.6:0/640285236 shutdown_connections 2023-07-21T07:35:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.658+0000 7fad4d434700 1 -- 172.21.15.6:0/640285236 wait complete. 2023-07-21T07:35:22.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.659+0000 7fad4d434700 1 Processor -- start 2023-07-21T07:35:22.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.659+0000 7fad4d434700 1 -- start start 2023-07-21T07:35:22.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad4d434700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad48071d00 0x7fad48153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad4d434700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad481519c0 0x7fad480ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad4d434700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad481586c0 0x7fad480acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad4d434700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad48157870 con 0x7fad481586c0 2023-07-21T07:35:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad4d434700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad480ac530 con 0x7fad48071d00 2023-07-21T07:35:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad4d434700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4814e650 con 0x7fad481519c0 2023-07-21T07:35:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad481586c0 0x7fad480acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad481586c0 0x7fad480acf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33974/0 (socket says 172.21.15.6:33974) 2023-07-21T07:35:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad477fe700 1 -- 172.21.15.6:0/888080513 learned_addr learned my addr 172.21.15.6:0/888080513 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad467fc700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad481519c0 0x7fad480ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad46ffd700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad48071d00 0x7fad48153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad477fe700 1 -- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad481519c0 msgr2=0x7fad480ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad477fe700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad481519c0 0x7fad480ac9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad477fe700 1 -- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad48071d00 msgr2=0x7fad48153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad477fe700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad48071d00 0x7fad48153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad477fe700 1 -- 172.21.15.6:0/888080513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c009550 con 0x7fad481586c0 2023-07-21T07:35:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.660+0000 7fad477fe700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad481586c0 0x7fad480acf00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fad4000b9e0 tx=0x7fad4000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.661+0000 7fad2f7fe700 1 -- 172.21.15.6:0/888080513 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4000c950 con 0x7fad481586c0 2023-07-21T07:35:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.661+0000 7fad2f7fe700 1 -- 172.21.15.6:0/888080513 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4000cad0 con 0x7fad481586c0 2023-07-21T07:35:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.661+0000 7fad4d434700 1 -- 172.21.15.6:0/888080513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad48156260 con 0x7fad481586c0 2023-07-21T07:35:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.661+0000 7fad2f7fe700 1 -- 172.21.15.6:0/888080513 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4000ce80 con 0x7fad481586c0 2023-07-21T07:35:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.661+0000 7fad4d434700 1 -- 172.21.15.6:0/888080513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad481540d0 con 0x7fad481586c0 2023-07-21T07:35:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.662+0000 7fad4d434700 1 -- 172.21.15.6:0/888080513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad48156780 con 0x7fad481586c0 2023-07-21T07:35:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.662+0000 7fad2f7fe700 1 -- 172.21.15.6:0/888080513 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad4001d3b0 con 0x7fad481586c0 2023-07-21T07:35:22.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.662+0000 7fad2f7fe700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fad3406ace0 0x7fad3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:22.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.662+0000 7fad2f7fe700 1 -- 172.21.15.6:0/888080513 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fad40088fc0 con 0x7fad481586c0 2023-07-21T07:35:22.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.663+0000 7fad46ffd700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fad3406ace0 0x7fad3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:22.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.663+0000 7fad46ffd700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fad3406ace0 0x7fad3406d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fad38004f30 tx=0x7fad38009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:22.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.667+0000 7fad2f7fe700 1 -- 172.21.15.6:0/888080513 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fad400bb310 con 0x7fad481586c0 2023-07-21T07:35:22.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:22.868+0000 7fad4d434700 1 -- 172.21.15.6:0/888080513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad48074500 con 0x7fad481586c0 2023-07-21T07:35:23.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.502+0000 7fad2f7fe700 1 -- 172.21.15.6:0/888080513 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7fad40019020 con 0x7fad481586c0 2023-07-21T07:35:23.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.507+0000 7fad4d434700 1 -- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fad3406ace0 msgr2=0x7fad3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:23.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.507+0000 7fad4d434700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fad3406ace0 0x7fad3406d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fad38004f30 tx=0x7fad38009040 comp rx=0 tx=0).stop 2023-07-21T07:35:23.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.507+0000 7fad4d434700 1 -- 172.21.15.6:0/888080513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad481586c0 msgr2=0x7fad480acf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:23.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.507+0000 7fad4d434700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad481586c0 0x7fad480acf00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fad4000b9e0 tx=0x7fad4000bda0 comp rx=0 tx=0).stop 2023-07-21T07:35:23.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.508+0000 7fad4d434700 1 -- 172.21.15.6:0/888080513 shutdown_connections 2023-07-21T07:35:23.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.508+0000 7fad4d434700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fad3406ace0 0x7fad3406d1a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:23.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.508+0000 7fad4d434700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad481586c0 0x7fad480acf00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:23.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.508+0000 7fad4d434700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad48071d00 0x7fad48153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:23.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.508+0000 7fad4d434700 1 --2- 172.21.15.6:0/888080513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad481519c0 0x7fad480ac9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:23.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.508+0000 7fad4d434700 1 -- 172.21.15.6:0/888080513 >> 172.21.15.6:0/888080513 conn(0x7fad480c7b60 msgr2=0x7fad480c7240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:23.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.508+0000 7fad4d434700 1 -- 172.21.15.6:0/888080513 shutdown_connections 2023-07-21T07:35:23.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.508+0000 7fad4d434700 1 -- 172.21.15.6:0/888080513 wait complete. 2023-07-21T07:35:23.568 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-21T07:35:23.580 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T07:35:23.581 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T07:35:23.581 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T07:35:23.581 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T07:35:23.582 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T07:35:23.582 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T07:35:23.582 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T07:35:23.582 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T07:35:23.583 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T07:35:23.583 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T07:35:23.583 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T07:35:23.583 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T07:35:23.584 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T07:35:23.584 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T07:35:23.585 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T07:35:23.585 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T07:35:23.591 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T07:35:23.592 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T07:35:23.593 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T07:35:23.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T07:35:23.594 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T07:35:23.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T07:35:23.595 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T07:35:23.595 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T07:35:23.634 INFO:tasks.ceph.mds.a:Started 2023-07-21T07:35:23.635 DEBUG:teuthology.parallel:result is None 2023-07-21T07:35:23.636 INFO:tasks.ceph.mds.c:Started 2023-07-21T07:35:23.636 DEBUG:teuthology.parallel:result is None 2023-07-21T07:35:23.637 INFO:tasks.ceph.mds.b:Started 2023-07-21T07:35:23.637 DEBUG:teuthology.parallel:result is None 2023-07-21T07:35:23.638 INFO:tasks.ceph.mds.d:Started 2023-07-21T07:35:23.639 DEBUG:teuthology.parallel:result is None 2023-07-21T07:35:23.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T07:35:23.723 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2023-07-21T07:35:23.724 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2023-07-21T07:35:23.725 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T07:35:23.725 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T07:35:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.727+0000 7fa9bd0a4700 1 Processor -- start 2023-07-21T07:35:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.727+0000 7fa9bd0a4700 1 -- start start 2023-07-21T07:35:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.728+0000 7fa9bd0a4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa9b80c6e30 0x7fa9b8072060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.728+0000 7fa9bd0a4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9b814fdc0 0x7fa9b806e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.728+0000 7fa9bd0a4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b80c34d0 con 0x7fa9b8071750 2023-07-21T07:35:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.728+0000 7fa9bd0a4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b80c26d0 con 0x7fa9b80c6e30 2023-07-21T07:35:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.728+0000 7fa9bd0a4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80c37b0 con 0x7fa9b814fdc0 2023-07-21T07:35:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.728+0000 7fa9b6d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa9b80c6e30 0x7fa9b8072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.728+0000 7fa9b759e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9b814fdc0 0x7fa9b806e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.728+0000 7fa9b759e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9b814fdc0 0x7fa9b806e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:59632/0 (socket says 172.21.15.6:59632) 2023-07-21T07:35:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.728+0000 7fa9b659c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa9b8071750 0x7fa9b814f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:45266/0 (socket says 172.21.15.6:45266) 2023-07-21T07:35:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.728+0000 7fa9b6d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa9b80c6e30 0x7fa9b8072060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:55806/0 (socket says 172.21.15.6:55806) 2023-07-21T07:35:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.728+0000 7fa9b759e700 1 -- 172.21.15.6:0/3031788417 learned_addr learned my addr 172.21.15.6:0/3031788417 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9b5d9b700 1 -- 172.21.15.6:0/3031788417 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036314096 0 0) 0x7fa9b80c34d0 con 0x7fa9b8071750 2023-07-21T07:35:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9b6d9d700 1 -- 172.21.15.6:0/3031788417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9b814fdc0 msgr2=0x7fa9b806e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9b6d9d700 1 --2- 172.21.15.6:0/3031788417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9b814fdc0 0x7fa9b806e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9b6d9d700 1 -- 172.21.15.6:0/3031788417 >> v1:172.21.15.86:6789/0 conn(0x7fa9b8071750 legacy=0x7fa9b814f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9b6d9d700 1 -- 172.21.15.6:0/3031788417 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b80c3a90 con 0x7fa9b80c6e30 2023-07-21T07:35:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9b759e700 1 --2- 172.21.15.6:0/3031788417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9b814fdc0 0x7fa9b806e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9b6d9d700 1 --2- 172.21.15.6:0/3031788417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9b80c6e30 0x7fa9b8072060 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009840 tx=0x7fa9b0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9d44d72db040ea4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9b5d9b700 1 -- 172.21.15.6:0/3031788417 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0011830 con 0x7fa9b80c6e30 2023-07-21T07:35:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9b5d9b700 1 -- 172.21.15.6:0/3031788417 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b0011990 con 0x7fa9b80c6e30 2023-07-21T07:35:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9b5d9b700 1 -- 172.21.15.6:0/3031788417 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0011d20 con 0x7fa9b80c6e30 2023-07-21T07:35:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/3031788417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9b80c6e30 msgr2=0x7fa9b8072060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9bd0a4700 1 --2- 172.21.15.6:0/3031788417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9b80c6e30 0x7fa9b8072060 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009840 tx=0x7fa9b0009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/3031788417 shutdown_connections 2023-07-21T07:35:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9bd0a4700 1 --2- 172.21.15.6:0/3031788417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9b814fdc0 0x7fa9b806e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9bd0a4700 1 --2- 172.21.15.6:0/3031788417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9b80c6e30 0x7fa9b8072060 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.729+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/3031788417 >> 172.21.15.6:0/3031788417 conn(0x7fa9b80a9670 msgr2=0x7fa9b80a9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.730+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/3031788417 shutdown_connections 2023-07-21T07:35:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.730+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/3031788417 wait complete. 2023-07-21T07:35:23.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.731+0000 7fa9bd0a4700 1 Processor -- start 2023-07-21T07:35:23.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.731+0000 7fa9bd0a4700 1 -- start start 2023-07-21T07:35:23.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9bd0a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b8071750 0x7fa9b80a8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9bd0a4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9b80c6e30 0x7fa9b814d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9bd0a4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9b814fdc0 0x7fa9b80abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9bd0a4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80be060 con 0x7fa9b8071750 2023-07-21T07:35:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9bd0a4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b81e7d00 con 0x7fa9b814fdc0 2023-07-21T07:35:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9bd0a4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80abb80 con 0x7fa9b80c6e30 2023-07-21T07:35:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9b6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b8071750 0x7fa9b80a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9b6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b8071750 0x7fa9b80a8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34008/0 (socket says 172.21.15.6:34008) 2023-07-21T07:35:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9b6d9d700 1 -- 172.21.15.6:0/2902957964 learned_addr learned my addr 172.21.15.6:0/2902957964 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9b659c700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9b80c6e30 0x7fa9b814d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9b759e700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9b814fdc0 0x7fa9b80abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9b6d9d700 1 -- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9b80c6e30 msgr2=0x7fa9b814d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9b6d9d700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9b80c6e30 0x7fa9b814d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9b6d9d700 1 -- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9b814fdc0 msgr2=0x7fa9b80abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9b6d9d700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9b814fdc0 0x7fa9b80abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9b6d9d700 1 -- 172.21.15.6:0/2902957964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a8009b30 con 0x7fa9b8071750 2023-07-21T07:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9b759e700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9b814fdc0 0x7fa9b80abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.732+0000 7fa9b6d9d700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b8071750 0x7fa9b80a8120 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009fd0 tx=0x7fa9b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.733+0000 7fa9af7fe700 1 -- 172.21.15.6:0/2902957964 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00036a0 con 0x7fa9b8071750 2023-07-21T07:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.733+0000 7fa9af7fe700 1 -- 172.21.15.6:0/2902957964 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b001f070 con 0x7fa9b8071750 2023-07-21T07:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.733+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/2902957964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b00094a0 con 0x7fa9b8071750 2023-07-21T07:35:23.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.733+0000 7fa9af7fe700 1 -- 172.21.15.6:0/2902957964 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0003a60 con 0x7fa9b8071750 2023-07-21T07:35:23.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.733+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/2902957964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b814e080 con 0x7fa9b8071750 2023-07-21T07:35:23.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.734+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/2902957964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b804ecc0 con 0x7fa9b8071750 2023-07-21T07:35:23.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.734+0000 7fa9af7fe700 1 -- 172.21.15.6:0/2902957964 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa9b0003bc0 con 0x7fa9b8071750 2023-07-21T07:35:23.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.735+0000 7fa9af7fe700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa99806ace0 0x7fa99806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:23.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.735+0000 7fa9af7fe700 1 -- 172.21.15.6:0/2902957964 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa9b0021070 con 0x7fa9b8071750 2023-07-21T07:35:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.735+0000 7fa9b659c700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa99806ace0 0x7fa99806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.736+0000 7fa9b659c700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa99806ace0 0x7fa99806d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80ad120 tx=0x7fa9a0007e70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:23.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.739+0000 7fa9af7fe700 1 -- 172.21.15.6:0/2902957964 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa9b0055e50 con 0x7fa9b8071750 2023-07-21T07:35:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:23.956+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/2902957964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa9b8071bc0 con 0x7fa9b8071750 2023-07-21T07:35:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.509+0000 7fa9af7fe700 1 -- 172.21.15.6:0/2902957964 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa9b0059470 con 0x7fa9b8071750 2023-07-21T07:35:24.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.512+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa99806ace0 msgr2=0x7fa99806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:24.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.512+0000 7fa9bd0a4700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa99806ace0 0x7fa99806d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80ad120 tx=0x7fa9a0007e70 comp rx=0 tx=0).stop 2023-07-21T07:35:24.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.512+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/2902957964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b8071750 msgr2=0x7fa9b80a8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:24.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.512+0000 7fa9bd0a4700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b8071750 0x7fa9b80a8120 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009fd0 tx=0x7fa9b0004750 comp rx=0 tx=0).stop 2023-07-21T07:35:24.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.512+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/2902957964 shutdown_connections 2023-07-21T07:35:24.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.512+0000 7fa9bd0a4700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa99806ace0 0x7fa99806d1a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:24.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.512+0000 7fa9bd0a4700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9b814fdc0 0x7fa9b80abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:24.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.512+0000 7fa9bd0a4700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9b8071750 0x7fa9b80a8120 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:24.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.512+0000 7fa9bd0a4700 1 --2- 172.21.15.6:0/2902957964 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9b80c6e30 0x7fa9b814d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:24.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.512+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/2902957964 >> 172.21.15.6:0/2902957964 conn(0x7fa9b80a9670 msgr2=0x7fa9b80c5670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:24.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.512+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/2902957964 shutdown_connections 2023-07-21T07:35:24.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.512+0000 7fa9bd0a4700 1 -- 172.21.15.6:0/2902957964 wait complete. 2023-07-21T07:35:24.569 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-07-21T07:35:24.579 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T07:35:24.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.657+0000 7fb010af5700 1 Processor -- start 2023-07-21T07:35:24.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.657+0000 7fb010af5700 1 -- start start 2023-07-21T07:35:24.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb010af5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb00c06a090 0x7fb00c06a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:24.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb010af5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb00c0c5660 0x7fb00c0c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:24.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb010af5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00c0c4930 con 0x7fb00c151b10 2023-07-21T07:35:24.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb010af5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00c0c51d0 con 0x7fb00c06a090 2023-07-21T07:35:24.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb010af5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00c06da60 con 0x7fb00c0c5660 2023-07-21T07:35:24.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb009d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb00c06a090 0x7fb00c06a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:24.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb009d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb00c06a090 0x7fb00c06a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34020/0 (socket says 172.21.15.6:34020) 2023-07-21T07:35:24.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb00a59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb00c151b10 0x7fb00c154f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42038/0 (socket says 172.21.15.6:42038) 2023-07-21T07:35:24.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb009d9b700 1 -- 172.21.15.6:0/1046421010 learned_addr learned my addr 172.21.15.6:0/1046421010 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:24.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb00ad9d700 1 --2- 172.21.15.6:0/1046421010 >> v2:172.21.15.86:3300/0 conn(0x7fb00c0c5660 0x7fb00c0c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:24.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb009d9b700 1 -- 172.21.15.6:0/1046421010 >> v2:172.21.15.86:3300/0 conn(0x7fb00c0c5660 msgr2=0x7fb00c0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:24.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb009d9b700 1 --2- 172.21.15.6:0/1046421010 >> v2:172.21.15.86:3300/0 conn(0x7fb00c0c5660 0x7fb00c0c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb009d9b700 1 -- 172.21.15.6:0/1046421010 >> v1:172.21.15.6:6789/0 conn(0x7fb00c151b10 legacy=0x7fb00c154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb009d9b700 1 -- 172.21.15.6:0/1046421010 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c0c4b80 con 0x7fb00c06a090 2023-07-21T07:35:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb00959a700 1 -- 172.21.15.6:0/1046421010 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253554361 0 0) 0x7fb00c0c4930 con 0x7fb00c151b10 2023-07-21T07:35:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb009d9b700 1 --2- 172.21.15.6:0/1046421010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00c06a090 0x7fb00c06a510 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb00c06c530 tx=0x7fb000009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0db6fcd49a7f10a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.658+0000 7fb00959a700 1 -- 172.21.15.6:0/1046421010 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000011830 con 0x7fb00c06a090 2023-07-21T07:35:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.659+0000 7fb00959a700 1 -- 172.21.15.6:0/1046421010 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb000011990 con 0x7fb00c06a090 2023-07-21T07:35:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.659+0000 7fb00959a700 1 -- 172.21.15.6:0/1046421010 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000011d20 con 0x7fb00c06a090 2023-07-21T07:35:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.659+0000 7fb010af5700 1 -- 172.21.15.6:0/1046421010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00c06a090 msgr2=0x7fb00c06a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.659+0000 7fb010af5700 1 --2- 172.21.15.6:0/1046421010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00c06a090 0x7fb00c06a510 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb00c06c530 tx=0x7fb000009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.659+0000 7fb010af5700 1 -- 172.21.15.6:0/1046421010 shutdown_connections 2023-07-21T07:35:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.659+0000 7fb010af5700 1 --2- 172.21.15.6:0/1046421010 >> v2:172.21.15.86:3300/0 conn(0x7fb00c0c5660 0x7fb00c0c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.659+0000 7fb010af5700 1 --2- 172.21.15.6:0/1046421010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00c06a090 0x7fb00c06a510 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.659+0000 7fb010af5700 1 -- 172.21.15.6:0/1046421010 >> 172.21.15.6:0/1046421010 conn(0x7fb00c0a8660 msgr2=0x7fb00c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:24.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.659+0000 7fb010af5700 1 -- 172.21.15.6:0/1046421010 shutdown_connections 2023-07-21T07:35:24.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.659+0000 7fb010af5700 1 -- 172.21.15.6:0/1046421010 wait complete. 2023-07-21T07:35:24.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.661+0000 7fb010af5700 1 Processor -- start 2023-07-21T07:35:24.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.661+0000 7fb010af5700 1 -- start start 2023-07-21T07:35:24.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.661+0000 7fb010af5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00c06a090 0x7fb00c1ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:24.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.661+0000 7fb010af5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c0c5660 0x7fb00c0a7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.661+0000 7fb010af5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb00c151b10 0x7fb00c14aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.661+0000 7fb010af5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c1ea7e0 con 0x7fb00c06a090 2023-07-21T07:35:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.661+0000 7fb010af5700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c14bd20 con 0x7fb00c0c5660 2023-07-21T07:35:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.661+0000 7fb010af5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c14c000 con 0x7fb00c151b10 2023-07-21T07:35:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.661+0000 7fb00a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00c06a090 0x7fb00c1ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.661+0000 7fb00a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00c06a090 0x7fb00c1ea2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34024/0 (socket says 172.21.15.6:34024) 2023-07-21T07:35:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.661+0000 7fb00a59c700 1 -- 172.21.15.6:0/3462289508 learned_addr learned my addr 172.21.15.6:0/3462289508 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7fb009d9b700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c0c5660 0x7fb00c0a7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7fb00a59c700 1 -- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb00c151b10 msgr2=0x7fb00c14aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7fb00ad9d700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb00c151b10 0x7fb00c14aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7fb00a59c700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb00c151b10 0x7fb00c14aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7fb00a59c700 1 -- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c0c5660 msgr2=0x7fb00c0a7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7fb00a59c700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c0c5660 0x7fb00c0a7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7fb00a59c700 1 -- 172.21.15.6:0/3462289508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000009550 con 0x7fb00c06a090 2023-07-21T07:35:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7fb009d9b700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c0c5660 0x7fb00c0a7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7fb00a59c700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00c06a090 0x7fb00c1ea2a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faffc00c550 tx=0x7faffc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7faffaffd700 1 -- 172.21.15.6:0/3462289508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc004c80 con 0x7fb00c06a090 2023-07-21T07:35:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7faffaffd700 1 -- 172.21.15.6:0/3462289508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc004e00 con 0x7fb00c06a090 2023-07-21T07:35:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7faffaffd700 1 -- 172.21.15.6:0/3462289508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc007310 con 0x7fb00c06a090 2023-07-21T07:35:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7fb010af5700 1 -- 172.21.15.6:0/3462289508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00c14e040 con 0x7fb00c06a090 2023-07-21T07:35:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.662+0000 7fb010af5700 1 -- 172.21.15.6:0/3462289508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00c14e600 con 0x7fb00c06a090 2023-07-21T07:35:24.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.663+0000 7fb010af5700 1 -- 172.21.15.6:0/3462289508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00c14e7f0 con 0x7fb00c06a090 2023-07-21T07:35:24.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.663+0000 7faffaffd700 1 -- 172.21.15.6:0/3462289508 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faffc007470 con 0x7fb00c06a090 2023-07-21T07:35:24.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.664+0000 7faffaffd700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fafec06ace0 0x7fafec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:24.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.664+0000 7faffaffd700 1 -- 172.21.15.6:0/3462289508 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faffc088ea0 con 0x7fb00c06a090 2023-07-21T07:35:24.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.664+0000 7fb009d9b700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fafec06ace0 0x7fafec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:24.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.665+0000 7fb009d9b700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fafec06ace0 0x7fafec06d1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb00c154570 tx=0x7fb000008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:24.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.668+0000 7faffaffd700 1 -- 172.21.15.6:0/3462289508 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faffc0542a0 con 0x7fb00c06a090 2023-07-21T07:35:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.946+0000 7fb010af5700 1 -- 172.21.15.6:0/3462289508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb00c074500 con 0x7fb00c06a090 2023-07-21T07:35:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.946+0000 7faffaffd700 1 -- 172.21.15.6:0/3462289508 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6065 (secure 0 0 0) 0x7faffc0578c0 con 0x7fb00c06a090 2023-07-21T07:35:24.999 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:24.999 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T07:35:24.999 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-07-21T07:35:25.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.000 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-07-21T07:35:25.000 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpk0z4rHBAAYud3Yf8vYEhpCM6Z6VgXHA==", 2023-07-21T07:35:25.001 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.001 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T07:35:25.001 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T07:35:25.001 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T07:35:25.001 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.002 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.002 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-07-21T07:35:25.002 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpku4+LKBAAxi3bH3yBdtlwmeTikK80bg==", 2023-07-21T07:35:25.003 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.003 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T07:35:25.003 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T07:35:25.004 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T07:35:25.004 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.004 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.005 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-07-21T07:35:25.005 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpkNSGcIxAARuNmmUnW9ym/xs6LvW8IbQ==", 2023-07-21T07:35:25.005 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.005 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T07:35:25.005 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T07:35:25.005 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T07:35:25.005 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.006 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.006 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-07-21T07:35:25.007 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpkU+XALxAAxJNRVW7qFMskSDxzL3C/cA==", 2023-07-21T07:35:25.007 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.007 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T07:35:25.007 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T07:35:25.007 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T07:35:25.007 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.008 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.008 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-07-21T07:35:25.008 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDZNLpk1HKJDRAAA7k2o/9a+6cPD25oW+dzFw==", 2023-07-21T07:35:25.008 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.008 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:35:25.009 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:35:25.009 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.009 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.009 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.009 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-07-21T07:35:25.009 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDcNLpk8USEDRAAyEhBUafsvjZmS1ohCCTVmA==", 2023-07-21T07:35:25.010 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.010 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:35:25.010 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:35:25.010 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.010 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.011 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-07-21T07:35:25.011 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDfNLpkDEVIDRAAGx/lupvJ0CwjQw78KGvrKA==", 2023-07-21T07:35:25.011 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.011 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:35:25.011 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:35:25.012 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.012 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.013 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-07-21T07:35:25.013 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDiNLpkdwQ7DRAAbkOprHrWx2EJ6xPNKv7QDQ==", 2023-07-21T07:35:25.013 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.013 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:35:25.014 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:35:25.014 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.014 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.014 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-07-21T07:35:25.014 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDoNLpkdOldEhAAhUmrtb4x6TODMTc92laajg==", 2023-07-21T07:35:25.015 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.015 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:35:25.015 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:35:25.015 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.015 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.016 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-07-21T07:35:25.016 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDrNLpk/+5CEhAA1WwlM+hQhnRj1Z2e8XC95A==", 2023-07-21T07:35:25.016 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.017 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:35:25.017 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:35:25.017 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.017 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.018 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-07-21T07:35:25.018 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDuNLpkIN+YERAAze6JtDcxO3PCh12/2nVF+g==", 2023-07-21T07:35:25.018 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.018 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:35:25.018 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:35:25.018 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.018 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.019 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-07-21T07:35:25.019 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDxNLpkU2LGEBAAY6RKoHI1Qo2NK7L2/gWtNw==", 2023-07-21T07:35:25.019 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.019 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:35:25.019 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:35:25.020 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.020 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.020 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-07-21T07:35:25.020 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpkoWkHNxAAuz8SyrpFX/iEiqy/znfHAQ==", 2023-07-21T07:35:25.021 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.021 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T07:35:25.021 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T07:35:25.021 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T07:35:25.021 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T07:35:25.021 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.022 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-07-21T07:35:25.022 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpkvOxjOhAA2c1WuwU8rO+o7NzkpQOe0w==", 2023-07-21T07:35:25.022 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.022 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T07:35:25.022 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T07:35:25.022 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T07:35:25.022 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T07:35:25.023 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.023 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.023 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-07-21T07:35:25.023 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDUNLpkkhwvOxAAOO0R75hmjBUOe/whPA2prQ==", 2023-07-21T07:35:25.023 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.024 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T07:35:25.024 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T07:35:25.024 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T07:35:25.024 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.024 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.025 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mds", 2023-07-21T07:35:25.025 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQD3NLpkaZH9AxAAOaB69mfXDxIuUhaycBF8YQ==", 2023-07-21T07:35:25.025 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.025 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mds" 2023-07-21T07:35:25.025 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.025 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mgr", 2023-07-21T07:35:25.026 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQD3NLpkAJz9AxAAdZTqS3XjoPPxiUFbTjxzvA==", 2023-07-21T07:35:25.026 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.026 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-21T07:35:25.026 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.026 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-osd", 2023-07-21T07:35:25.027 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQD3NLpkMqb9AxAA2V31C9HQdIwX6zF6m2cTYg==", 2023-07-21T07:35:25.027 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.027 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-osd" 2023-07-21T07:35:25.027 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.027 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.027 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd", 2023-07-21T07:35:25.027 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQD3NLpkaq/9AxAAtrvY4JoGfkYTEHQWerRvvQ==", 2023-07-21T07:35:25.028 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.028 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-21T07:35:25.028 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.028 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.028 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-21T07:35:25.028 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQD3NLpk6rf9AxAAyVFygZZqiMaslJnTAgZgIA==", 2023-07-21T07:35:25.029 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.029 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-21T07:35:25.029 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.029 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.029 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rgw", 2023-07-21T07:35:25.029 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQD3NLpkRcD9AxAAhH2YG+Av7N+ToCVHO0ooiw==", 2023-07-21T07:35:25.029 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.030 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-21T07:35:25.030 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.030 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-07-21T07:35:25.030 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpkWv2zGBAADpiO2+8RH3B7PbW3GZ5ndw==", 2023-07-21T07:35:25.030 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.031 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T07:35:25.031 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T07:35:25.031 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.031 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:25.031 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:25.031 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-07-21T07:35:25.031 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpkkOYAFRAAxh0V44ESZiIEES+3GWKyAQ==", 2023-07-21T07:35:25.032 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:35:25.032 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T07:35:25.032 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T07:35:25.032 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:35:25.032 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.032 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:25.032 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-07-21T07:35:25.032 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T07:35:25.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.948+0000 7fb010af5700 1 -- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fafec06ace0 msgr2=0x7fafec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.948+0000 7fb010af5700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fafec06ace0 0x7fafec06d1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb00c154570 tx=0x7fb000008030 comp rx=0 tx=0).stop 2023-07-21T07:35:25.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.948+0000 7fb010af5700 1 -- 172.21.15.6:0/3462289508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00c06a090 msgr2=0x7fb00c1ea2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.948+0000 7fb010af5700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00c06a090 0x7fb00c1ea2a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faffc00c550 tx=0x7faffc00c910 comp rx=0 tx=0).stop 2023-07-21T07:35:25.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.948+0000 7fb010af5700 1 -- 172.21.15.6:0/3462289508 shutdown_connections 2023-07-21T07:35:25.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.948+0000 7fb010af5700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fafec06ace0 0x7fafec06d1a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.948+0000 7fb010af5700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb00c151b10 0x7fb00c14aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.948+0000 7fb010af5700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00c06a090 0x7fb00c1ea2a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.948+0000 7fb010af5700 1 --2- 172.21.15.6:0/3462289508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb00c0c5660 0x7fb00c0a7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.948+0000 7fb010af5700 1 -- 172.21.15.6:0/3462289508 >> 172.21.15.6:0/3462289508 conn(0x7fb00c0a8660 msgr2=0x7fb00c0a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:25.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.948+0000 7fb010af5700 1 -- 172.21.15.6:0/3462289508 shutdown_connections 2023-07-21T07:35:25.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:24.948+0000 7fb010af5700 1 -- 172.21.15.6:0/3462289508 wait complete. 2023-07-21T07:35:25.037 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-21T07:35:25.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.110+0000 7f97f466b700 1 Processor -- start 2023-07-21T07:35:25.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.110+0000 7f97f466b700 1 -- start start 2023-07-21T07:35:25.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.111+0000 7f97f466b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97ec0c6c90 0x7f97ec0c5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:25.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.111+0000 7f97f466b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f97ec0c1330 0x7f97ec151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:25.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.111+0000 7f97f466b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec0c5770 con 0x7f97ec155110 2023-07-21T07:35:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.111+0000 7f97f466b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec152160 con 0x7f97ec0c6c90 2023-07-21T07:35:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.111+0000 7f97f466b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec0c4b70 con 0x7f97ec0c1330 2023-07-21T07:35:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.111+0000 7f97f2407700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97ec0c6c90 0x7f97ec0c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.111+0000 7f97f2407700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97ec0c6c90 0x7f97ec0c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34032/0 (socket says 172.21.15.6:34032) 2023-07-21T07:35:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.111+0000 7f97f2407700 1 -- 172.21.15.6:0/2023232877 learned_addr learned my addr 172.21.15.6:0/2023232877 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.112+0000 7f97f1c06700 1 --2- 172.21.15.6:0/2023232877 >> v2:172.21.15.86:3300/0 conn(0x7f97ec0c1330 0x7f97ec151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.112+0000 7f97f2407700 1 -- 172.21.15.6:0/2023232877 >> v2:172.21.15.86:3300/0 conn(0x7f97ec0c1330 msgr2=0x7f97ec151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.112+0000 7f97f2407700 1 --2- 172.21.15.6:0/2023232877 >> v2:172.21.15.86:3300/0 conn(0x7f97ec0c1330 0x7f97ec151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.112+0000 7f97f2407700 1 -- 172.21.15.6:0/2023232877 >> v1:172.21.15.86:6789/0 conn(0x7f97ec155110 legacy=0x7f97ec14e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.112+0000 7f97f2407700 1 -- 172.21.15.6:0/2023232877 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec0c17d0 con 0x7f97ec0c6c90 2023-07-21T07:35:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.112+0000 7f97f2407700 1 --2- 172.21.15.6:0/2023232877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0c6c90 0x7f97ec0c5230 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0c44d0 tx=0x7f97e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3607d10da103a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.112+0000 7f97f1405700 1 -- 172.21.15.6:0/2023232877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e800b870 con 0x7f97ec0c6c90 2023-07-21T07:35:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.112+0000 7f97f1405700 1 -- 172.21.15.6:0/2023232877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e800b9d0 con 0x7f97ec0c6c90 2023-07-21T07:35:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.112+0000 7f97f1405700 1 -- 172.21.15.6:0/2023232877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e800bd60 con 0x7f97ec0c6c90 2023-07-21T07:35:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.113+0000 7f97f466b700 1 -- 172.21.15.6:0/2023232877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0c6c90 msgr2=0x7f97ec0c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.113+0000 7f97f466b700 1 --2- 172.21.15.6:0/2023232877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0c6c90 0x7f97ec0c5230 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0c44d0 tx=0x7f97e8009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.113+0000 7f97f466b700 1 -- 172.21.15.6:0/2023232877 shutdown_connections 2023-07-21T07:35:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.113+0000 7f97f466b700 1 --2- 172.21.15.6:0/2023232877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0c6c90 0x7f97ec0c5230 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.113+0000 7f97f466b700 1 --2- 172.21.15.6:0/2023232877 >> v2:172.21.15.86:3300/0 conn(0x7f97ec0c1330 0x7f97ec151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.113+0000 7f97f466b700 1 -- 172.21.15.6:0/2023232877 >> 172.21.15.6:0/2023232877 conn(0x7f97ec06b1a0 msgr2=0x7f97ec06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.113+0000 7f97f466b700 1 -- 172.21.15.6:0/2023232877 shutdown_connections 2023-07-21T07:35:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.113+0000 7f97f466b700 1 -- 172.21.15.6:0/2023232877 wait complete. 2023-07-21T07:35:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.114+0000 7f97f466b700 1 Processor -- start 2023-07-21T07:35:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.114+0000 7f97f466b700 1 -- start start 2023-07-21T07:35:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f466b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0c1330 0x7f97ec0c0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:25.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f466b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97ec0c6c90 0x7f97ec0abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:25.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f466b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97ec155110 0x7f97ec0ac420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:25.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f466b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0aa170 con 0x7f97ec0c1330 2023-07-21T07:35:25.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f466b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0abac0 con 0x7f97ec155110 2023-07-21T07:35:25.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f466b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0a9880 con 0x7f97ec0c6c90 2023-07-21T07:35:25.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f2407700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0c1330 0x7f97ec0c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:25.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f2407700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0c1330 0x7f97ec0c0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34036/0 (socket says 172.21.15.6:34036) 2023-07-21T07:35:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f2407700 1 -- 172.21.15.6:0/837429274 learned_addr learned my addr 172.21.15.6:0/837429274 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f1c06700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97ec0c6c90 0x7f97ec0abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f2407700 1 -- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97ec0c6c90 msgr2=0x7f97ec0abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f2407700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97ec0c6c90 0x7f97ec0abee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f2407700 1 -- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97ec155110 msgr2=0x7f97ec0ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f2c08700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97ec155110 0x7f97ec0ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f2407700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97ec155110 0x7f97ec0ac420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f2407700 1 -- 172.21.15.6:0/837429274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e8009550 con 0x7f97ec0c1330 2023-07-21T07:35:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f2407700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0c1330 0x7f97ec0c0470 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f97e8000c00 tx=0x7f97e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97deffd700 1 -- 172.21.15.6:0/837429274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8004540 con 0x7f97ec0c1330 2023-07-21T07:35:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97deffd700 1 -- 172.21.15.6:0/837429274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e80036a0 con 0x7f97ec0c1330 2023-07-21T07:35:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97deffd700 1 -- 172.21.15.6:0/837429274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8003a30 con 0x7f97ec0c1330 2023-07-21T07:35:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.115+0000 7f97f466b700 1 -- 172.21.15.6:0/837429274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ec1e6bc0 con 0x7f97ec0c1330 2023-07-21T07:35:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.116+0000 7f97f466b700 1 -- 172.21.15.6:0/837429274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec0a9e00 con 0x7f97ec0c1330 2023-07-21T07:35:25.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.116+0000 7f97f466b700 1 -- 172.21.15.6:0/837429274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec0a9fc0 con 0x7f97ec0c1330 2023-07-21T07:35:25.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.117+0000 7f97deffd700 1 -- 172.21.15.6:0/837429274 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97e8021070 con 0x7f97ec0c1330 2023-07-21T07:35:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.117+0000 7f97deffd700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f97d006ace0 0x7f97d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.117+0000 7f97deffd700 1 -- 172.21.15.6:0/837429274 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f97e808a940 con 0x7f97ec0c1330 2023-07-21T07:35:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.118+0000 7f97f1c06700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f97d006ace0 0x7f97d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.118+0000 7f97f1c06700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f97d006ace0 0x7f97d006d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009770 tx=0x7f97e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.122+0000 7f97deffd700 1 -- 172.21.15.6:0/837429274 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f97e8055d30 con 0x7f97ec0c1330 2023-07-21T07:35:25.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.403+0000 7f97f466b700 1 -- 172.21.15.6:0/837429274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f97ec04ecc0 con 0x7f97ec0c1330 2023-07-21T07:35:25.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.406+0000 7f97deffd700 1 -- 172.21.15.6:0/837429274 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f97e8059350 con 0x7f97ec0c1330 2023-07-21T07:35:25.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.408+0000 7f97f466b700 1 -- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f97d006ace0 msgr2=0x7f97d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.408+0000 7f97f466b700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f97d006ace0 0x7f97d006d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009770 tx=0x7f97e0008040 comp rx=0 tx=0).stop 2023-07-21T07:35:25.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.408+0000 7f97f466b700 1 -- 172.21.15.6:0/837429274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0c1330 msgr2=0x7f97ec0c0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.408+0000 7f97f466b700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0c1330 0x7f97ec0c0470 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f97e8000c00 tx=0x7f97e8004750 comp rx=0 tx=0).stop 2023-07-21T07:35:25.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.408+0000 7f97f466b700 1 -- 172.21.15.6:0/837429274 shutdown_connections 2023-07-21T07:35:25.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.408+0000 7f97f466b700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f97d006ace0 0x7f97d006d1a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.408+0000 7f97f466b700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97ec155110 0x7f97ec0ac420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.408+0000 7f97f466b700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0c1330 0x7f97ec0c0470 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.408+0000 7f97f466b700 1 --2- 172.21.15.6:0/837429274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97ec0c6c90 0x7f97ec0abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.408+0000 7f97f466b700 1 -- 172.21.15.6:0/837429274 >> 172.21.15.6:0/837429274 conn(0x7f97ec06b1a0 msgr2=0x7f97ec14f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:25.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.408+0000 7f97f466b700 1 -- 172.21.15.6:0/837429274 shutdown_connections 2023-07-21T07:35:25.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.408+0000 7f97f466b700 1 -- 172.21.15.6:0/837429274 wait complete. 2023-07-21T07:35:25.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-21T07:35:25.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.548+0000 7fbcf5c4b700 1 Processor -- start 2023-07-21T07:35:25.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.548+0000 7fbcf5c4b700 1 -- start start 2023-07-21T07:35:25.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.549+0000 7fbcf5c4b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbcf006e6f0 0x7fbcf00c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:25.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.549+0000 7fbcf5c4b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf006ec00 con 0x7fbcf00a9c10 2023-07-21T07:35:25.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.549+0000 7fbcf5c4b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf0152480 con 0x7fbcf0152960 2023-07-21T07:35:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.549+0000 7fbcf5c4b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf0152270 con 0x7fbcf006e6f0 2023-07-21T07:35:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.549+0000 7fbceeffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbcf006e6f0 0x7fbcf00c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.549+0000 7fbcef7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbcf00a9c10 0x7fbcf014f4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42066/0 (socket says 172.21.15.6:42066) 2023-07-21T07:35:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.550+0000 7fbcef7fe700 1 -- 172.21.15.6:0/2439325865 learned_addr learned my addr 172.21.15.6:0/2439325865 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.550+0000 7fbceeffd700 1 -- 172.21.15.6:0/2439325865 >> v1:172.21.15.86:6789/0 conn(0x7fbcf0152960 legacy=0x7fbcf00c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.550+0000 7fbceeffd700 1 -- 172.21.15.6:0/2439325865 >> v1:172.21.15.6:6789/0 conn(0x7fbcf00a9c10 legacy=0x7fbcf014f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.550+0000 7fbcee7fc700 1 -- 172.21.15.6:0/2439325865 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836687864 0 0) 0x7fbcf006ec00 con 0x7fbcf00a9c10 2023-07-21T07:35:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.550+0000 7fbceeffd700 1 -- 172.21.15.6:0/2439325865 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf006ee50 con 0x7fbcf006e6f0 2023-07-21T07:35:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.550+0000 7fbceeffd700 1 --2- 172.21.15.6:0/2439325865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf006e6f0 0x7fbcf00c3d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009840 tx=0x7fbce0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88918e57f616d51 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.550+0000 7fbcee7fc700 1 -- 172.21.15.6:0/2439325865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0011830 con 0x7fbcf006e6f0 2023-07-21T07:35:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.550+0000 7fbcee7fc700 1 -- 172.21.15.6:0/2439325865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce0011990 con 0x7fbcf006e6f0 2023-07-21T07:35:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.550+0000 7fbcee7fc700 1 -- 172.21.15.6:0/2439325865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0011d20 con 0x7fbcf006e6f0 2023-07-21T07:35:25.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.551+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/2439325865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf006e6f0 msgr2=0x7fbcf00c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.551+0000 7fbcf5c4b700 1 --2- 172.21.15.6:0/2439325865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf006e6f0 0x7fbcf00c3d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009840 tx=0x7fbce0009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.551+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/2439325865 shutdown_connections 2023-07-21T07:35:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.551+0000 7fbcf5c4b700 1 --2- 172.21.15.6:0/2439325865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf006e6f0 0x7fbcf00c3d80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.551+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/2439325865 >> 172.21.15.6:0/2439325865 conn(0x7fbcf006a270 msgr2=0x7fbcf006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.551+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/2439325865 shutdown_connections 2023-07-21T07:35:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.551+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/2439325865 wait complete. 2023-07-21T07:35:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.552+0000 7fbcf5c4b700 1 Processor -- start 2023-07-21T07:35:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.552+0000 7fbcf5c4b700 1 -- start start 2023-07-21T07:35:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbcf5c4b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcf006e6f0 0x7fbcf00bbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbcf5c4b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcf00a9c10 0x7fbcf0150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbcf5c4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf0152960 0x7fbcf01ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbcf5c4b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00bc430 con 0x7fbcf0152960 2023-07-21T07:35:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbcf5c4b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00bba60 con 0x7fbcf006e6f0 2023-07-21T07:35:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbcf5c4b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00a67f0 con 0x7fbcf00a9c10 2023-07-21T07:35:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbceffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf0152960 0x7fbcf01ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:25.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbceffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf0152960 0x7fbcf01ed0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34056/0 (socket says 172.21.15.6:34056) 2023-07-21T07:35:25.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbceffff700 1 -- 172.21.15.6:0/1874250436 learned_addr learned my addr 172.21.15.6:0/1874250436 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:25.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbcef7fe700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcf006e6f0 0x7fbcf00bbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:25.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbceeffd700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcf00a9c10 0x7fbcf0150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:25.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbceffff700 1 -- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcf00a9c10 msgr2=0x7fbcf0150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbceffff700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcf00a9c10 0x7fbcf0150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbceffff700 1 -- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcf006e6f0 msgr2=0x7fbcf00bbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbceffff700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcf006e6f0 0x7fbcf00bbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.553+0000 7fbceffff700 1 -- 172.21.15.6:0/1874250436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce00094a0 con 0x7fbcf0152960 2023-07-21T07:35:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.554+0000 7fbceffff700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf0152960 0x7fbcf01ed0d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbce800cba0 tx=0x7fbce800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:25.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.554+0000 7fbce7fff700 1 -- 172.21.15.6:0/1874250436 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8003c00 con 0x7fbcf0152960 2023-07-21T07:35:25.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.554+0000 7fbce7fff700 1 -- 172.21.15.6:0/1874250436 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce8003d60 con 0x7fbcf0152960 2023-07-21T07:35:25.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.554+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/1874250436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf00bd490 con 0x7fbcf0152960 2023-07-21T07:35:25.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.554+0000 7fbce7fff700 1 -- 172.21.15.6:0/1874250436 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce800aac0 con 0x7fbcf0152960 2023-07-21T07:35:25.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.554+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/1874250436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf006d130 con 0x7fbcf0152960 2023-07-21T07:35:25.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.555+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/1874250436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf00bbbd0 con 0x7fbcf0152960 2023-07-21T07:35:25.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.555+0000 7fbce7fff700 1 -- 172.21.15.6:0/1874250436 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbce800ac20 con 0x7fbcf0152960 2023-07-21T07:35:25.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.556+0000 7fbce7fff700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbcd006ace0 0x7fbcd006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:25.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.556+0000 7fbce7fff700 1 -- 172.21.15.6:0/1874250436 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbce8089060 con 0x7fbcf0152960 2023-07-21T07:35:25.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.556+0000 7fbcef7fe700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbcd006ace0 0x7fbcd006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:25.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.556+0000 7fbcef7fe700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbcd006ace0 0x7fbcd006d1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8007b10 tx=0x7fbcd8007a60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:25.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.560+0000 7fbce7fff700 1 -- 172.21.15.6:0/1874250436 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbce80544f0 con 0x7fbcf0152960 2023-07-21T07:35:25.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.841+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/1874250436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fbcf004ecc0 con 0x7fbcf0152960 2023-07-21T07:35:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.845+0000 7fbce7fff700 1 -- 172.21.15.6:0/1874250436 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbce8057b10 con 0x7fbcf0152960 2023-07-21T07:35:25.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.847+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbcd006ace0 msgr2=0x7fbcd006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.847+0000 7fbcf5c4b700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbcd006ace0 0x7fbcd006d1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8007b10 tx=0x7fbcd8007a60 comp rx=0 tx=0).stop 2023-07-21T07:35:25.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.847+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/1874250436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf0152960 msgr2=0x7fbcf01ed0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:25.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.847+0000 7fbcf5c4b700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf0152960 0x7fbcf01ed0d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbce800cba0 tx=0x7fbce800ceb0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.847+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/1874250436 shutdown_connections 2023-07-21T07:35:25.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.847+0000 7fbcf5c4b700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbcd006ace0 0x7fbcd006d1a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.847+0000 7fbcf5c4b700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf0152960 0x7fbcf01ed0d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.847+0000 7fbcf5c4b700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcf006e6f0 0x7fbcf00bbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.847+0000 7fbcf5c4b700 1 --2- 172.21.15.6:0/1874250436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcf00a9c10 0x7fbcf0150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:25.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.847+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/1874250436 >> 172.21.15.6:0/1874250436 conn(0x7fbcf006a270 msgr2=0x7fbcf014fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:25.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.847+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/1874250436 shutdown_connections 2023-07-21T07:35:25.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.847+0000 7fbcf5c4b700 1 -- 172.21.15.6:0/1874250436 wait complete. 2023-07-21T07:35:25.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-21T07:35:26.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.985+0000 7f71e39e9700 1 Processor -- start 2023-07-21T07:35:26.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.985+0000 7f71e39e9700 1 -- start start 2023-07-21T07:35:26.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e39e9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71dc155370 0x7f71dc0c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e39e9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f71dc0c48b0 0x7f71dc06a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e39e9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f71dc06a640 0x7f71dc158020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e39e9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc0c54e0 con 0x7f71dc06a640 2023-07-21T07:35:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e39e9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc154710 con 0x7f71dc0c48b0 2023-07-21T07:35:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e39e9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0c5730 con 0x7f71dc155370 2023-07-21T07:35:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e1f86700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f71dc06a640 0x7f71dc158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e1f86700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f71dc06a640 0x7f71dc158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34064/0 (socket says 172.21.15.6:34064) 2023-07-21T07:35:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e1f86700 1 -- 172.21.15.6:0/481103519 learned_addr learned my addr 172.21.15.6:0/481103519 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e1785700 1 --2- 172.21.15.6:0/481103519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71dc155370 0x7f71dc0c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e0f84700 1 --2- 172.21.15.6:0/481103519 >> v2:172.21.15.86:3300/0 conn(0x7f71dc0c48b0 0x7f71dc06a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e1f86700 1 -- 172.21.15.6:0/481103519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71dc155370 msgr2=0x7f71dc0c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e1f86700 1 --2- 172.21.15.6:0/481103519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71dc155370 0x7f71dc0c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e1f86700 1 -- 172.21.15.6:0/481103519 >> v2:172.21.15.86:3300/0 conn(0x7f71dc0c48b0 msgr2=0x7f71dc06a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e1f86700 1 --2- 172.21.15.6:0/481103519 >> v2:172.21.15.86:3300/0 conn(0x7f71dc0c48b0 0x7f71dc06a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e1f86700 1 -- 172.21.15.6:0/481103519 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0c5a10 con 0x7f71dc06a640 2023-07-21T07:35:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e0f84700 1 --2- 172.21.15.6:0/481103519 >> v2:172.21.15.86:3300/0 conn(0x7f71dc0c48b0 0x7f71dc06a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71e1f86700 1 --2- 172.21.15.6:0/481103519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71dc06a640 0x7f71dc158020 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f71dc06acf0 tx=0x7f71d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb22f182d9eabea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.986+0000 7f71d3fff700 1 -- 172.21.15.6:0/481103519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400e070 con 0x7f71dc06a640 2023-07-21T07:35:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.987+0000 7f71d3fff700 1 -- 172.21.15.6:0/481103519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d400b9c0 con 0x7f71dc06a640 2023-07-21T07:35:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.987+0000 7f71d3fff700 1 -- 172.21.15.6:0/481103519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400bd70 con 0x7f71dc06a640 2023-07-21T07:35:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.987+0000 7f71e39e9700 1 -- 172.21.15.6:0/481103519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71dc06a640 msgr2=0x7f71dc158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.987+0000 7f71e39e9700 1 --2- 172.21.15.6:0/481103519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71dc06a640 0x7f71dc158020 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f71dc06acf0 tx=0x7f71d400b330 comp rx=0 tx=0).stop 2023-07-21T07:35:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.987+0000 7f71e39e9700 1 -- 172.21.15.6:0/481103519 shutdown_connections 2023-07-21T07:35:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.987+0000 7f71e39e9700 1 --2- 172.21.15.6:0/481103519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71dc06a640 0x7f71dc158020 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.987+0000 7f71e39e9700 1 --2- 172.21.15.6:0/481103519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71dc155370 0x7f71dc0c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.987+0000 7f71e39e9700 1 --2- 172.21.15.6:0/481103519 >> v2:172.21.15.86:3300/0 conn(0x7f71dc0c48b0 0x7f71dc06a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.987+0000 7f71e39e9700 1 -- 172.21.15.6:0/481103519 >> 172.21.15.6:0/481103519 conn(0x7f71dc06b1a0 msgr2=0x7f71dc06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.987+0000 7f71e39e9700 1 -- 172.21.15.6:0/481103519 shutdown_connections 2023-07-21T07:35:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.987+0000 7f71e39e9700 1 -- 172.21.15.6:0/481103519 wait complete. 2023-07-21T07:35:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.988+0000 7f71e39e9700 1 Processor -- start 2023-07-21T07:35:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.988+0000 7f71e39e9700 1 -- start start 2023-07-21T07:35:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e39e9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71dc06a640 0x7f71dc0a7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e39e9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71dc0c48b0 0x7f71dc14e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e39e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71dc155370 0x7f71dc0a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e39e9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0a88c0 con 0x7f71dc155370 2023-07-21T07:35:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e39e9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc1ea7a0 con 0x7f71dc0c48b0 2023-07-21T07:35:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e39e9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0bfda0 con 0x7f71dc06a640 2023-07-21T07:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e1f86700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71dc155370 0x7f71dc0a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e1f86700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71dc155370 0x7f71dc0a6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34070/0 (socket says 172.21.15.6:34070) 2023-07-21T07:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e1f86700 1 -- 172.21.15.6:0/4234727485 learned_addr learned my addr 172.21.15.6:0/4234727485 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e0f84700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71dc0c48b0 0x7f71dc14e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e1785700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71dc06a640 0x7f71dc0a7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e1f86700 1 -- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71dc06a640 msgr2=0x7f71dc0a7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e1f86700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71dc06a640 0x7f71dc0a7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e1f86700 1 -- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71dc0c48b0 msgr2=0x7f71dc14e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e1f86700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71dc0c48b0 0x7f71dc14e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.989+0000 7f71e1f86700 1 -- 172.21.15.6:0/4234727485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d4009b30 con 0x7f71dc155370 2023-07-21T07:35:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.990+0000 7f71e1f86700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71dc155370 0x7f71dc0a6960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f71dc06af50 tx=0x7f71d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.990+0000 7f71d1ffb700 1 -- 172.21.15.6:0/4234727485 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4004250 con 0x7f71dc155370 2023-07-21T07:35:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.990+0000 7f71d1ffb700 1 -- 172.21.15.6:0/4234727485 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d40043d0 con 0x7f71dc155370 2023-07-21T07:35:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.990+0000 7f71e39e9700 1 -- 172.21.15.6:0/4234727485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc0c0080 con 0x7f71dc155370 2023-07-21T07:35:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.990+0000 7f71d1ffb700 1 -- 172.21.15.6:0/4234727485 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4004780 con 0x7f71dc155370 2023-07-21T07:35:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.990+0000 7f71e39e9700 1 -- 172.21.15.6:0/4234727485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc1eaa80 con 0x7f71dc155370 2023-07-21T07:35:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.991+0000 7f71e39e9700 1 -- 172.21.15.6:0/4234727485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc0a6760 con 0x7f71dc155370 2023-07-21T07:35:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.992+0000 7f71d1ffb700 1 -- 172.21.15.6:0/4234727485 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71d401c440 con 0x7f71dc155370 2023-07-21T07:35:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.992+0000 7f71d1ffb700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f71c006ace0 0x7f71c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.992+0000 7f71d1ffb700 1 -- 172.21.15.6:0/4234727485 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f71d408a970 con 0x7f71dc155370 2023-07-21T07:35:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.992+0000 7f71e1785700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f71c006ace0 0x7f71c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.993+0000 7f71e1785700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f71c006ace0 0x7f71c006d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f71d800b9b0 tx=0x7f71d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:25.996+0000 7f71d1ffb700 1 -- 172.21.15.6:0/4234727485 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f71d4055e00 con 0x7f71dc155370 2023-07-21T07:35:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.274+0000 7f71e39e9700 1 -- 172.21.15.6:0/4234727485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f71dc04ecc0 con 0x7f71dc155370 2023-07-21T07:35:26.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.278+0000 7f71d1ffb700 1 -- 172.21.15.6:0/4234727485 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f71d40200a0 con 0x7f71dc155370 2023-07-21T07:35:26.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.280+0000 7f71e39e9700 1 -- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f71c006ace0 msgr2=0x7f71c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.280+0000 7f71e39e9700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f71c006ace0 0x7f71c006d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f71d800b9b0 tx=0x7f71d8008040 comp rx=0 tx=0).stop 2023-07-21T07:35:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.280+0000 7f71e39e9700 1 -- 172.21.15.6:0/4234727485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71dc155370 msgr2=0x7f71dc0a6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.280+0000 7f71e39e9700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71dc155370 0x7f71dc0a6960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f71dc06af50 tx=0x7f71d4004ad0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.280+0000 7f71e39e9700 1 -- 172.21.15.6:0/4234727485 shutdown_connections 2023-07-21T07:35:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.280+0000 7f71e39e9700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f71c006ace0 0x7f71c006d1a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.280+0000 7f71e39e9700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71dc155370 0x7f71dc0a6960 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.280+0000 7f71e39e9700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71dc06a640 0x7f71dc0a7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.280+0000 7f71e39e9700 1 --2- 172.21.15.6:0/4234727485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71dc0c48b0 0x7f71dc14e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.280+0000 7f71e39e9700 1 -- 172.21.15.6:0/4234727485 >> 172.21.15.6:0/4234727485 conn(0x7f71dc06b1a0 msgr2=0x7f71dc153b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.280+0000 7f71e39e9700 1 -- 172.21.15.6:0/4234727485 shutdown_connections 2023-07-21T07:35:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.280+0000 7f71e39e9700 1 -- 172.21.15.6:0/4234727485 wait complete. 2023-07-21T07:35:26.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-21T07:35:26.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.418+0000 7f8958cc6700 1 Processor -- start 2023-07-21T07:35:26.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.418+0000 7f8958cc6700 1 -- start start 2023-07-21T07:35:26.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.419+0000 7f8958cc6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8954155370 0x7f89540c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.419+0000 7f8958cc6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89540c48b0 0x7f895406a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.419+0000 7f8958cc6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89540c54e0 con 0x7f895406a640 2023-07-21T07:35:26.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.419+0000 7f8958cc6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8954154710 con 0x7f89540c48b0 2023-07-21T07:35:26.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.419+0000 7f8958cc6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89540c5730 con 0x7f8954155370 2023-07-21T07:35:26.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.419+0000 7f8951d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89540c48b0 0x7f895406a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.419+0000 7f8952d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f895406a640 0x7f8954158020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42096/0 (socket says 172.21.15.6:42096) 2023-07-21T07:35:26.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.419+0000 7f8952d9d700 1 -- 172.21.15.6:0/1308356004 learned_addr learned my addr 172.21.15.6:0/1308356004 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:26.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.420+0000 7f895259c700 1 --2- 172.21.15.6:0/1308356004 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8954155370 0x7f89540c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.420+0000 7f8951d9b700 1 -- 172.21.15.6:0/1308356004 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8954155370 msgr2=0x7f89540c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:26.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.420+0000 7f8951d9b700 1 --2- 172.21.15.6:0/1308356004 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8954155370 0x7f89540c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.420+0000 7f8951d9b700 1 -- 172.21.15.6:0/1308356004 >> v1:172.21.15.6:6789/0 conn(0x7f895406a640 legacy=0x7f8954158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.420+0000 7f8951d9b700 1 -- 172.21.15.6:0/1308356004 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89540c5a10 con 0x7f89540c48b0 2023-07-21T07:35:26.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.420+0000 7f895159a700 1 -- 172.21.15.6:0/1308356004 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951111869 0 0) 0x7f89540c54e0 con 0x7f895406a640 2023-07-21T07:35:26.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.420+0000 7f895259c700 1 --2- 172.21.15.6:0/1308356004 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8954155370 0x7f89540c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:26.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.420+0000 7f8951d9b700 1 --2- 172.21.15.6:0/1308356004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89540c48b0 0x7f895406a100 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8944009840 tx=0x7f8944009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2481cfb6fad158a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:26.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.420+0000 7f895159a700 1 -- 172.21.15.6:0/1308356004 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944011830 con 0x7f89540c48b0 2023-07-21T07:35:26.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.420+0000 7f895159a700 1 -- 172.21.15.6:0/1308356004 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8944011990 con 0x7f89540c48b0 2023-07-21T07:35:26.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.420+0000 7f895159a700 1 -- 172.21.15.6:0/1308356004 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944011d20 con 0x7f89540c48b0 2023-07-21T07:35:26.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.420+0000 7f8958cc6700 1 -- 172.21.15.6:0/1308356004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89540c48b0 msgr2=0x7f895406a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.420+0000 7f8958cc6700 1 --2- 172.21.15.6:0/1308356004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89540c48b0 0x7f895406a100 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8944009840 tx=0x7f8944009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:26.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.421+0000 7f8958cc6700 1 -- 172.21.15.6:0/1308356004 shutdown_connections 2023-07-21T07:35:26.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.421+0000 7f8958cc6700 1 --2- 172.21.15.6:0/1308356004 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8954155370 0x7f89540c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.421+0000 7f8958cc6700 1 --2- 172.21.15.6:0/1308356004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89540c48b0 0x7f895406a100 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.421+0000 7f8958cc6700 1 -- 172.21.15.6:0/1308356004 >> 172.21.15.6:0/1308356004 conn(0x7f895406b1a0 msgr2=0x7f895406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:26.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.421+0000 7f8958cc6700 1 -- 172.21.15.6:0/1308356004 shutdown_connections 2023-07-21T07:35:26.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.421+0000 7f8958cc6700 1 -- 172.21.15.6:0/1308356004 wait complete. 2023-07-21T07:35:26.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.422+0000 7f8958cc6700 1 Processor -- start 2023-07-21T07:35:26.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.422+0000 7f8958cc6700 1 -- start start 2023-07-21T07:35:26.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f8958cc6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895406a640 0x7f89540be5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f8958cc6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89540c48b0 0x7f89540beb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f8958cc6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8954155370 0x7f89541e0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f8958cc6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89541df000 con 0x7f895406a640 2023-07-21T07:35:26.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f8958cc6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89540bf040 con 0x7f89540c48b0 2023-07-21T07:35:26.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f8958cc6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89541ee340 con 0x7f8954155370 2023-07-21T07:35:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f895259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895406a640 0x7f89540be5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f895259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895406a640 0x7f89540be5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34080/0 (socket says 172.21.15.6:34080) 2023-07-21T07:35:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f895259c700 1 -- 172.21.15.6:0/2512984445 learned_addr learned my addr 172.21.15.6:0/2512984445 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f8952d9d700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8954155370 0x7f89541e0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f8951d9b700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89540c48b0 0x7f89540beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f895259c700 1 -- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8954155370 msgr2=0x7f89541e0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f895259c700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8954155370 0x7f89541e0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f895259c700 1 -- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89540c48b0 msgr2=0x7f89540beb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f895259c700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89540c48b0 0x7f89540beb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f895259c700 1 -- 172.21.15.6:0/2512984445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89440094a0 con 0x7f895406a640 2023-07-21T07:35:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f895259c700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895406a640 0x7f89540be5c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f894800c7f0 tx=0x7f894800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f8942ffd700 1 -- 172.21.15.6:0/2512984445 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948011800 con 0x7f895406a640 2023-07-21T07:35:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f8942ffd700 1 -- 172.21.15.6:0/2512984445 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8948011960 con 0x7f895406a640 2023-07-21T07:35:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f8942ffd700 1 -- 172.21.15.6:0/2512984445 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948011d10 con 0x7f895406a640 2023-07-21T07:35:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f8958cc6700 1 -- 172.21.15.6:0/2512984445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89541ee870 con 0x7f895406a640 2023-07-21T07:35:26.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.423+0000 7f8958cc6700 1 -- 172.21.15.6:0/2512984445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89541ee590 con 0x7f895406a640 2023-07-21T07:35:26.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.424+0000 7f8958cc6700 1 -- 172.21.15.6:0/2512984445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8954154d40 con 0x7f895406a640 2023-07-21T07:35:26.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.425+0000 7f8942ffd700 1 -- 172.21.15.6:0/2512984445 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8948018360 con 0x7f895406a640 2023-07-21T07:35:26.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.425+0000 7f8942ffd700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f893406ace0 0x7f893406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.425+0000 7f8942ffd700 1 -- 172.21.15.6:0/2512984445 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8948089080 con 0x7f895406a640 2023-07-21T07:35:26.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.425+0000 7f8951d9b700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f893406ace0 0x7f893406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.426+0000 7f8951d9b700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f893406ace0 0x7f893406d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f89440090b0 tx=0x7f8944008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:26.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.429+0000 7f8942ffd700 1 -- 172.21.15.6:0/2512984445 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8948057fa0 con 0x7f895406a640 2023-07-21T07:35:26.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.711+0000 7f8958cc6700 1 -- 172.21.15.6:0/2512984445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f895404ecc0 con 0x7f895406a640 2023-07-21T07:35:26.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.716+0000 7f8942ffd700 1 -- 172.21.15.6:0/2512984445 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8948057b30 con 0x7f895406a640 2023-07-21T07:35:26.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.718+0000 7f8958cc6700 1 -- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f893406ace0 msgr2=0x7f893406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.718+0000 7f8958cc6700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f893406ace0 0x7f893406d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f89440090b0 tx=0x7f8944008030 comp rx=0 tx=0).stop 2023-07-21T07:35:26.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.718+0000 7f8958cc6700 1 -- 172.21.15.6:0/2512984445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895406a640 msgr2=0x7f89540be5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.718+0000 7f8958cc6700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895406a640 0x7f89540be5c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f894800c7f0 tx=0x7f894800cbb0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.718+0000 7f8958cc6700 1 -- 172.21.15.6:0/2512984445 shutdown_connections 2023-07-21T07:35:26.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.718+0000 7f8958cc6700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f893406ace0 0x7f893406d1a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.718+0000 7f8958cc6700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8954155370 0x7f89541e0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.718+0000 7f8958cc6700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895406a640 0x7f89540be5c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.718+0000 7f8958cc6700 1 --2- 172.21.15.6:0/2512984445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89540c48b0 0x7f89540beb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.718+0000 7f8958cc6700 1 -- 172.21.15.6:0/2512984445 >> 172.21.15.6:0/2512984445 conn(0x7f895406b1a0 msgr2=0x7f89540c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:26.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.718+0000 7f8958cc6700 1 -- 172.21.15.6:0/2512984445 shutdown_connections 2023-07-21T07:35:26.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.718+0000 7f8958cc6700 1 -- 172.21.15.6:0/2512984445 wait complete. 2023-07-21T07:35:26.782 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-21T07:35:26.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.855+0000 7fc527576700 1 Processor -- start 2023-07-21T07:35:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.855+0000 7fc527576700 1 -- start start 2023-07-21T07:35:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.856+0000 7fc527576700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc520155370 0x7fc5200c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.856+0000 7fc527576700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5200c48b0 0x7fc52006a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.856+0000 7fc527576700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc52006a640 0x7fc520158020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.856+0000 7fc527576700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5200c54e0 con 0x7fc52006a640 2023-07-21T07:35:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.856+0000 7fc527576700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc520154710 con 0x7fc5200c48b0 2023-07-21T07:35:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.856+0000 7fc527576700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200c5730 con 0x7fc520155370 2023-07-21T07:35:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.856+0000 7fc525b13700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc52006a640 0x7fc520158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.856+0000 7fc525b13700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc52006a640 0x7fc520158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34092/0 (socket says 172.21.15.6:34092) 2023-07-21T07:35:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.856+0000 7fc525b13700 1 -- 172.21.15.6:0/3993497871 learned_addr learned my addr 172.21.15.6:0/3993497871 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.856+0000 7fc525312700 1 --2- 172.21.15.6:0/3993497871 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc520155370 0x7fc5200c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.856+0000 7fc524b11700 1 --2- 172.21.15.6:0/3993497871 >> v2:172.21.15.86:3300/0 conn(0x7fc5200c48b0 0x7fc52006a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.857+0000 7fc525b13700 1 -- 172.21.15.6:0/3993497871 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc520155370 msgr2=0x7fc5200c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.857+0000 7fc525b13700 1 --2- 172.21.15.6:0/3993497871 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc520155370 0x7fc5200c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.857+0000 7fc525b13700 1 -- 172.21.15.6:0/3993497871 >> v2:172.21.15.86:3300/0 conn(0x7fc5200c48b0 msgr2=0x7fc52006a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.857+0000 7fc525b13700 1 --2- 172.21.15.6:0/3993497871 >> v2:172.21.15.86:3300/0 conn(0x7fc5200c48b0 0x7fc52006a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.857+0000 7fc525b13700 1 -- 172.21.15.6:0/3993497871 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200c5a10 con 0x7fc52006a640 2023-07-21T07:35:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.857+0000 7fc525b13700 1 --2- 172.21.15.6:0/3993497871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc52006a640 0x7fc520158020 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc52006acf0 tx=0x7fc51800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d955d3c6be317bf2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.857+0000 7fc517fff700 1 -- 172.21.15.6:0/3993497871 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800e070 con 0x7fc52006a640 2023-07-21T07:35:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.857+0000 7fc517fff700 1 -- 172.21.15.6:0/3993497871 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51800b910 con 0x7fc52006a640 2023-07-21T07:35:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.857+0000 7fc517fff700 1 -- 172.21.15.6:0/3993497871 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800bcc0 con 0x7fc52006a640 2023-07-21T07:35:26.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.858+0000 7fc527576700 1 -- 172.21.15.6:0/3993497871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc52006a640 msgr2=0x7fc520158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.858+0000 7fc527576700 1 --2- 172.21.15.6:0/3993497871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc52006a640 0x7fc520158020 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc52006acf0 tx=0x7fc51800b330 comp rx=0 tx=0).stop 2023-07-21T07:35:26.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.858+0000 7fc527576700 1 -- 172.21.15.6:0/3993497871 shutdown_connections 2023-07-21T07:35:26.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.858+0000 7fc527576700 1 --2- 172.21.15.6:0/3993497871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc52006a640 0x7fc520158020 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.858+0000 7fc527576700 1 --2- 172.21.15.6:0/3993497871 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc520155370 0x7fc5200c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.858+0000 7fc527576700 1 --2- 172.21.15.6:0/3993497871 >> v2:172.21.15.86:3300/0 conn(0x7fc5200c48b0 0x7fc52006a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.858+0000 7fc527576700 1 -- 172.21.15.6:0/3993497871 >> 172.21.15.6:0/3993497871 conn(0x7fc52006b1a0 msgr2=0x7fc52006b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.858+0000 7fc527576700 1 -- 172.21.15.6:0/3993497871 shutdown_connections 2023-07-21T07:35:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.858+0000 7fc527576700 1 -- 172.21.15.6:0/3993497871 wait complete. 2023-07-21T07:35:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.859+0000 7fc527576700 1 Processor -- start 2023-07-21T07:35:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.859+0000 7fc527576700 1 -- start start 2023-07-21T07:35:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc527576700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc52006a640 0x7fc5201e16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc527576700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5200c48b0 0x7fc5201de150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc527576700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc520155370 0x7fc5201ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc527576700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200bfd30 con 0x7fc520155370 2023-07-21T07:35:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc527576700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5201edba0 con 0x7fc5200c48b0 2023-07-21T07:35:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc527576700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200bfff0 con 0x7fc52006a640 2023-07-21T07:35:26.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc525b13700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc520155370 0x7fc5201ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc525b13700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc520155370 0x7fc5201ed1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34098/0 (socket says 172.21.15.6:34098) 2023-07-21T07:35:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc525b13700 1 -- 172.21.15.6:0/3177659367 learned_addr learned my addr 172.21.15.6:0/3177659367 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc524b11700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5200c48b0 0x7fc5201de150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc525312700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc52006a640 0x7fc5201e16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc525b13700 1 -- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc52006a640 msgr2=0x7fc5201e16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc525b13700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc52006a640 0x7fc5201e16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc525b13700 1 -- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5200c48b0 msgr2=0x7fc5201de150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:26.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc525b13700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5200c48b0 0x7fc5201de150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:26.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc525b13700 1 -- 172.21.15.6:0/3177659367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc518009b30 con 0x7fc520155370 2023-07-21T07:35:26.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc524b11700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5200c48b0 0x7fc5201de150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:26.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc525b13700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc520155370 0x7fc5201ed1a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc52006af50 tx=0x7fc518004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:26.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc515ffb700 1 -- 172.21.15.6:0/3177659367 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800ce80 con 0x7fc520155370 2023-07-21T07:35:26.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc515ffb700 1 -- 172.21.15.6:0/3177659367 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc518004250 con 0x7fc520155370 2023-07-21T07:35:26.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc527576700 1 -- 172.21.15.6:0/3177659367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5200c02d0 con 0x7fc520155370 2023-07-21T07:35:26.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.860+0000 7fc515ffb700 1 -- 172.21.15.6:0/3177659367 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518004600 con 0x7fc520155370 2023-07-21T07:35:26.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.861+0000 7fc527576700 1 -- 172.21.15.6:0/3177659367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5200bce80 con 0x7fc520155370 2023-07-21T07:35:26.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.861+0000 7fc527576700 1 -- 172.21.15.6:0/3177659367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5200c0460 con 0x7fc520155370 2023-07-21T07:35:26.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.862+0000 7fc515ffb700 1 -- 172.21.15.6:0/3177659367 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc518004760 con 0x7fc520155370 2023-07-21T07:35:26.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.862+0000 7fc515ffb700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc50406ace0 0x7fc50406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:26.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.862+0000 7fc515ffb700 1 -- 172.21.15.6:0/3177659367 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc51808a890 con 0x7fc520155370 2023-07-21T07:35:26.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.863+0000 7fc525312700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc50406ace0 0x7fc50406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:26.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.863+0000 7fc525312700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc50406ace0 0x7fc50406d1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc510009a10 tx=0x7fc510008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:26.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:26.867+0000 7fc515ffb700 1 -- 172.21.15.6:0/3177659367 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc518055c80 con 0x7fc520155370 2023-07-21T07:35:27.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.147+0000 7fc527576700 1 -- 172.21.15.6:0/3177659367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc52004ecc0 con 0x7fc520155370 2023-07-21T07:35:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.153+0000 7fc515ffb700 1 -- 172.21.15.6:0/3177659367 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc5180200a0 con 0x7fc520155370 2023-07-21T07:35:27.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.155+0000 7fc527576700 1 -- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc50406ace0 msgr2=0x7fc50406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:27.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.155+0000 7fc527576700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc50406ace0 0x7fc50406d1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc510009a10 tx=0x7fc510008040 comp rx=0 tx=0).stop 2023-07-21T07:35:27.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.155+0000 7fc527576700 1 -- 172.21.15.6:0/3177659367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc520155370 msgr2=0x7fc5201ed1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:27.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.155+0000 7fc527576700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc520155370 0x7fc5201ed1a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc52006af50 tx=0x7fc518004ad0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.155+0000 7fc527576700 1 -- 172.21.15.6:0/3177659367 shutdown_connections 2023-07-21T07:35:27.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.155+0000 7fc527576700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc50406ace0 0x7fc50406d1a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.155+0000 7fc527576700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc520155370 0x7fc5201ed1a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.155+0000 7fc527576700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc52006a640 0x7fc5201e16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.155+0000 7fc527576700 1 --2- 172.21.15.6:0/3177659367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5200c48b0 0x7fc5201de150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.155+0000 7fc527576700 1 -- 172.21.15.6:0/3177659367 >> 172.21.15.6:0/3177659367 conn(0x7fc52006b1a0 msgr2=0x7fc52006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:27.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.155+0000 7fc527576700 1 -- 172.21.15.6:0/3177659367 shutdown_connections 2023-07-21T07:35:27.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.155+0000 7fc527576700 1 -- 172.21.15.6:0/3177659367 wait complete. 2023-07-21T07:35:27.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-21T07:35:27.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.293+0000 7fde89f88700 1 Processor -- start 2023-07-21T07:35:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.293+0000 7fde89f88700 1 -- start start 2023-07-21T07:35:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.294+0000 7fde89f88700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde84155370 0x7fde840c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.294+0000 7fde89f88700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde840c48b0 0x7fde8406a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.294+0000 7fde89f88700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde840c54e0 con 0x7fde8406a640 2023-07-21T07:35:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.294+0000 7fde89f88700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde84154710 con 0x7fde840c48b0 2023-07-21T07:35:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.294+0000 7fde89f88700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde840c5730 con 0x7fde84155370 2023-07-21T07:35:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.294+0000 7fde82ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde840c48b0 0x7fde8406a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:27.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.294+0000 7fde82ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde840c48b0 0x7fde8406a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34104/0 (socket says 172.21.15.6:34104) 2023-07-21T07:35:27.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.294+0000 7fde82ffd700 1 -- 172.21.15.6:0/1086373163 learned_addr learned my addr 172.21.15.6:0/1086373163 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:27.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.295+0000 7fde837fe700 1 --2- 172.21.15.6:0/1086373163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde84155370 0x7fde840c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:27.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.295+0000 7fde82ffd700 1 -- 172.21.15.6:0/1086373163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde84155370 msgr2=0x7fde840c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:27.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.295+0000 7fde82ffd700 1 --2- 172.21.15.6:0/1086373163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde84155370 0x7fde840c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.295+0000 7fde82ffd700 1 -- 172.21.15.6:0/1086373163 >> v1:172.21.15.86:6789/0 conn(0x7fde8406a640 legacy=0x7fde84158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:27.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.295+0000 7fde82ffd700 1 -- 172.21.15.6:0/1086373163 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde840c5a10 con 0x7fde840c48b0 2023-07-21T07:35:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.295+0000 7fde82ffd700 1 --2- 172.21.15.6:0/1086373163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde840c48b0 0x7fde8406a100 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fde780098f0 tx=0x7fde78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2b0bf1179071fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.295+0000 7fde827fc700 1 -- 172.21.15.6:0/1086373163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7800b8a0 con 0x7fde840c48b0 2023-07-21T07:35:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.295+0000 7fde827fc700 1 -- 172.21.15.6:0/1086373163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7800ba00 con 0x7fde840c48b0 2023-07-21T07:35:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.295+0000 7fde827fc700 1 -- 172.21.15.6:0/1086373163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7800bd90 con 0x7fde840c48b0 2023-07-21T07:35:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.296+0000 7fde89f88700 1 -- 172.21.15.6:0/1086373163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde840c48b0 msgr2=0x7fde8406a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.296+0000 7fde89f88700 1 --2- 172.21.15.6:0/1086373163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde840c48b0 0x7fde8406a100 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fde780098f0 tx=0x7fde78009c00 comp rx=0 tx=0).stop 2023-07-21T07:35:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.296+0000 7fde89f88700 1 -- 172.21.15.6:0/1086373163 shutdown_connections 2023-07-21T07:35:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.296+0000 7fde89f88700 1 --2- 172.21.15.6:0/1086373163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde84155370 0x7fde840c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.296+0000 7fde89f88700 1 --2- 172.21.15.6:0/1086373163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde840c48b0 0x7fde8406a100 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.296+0000 7fde89f88700 1 -- 172.21.15.6:0/1086373163 >> 172.21.15.6:0/1086373163 conn(0x7fde8406b1a0 msgr2=0x7fde8406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.296+0000 7fde89f88700 1 -- 172.21.15.6:0/1086373163 shutdown_connections 2023-07-21T07:35:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.296+0000 7fde89f88700 1 -- 172.21.15.6:0/1086373163 wait complete. 2023-07-21T07:35:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.297+0000 7fde89f88700 1 Processor -- start 2023-07-21T07:35:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.297+0000 7fde89f88700 1 -- start start 2023-07-21T07:35:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde89f88700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde8406a640 0x7fde8414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde89f88700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde840c48b0 0x7fde841e12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde89f88700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84155370 0x7fde840bed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde89f88700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8414f000 con 0x7fde84155370 2023-07-21T07:35:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde89f88700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde840bfef0 con 0x7fde840c48b0 2023-07-21T07:35:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde89f88700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde840c01d0 con 0x7fde8406a640 2023-07-21T07:35:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84155370 0x7fde840bed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84155370 0x7fde840bed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34112/0 (socket says 172.21.15.6:34112) 2023-07-21T07:35:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde83fff700 1 -- 172.21.15.6:0/2829230206 learned_addr learned my addr 172.21.15.6:0/2829230206 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde837fe700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde8406a640 0x7fde8414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde82ffd700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde840c48b0 0x7fde841e12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde83fff700 1 -- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde8406a640 msgr2=0x7fde8414eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde83fff700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde8406a640 0x7fde8414eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde83fff700 1 -- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde840c48b0 msgr2=0x7fde841e12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde83fff700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde840c48b0 0x7fde841e12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde83fff700 1 -- 172.21.15.6:0/2829230206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde78009550 con 0x7fde84155370 2023-07-21T07:35:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde83fff700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84155370 0x7fde840bed30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00cc50 tx=0x7fde7c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.298+0000 7fde6bfff700 1 -- 172.21.15.6:0/2829230206 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c00ad80 con 0x7fde84155370 2023-07-21T07:35:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.299+0000 7fde6bfff700 1 -- 172.21.15.6:0/2829230206 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c00ce50 con 0x7fde84155370 2023-07-21T07:35:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.299+0000 7fde89f88700 1 -- 172.21.15.6:0/2829230206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde840c04b0 con 0x7fde84155370 2023-07-21T07:35:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.299+0000 7fde6bfff700 1 -- 172.21.15.6:0/2829230206 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c003c40 con 0x7fde84155370 2023-07-21T07:35:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.299+0000 7fde89f88700 1 -- 172.21.15.6:0/2829230206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde840be810 con 0x7fde84155370 2023-07-21T07:35:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.300+0000 7fde89f88700 1 -- 172.21.15.6:0/2829230206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde840bea30 con 0x7fde84155370 2023-07-21T07:35:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.300+0000 7fde6bfff700 1 -- 172.21.15.6:0/2829230206 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde7c0050d0 con 0x7fde84155370 2023-07-21T07:35:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.301+0000 7fde6bfff700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fde7006ace0 0x7fde7006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.301+0000 7fde6bfff700 1 -- 172.21.15.6:0/2829230206 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fde7c0891b0 con 0x7fde84155370 2023-07-21T07:35:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.301+0000 7fde837fe700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fde7006ace0 0x7fde7006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.301+0000 7fde837fe700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fde7006ace0 0x7fde7006d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fde7400b9b0 tx=0x7fde74008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.305+0000 7fde6bfff700 1 -- 172.21.15.6:0/2829230206 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fde7c054640 con 0x7fde84155370 2023-07-21T07:35:27.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.587+0000 7fde89f88700 1 -- 172.21.15.6:0/2829230206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fde8404ecc0 con 0x7fde84155370 2023-07-21T07:35:27.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.592+0000 7fde6bfff700 1 -- 172.21.15.6:0/2829230206 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fde7c057c60 con 0x7fde84155370 2023-07-21T07:35:27.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.594+0000 7fde89f88700 1 -- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fde7006ace0 msgr2=0x7fde7006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:27.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.594+0000 7fde89f88700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fde7006ace0 0x7fde7006d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fde7400b9b0 tx=0x7fde74008040 comp rx=0 tx=0).stop 2023-07-21T07:35:27.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.594+0000 7fde89f88700 1 -- 172.21.15.6:0/2829230206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84155370 msgr2=0x7fde840bed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:27.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.594+0000 7fde89f88700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84155370 0x7fde840bed30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00cc50 tx=0x7fde7c00a340 comp rx=0 tx=0).stop 2023-07-21T07:35:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.594+0000 7fde89f88700 1 -- 172.21.15.6:0/2829230206 shutdown_connections 2023-07-21T07:35:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.594+0000 7fde89f88700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fde7006ace0 0x7fde7006d1a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.594+0000 7fde89f88700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84155370 0x7fde840bed30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.594+0000 7fde89f88700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde8406a640 0x7fde8414eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.594+0000 7fde89f88700 1 --2- 172.21.15.6:0/2829230206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde840c48b0 0x7fde841e12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.594+0000 7fde89f88700 1 -- 172.21.15.6:0/2829230206 >> 172.21.15.6:0/2829230206 conn(0x7fde8406b1a0 msgr2=0x7fde840c2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.594+0000 7fde89f88700 1 -- 172.21.15.6:0/2829230206 shutdown_connections 2023-07-21T07:35:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.595+0000 7fde89f88700 1 -- 172.21.15.6:0/2829230206 wait complete. 2023-07-21T07:35:27.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:27.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.733+0000 7f0da85e8700 1 Processor -- start 2023-07-21T07:35:27.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.733+0000 7f0da85e8700 1 -- start start 2023-07-21T07:35:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.734+0000 7f0da85e8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da006a090 0x7f0da006a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.734+0000 7f0da85e8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0da00c5660 0x7f0da00c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.734+0000 7f0da85e8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da00c4930 con 0x7f0da0151b10 2023-07-21T07:35:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.734+0000 7f0da85e8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da00c51d0 con 0x7f0da00c5660 2023-07-21T07:35:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.734+0000 7f0da85e8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da006da60 con 0x7f0da006a090 2023-07-21T07:35:27.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.734+0000 7f0da5b83700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da006a090 0x7f0da006a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:27.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.734+0000 7f0da6b85700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0da00c5660 0x7f0da00c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:27.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.734+0000 7f0da5b83700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da006a090 0x7f0da006a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:59744/0 (socket says 172.21.15.6:59744) 2023-07-21T07:35:27.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.734+0000 7f0da6b85700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0da00c5660 0x7f0da00c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:55924/0 (socket says 172.21.15.6:55924) 2023-07-21T07:35:27.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.734+0000 7f0da5b83700 1 -- 172.21.15.6:0/3940883333 learned_addr learned my addr 172.21.15.6:0/3940883333 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:27.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.734+0000 7f0da6b85700 1 -- 172.21.15.6:0/3940883333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da006a090 msgr2=0x7f0da006a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:27.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.734+0000 7f0da6b85700 1 --2- 172.21.15.6:0/3940883333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da006a090 0x7f0da006a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.735+0000 7f0da6b85700 1 -- 172.21.15.6:0/3940883333 >> v1:172.21.15.86:6789/0 conn(0x7f0da0151b10 legacy=0x7f0da0154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:27.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.735+0000 7f0da5382700 1 -- 172.21.15.6:0/3940883333 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490151171 0 0) 0x7f0da00c4930 con 0x7f0da0151b10 2023-07-21T07:35:27.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.735+0000 7f0da6b85700 1 -- 172.21.15.6:0/3940883333 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00c4b80 con 0x7f0da00c5660 2023-07-21T07:35:27.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.735+0000 7f0da5b83700 1 --2- 172.21.15.6:0/3940883333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da006a090 0x7f0da006a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:27.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.735+0000 7f0da6b85700 1 --2- 172.21.15.6:0/3940883333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da00c5660 0x7f0da00c5af0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009d90 tx=0x7f0d9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c00cd5761517cf2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:27.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.735+0000 7f0da5382700 1 -- 172.21.15.6:0/3940883333 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800e070 con 0x7f0da00c5660 2023-07-21T07:35:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.735+0000 7f0da5382700 1 -- 172.21.15.6:0/3940883333 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9800bb20 con 0x7f0da00c5660 2023-07-21T07:35:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.735+0000 7f0da5382700 1 -- 172.21.15.6:0/3940883333 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98012430 con 0x7f0da00c5660 2023-07-21T07:35:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.735+0000 7f0da85e8700 1 -- 172.21.15.6:0/3940883333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da00c5660 msgr2=0x7f0da00c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.735+0000 7f0da85e8700 1 --2- 172.21.15.6:0/3940883333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da00c5660 0x7f0da00c5af0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009d90 tx=0x7f0d9800b330 comp rx=0 tx=0).stop 2023-07-21T07:35:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.736+0000 7f0da85e8700 1 -- 172.21.15.6:0/3940883333 shutdown_connections 2023-07-21T07:35:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.736+0000 7f0da85e8700 1 --2- 172.21.15.6:0/3940883333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da00c5660 0x7f0da00c5af0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.736+0000 7f0da85e8700 1 --2- 172.21.15.6:0/3940883333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da006a090 0x7f0da006a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.736+0000 7f0da85e8700 1 -- 172.21.15.6:0/3940883333 >> 172.21.15.6:0/3940883333 conn(0x7f0da00a8660 msgr2=0x7f0da00a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.736+0000 7f0da85e8700 1 -- 172.21.15.6:0/3940883333 shutdown_connections 2023-07-21T07:35:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.736+0000 7f0da85e8700 1 -- 172.21.15.6:0/3940883333 wait complete. 2023-07-21T07:35:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.737+0000 7f0da85e8700 1 Processor -- start 2023-07-21T07:35:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.737+0000 7f0da85e8700 1 -- start start 2023-07-21T07:35:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.737+0000 7f0da85e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da006a090 0x7f0da0154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.737+0000 7f0da85e8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da00c5660 0x7f0da014ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.737+0000 7f0da85e8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da0151b10 0x7f0da014e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.737+0000 7f0da85e8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da01edc00 con 0x7f0da006a090 2023-07-21T07:35:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.737+0000 7f0da85e8700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00bf5a0 con 0x7f0da00c5660 2023-07-21T07:35:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.737+0000 7f0da85e8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da014e830 con 0x7f0da0151b10 2023-07-21T07:35:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0da6384700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da006a090 0x7f0da0154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0da6384700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da006a090 0x7f0da0154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34122/0 (socket says 172.21.15.6:34122) 2023-07-21T07:35:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0da6384700 1 -- 172.21.15.6:0/2198881173 learned_addr learned my addr 172.21.15.6:0/2198881173 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0da5b83700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da00c5660 0x7f0da014ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0da6b85700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da0151b10 0x7f0da014e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0da6384700 1 -- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da0151b10 msgr2=0x7f0da014e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0da6384700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da0151b10 0x7f0da014e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0da6384700 1 -- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da00c5660 msgr2=0x7f0da014ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0da6384700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da00c5660 0x7f0da014ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0da6384700 1 -- 172.21.15.6:0/2198881173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d90009550 con 0x7f0da006a090 2023-07-21T07:35:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0da6384700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da006a090 0x7f0da0154b80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00c480 tx=0x7f0d9c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0d96ffd700 1 -- 172.21.15.6:0/2198881173 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0054e0 con 0x7f0da006a090 2023-07-21T07:35:27.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0d96ffd700 1 -- 172.21.15.6:0/2198881173 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c00ce50 con 0x7f0da006a090 2023-07-21T07:35:27.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0d96ffd700 1 -- 172.21.15.6:0/2198881173 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0038c0 con 0x7f0da006a090 2023-07-21T07:35:27.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0da85e8700 1 -- 172.21.15.6:0/2198881173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d98009a70 con 0x7f0da006a090 2023-07-21T07:35:27.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.738+0000 7f0da85e8700 1 -- 172.21.15.6:0/2198881173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da00beee0 con 0x7f0da006a090 2023-07-21T07:35:27.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.739+0000 7f0da85e8700 1 -- 172.21.15.6:0/2198881173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da0074500 con 0x7f0da006a090 2023-07-21T07:35:27.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.740+0000 7f0d96ffd700 1 -- 172.21.15.6:0/2198881173 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d9c003a20 con 0x7f0da006a090 2023-07-21T07:35:27.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.740+0000 7f0d96ffd700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d8406ace0 0x7f0d8406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:27.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.740+0000 7f0d96ffd700 1 -- 172.21.15.6:0/2198881173 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0d9c088410 con 0x7f0da006a090 2023-07-21T07:35:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.740+0000 7f0da5b83700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d8406ace0 0x7f0d8406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.741+0000 7f0da5b83700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d8406ace0 0x7f0d8406d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0da01554a0 tx=0x7f0d900092c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.744+0000 7f0d96ffd700 1 -- 172.21.15.6:0/2198881173 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0d9c0538a0 con 0x7f0da006a090 2023-07-21T07:35:27.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.947+0000 7f0da85e8700 1 -- 172.21.15.6:0/2198881173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0da006af60 con 0x7f0da006a090 2023-07-21T07:35:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.948+0000 7f0d96ffd700 1 -- 172.21.15.6:0/2198881173 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+14531 (secure 0 0 0) 0x7f0d9c056ec0 con 0x7f0da006a090 2023-07-21T07:35:28.001 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:28.001 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":32,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:24.515517+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.950+0000 7f0da85e8700 1 -- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d8406ace0 msgr2=0x7f0d8406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.950+0000 7f0da85e8700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d8406ace0 0x7f0d8406d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0da01554a0 tx=0x7f0d900092c0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.950+0000 7f0da85e8700 1 -- 172.21.15.6:0/2198881173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da006a090 msgr2=0x7f0da0154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.950+0000 7f0da85e8700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da006a090 0x7f0da0154b80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00c480 tx=0x7f0d9c00c790 comp rx=0 tx=0).stop 2023-07-21T07:35:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.950+0000 7f0da85e8700 1 -- 172.21.15.6:0/2198881173 shutdown_connections 2023-07-21T07:35:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.950+0000 7f0da85e8700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0d8406ace0 0x7f0d8406d1a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.950+0000 7f0da85e8700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0da0151b10 0x7f0da014e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.950+0000 7f0da85e8700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0da006a090 0x7f0da0154b80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.950+0000 7f0da85e8700 1 --2- 172.21.15.6:0/2198881173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0da00c5660 0x7f0da014ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.950+0000 7f0da85e8700 1 -- 172.21.15.6:0/2198881173 >> 172.21.15.6:0/2198881173 conn(0x7f0da00a8660 msgr2=0x7f0da00c2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:28.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.950+0000 7f0da85e8700 1 -- 172.21.15.6:0/2198881173 shutdown_connections 2023-07-21T07:35:28.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:27.950+0000 7f0da85e8700 1 -- 172.21.15.6:0/2198881173 wait complete. 2023-07-21T07:35:28.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:35:28.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:35:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.091+0000 7f4f95c66700 1 Processor -- start 2023-07-21T07:35:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.091+0000 7f4f95c66700 1 -- start start 2023-07-21T07:35:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.092+0000 7f4f95c66700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4f900abee0 0x7f4f9006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.092+0000 7f4f95c66700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f90152da0 0x7f4f901561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.092+0000 7f4f95c66700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f90155d20 con 0x7f4f9014f4b0 2023-07-21T07:35:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.092+0000 7f4f95c66700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f900c5de0 con 0x7f4f90152da0 2023-07-21T07:35:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.092+0000 7f4f95c66700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f900c4ce0 con 0x7f4f900abee0 2023-07-21T07:35:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.092+0000 7f4f8effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f90152da0 0x7f4f901561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.092+0000 7f4f8effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f90152da0 0x7f4f901561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34130/0 (socket says 172.21.15.6:34130) 2023-07-21T07:35:28.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.092+0000 7f4f8effd700 1 -- 172.21.15.6:0/3170418667 learned_addr learned my addr 172.21.15.6:0/3170418667 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:28.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.093+0000 7f4f8effd700 1 -- 172.21.15.6:0/3170418667 >> v2:172.21.15.86:3300/0 conn(0x7f4f900abee0 msgr2=0x7f4f9006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:28.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.093+0000 7f4f8f7fe700 1 --2- 172.21.15.6:0/3170418667 >> v2:172.21.15.86:3300/0 conn(0x7f4f900abee0 0x7f4f9006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.093+0000 7f4f8effd700 1 --2- 172.21.15.6:0/3170418667 >> v2:172.21.15.86:3300/0 conn(0x7f4f900abee0 0x7f4f9006d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.093+0000 7f4f8effd700 1 -- 172.21.15.6:0/3170418667 >> v1:172.21.15.86:6789/0 conn(0x7f4f9014f4b0 legacy=0x7f4f9006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:28.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.093+0000 7f4f8effd700 1 -- 172.21.15.6:0/3170418667 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f900c4fc0 con 0x7f4f90152da0 2023-07-21T07:35:28.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.093+0000 7f4f8effd700 1 --2- 172.21.15.6:0/3170418667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f90152da0 0x7f4f901561b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4f90074090 tx=0x7f4f78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c325ddc949734fc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:28.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.093+0000 7f4f8e7fc700 1 -- 172.21.15.6:0/3170418667 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78004230 con 0x7f4f90152da0 2023-07-21T07:35:28.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.093+0000 7f4f8e7fc700 1 -- 172.21.15.6:0/3170418667 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f78004390 con 0x7f4f90152da0 2023-07-21T07:35:28.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.093+0000 7f4f8e7fc700 1 -- 172.21.15.6:0/3170418667 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f780036a0 con 0x7f4f90152da0 2023-07-21T07:35:28.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.093+0000 7f4f95c66700 1 -- 172.21.15.6:0/3170418667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f90152da0 msgr2=0x7f4f901561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.093+0000 7f4f95c66700 1 --2- 172.21.15.6:0/3170418667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f90152da0 0x7f4f901561b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4f90074090 tx=0x7f4f78009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.094+0000 7f4f95c66700 1 -- 172.21.15.6:0/3170418667 shutdown_connections 2023-07-21T07:35:28.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.094+0000 7f4f95c66700 1 --2- 172.21.15.6:0/3170418667 >> v2:172.21.15.86:3300/0 conn(0x7f4f900abee0 0x7f4f9006d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.094+0000 7f4f95c66700 1 --2- 172.21.15.6:0/3170418667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f90152da0 0x7f4f901561b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.094+0000 7f4f95c66700 1 -- 172.21.15.6:0/3170418667 >> 172.21.15.6:0/3170418667 conn(0x7f4f900a8660 msgr2=0x7f4f900a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.094+0000 7f4f95c66700 1 -- 172.21.15.6:0/3170418667 shutdown_connections 2023-07-21T07:35:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.094+0000 7f4f95c66700 1 -- 172.21.15.6:0/3170418667 wait complete. 2023-07-21T07:35:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.095+0000 7f4f95c66700 1 Processor -- start 2023-07-21T07:35:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.095+0000 7f4f95c66700 1 -- start start 2023-07-21T07:35:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f95c66700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f900abee0 0x7f4f900bc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f95c66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f9014f4b0 0x7f4f900c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f95c66700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f90152da0 0x7f4f9014cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f95c66700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f901e75a0 con 0x7f4f9014f4b0 2023-07-21T07:35:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f95c66700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900c13d0 con 0x7f4f90152da0 2023-07-21T07:35:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f95c66700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900c16b0 con 0x7f4f900abee0 2023-07-21T07:35:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f9014f4b0 0x7f4f900c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f9014f4b0 0x7f4f900c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34138/0 (socket says 172.21.15.6:34138) 2023-07-21T07:35:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f8effd700 1 -- 172.21.15.6:0/2849367597 learned_addr learned my addr 172.21.15.6:0/2849367597 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f8f7fe700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f900abee0 0x7f4f900bc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f8ffff700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f90152da0 0x7f4f9014cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f8effd700 1 -- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f900abee0 msgr2=0x7f4f900bc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f8effd700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f900abee0 0x7f4f900bc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f8effd700 1 -- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f90152da0 msgr2=0x7f4f9014cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f8effd700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f90152da0 0x7f4f9014cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f8effd700 1 -- 172.21.15.6:0/2849367597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78009550 con 0x7f4f9014f4b0 2023-07-21T07:35:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f8ffff700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f90152da0 0x7f4f9014cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f8effd700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f9014f4b0 0x7f4f900c4320 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4f9006c140 tx=0x7f4f78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f87fff700 1 -- 172.21.15.6:0/2849367597 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78003e70 con 0x7f4f9014f4b0 2023-07-21T07:35:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f87fff700 1 -- 172.21.15.6:0/2849367597 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7801f070 con 0x7f4f9014f4b0 2023-07-21T07:35:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f95c66700 1 -- 172.21.15.6:0/2849367597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f900c1f70 con 0x7f4f9014f4b0 2023-07-21T07:35:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f87fff700 1 -- 172.21.15.6:0/2849367597 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78011890 con 0x7f4f9014f4b0 2023-07-21T07:35:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.096+0000 7f4f95c66700 1 -- 172.21.15.6:0/2849367597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f900c1c80 con 0x7f4f9014f4b0 2023-07-21T07:35:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.097+0000 7f4f95c66700 1 -- 172.21.15.6:0/2849367597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f901eab10 con 0x7f4f9014f4b0 2023-07-21T07:35:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.098+0000 7f4f87fff700 1 -- 172.21.15.6:0/2849367597 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f78021030 con 0x7f4f9014f4b0 2023-07-21T07:35:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.098+0000 7f4f87fff700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4f7006ace0 0x7f4f7006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.098+0000 7f4f87fff700 1 -- 172.21.15.6:0/2849367597 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4f7808a760 con 0x7f4f9014f4b0 2023-07-21T07:35:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.099+0000 7f4f8f7fe700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4f7006ace0 0x7f4f7006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.099+0000 7f4f8f7fe700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4f7006ace0 0x7f4f7006d1a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f900c0750 tx=0x7f4f80008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.103+0000 7f4f87fff700 1 -- 172.21.15.6:0/2849367597 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f901eab10 con 0x7f4f9014f4b0 2023-07-21T07:35:28.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.297+0000 7f4f95c66700 1 -- 172.21.15.6:0/2849367597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f901eab10 con 0x7f4f9014f4b0 2023-07-21T07:35:28.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.297+0000 7f4f87fff700 1 -- 172.21.15.6:0/2849367597 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f901eab10 con 0x7f4f9014f4b0 2023-07-21T07:35:28.350 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:35:28.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.300+0000 7f4f95c66700 1 -- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4f7006ace0 msgr2=0x7f4f7006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.300+0000 7f4f95c66700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4f7006ace0 0x7f4f7006d1a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f900c0750 tx=0x7f4f80008040 comp rx=0 tx=0).stop 2023-07-21T07:35:28.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.300+0000 7f4f95c66700 1 -- 172.21.15.6:0/2849367597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f9014f4b0 msgr2=0x7f4f900c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.300+0000 7f4f95c66700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f9014f4b0 0x7f4f900c4320 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4f9006c140 tx=0x7f4f78004750 comp rx=0 tx=0).stop 2023-07-21T07:35:28.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.300+0000 7f4f95c66700 1 -- 172.21.15.6:0/2849367597 shutdown_connections 2023-07-21T07:35:28.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.300+0000 7f4f95c66700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4f7006ace0 0x7f4f7006d1a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.300+0000 7f4f95c66700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f90152da0 0x7f4f9014cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.300+0000 7f4f95c66700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f900abee0 0x7f4f900bc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.300+0000 7f4f95c66700 1 --2- 172.21.15.6:0/2849367597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f9014f4b0 0x7f4f900c4320 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.300+0000 7f4f95c66700 1 -- 172.21.15.6:0/2849367597 >> 172.21.15.6:0/2849367597 conn(0x7f4f900a8660 msgr2=0x7f4f90070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:28.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.300+0000 7f4f95c66700 1 -- 172.21.15.6:0/2849367597 shutdown_connections 2023-07-21T07:35:28.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.300+0000 7f4f95c66700 1 -- 172.21.15.6:0/2849367597 wait complete. 2023-07-21T07:35:28.364 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:35:28.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.439+0000 7f12ffb62700 1 Processor -- start 2023-07-21T07:35:28.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.439+0000 7f12ffb62700 1 -- start start 2023-07-21T07:35:28.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.440+0000 7f12ffb62700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12f80ba140 0x7f12f80c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.440+0000 7f12ffb62700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f12f806d8a0 0x7f12f80c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.440+0000 7f12ffb62700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f8155530 con 0x7f12f806a300 2023-07-21T07:35:28.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.440+0000 7f12ffb62700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f80c1a30 con 0x7f12f806d8a0 2023-07-21T07:35:28.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.440+0000 7f12ffb62700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f8154920 con 0x7f12f80ba140 2023-07-21T07:35:28.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.440+0000 7f12fd0fd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12f80ba140 0x7f12f80c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.440+0000 7f12fe0ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f12f806d8a0 0x7f12f80c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.440+0000 7f12fd0fd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12f80ba140 0x7f12f80c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:59772/0 (socket says 172.21.15.6:59772) 2023-07-21T07:35:28.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.440+0000 7f12fd8fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f12f806a300 0x7f12f81519b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:45406/0 (socket says 172.21.15.6:45406) 2023-07-21T07:35:28.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.440+0000 7f12fe0ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f12f806d8a0 0x7f12f80c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:55952/0 (socket says 172.21.15.6:55952) 2023-07-21T07:35:28.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.440+0000 7f12fd8fe700 1 -- 172.21.15.6:0/1841663957 learned_addr learned my addr 172.21.15.6:0/1841663957 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:28.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.441+0000 7f12fe0ff700 1 -- 172.21.15.6:0/1841663957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12f80ba140 msgr2=0x7f12f80c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:28.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.441+0000 7f12fe0ff700 1 --2- 172.21.15.6:0/1841663957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12f80ba140 0x7f12f80c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.441+0000 7f12fe0ff700 1 -- 172.21.15.6:0/1841663957 >> v1:172.21.15.86:6789/0 conn(0x7f12f806a300 legacy=0x7f12f81519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.441+0000 7f12fe0ff700 1 -- 172.21.15.6:0/1841663957 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8154c00 con 0x7f12f806d8a0 2023-07-21T07:35:28.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.441+0000 7f12fc8fc700 1 -- 172.21.15.6:0/1841663957 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632531095 0 0) 0x7f12f8155530 con 0x7f12f806a300 2023-07-21T07:35:28.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.441+0000 7f12fe0ff700 1 --2- 172.21.15.6:0/1841663957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12f806d8a0 0x7f12f80c4f80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009d90 tx=0x7f12f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62b5313cc093de7b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:28.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.441+0000 7f12fc8fc700 1 -- 172.21.15.6:0/1841663957 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f000e070 con 0x7f12f806d8a0 2023-07-21T07:35:28.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.441+0000 7f12fc8fc700 1 -- 172.21.15.6:0/1841663957 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f000bb20 con 0x7f12f806d8a0 2023-07-21T07:35:28.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.441+0000 7f12fc8fc700 1 -- 172.21.15.6:0/1841663957 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0012430 con 0x7f12f806d8a0 2023-07-21T07:35:28.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.442+0000 7f12ffb62700 1 -- 172.21.15.6:0/1841663957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12f806d8a0 msgr2=0x7f12f80c4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.442+0000 7f12ffb62700 1 --2- 172.21.15.6:0/1841663957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12f806d8a0 0x7f12f80c4f80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009d90 tx=0x7f12f000b330 comp rx=0 tx=0).stop 2023-07-21T07:35:28.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.442+0000 7f12ffb62700 1 -- 172.21.15.6:0/1841663957 shutdown_connections 2023-07-21T07:35:28.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.442+0000 7f12ffb62700 1 --2- 172.21.15.6:0/1841663957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12f806d8a0 0x7f12f80c4f80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.442+0000 7f12ffb62700 1 --2- 172.21.15.6:0/1841663957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12f80ba140 0x7f12f80c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.442+0000 7f12ffb62700 1 -- 172.21.15.6:0/1841663957 >> 172.21.15.6:0/1841663957 conn(0x7f12f80a8660 msgr2=0x7f12f80a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:28.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.442+0000 7f12ffb62700 1 -- 172.21.15.6:0/1841663957 shutdown_connections 2023-07-21T07:35:28.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.442+0000 7f12ffb62700 1 -- 172.21.15.6:0/1841663957 wait complete. 2023-07-21T07:35:28.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.443+0000 7f12ffb62700 1 Processor -- start 2023-07-21T07:35:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.443+0000 7f12ffb62700 1 -- start start 2023-07-21T07:35:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12ffb62700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12f806a300 0x7f12f814c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12ffb62700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12f806d8a0 0x7f12f8071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12ffb62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f80ba140 0x7f12f81df480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12ffb62700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f80bff00 con 0x7f12f80ba140 2023-07-21T07:35:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12ffb62700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f8070f10 con 0x7f12f806d8a0 2023-07-21T07:35:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12ffb62700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f81de9c0 con 0x7f12f806a300 2023-07-21T07:35:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12fe0ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f80ba140 0x7f12f81df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12fe0ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f80ba140 0x7f12f81df480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34154/0 (socket says 172.21.15.6:34154) 2023-07-21T07:35:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12fe0ff700 1 -- 172.21.15.6:0/2775206607 learned_addr learned my addr 172.21.15.6:0/2775206607 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12fd8fe700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12f806a300 0x7f12f814c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12fd0fd700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12f806d8a0 0x7f12f8071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12fe0ff700 1 -- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12f806a300 msgr2=0x7f12f814c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12fe0ff700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12f806a300 0x7f12f814c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12fe0ff700 1 -- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12f806d8a0 msgr2=0x7f12f8071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12fe0ff700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12f806d8a0 0x7f12f8071c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12fe0ff700 1 -- 172.21.15.6:0/2775206607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f0009a70 con 0x7f12f80ba140 2023-07-21T07:35:28.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12fe0ff700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f80ba140 0x7f12f81df480 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f12f806d570 tx=0x7f12f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:28.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.444+0000 7f12ee7fc700 1 -- 172.21.15.6:0/2775206607 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0012430 con 0x7f12f80ba140 2023-07-21T07:35:28.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.445+0000 7f12ee7fc700 1 -- 172.21.15.6:0/2775206607 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f0020070 con 0x7f12f80ba140 2023-07-21T07:35:28.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.445+0000 7f12ffb62700 1 -- 172.21.15.6:0/2775206607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f8071120 con 0x7f12f80ba140 2023-07-21T07:35:28.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.445+0000 7f12ee7fc700 1 -- 172.21.15.6:0/2775206607 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0004280 con 0x7f12f80ba140 2023-07-21T07:35:28.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.445+0000 7f12ffb62700 1 -- 172.21.15.6:0/2775206607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f81ded30 con 0x7f12f80ba140 2023-07-21T07:35:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.446+0000 7f12ffb62700 1 -- 172.21.15.6:0/2775206607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f81df170 con 0x7f12f80ba140 2023-07-21T07:35:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.446+0000 7f12ee7fc700 1 -- 172.21.15.6:0/2775206607 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f12f00043e0 con 0x7f12f80ba140 2023-07-21T07:35:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.446+0000 7f12ee7fc700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f12dc06ace0 0x7f12dc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.446+0000 7f12ee7fc700 1 -- 172.21.15.6:0/2775206607 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f12f0022070 con 0x7f12f80ba140 2023-07-21T07:35:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.447+0000 7f12fd8fe700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f12dc06ace0 0x7f12dc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.447+0000 7f12fd8fe700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f12dc06ace0 0x7f12dc06d1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000f60 tx=0x7f12e8007e70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.451+0000 7f12ee7fc700 1 -- 172.21.15.6:0/2775206607 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f12f00561b0 con 0x7f12f80ba140 2023-07-21T07:35:28.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.649+0000 7f12ffb62700 1 -- 172.21.15.6:0/2775206607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f12f814c760 con 0x7f12f80ba140 2023-07-21T07:35:28.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.650+0000 7f12ee7fc700 1 -- 172.21.15.6:0/2775206607 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12f002c0a0 con 0x7f12f80ba140 2023-07-21T07:35:28.703 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:35:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.652+0000 7f12ffb62700 1 -- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f12dc06ace0 msgr2=0x7f12dc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.652+0000 7f12ffb62700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f12dc06ace0 0x7f12dc06d1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000f60 tx=0x7f12e8007e70 comp rx=0 tx=0).stop 2023-07-21T07:35:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.652+0000 7f12ffb62700 1 -- 172.21.15.6:0/2775206607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f80ba140 msgr2=0x7f12f81df480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.652+0000 7f12ffb62700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f80ba140 0x7f12f81df480 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f12f806d570 tx=0x7f12f0004ad0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.652+0000 7f12ffb62700 1 -- 172.21.15.6:0/2775206607 shutdown_connections 2023-07-21T07:35:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.652+0000 7f12ffb62700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f12dc06ace0 0x7f12dc06d1a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.652+0000 7f12ffb62700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f80ba140 0x7f12f81df480 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.652+0000 7f12ffb62700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12f806a300 0x7f12f814c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.652+0000 7f12ffb62700 1 --2- 172.21.15.6:0/2775206607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12f806d8a0 0x7f12f8071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.652+0000 7f12ffb62700 1 -- 172.21.15.6:0/2775206607 >> 172.21.15.6:0/2775206607 conn(0x7f12f80a8660 msgr2=0x7f12f8150180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.652+0000 7f12ffb62700 1 -- 172.21.15.6:0/2775206607 shutdown_connections 2023-07-21T07:35:28.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.652+0000 7f12ffb62700 1 -- 172.21.15.6:0/2775206607 wait complete. 2023-07-21T07:35:28.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T07:35:28.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.789+0000 7f87fe4e8700 1 Processor -- start 2023-07-21T07:35:28.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.789+0000 7f87fe4e8700 1 -- start start 2023-07-21T07:35:28.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.790+0000 7f87fe4e8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87f814e790 0x7f87f8155a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.790+0000 7f87fe4e8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f806a780 con 0x7f87f8154590 2023-07-21T07:35:28.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.790+0000 7f87fe4e8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f806b5e0 con 0x7f87f80c4920 2023-07-21T07:35:28.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.790+0000 7f87fe4e8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f806c180 con 0x7f87f814e790 2023-07-21T07:35:28.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.790+0000 7f87f77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f87f8154590 0x7f87f814e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42180/0 (socket says 172.21.15.6:42180) 2023-07-21T07:35:28.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.790+0000 7f87f77fe700 1 -- 172.21.15.6:0/708575022 learned_addr learned my addr 172.21.15.6:0/708575022 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:28.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036726412 0 0) 0x7f87f806a780 con 0x7f87f8154590 2023-07-21T07:35:28.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87fca85700 1 --2- 172.21.15.6:0/708575022 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87f814e790 0x7f87f8155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87e40035b0 con 0x7f87f8154590 2023-07-21T07:35:28.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1200378403 0 0) 0x7f87e40035b0 con 0x7f87f8154590 2023-07-21T07:35:28.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87f814e790 msgr2=0x7f87f8155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:28.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 --2- 172.21.15.6:0/708575022 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87f814e790 0x7f87f8155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 >> v1:172.21.15.86:6789/0 conn(0x7f87f80c4920 legacy=0x7f87f806ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f806a9d0 con 0x7f87f8154590 2023-07-21T07:35:28.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f87e0001670 con 0x7f87f8154590 2023-07-21T07:35:28.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 >> v1:172.21.15.6:6789/0 conn(0x7f87f8154590 legacy=0x7f87f814e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 --2- 172.21.15.6:0/708575022 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87f814e790 0x7f87e4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 --2- 172.21.15.6:0/708575022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87e4003f70 0x7f87e4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 --2- 172.21.15.6:0/708575022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e4004d90 0x7f87e4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f806c180 con 0x7f87e4004d90 2023-07-21T07:35:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e400bb20 con 0x7f87e4003f70 2023-07-21T07:35:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e400bce0 con 0x7f87f814e790 2023-07-21T07:35:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87fca85700 1 --2- 172.21.15.6:0/708575022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e4004d90 0x7f87e4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f7fff700 1 --2- 172.21.15.6:0/708575022 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87f814e790 0x7f87e4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87f77fe700 1 --2- 172.21.15.6:0/708575022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87e4003f70 0x7f87e4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87fca85700 1 -- 172.21.15.6:0/708575022 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87f814e790 msgr2=0x7f87e4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87fca85700 1 --2- 172.21.15.6:0/708575022 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87f814e790 0x7f87e4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87fca85700 1 -- 172.21.15.6:0/708575022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87e4003f70 msgr2=0x7f87e4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87fca85700 1 --2- 172.21.15.6:0/708575022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87e4003f70 0x7f87e4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.791+0000 7f87fca85700 1 -- 172.21.15.6:0/708575022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e40035b0 con 0x7f87e4004d90 2023-07-21T07:35:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.792+0000 7f87fca85700 1 --2- 172.21.15.6:0/708575022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e4004d90 0x7f87e4005210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f87f0009f90 tx=0x7f87e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599d77d3fbd781cd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.792+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f000ebd0 con 0x7f87e4004d90 2023-07-21T07:35:28.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.792+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f000f040 con 0x7f87e4004d90 2023-07-21T07:35:28.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.792+0000 7f87f6ffd700 1 -- 172.21.15.6:0/708575022 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0014480 con 0x7f87e4004d90 2023-07-21T07:35:28.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.792+0000 7f87fe4e8700 1 -- 172.21.15.6:0/708575022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e4004d90 msgr2=0x7f87e4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.792+0000 7f87fe4e8700 1 --2- 172.21.15.6:0/708575022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e4004d90 0x7f87e4005210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f87f0009f90 tx=0x7f87e4005880 comp rx=0 tx=0).stop 2023-07-21T07:35:28.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.792+0000 7f87fca85700 1 -- 172.21.15.6:0/708575022 reap_dead start 2023-07-21T07:35:28.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.792+0000 7f87fe4e8700 1 -- 172.21.15.6:0/708575022 shutdown_connections 2023-07-21T07:35:28.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.792+0000 7f87fe4e8700 1 -- 172.21.15.6:0/708575022 >> 172.21.15.6:0/708575022 conn(0x7f87f80c9d30 msgr2=0x7f87f80ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:28.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.792+0000 7f87fe4e8700 1 -- 172.21.15.6:0/708575022 shutdown_connections 2023-07-21T07:35:28.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.792+0000 7f87fe4e8700 1 -- 172.21.15.6:0/708575022 wait complete. 2023-07-21T07:35:28.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.794+0000 7f87fe4e8700 1 Processor -- start 2023-07-21T07:35:28.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.794+0000 7f87fe4e8700 1 -- start start 2023-07-21T07:35:28.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87fe4e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f80aafd0 0x7f87f81510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87fe4e8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87f81e96d0 0x7f87f80c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87fe4e8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87f8151600 0x7f87f80c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87fe4e8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80c2af0 con 0x7f87f80aafd0 2023-07-21T07:35:28.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87fe4e8700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80c1fe0 con 0x7f87f8151600 2023-07-21T07:35:28.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87fe4e8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80c22c0 con 0x7f87f81e96d0 2023-07-21T07:35:28.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f80aafd0 0x7f87f81510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f80aafd0 0x7f87f81510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34170/0 (socket says 172.21.15.6:34170) 2023-07-21T07:35:28.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87f7fff700 1 -- 172.21.15.6:0/3808784750 learned_addr learned my addr 172.21.15.6:0/3808784750 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:28.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87fca85700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87f8151600 0x7f87f80c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87f77fe700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87f81e96d0 0x7f87f80c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87f7fff700 1 -- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87f81e96d0 msgr2=0x7f87f80c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87f7fff700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87f81e96d0 0x7f87f80c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87f7fff700 1 -- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87f8151600 msgr2=0x7f87f80c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87f7fff700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87f8151600 0x7f87f80c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.795+0000 7f87f7fff700 1 -- 172.21.15.6:0/3808784750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f80c8c20 con 0x7f87f80aafd0 2023-07-21T07:35:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.796+0000 7f87f7fff700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f80aafd0 0x7f87f81510c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f87e800f860 tx=0x7f87e800fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.796+0000 7f87f4ff9700 1 -- 172.21.15.6:0/3808784750 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e80052e0 con 0x7f87f80aafd0 2023-07-21T07:35:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.796+0000 7f87f4ff9700 1 -- 172.21.15.6:0/3808784750 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e8005460 con 0x7f87f80aafd0 2023-07-21T07:35:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.796+0000 7f87f4ff9700 1 -- 172.21.15.6:0/3808784750 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e80038c0 con 0x7f87f80aafd0 2023-07-21T07:35:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.796+0000 7f87fe4e8700 1 -- 172.21.15.6:0/3808784750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f814da00 con 0x7f87f80aafd0 2023-07-21T07:35:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.796+0000 7f87fe4e8700 1 -- 172.21.15.6:0/3808784750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f8152d10 con 0x7f87f80aafd0 2023-07-21T07:35:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.797+0000 7f87fe4e8700 1 -- 172.21.15.6:0/3808784750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f8074500 con 0x7f87f80aafd0 2023-07-21T07:35:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.797+0000 7f87f4ff9700 1 -- 172.21.15.6:0/3808784750 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87e8003a20 con 0x7f87f80aafd0 2023-07-21T07:35:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.798+0000 7f87f4ff9700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f87d806ace0 0x7f87d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.798+0000 7f87f4ff9700 1 -- 172.21.15.6:0/3808784750 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f87e8088ee0 con 0x7f87f80aafd0 2023-07-21T07:35:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.798+0000 7f87f77fe700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f87d806ace0 0x7f87d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.798+0000 7f87f77fe700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f87d806ace0 0x7f87d806d1a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f87e00010e0 tx=0x7f87e0000ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:28.803+0000 7f87f4ff9700 1 -- 172.21.15.6:0/3808784750 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f87e8054370 con 0x7f87f80aafd0 2023-07-21T07:35:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.001+0000 7f87fe4e8700 1 -- 172.21.15.6:0/3808784750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f87f80c3e30 con 0x7f87f80aafd0 2023-07-21T07:35:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.001+0000 7f87f4ff9700 1 -- 172.21.15.6:0/3808784750 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+126 (secure 0 0 0) 0x7f87e8057990 con 0x7f87f80aafd0 2023-07-21T07:35:29.054 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:29.054 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T07:35:29.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:29.054 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T07:35:29.054 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T07:35:29.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:29.055 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:29.055 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T07:35:29.055 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T07:35:29.055 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:29.055 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T07:35:29.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.003+0000 7f87fe4e8700 1 -- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f87d806ace0 msgr2=0x7f87d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:29.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.003+0000 7f87fe4e8700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f87d806ace0 0x7f87d806d1a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f87e00010e0 tx=0x7f87e0000ed0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.003+0000 7f87fe4e8700 1 -- 172.21.15.6:0/3808784750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f80aafd0 msgr2=0x7f87f81510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.003+0000 7f87fe4e8700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f80aafd0 0x7f87f81510c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f87e800f860 tx=0x7f87e800fb70 comp rx=0 tx=0).stop 2023-07-21T07:35:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.003+0000 7f87fe4e8700 1 -- 172.21.15.6:0/3808784750 shutdown_connections 2023-07-21T07:35:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.003+0000 7f87fe4e8700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f87d806ace0 0x7f87d806d1a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.003+0000 7f87fe4e8700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87f8151600 0x7f87f80c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.003+0000 7f87fe4e8700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f80aafd0 0x7f87f81510c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.003+0000 7f87fe4e8700 1 --2- 172.21.15.6:0/3808784750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87f81e96d0 0x7f87f80c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.003+0000 7f87fe4e8700 1 -- 172.21.15.6:0/3808784750 >> 172.21.15.6:0/3808784750 conn(0x7f87f80c9d30 msgr2=0x7f87f8154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:29.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.003+0000 7f87fe4e8700 1 -- 172.21.15.6:0/3808784750 shutdown_connections 2023-07-21T07:35:29.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.003+0000 7f87fe4e8700 1 -- 172.21.15.6:0/3808784750 wait complete. 2023-07-21T07:35:29.068 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T07:35:29.069 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T07:35:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7ca2ae4700 1 Processor -- start 2023-07-21T07:35:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7ca2ae4700 1 -- start start 2023-07-21T07:35:29.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7ca2ae4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c9c151ee0 0x7f7c9c0a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7ca2ae4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c9c0c1ea0 0x7f7c9c154880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7ca2ae4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9c0716f0 con 0x7f7c9c154dc0 2023-07-21T07:35:29.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7ca2ae4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9c0c2320 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7ca2ae4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c1522c0 con 0x7f7c9c151ee0 2023-07-21T07:35:29.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7c9bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c9c0c1ea0 0x7f7c9c154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:29.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7c9bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c9c0c1ea0 0x7f7c9c154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34178/0 (socket says 172.21.15.6:34178) 2023-07-21T07:35:29.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7c9bfff700 1 -- 172.21.15.6:0/828405564 learned_addr learned my addr 172.21.15.6:0/828405564 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:29.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7ca0880700 1 --2- 172.21.15.6:0/828405564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c9c151ee0 0x7f7c9c0a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:29.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7c9bfff700 1 -- 172.21.15.6:0/828405564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c9c151ee0 msgr2=0x7f7c9c0a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:29.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7c9bfff700 1 --2- 172.21.15.6:0/828405564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c9c151ee0 0x7f7c9c0a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7c9bfff700 1 -- 172.21.15.6:0/828405564 >> v1:172.21.15.86:6789/0 conn(0x7f7c9c154dc0 legacy=0x7f7c9c0c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:29.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7c9bfff700 1 -- 172.21.15.6:0/828405564 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c0c1bf0 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7c9b7fe700 1 -- 172.21.15.6:0/828405564 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881102489 0 0) 0x7f7c9c0716f0 con 0x7f7c9c154dc0 2023-07-21T07:35:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7c9bfff700 1 --2- 172.21.15.6:0/828405564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c9c0c1ea0 0x7f7c9c154880 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7c880098f0 tx=0x7f7c88009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61412076709d4a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.146+0000 7f7c9b7fe700 1 -- 172.21.15.6:0/828405564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88011830 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.147+0000 7f7c9b7fe700 1 -- 172.21.15.6:0/828405564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88011990 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.147+0000 7f7c9b7fe700 1 -- 172.21.15.6:0/828405564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88011d20 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.147+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/828405564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c9c0c1ea0 msgr2=0x7f7c9c154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.147+0000 7f7ca2ae4700 1 --2- 172.21.15.6:0/828405564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c9c0c1ea0 0x7f7c9c154880 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7c880098f0 tx=0x7f7c88009c00 comp rx=0 tx=0).stop 2023-07-21T07:35:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.147+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/828405564 shutdown_connections 2023-07-21T07:35:29.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.147+0000 7f7ca2ae4700 1 --2- 172.21.15.6:0/828405564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c9c151ee0 0x7f7c9c0a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.147+0000 7f7ca2ae4700 1 --2- 172.21.15.6:0/828405564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c9c0c1ea0 0x7f7c9c154880 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.147+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/828405564 >> 172.21.15.6:0/828405564 conn(0x7f7c9c0c36f0 msgr2=0x7f7c9c0c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.147+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/828405564 shutdown_connections 2023-07-21T07:35:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.147+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/828405564 wait complete. 2023-07-21T07:35:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.148+0000 7f7ca2ae4700 1 Processor -- start 2023-07-21T07:35:29.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.148+0000 7f7ca2ae4700 1 -- start start 2023-07-21T07:35:29.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.149+0000 7f7ca2ae4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c9c0c1ea0 0x7f7c9c0a8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.149+0000 7f7ca2ae4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c9c151ee0 0x7f7c9c0a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.149+0000 7f7ca2ae4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c9c154dc0 0x7f7c9c14e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.149+0000 7f7ca2ae4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c0b8840 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.149+0000 7f7ca2ae4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c0a75f0 con 0x7f7c9c151ee0 2023-07-21T07:35:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.149+0000 7f7ca2ae4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c0ba480 con 0x7f7c9c154dc0 2023-07-21T07:35:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.149+0000 7f7ca0880700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c9c0c1ea0 0x7f7c9c0a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.149+0000 7f7ca0880700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c9c0c1ea0 0x7f7c9c0a8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34184/0 (socket says 172.21.15.6:34184) 2023-07-21T07:35:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.149+0000 7f7ca0880700 1 -- 172.21.15.6:0/3876510714 learned_addr learned my addr 172.21.15.6:0/3876510714 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7c9bfff700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c9c151ee0 0x7f7c9c0a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7ca1081700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c9c154dc0 0x7f7c9c14e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7ca0880700 1 -- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c9c154dc0 msgr2=0x7f7c9c14e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7ca0880700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c9c154dc0 0x7f7c9c14e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7ca0880700 1 -- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c9c151ee0 msgr2=0x7f7c9c0a8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7ca0880700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c9c151ee0 0x7f7c9c0a8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7ca0880700 1 -- 172.21.15.6:0/3876510714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c88009550 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7c9bfff700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c9c151ee0 0x7f7c9c0a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7ca0880700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c9c0c1ea0 0x7f7c9c0a8700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000e9d0 tx=0x7f7c9000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7c997fa700 1 -- 172.21.15.6:0/3876510714 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90009730 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7c997fa700 1 -- 172.21.15.6:0/3876510714 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9000c850 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/3876510714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9c0a9180 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7c997fa700 1 -- 172.21.15.6:0/3876510714 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9000cbe0 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.150+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/3876510714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9c1e6e10 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.151+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/3876510714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9c0b8980 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.151+0000 7f7c997fa700 1 -- 172.21.15.6:0/3876510714 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c9000cd40 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.152+0000 7f7c997fa700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7c8006ad10 0x7f7c8006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.152+0000 7f7c997fa700 1 -- 172.21.15.6:0/3876510714 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7c900891f0 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.152+0000 7f7c9bfff700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7c8006ad10 0x7f7c8006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.152+0000 7f7c9bfff700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7c8006ad10 0x7f7c8006d1d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0c6b30 tx=0x7f7c88008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.157+0000 7f7c997fa700 1 -- 172.21.15.6:0/3876510714 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7c9c0b8980 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.354+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/3876510714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7c9c0b8980 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.528+0000 7f7c997fa700 1 -- 172.21.15.6:0/3876510714 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7c9c0b8980 con 0x7f7c9c0c1ea0 2023-07-21T07:35:29.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.533+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7c8006ad10 msgr2=0x7f7c8006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:29.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.533+0000 7f7ca2ae4700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7c8006ad10 0x7f7c8006d1d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0c6b30 tx=0x7f7c88008030 comp rx=0 tx=0).stop 2023-07-21T07:35:29.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.533+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/3876510714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c9c0c1ea0 msgr2=0x7f7c9c0a8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:29.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.533+0000 7f7ca2ae4700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c9c0c1ea0 0x7f7c9c0a8700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000e9d0 tx=0x7f7c9000ed90 comp rx=0 tx=0).stop 2023-07-21T07:35:29.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.533+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/3876510714 shutdown_connections 2023-07-21T07:35:29.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.533+0000 7f7ca2ae4700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7c8006ad10 0x7f7c8006d1d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.533+0000 7f7ca2ae4700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c9c154dc0 0x7f7c9c14e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.533+0000 7f7ca2ae4700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c9c0c1ea0 0x7f7c9c0a8700 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.533+0000 7f7ca2ae4700 1 --2- 172.21.15.6:0/3876510714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c9c151ee0 0x7f7c9c0a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.533+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/3876510714 >> 172.21.15.6:0/3876510714 conn(0x7f7c9c0c36f0 msgr2=0x7f7c9c152520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:29.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.533+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/3876510714 shutdown_connections 2023-07-21T07:35:29.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.533+0000 7f7ca2ae4700 1 -- 172.21.15.6:0/3876510714 wait complete. 2023-07-21T07:35:29.588 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T07:35:29.598 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T07:35:29.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.678+0000 7f8306999700 1 Processor -- start 2023-07-21T07:35:29.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.678+0000 7f8306999700 1 -- start start 2023-07-21T07:35:29.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.679+0000 7f8306999700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83000ba140 0x7f83000c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.679+0000 7f8306999700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8300155530 con 0x7f830006a300 2023-07-21T07:35:29.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.679+0000 7f8306999700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83000c5690 con 0x7f830006d8a0 2023-07-21T07:35:29.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.679+0000 7f8306999700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83000c1a30 con 0x7f83000ba140 2023-07-21T07:35:29.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.679+0000 7f82fffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f830006a300 0x7f83001519b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42212/0 (socket says 172.21.15.6:42212) 2023-07-21T07:35:29.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.679+0000 7f82fffff700 1 -- 172.21.15.6:0/3911456048 learned_addr learned my addr 172.21.15.6:0/3911456048 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82ff7fe700 1 --2- 172.21.15.6:0/3911456048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83000ba140 0x7f83000c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441055399 0 0) 0x7f8300155530 con 0x7f830006a300 2023-07-21T07:35:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82ec0035b0 con 0x7f830006a300 2023-07-21T07:35:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2825528655 0 0) 0x7f82ec0035b0 con 0x7f830006a300 2023-07-21T07:35:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83000ba140 msgr2=0x7f83000c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 --2- 172.21.15.6:0/3911456048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83000ba140 0x7f83000c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 >> v1:172.21.15.86:6789/0 conn(0x7f830006d8a0 legacy=0x7f83000c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300154920 con 0x7f830006a300 2023-07-21T07:35:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f82f0001670 con 0x7f830006a300 2023-07-21T07:35:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 >> v1:172.21.15.6:6789/0 conn(0x7f830006a300 legacy=0x7f83001519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 --2- 172.21.15.6:0/3911456048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82ec003a30 0x7f82ec003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 --2- 172.21.15.6:0/3911456048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83000ba140 0x7f82ec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 --2- 172.21.15.6:0/3911456048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec004d90 0x7f82ec005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83000c1a30 con 0x7f82ec004d90 2023-07-21T07:35:29.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec00bb70 con 0x7f82ec003a30 2023-07-21T07:35:29.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec00bd30 con 0x7f83000ba140 2023-07-21T07:35:29.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f8304f36700 1 --2- 172.21.15.6:0/3911456048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec004d90 0x7f82ec005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:29.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82ff7fe700 1 --2- 172.21.15.6:0/3911456048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83000ba140 0x7f82ec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:29.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f82fffff700 1 --2- 172.21.15.6:0/3911456048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82ec003a30 0x7f82ec003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:29.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f8304f36700 1 -- 172.21.15.6:0/3911456048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83000ba140 msgr2=0x7f82ec004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:29.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f8304f36700 1 --2- 172.21.15.6:0/3911456048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83000ba140 0x7f82ec004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f8304f36700 1 -- 172.21.15.6:0/3911456048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82ec003a30 msgr2=0x7f82ec003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:29.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f8304f36700 1 --2- 172.21.15.6:0/3911456048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82ec003a30 0x7f82ec003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.680+0000 7f8304f36700 1 -- 172.21.15.6:0/3911456048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec0035b0 con 0x7f82ec004d90 2023-07-21T07:35:29.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.681+0000 7f8304f36700 1 --2- 172.21.15.6:0/3911456048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec004d90 0x7f82ec005210 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f82f800c190 tx=0x7f82ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4f3704ae114a5d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:29.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.681+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8001db0 con 0x7f82ec004d90 2023-07-21T07:35:29.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.681+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f800ccd0 con 0x7f82ec004d90 2023-07-21T07:35:29.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.681+0000 7f82feffd700 1 -- 172.21.15.6:0/3911456048 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8003c40 con 0x7f82ec004d90 2023-07-21T07:35:29.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.681+0000 7f8306999700 1 -- 172.21.15.6:0/3911456048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec004d90 msgr2=0x7f82ec005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:29.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.681+0000 7f8306999700 1 --2- 172.21.15.6:0/3911456048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec004d90 0x7f82ec005210 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f82f800c190 tx=0x7f82ec005880 comp rx=0 tx=0).stop 2023-07-21T07:35:29.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.681+0000 7f8304f36700 1 -- 172.21.15.6:0/3911456048 reap_dead start 2023-07-21T07:35:29.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.681+0000 7f8306999700 1 -- 172.21.15.6:0/3911456048 shutdown_connections 2023-07-21T07:35:29.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.681+0000 7f8306999700 1 -- 172.21.15.6:0/3911456048 >> 172.21.15.6:0/3911456048 conn(0x7f83000a8660 msgr2=0x7f83000a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:29.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.681+0000 7f8306999700 1 -- 172.21.15.6:0/3911456048 shutdown_connections 2023-07-21T07:35:29.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.681+0000 7f8306999700 1 -- 172.21.15.6:0/3911456048 wait complete. 2023-07-21T07:35:29.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.683+0000 7f8306999700 1 Processor -- start 2023-07-21T07:35:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.683+0000 7f8306999700 1 -- start start 2023-07-21T07:35:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f8306999700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec004d90 0x7f83001edd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f8306999700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8300071c50 0x7f830014c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f8306999700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83001ebe30 0x7f83001ec290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f8306999700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8300072460 con 0x7f82ec004d90 2023-07-21T07:35:29.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f8306999700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83001ee270 con 0x7f8300071c50 2023-07-21T07:35:29.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f8306999700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8300072180 con 0x7f83001ebe30 2023-07-21T07:35:29.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f82fffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec004d90 0x7f83001edd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:29.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f82fffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec004d90 0x7f83001edd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34204/0 (socket says 172.21.15.6:34204) 2023-07-21T07:35:29.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f82fffff700 1 -- 172.21.15.6:0/4210297625 learned_addr learned my addr 172.21.15.6:0/4210297625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:29.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f82fffff700 1 -- 172.21.15.6:0/4210297625 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83001ebe30 msgr2=0x7f83001ec290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:29.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f82fffff700 1 --2- 172.21.15.6:0/4210297625 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83001ebe30 0x7f83001ec290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f82ff7fe700 1 --2- 172.21.15.6:0/4210297625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8300071c50 0x7f830014c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:29.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f82fffff700 1 -- 172.21.15.6:0/4210297625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8300071c50 msgr2=0x7f830014c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:29.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f82fffff700 1 --2- 172.21.15.6:0/4210297625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8300071c50 0x7f830014c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:29.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.685+0000 7f82fffff700 1 -- 172.21.15.6:0/4210297625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83001eb350 con 0x7f82ec004d90 2023-07-21T07:35:29.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.686+0000 7f82fffff700 1 --2- 172.21.15.6:0/4210297625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec004d90 0x7f83001edd30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f82f00072c0 tx=0x7f82f0007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:29.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.686+0000 7f82fcff9700 1 -- 172.21.15.6:0/4210297625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f00014a0 con 0x7f82ec004d90 2023-07-21T07:35:29.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.686+0000 7f82fcff9700 1 -- 172.21.15.6:0/4210297625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f000f850 con 0x7f82ec004d90 2023-07-21T07:35:29.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.686+0000 7f8306999700 1 -- 172.21.15.6:0/4210297625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83001eb630 con 0x7f82ec004d90 2023-07-21T07:35:29.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.686+0000 7f82fcff9700 1 -- 172.21.15.6:0/4210297625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f000fc00 con 0x7f82ec004d90 2023-07-21T07:35:29.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.686+0000 7f8306999700 1 -- 172.21.15.6:0/4210297625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830014c930 con 0x7f82ec004d90 2023-07-21T07:35:29.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.686+0000 7f8306999700 1 -- 172.21.15.6:0/4210297625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83001ebb50 con 0x7f82ec004d90 2023-07-21T07:35:29.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.686+0000 7f82fcff9700 1 -- 172.21.15.6:0/4210297625 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f82f000fd60 con 0x7f82ec004d90 2023-07-21T07:35:29.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.688+0000 7f82fcff9700 1 --2- 172.21.15.6:0/4210297625 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f82e006ad10 0x7f82e006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:29.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.688+0000 7f82fcff9700 1 -- 172.21.15.6:0/4210297625 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f82f0089260 con 0x7f82ec004d90 2023-07-21T07:35:29.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.688+0000 7f82ff7fe700 1 --2- 172.21.15.6:0/4210297625 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f82e006ad10 0x7f82e006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:29.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.688+0000 7f82ff7fe700 1 --2- 172.21.15.6:0/4210297625 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f82e006ad10 0x7f82e006d1d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f830014d080 tx=0x7f82e8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:29.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.692+0000 7f82fcff9700 1 -- 172.21.15.6:0/4210297625 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f83001ebb50 con 0x7f82ec004d90 2023-07-21T07:35:29.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:29.890+0000 7f8306999700 1 -- 172.21.15.6:0/4210297625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f83001ebb50 con 0x7f82ec004d90 2023-07-21T07:35:30.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.533+0000 7f82fcff9700 1 -- 172.21.15.6:0/4210297625 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) v1 ==== 170+0+0 (secure 0 0 0) 0x7f83001ebb50 con 0x7f82ec004d90 2023-07-21T07:35:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.542+0000 7f8306999700 1 -- 172.21.15.6:0/4210297625 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f82e006ad10 msgr2=0x7f82e006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.542+0000 7f8306999700 1 --2- 172.21.15.6:0/4210297625 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f82e006ad10 0x7f82e006d1d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f830014d080 tx=0x7f82e8008040 comp rx=0 tx=0).stop 2023-07-21T07:35:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.542+0000 7f8306999700 1 -- 172.21.15.6:0/4210297625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec004d90 msgr2=0x7f83001edd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.542+0000 7f8306999700 1 --2- 172.21.15.6:0/4210297625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec004d90 0x7f83001edd30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f82f00072c0 tx=0x7f82f0007680 comp rx=0 tx=0).stop 2023-07-21T07:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.542+0000 7f8306999700 1 -- 172.21.15.6:0/4210297625 shutdown_connections 2023-07-21T07:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.542+0000 7f8306999700 1 --2- 172.21.15.6:0/4210297625 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f82e006ad10 0x7f82e006d1d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.542+0000 7f8306999700 1 --2- 172.21.15.6:0/4210297625 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83001ebe30 0x7f83001ec290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.542+0000 7f8306999700 1 --2- 172.21.15.6:0/4210297625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec004d90 0x7f83001edd30 secure :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f82f00072c0 tx=0x7f82f0007680 comp rx=0 tx=0).stop 2023-07-21T07:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.542+0000 7f8306999700 1 --2- 172.21.15.6:0/4210297625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8300071c50 0x7f830014c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.542+0000 7f8306999700 1 -- 172.21.15.6:0/4210297625 >> 172.21.15.6:0/4210297625 conn(0x7f83000a8660 msgr2=0x7f83000c3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:30.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.544+0000 7f8306999700 1 -- 172.21.15.6:0/4210297625 shutdown_connections 2023-07-21T07:35:30.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.544+0000 7f8306999700 1 -- 172.21.15.6:0/4210297625 wait complete. 2023-07-21T07:35:30.601 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T07:35:30.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T07:35:30.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.698+0000 7f49a3748700 1 Processor -- start 2023-07-21T07:35:30.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.699+0000 7f49a3748700 1 -- start start 2023-07-21T07:35:30.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.699+0000 7f49a3748700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f499c151c20 0x7f499c0c0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:30.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.699+0000 7f49a3748700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499c0c5a50 con 0x7f499c157b70 2023-07-21T07:35:30.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.699+0000 7f49a3748700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499c152000 con 0x7f499c155000 2023-07-21T07:35:30.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.699+0000 7f49a3748700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499c0c8800 con 0x7f499c151c20 2023-07-21T07:35:30.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.699+0000 7f49a1ce5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f499c157b70 0x7f499c158020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42236/0 (socket says 172.21.15.6:42236) 2023-07-21T07:35:30.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.699+0000 7f49a1ce5700 1 -- 172.21.15.6:0/2554371448 learned_addr learned my addr 172.21.15.6:0/2554371448 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:30.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.700+0000 7f49a14e4700 1 --2- 172.21.15.6:0/2554371448 >> v2:172.21.15.86:3300/0 conn(0x7f499c151c20 0x7f499c0c0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:30.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.700+0000 7f4993fff700 1 -- 172.21.15.6:0/2554371448 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830056376 0 0) 0x7f499c0c5a50 con 0x7f499c157b70 2023-07-21T07:35:30.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.700+0000 7f4993fff700 1 -- 172.21.15.6:0/2554371448 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49880035b0 con 0x7f499c157b70 2023-07-21T07:35:30.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.700+0000 7f4993fff700 1 -- 172.21.15.6:0/2554371448 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475505783 0 0) 0x7f499c152000 con 0x7f499c155000 2023-07-21T07:35:30.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.700+0000 7f4993fff700 1 -- 172.21.15.6:0/2554371448 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f499c0c5a50 con 0x7f499c155000 2023-07-21T07:35:30.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.700+0000 7f4993fff700 1 -- 172.21.15.6:0/2554371448 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2493561317 0 0) 0x7f49880035b0 con 0x7f499c157b70 2023-07-21T07:35:30.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.700+0000 7f49a14e4700 1 -- 172.21.15.6:0/2554371448 >> v1:172.21.15.86:6789/0 conn(0x7f499c155000 legacy=0x7f499c0c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:30.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.700+0000 7f49a14e4700 1 -- 172.21.15.6:0/2554371448 >> v1:172.21.15.6:6789/0 conn(0x7f499c157b70 legacy=0x7f499c158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:30.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.700+0000 7f49a14e4700 1 -- 172.21.15.6:0/2554371448 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c155500 con 0x7f499c151c20 2023-07-21T07:35:30.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.700+0000 7f49a14e4700 1 --2- 172.21.15.6:0/2554371448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f499c151c20 0x7f499c0c0e60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f498c009840 tx=0x7f498c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd8571519192874c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:30.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.700+0000 7f4993fff700 1 -- 172.21.15.6:0/2554371448 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49940019f0 con 0x7f499c151c20 2023-07-21T07:35:30.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.700+0000 7f4993fff700 1 -- 172.21.15.6:0/2554371448 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c004030 con 0x7f499c151c20 2023-07-21T07:35:30.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.700+0000 7f4993fff700 1 -- 172.21.15.6:0/2554371448 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c0043a0 con 0x7f499c151c20 2023-07-21T07:35:30.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.701+0000 7f49a3748700 1 -- 172.21.15.6:0/2554371448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f499c151c20 msgr2=0x7f499c0c0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:30.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.701+0000 7f49a3748700 1 --2- 172.21.15.6:0/2554371448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f499c151c20 0x7f499c0c0e60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f498c009840 tx=0x7f498c009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:30.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.701+0000 7f49a3748700 1 -- 172.21.15.6:0/2554371448 shutdown_connections 2023-07-21T07:35:30.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.701+0000 7f49a3748700 1 --2- 172.21.15.6:0/2554371448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f499c151c20 0x7f499c0c0e60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:30.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.701+0000 7f49a3748700 1 -- 172.21.15.6:0/2554371448 >> 172.21.15.6:0/2554371448 conn(0x7f499c0c7b50 msgr2=0x7f499c0c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:30.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.701+0000 7f49a3748700 1 -- 172.21.15.6:0/2554371448 shutdown_connections 2023-07-21T07:35:30.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.701+0000 7f49a3748700 1 -- 172.21.15.6:0/2554371448 wait complete. 2023-07-21T07:35:30.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.702+0000 7f49a3748700 1 Processor -- start 2023-07-21T07:35:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.702+0000 7f49a3748700 1 -- start start 2023-07-21T07:35:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a3748700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f499c151c20 0x7f499c071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a3748700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f499c155000 0x7f499c14bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a3748700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499c157b70 0x7f499c14c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a3748700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c156a50 con 0x7f499c155000 2023-07-21T07:35:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a3748700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c14d9b0 con 0x7f499c151c20 2023-07-21T07:35:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a3748700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c1e9740 con 0x7f499c157b70 2023-07-21T07:35:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a0ce3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f499c155000 0x7f499c14bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:30.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a0ce3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f499c155000 0x7f499c14bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34220/0 (socket says 172.21.15.6:34220) 2023-07-21T07:35:30.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a0ce3700 1 -- 172.21.15.6:0/4041882938 learned_addr learned my addr 172.21.15.6:0/4041882938 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:30.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a1ce5700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499c157b70 0x7f499c14c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:30.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a14e4700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f499c151c20 0x7f499c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:30.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a0ce3700 1 -- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499c157b70 msgr2=0x7f499c14c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:30.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a0ce3700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499c157b70 0x7f499c14c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:30.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a0ce3700 1 -- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f499c151c20 msgr2=0x7f499c071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:30.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a0ce3700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f499c151c20 0x7f499c071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:30.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.703+0000 7f49a0ce3700 1 -- 172.21.15.6:0/4041882938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c0094a0 con 0x7f499c155000 2023-07-21T07:35:30.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.704+0000 7f49a0ce3700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f499c155000 0x7f499c14bfd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f499800c490 tx=0x7f499800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:30.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.704+0000 7f4991ffb700 1 -- 172.21.15.6:0/4041882938 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499800cea0 con 0x7f499c155000 2023-07-21T07:35:30.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.704+0000 7f4991ffb700 1 -- 172.21.15.6:0/4041882938 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49980052f0 con 0x7f499c155000 2023-07-21T07:35:30.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.704+0000 7f49a3748700 1 -- 172.21.15.6:0/4041882938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c14df00 con 0x7f499c155000 2023-07-21T07:35:30.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.704+0000 7f4991ffb700 1 -- 172.21.15.6:0/4041882938 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998003680 con 0x7f499c155000 2023-07-21T07:35:30.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.704+0000 7f49a3748700 1 -- 172.21.15.6:0/4041882938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c14d110 con 0x7f499c155000 2023-07-21T07:35:30.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.705+0000 7f49a3748700 1 -- 172.21.15.6:0/4041882938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499c1e98b0 con 0x7f499c155000 2023-07-21T07:35:30.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.706+0000 7f4991ffb700 1 -- 172.21.15.6:0/4041882938 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49980037e0 con 0x7f499c155000 2023-07-21T07:35:30.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.706+0000 7f4991ffb700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f498006ace0 0x7f498006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:30.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.706+0000 7f4991ffb700 1 -- 172.21.15.6:0/4041882938 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f4998088790 con 0x7f499c155000 2023-07-21T07:35:30.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.706+0000 7f49a14e4700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f498006ace0 0x7f498006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:30.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.707+0000 7f49a14e4700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f498006ace0 0x7f498006d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f498c000c00 tx=0x7f498c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:30.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.711+0000 7f4991ffb700 1 -- 172.21.15.6:0/4041882938 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f499c1e98b0 con 0x7f499c155000 2023-07-21T07:35:31.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:30.953+0000 7f49a3748700 1 -- 172.21.15.6:0/4041882938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f499c1e98b0 con 0x7f499c155000 2023-07-21T07:35:31.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.569+0000 7f4991ffb700 1 -- 172.21.15.6:0/4041882938 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f499c1e98b0 con 0x7f499c155000 2023-07-21T07:35:31.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.576+0000 7f49a3748700 1 -- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f498006ace0 msgr2=0x7f498006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:31.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.576+0000 7f49a3748700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f498006ace0 0x7f498006d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f498c000c00 tx=0x7f498c008030 comp rx=0 tx=0).stop 2023-07-21T07:35:31.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.576+0000 7f49a3748700 1 -- 172.21.15.6:0/4041882938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f499c155000 msgr2=0x7f499c14bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:31.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.576+0000 7f49a3748700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f499c155000 0x7f499c14bfd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f499800c490 tx=0x7f499800c7a0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.577+0000 7f49a3748700 1 -- 172.21.15.6:0/4041882938 shutdown_connections 2023-07-21T07:35:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.577+0000 7f49a3748700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f498006ace0 0x7f498006d1a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.577+0000 7f49a3748700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499c157b70 0x7f499c14c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.577+0000 7f49a3748700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f499c151c20 0x7f499c071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.577+0000 7f49a3748700 1 --2- 172.21.15.6:0/4041882938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f499c155000 0x7f499c14bfd0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.577+0000 7f49a3748700 1 -- 172.21.15.6:0/4041882938 >> 172.21.15.6:0/4041882938 conn(0x7f499c0c7b50 msgr2=0x7f499c0a8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:31.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.577+0000 7f49a3748700 1 -- 172.21.15.6:0/4041882938 shutdown_connections 2023-07-21T07:35:31.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.577+0000 7f49a3748700 1 -- 172.21.15.6:0/4041882938 wait complete. 2023-07-21T07:35:31.631 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 5 and data pool 6 2023-07-21T07:35:31.648 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.726+0000 7f0b25281700 1 Processor -- start 2023-07-21T07:35:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.726+0000 7f0b25281700 1 -- start start 2023-07-21T07:35:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.727+0000 7f0b25281700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0b2014f9a0 0x7f0b201523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.727+0000 7f0b25281700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b2014fd80 0x7f0b200c8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.727+0000 7f0b25281700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b201528f0 con 0x7f0b2006f620 2023-07-21T07:35:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.727+0000 7f0b25281700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b200c2a10 con 0x7f0b2014fd80 2023-07-21T07:35:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.727+0000 7f0b25281700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b20156950 con 0x7f0b2014f9a0 2023-07-21T07:35:31.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.727+0000 7f0b1f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b2014fd80 0x7f0b200c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:31.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.727+0000 7f0b1e7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0b2006f620 0x7f0b20156240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42260/0 (socket says 172.21.15.6:42260) 2023-07-21T07:35:31.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.727+0000 7f0b1f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b2014fd80 0x7f0b200c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34244/0 (socket says 172.21.15.6:34244) 2023-07-21T07:35:31.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.727+0000 7f0b1e7fc700 1 -- 172.21.15.6:0/3493049123 learned_addr learned my addr 172.21.15.6:0/3493049123 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:31.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.727+0000 7f0b1effd700 1 --2- 172.21.15.6:0/3493049123 >> v2:172.21.15.86:3300/0 conn(0x7f0b2014f9a0 0x7f0b201523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:31.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b1f7fe700 1 -- 172.21.15.6:0/3493049123 >> v2:172.21.15.86:3300/0 conn(0x7f0b2014f9a0 msgr2=0x7f0b201523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:31.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b1f7fe700 1 --2- 172.21.15.6:0/3493049123 >> v2:172.21.15.86:3300/0 conn(0x7f0b2014f9a0 0x7f0b201523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b1f7fe700 1 -- 172.21.15.6:0/3493049123 >> v1:172.21.15.6:6789/0 conn(0x7f0b2006f620 legacy=0x7f0b20156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:31.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b1f7fe700 1 -- 172.21.15.6:0/3493049123 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b20155db0 con 0x7f0b2014fd80 2023-07-21T07:35:31.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b1f7fe700 1 --2- 172.21.15.6:0/3493049123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2014fd80 0x7f0b200c8080 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0b20071c50 tx=0x7f0b1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaebdf811b905acd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:31.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b1dffb700 1 -- 172.21.15.6:0/3493049123 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800e070 con 0x7f0b2014fd80 2023-07-21T07:35:31.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b1dffb700 1 -- 172.21.15.6:0/3493049123 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1800bbd0 con 0x7f0b2014fd80 2023-07-21T07:35:31.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b1dffb700 1 -- 172.21.15.6:0/3493049123 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18012430 con 0x7f0b2014fd80 2023-07-21T07:35:31.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b25281700 1 -- 172.21.15.6:0/3493049123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2014fd80 msgr2=0x7f0b200c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:31.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b25281700 1 --2- 172.21.15.6:0/3493049123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2014fd80 0x7f0b200c8080 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0b20071c50 tx=0x7f0b1800b330 comp rx=0 tx=0).stop 2023-07-21T07:35:31.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b25281700 1 -- 172.21.15.6:0/3493049123 shutdown_connections 2023-07-21T07:35:31.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b25281700 1 --2- 172.21.15.6:0/3493049123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2014fd80 0x7f0b200c8080 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b25281700 1 --2- 172.21.15.6:0/3493049123 >> v2:172.21.15.86:3300/0 conn(0x7f0b2014f9a0 0x7f0b201523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b25281700 1 -- 172.21.15.6:0/3493049123 >> 172.21.15.6:0/3493049123 conn(0x7f0b2006a480 msgr2=0x7f0b2006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:31.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b25281700 1 -- 172.21.15.6:0/3493049123 shutdown_connections 2023-07-21T07:35:31.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.728+0000 7f0b25281700 1 -- 172.21.15.6:0/3493049123 wait complete. 2023-07-21T07:35:31.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.730+0000 7f0b25281700 1 Processor -- start 2023-07-21T07:35:31.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.730+0000 7f0b25281700 1 -- start start 2023-07-21T07:35:31.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.730+0000 7f0b25281700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b2006f620 0x7f0b200aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:31.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.730+0000 7f0b25281700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2014f9a0 0x7f0b20150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.730+0000 7f0b25281700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b2014fd80 0x7f0b20150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.730+0000 7f0b25281700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b201ea380 con 0x7f0b2014f9a0 2023-07-21T07:35:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.730+0000 7f0b25281700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b201e9770 con 0x7f0b2014fd80 2023-07-21T07:35:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.730+0000 7f0b25281700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b201e9a50 con 0x7f0b2006f620 2023-07-21T07:35:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b1e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2014f9a0 0x7f0b20150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b1e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2014f9a0 0x7f0b20150630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34248/0 (socket says 172.21.15.6:34248) 2023-07-21T07:35:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b1e7fc700 1 -- 172.21.15.6:0/1489093985 learned_addr learned my addr 172.21.15.6:0/1489093985 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b1effd700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b2006f620 0x7f0b200aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b1f7fe700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b2014fd80 0x7f0b20150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b1e7fc700 1 -- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b2006f620 msgr2=0x7f0b200aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b1e7fc700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b2006f620 0x7f0b200aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b1e7fc700 1 -- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b2014fd80 msgr2=0x7f0b20150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b1e7fc700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b2014fd80 0x7f0b20150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b1e7fc700 1 -- 172.21.15.6:0/1489093985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b18009a70 con 0x7f0b2014f9a0 2023-07-21T07:35:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b1effd700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b2006f620 0x7f0b200aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:31.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b1f7fe700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b2014fd80 0x7f0b20150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:31.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b1e7fc700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2014f9a0 0x7f0b20150630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000c520 tx=0x7f0b1000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:31.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b077fe700 1 -- 172.21.15.6:0/1489093985 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10005d70 con 0x7f0b2014f9a0 2023-07-21T07:35:31.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b077fe700 1 -- 172.21.15.6:0/1489093985 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b100070d0 con 0x7f0b2014f9a0 2023-07-21T07:35:31.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b077fe700 1 -- 172.21.15.6:0/1489093985 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10007440 con 0x7f0b2014f9a0 2023-07-21T07:35:31.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b25281700 1 -- 172.21.15.6:0/1489093985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b201e9d30 con 0x7f0b2014f9a0 2023-07-21T07:35:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.731+0000 7f0b25281700 1 -- 172.21.15.6:0/1489093985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b200ab4c0 con 0x7f0b2014f9a0 2023-07-21T07:35:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.732+0000 7f0b25281700 1 -- 172.21.15.6:0/1489093985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b20074500 con 0x7f0b2014f9a0 2023-07-21T07:35:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.733+0000 7f0b077fe700 1 -- 172.21.15.6:0/1489093985 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b100075a0 con 0x7f0b2014f9a0 2023-07-21T07:35:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.733+0000 7f0b077fe700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b0c06ace0 0x7f0b0c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.733+0000 7f0b077fe700 1 -- 172.21.15.6:0/1489093985 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b10088840 con 0x7f0b2014f9a0 2023-07-21T07:35:31.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.733+0000 7f0b1effd700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b0c06ace0 0x7f0b0c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:31.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.734+0000 7f0b1effd700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b0c06ace0 0x7f0b0c06d1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0b140099f0 tx=0x7f0b14008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:31.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.737+0000 7f0b077fe700 1 -- 172.21.15.6:0/1489093985 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0b100539a0 con 0x7f0b2014f9a0 2023-07-21T07:35:31.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.936+0000 7f0b25281700 1 -- 172.21.15.6:0/1489093985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b200c3aa0 con 0x7f0b2014f9a0 2023-07-21T07:35:31.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.937+0000 7f0b077fe700 1 -- 172.21.15.6:0/1489093985 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18256 (secure 0 0 0) 0x7f0b10056fc0 con 0x7f0b2014f9a0 2023-07-21T07:35:31.989 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:31.989 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":35,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:30.954137+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:35:29.385402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T07:35:29.920618+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:31.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.939+0000 7f0b25281700 1 -- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b0c06ace0 msgr2=0x7f0b0c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.939+0000 7f0b25281700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b0c06ace0 0x7f0b0c06d1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0b140099f0 tx=0x7f0b14008040 comp rx=0 tx=0).stop 2023-07-21T07:35:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.939+0000 7f0b25281700 1 -- 172.21.15.6:0/1489093985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2014f9a0 msgr2=0x7f0b20150630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.939+0000 7f0b25281700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2014f9a0 0x7f0b20150630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000c520 tx=0x7f0b1000c8e0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.939+0000 7f0b25281700 1 -- 172.21.15.6:0/1489093985 shutdown_connections 2023-07-21T07:35:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.939+0000 7f0b25281700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0b0c06ace0 0x7f0b0c06d1a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.939+0000 7f0b25281700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b2014fd80 0x7f0b20150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.939+0000 7f0b25281700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b2006f620 0x7f0b200aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.939+0000 7f0b25281700 1 --2- 172.21.15.6:0/1489093985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b2014f9a0 0x7f0b20150630 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.939+0000 7f0b25281700 1 -- 172.21.15.6:0/1489093985 >> 172.21.15.6:0/1489093985 conn(0x7f0b2006a480 msgr2=0x7f0b20153e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.939+0000 7f0b25281700 1 -- 172.21.15.6:0/1489093985 shutdown_connections 2023-07-21T07:35:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:31.939+0000 7f0b25281700 1 -- 172.21.15.6:0/1489093985 wait complete. 2023-07-21T07:35:32.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.076+0000 7f4bb5d33700 1 Processor -- start 2023-07-21T07:35:32.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.076+0000 7f4bb5d33700 1 -- start start 2023-07-21T07:35:32.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.077+0000 7f4bb5d33700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4bb00c6170 0x7f4bb014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.077+0000 7f4bb5d33700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bb00c53e0 0x7f4bb0154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.077+0000 7f4bb5d33700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb00ba440 con 0x7f4bb00c3750 2023-07-21T07:35:32.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.077+0000 7f4bb5d33700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb00c15d0 con 0x7f4bb00c6170 2023-07-21T07:35:32.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.077+0000 7f4bb5d33700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00c18b0 con 0x7f4bb00c53e0 2023-07-21T07:35:32.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.077+0000 7f4baf7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4bb00c3750 0x7f4bb014e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42274/0 (socket says 172.21.15.6:42274) 2023-07-21T07:35:32.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.077+0000 7f4baf7fe700 1 -- 172.21.15.6:0/152118258 learned_addr learned my addr 172.21.15.6:0/152118258 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:32.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.077+0000 7f4baffff700 1 --2- 172.21.15.6:0/152118258 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bb00c53e0 0x7f4bb0154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:32.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.077+0000 7f4baeffd700 1 --2- 172.21.15.6:0/152118258 >> v2:172.21.15.86:3300/0 conn(0x7f4bb00c6170 0x7f4bb014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:32.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.077+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603664489 0 0) 0x7f4bb00ba440 con 0x7f4bb00c3750 2023-07-21T07:35:32.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.077+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b980057c0 con 0x7f4bb00c3750 2023-07-21T07:35:32.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3924734090 0 0) 0x7f4b980057c0 con 0x7f4bb00c3750 2023-07-21T07:35:32.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bb00c53e0 msgr2=0x7f4bb0154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:32.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 --2- 172.21.15.6:0/152118258 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bb00c53e0 0x7f4bb0154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 >> v2:172.21.15.86:3300/0 conn(0x7f4bb00c6170 msgr2=0x7f4bb014ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:32.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 --2- 172.21.15.6:0/152118258 >> v2:172.21.15.86:3300/0 conn(0x7f4bb00c6170 0x7f4bb014ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb00c1b90 con 0x7f4bb00c3750 2023-07-21T07:35:32.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f4ba0001670 con 0x7f4bb00c3750 2023-07-21T07:35:32.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 >> v1:172.21.15.6:6789/0 conn(0x7f4bb00c3750 legacy=0x7f4bb014e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:32.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 --2- 172.21.15.6:0/152118258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b98005c10 0x7f4b98006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 --2- 172.21.15.6:0/152118258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b98006a60 0x7f4b98006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 --2- 172.21.15.6:0/152118258 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bb00c53e0 0x7f4b98007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00c15d0 con 0x7f4b98005c10 2023-07-21T07:35:32.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00c18b0 con 0x7f4b98006a60 2023-07-21T07:35:32.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9800dc20 con 0x7f4bb00c53e0 2023-07-21T07:35:32.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4baf7fe700 1 --2- 172.21.15.6:0/152118258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b98005c10 0x7f4b98006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:32.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4baeffd700 1 --2- 172.21.15.6:0/152118258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b98006a60 0x7f4b98006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:32.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4baffff700 1 --2- 172.21.15.6:0/152118258 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bb00c53e0 0x7f4b98007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:32.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4baf7fe700 1 -- 172.21.15.6:0/152118258 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bb00c53e0 msgr2=0x7f4b98007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:32.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4baf7fe700 1 --2- 172.21.15.6:0/152118258 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bb00c53e0 0x7f4b98007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4baf7fe700 1 -- 172.21.15.6:0/152118258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b98006a60 msgr2=0x7f4b98006ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4baf7fe700 1 --2- 172.21.15.6:0/152118258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b98006a60 0x7f4b98006ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4baf7fe700 1 -- 172.21.15.6:0/152118258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b980057c0 con 0x7f4b98005c10 2023-07-21T07:35:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4baf7fe700 1 --2- 172.21.15.6:0/152118258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b98005c10 0x7f4b98006030 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c2f0 tx=0x7f4b98007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42674a320cfd5af server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000ce30 con 0x7f4b98005c10 2023-07-21T07:35:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.078+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba0005960 con 0x7f4b98005c10 2023-07-21T07:35:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.079+0000 7f4bae7fc700 1 -- 172.21.15.6:0/152118258 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0005cf0 con 0x7f4b98005c10 2023-07-21T07:35:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.079+0000 7f4bb5d33700 1 -- 172.21.15.6:0/152118258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b98005c10 msgr2=0x7f4b98006030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.079+0000 7f4bb5d33700 1 --2- 172.21.15.6:0/152118258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b98005c10 0x7f4b98006030 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c2f0 tx=0x7f4b98007a90 comp rx=0 tx=0).stop 2023-07-21T07:35:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.079+0000 7f4baffff700 1 -- 172.21.15.6:0/152118258 reap_dead start 2023-07-21T07:35:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.079+0000 7f4bb5d33700 1 -- 172.21.15.6:0/152118258 shutdown_connections 2023-07-21T07:35:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.079+0000 7f4bb5d33700 1 -- 172.21.15.6:0/152118258 >> 172.21.15.6:0/152118258 conn(0x7f4bb00a8c90 msgr2=0x7f4bb006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.079+0000 7f4bb5d33700 1 -- 172.21.15.6:0/152118258 shutdown_connections 2023-07-21T07:35:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.079+0000 7f4bb5d33700 1 -- 172.21.15.6:0/152118258 wait complete. 2023-07-21T07:35:32.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.080+0000 7f4bb5d33700 1 Processor -- start 2023-07-21T07:35:32.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.080+0000 7f4bb5d33700 1 -- start start 2023-07-21T07:35:32.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.081+0000 7f4bb5d33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b98005c10 0x7f4bb014f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.081+0000 7f4bb5d33700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bb00bd0d0 0x7f4bb0148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.081+0000 7f4bb5d33700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bb014a960 0x7f4bb01527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.081+0000 7f4bb5d33700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00726f0 con 0x7f4b98005c10 2023-07-21T07:35:32.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.081+0000 7f4bb5d33700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01546a0 con 0x7f4bb014a960 2023-07-21T07:35:32.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.081+0000 7f4bb5d33700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01ed9d0 con 0x7f4bb00bd0d0 2023-07-21T07:35:32.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.081+0000 7f4baf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b98005c10 0x7f4bb014f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:32.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.081+0000 7f4baf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b98005c10 0x7f4bb014f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34266/0 (socket says 172.21.15.6:34266) 2023-07-21T07:35:32.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.081+0000 7f4baf7fe700 1 -- 172.21.15.6:0/3895976134 learned_addr learned my addr 172.21.15.6:0/3895976134 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:32.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.082+0000 7f4baf7fe700 1 -- 172.21.15.6:0/3895976134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bb00bd0d0 msgr2=0x7f4bb0148740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:32.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.082+0000 7f4baf7fe700 1 --2- 172.21.15.6:0/3895976134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bb00bd0d0 0x7f4bb0148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.082+0000 7f4baf7fe700 1 -- 172.21.15.6:0/3895976134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bb014a960 msgr2=0x7f4bb01527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:32.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.082+0000 7f4baf7fe700 1 --2- 172.21.15.6:0/3895976134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bb014a960 0x7f4bb01527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.082+0000 7f4baf7fe700 1 -- 172.21.15.6:0/3895976134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb01edcb0 con 0x7f4b98005c10 2023-07-21T07:35:32.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.082+0000 7f4baf7fe700 1 --2- 172.21.15.6:0/3895976134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b98005c10 0x7f4bb014f2a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c8e0 tx=0x7f4ba0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:32.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.082+0000 7f4b97fff700 1 -- 172.21.15.6:0/3895976134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000ce60 con 0x7f4b98005c10 2023-07-21T07:35:32.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.082+0000 7f4b97fff700 1 -- 172.21.15.6:0/3895976134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba0004a80 con 0x7f4b98005c10 2023-07-21T07:35:32.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.082+0000 7f4b97fff700 1 -- 172.21.15.6:0/3895976134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0004e30 con 0x7f4b98005c10 2023-07-21T07:35:32.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.082+0000 7f4bb5d33700 1 -- 172.21.15.6:0/3895976134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb0154330 con 0x7f4b98005c10 2023-07-21T07:35:32.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.082+0000 7f4bb5d33700 1 -- 172.21.15.6:0/3895976134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb0152ce0 con 0x7f4b98005c10 2023-07-21T07:35:32.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.083+0000 7f4bb5d33700 1 -- 172.21.15.6:0/3895976134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb0072540 con 0x7f4b98005c10 2023-07-21T07:35:32.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.083+0000 7f4b97fff700 1 -- 172.21.15.6:0/3895976134 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ba0007070 con 0x7f4b98005c10 2023-07-21T07:35:32.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.084+0000 7f4b97fff700 1 --2- 172.21.15.6:0/3895976134 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b9c06ace0 0x7f4b9c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.084+0000 7f4b97fff700 1 -- 172.21.15.6:0/3895976134 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ba008a3f0 con 0x7f4b98005c10 2023-07-21T07:35:32.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.084+0000 7f4baeffd700 1 --2- 172.21.15.6:0/3895976134 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b9c06ace0 0x7f4b9c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:32.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.084+0000 7f4baeffd700 1 --2- 172.21.15.6:0/3895976134 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b9c06ace0 0x7f4b9c06d1a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4006ba0 tx=0x7f4ba4006b30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:32.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.088+0000 7f4b97fff700 1 -- 172.21.15.6:0/3895976134 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4ba0058fc0 con 0x7f4b98005c10 2023-07-21T07:35:32.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.288+0000 7f4bb5d33700 1 -- 172.21.15.6:0/3895976134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bb01ed830 con 0x7f4b98005c10 2023-07-21T07:35:32.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.289+0000 7f4b97fff700 1 -- 172.21.15.6:0/3895976134 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18256 (secure 0 0 0) 0x7f4bb01ed830 con 0x7f4b98005c10 2023-07-21T07:35:32.341 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:32.341 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":35,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:30.954137+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:35:29.385402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T07:35:29.920618+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:32.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.291+0000 7f4bb5d33700 1 -- 172.21.15.6:0/3895976134 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b9c06ace0 msgr2=0x7f4b9c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:32.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.291+0000 7f4bb5d33700 1 --2- 172.21.15.6:0/3895976134 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b9c06ace0 0x7f4b9c06d1a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4006ba0 tx=0x7f4ba4006b30 comp rx=0 tx=0).stop 2023-07-21T07:35:32.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.291+0000 7f4bb5d33700 1 -- 172.21.15.6:0/3895976134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b98005c10 msgr2=0x7f4bb014f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:32.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.291+0000 7f4bb5d33700 1 --2- 172.21.15.6:0/3895976134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b98005c10 0x7f4bb014f2a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c8e0 tx=0x7f4ba0000fe0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.292+0000 7f4bb5d33700 1 -- 172.21.15.6:0/3895976134 shutdown_connections 2023-07-21T07:35:32.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.292+0000 7f4bb5d33700 1 --2- 172.21.15.6:0/3895976134 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b9c06ace0 0x7f4b9c06d1a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.292+0000 7f4bb5d33700 1 --2- 172.21.15.6:0/3895976134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bb014a960 0x7f4bb01527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.292+0000 7f4bb5d33700 1 --2- 172.21.15.6:0/3895976134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b98005c10 0x7f4bb014f2a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.292+0000 7f4bb5d33700 1 --2- 172.21.15.6:0/3895976134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bb00bd0d0 0x7f4bb0148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.292+0000 7f4bb5d33700 1 -- 172.21.15.6:0/3895976134 >> 172.21.15.6:0/3895976134 conn(0x7f4bb00a8c90 msgr2=0x7f4bb014e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:32.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.292+0000 7f4bb5d33700 1 -- 172.21.15.6:0/3895976134 shutdown_connections 2023-07-21T07:35:32.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.292+0000 7f4bb5d33700 1 -- 172.21.15.6:0/3895976134 wait complete. 2023-07-21T07:35:32.356 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T07:35:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.432+0000 7f900968f700 1 Processor -- start 2023-07-21T07:35:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.433+0000 7f900968f700 1 -- start start 2023-07-21T07:35:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.433+0000 7f900968f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90040c6720 0x7f90040c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.433+0000 7f900968f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9004154ee0 0x7f90040c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.433+0000 7f900968f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900406ab50 con 0x7f900414af80 2023-07-21T07:35:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.433+0000 7f900968f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900406bcb0 con 0x7f9004154ee0 2023-07-21T07:35:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.433+0000 7f900968f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90040bd5e0 con 0x7f90040c6720 2023-07-21T07:35:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.434+0000 7f90027fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90040c6720 0x7f90040c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.434+0000 7f90037fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9004154ee0 0x7f90040c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.434+0000 7f9002ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f900414af80 0x7f900406b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:45536/0 (socket says 172.21.15.6:45536) 2023-07-21T07:35:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.434+0000 7f9002ffd700 1 -- 172.21.15.6:0/3371354650 learned_addr learned my addr 172.21.15.6:0/3371354650 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.434+0000 7f9001ffb700 1 -- 172.21.15.6:0/3371354650 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362692647 0 0) 0x7f900406ab50 con 0x7f900414af80 2023-07-21T07:35:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.434+0000 7f90027fc700 1 -- 172.21.15.6:0/3371354650 >> v2:172.21.15.86:3300/0 conn(0x7f9004154ee0 msgr2=0x7f90040c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.434+0000 7f90027fc700 1 --2- 172.21.15.6:0/3371354650 >> v2:172.21.15.86:3300/0 conn(0x7f9004154ee0 0x7f90040c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.434+0000 7f90027fc700 1 -- 172.21.15.6:0/3371354650 >> v1:172.21.15.86:6789/0 conn(0x7f900414af80 legacy=0x7f900406b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.434+0000 7f90027fc700 1 -- 172.21.15.6:0/3371354650 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900414b360 con 0x7f90040c6720 2023-07-21T07:35:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.434+0000 7f90037fe700 1 --2- 172.21.15.6:0/3371354650 >> v2:172.21.15.86:3300/0 conn(0x7f9004154ee0 0x7f90040c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.434+0000 7f90027fc700 1 --2- 172.21.15.6:0/3371354650 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90040c6720 0x7f90040c7dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009840 tx=0x7f8fec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=759027ef401cda91 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.434+0000 7f9001ffb700 1 -- 172.21.15.6:0/3371354650 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec011830 con 0x7f90040c6720 2023-07-21T07:35:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.434+0000 7f9001ffb700 1 -- 172.21.15.6:0/3371354650 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec011990 con 0x7f90040c6720 2023-07-21T07:35:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.435+0000 7f9001ffb700 1 -- 172.21.15.6:0/3371354650 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec011d20 con 0x7f90040c6720 2023-07-21T07:35:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.435+0000 7f900968f700 1 -- 172.21.15.6:0/3371354650 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90040c6720 msgr2=0x7f90040c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.435+0000 7f900968f700 1 --2- 172.21.15.6:0/3371354650 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90040c6720 0x7f90040c7dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009840 tx=0x7f8fec009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.435+0000 7f900968f700 1 -- 172.21.15.6:0/3371354650 shutdown_connections 2023-07-21T07:35:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.435+0000 7f900968f700 1 --2- 172.21.15.6:0/3371354650 >> v2:172.21.15.86:3300/0 conn(0x7f9004154ee0 0x7f90040c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.435+0000 7f900968f700 1 --2- 172.21.15.6:0/3371354650 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90040c6720 0x7f90040c7dd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.435+0000 7f900968f700 1 -- 172.21.15.6:0/3371354650 >> 172.21.15.6:0/3371354650 conn(0x7f90040ab8e0 msgr2=0x7f90040abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.435+0000 7f900968f700 1 -- 172.21.15.6:0/3371354650 shutdown_connections 2023-07-21T07:35:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.435+0000 7f900968f700 1 -- 172.21.15.6:0/3371354650 wait complete. 2023-07-21T07:35:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.436+0000 7f900968f700 1 Processor -- start 2023-07-21T07:35:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.436+0000 7f900968f700 1 -- start start 2023-07-21T07:35:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.437+0000 7f900968f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90040c6720 0x7f90040c3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.437+0000 7f900968f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900414af80 0x7f9004155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.437+0000 7f900968f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9004154ee0 0x7f9004156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.437+0000 7f900968f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9004157cb0 con 0x7f900414af80 2023-07-21T07:35:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.437+0000 7f900968f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9004158060 con 0x7f9004154ee0 2023-07-21T07:35:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.437+0000 7f900968f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90041588a0 con 0x7f90040c6720 2023-07-21T07:35:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.437+0000 7f90027fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900414af80 0x7f9004155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.437+0000 7f90027fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900414af80 0x7f9004155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34282/0 (socket says 172.21.15.6:34282) 2023-07-21T07:35:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.437+0000 7f90027fc700 1 -- 172.21.15.6:0/4227319355 learned_addr learned my addr 172.21.15.6:0/4227319355 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.437+0000 7f9002ffd700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90040c6720 0x7f90040c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.437+0000 7f90037fe700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9004154ee0 0x7f9004156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.438+0000 7f90027fc700 1 -- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90040c6720 msgr2=0x7f90040c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.438+0000 7f90027fc700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90040c6720 0x7f90040c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.438+0000 7f90027fc700 1 -- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9004154ee0 msgr2=0x7f9004156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.438+0000 7f90027fc700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9004154ee0 0x7f9004156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.438+0000 7f90027fc700 1 -- 172.21.15.6:0/4227319355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc009a70 con 0x7f900414af80 2023-07-21T07:35:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.438+0000 7f90027fc700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900414af80 0x7f9004155b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009b90 tx=0x7f8fec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.438+0000 7f8ffb7fe700 1 -- 172.21.15.6:0/4227319355 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0045d0 con 0x7f900414af80 2023-07-21T07:35:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.438+0000 7f8ffb7fe700 1 -- 172.21.15.6:0/4227319355 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec01e070 con 0x7f900414af80 2023-07-21T07:35:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.438+0000 7f900968f700 1 -- 172.21.15.6:0/4227319355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec0094a0 con 0x7f900414af80 2023-07-21T07:35:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.438+0000 7f8ffb7fe700 1 -- 172.21.15.6:0/4227319355 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0038a0 con 0x7f900414af80 2023-07-21T07:35:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.438+0000 7f900968f700 1 -- 172.21.15.6:0/4227319355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90041edb50 con 0x7f900414af80 2023-07-21T07:35:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.439+0000 7f900968f700 1 -- 172.21.15.6:0/4227319355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9004155850 con 0x7f900414af80 2023-07-21T07:35:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.439+0000 7f8ffb7fe700 1 -- 172.21.15.6:0/4227319355 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fec003a00 con 0x7f900414af80 2023-07-21T07:35:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.440+0000 7f8ffb7fe700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8fe406ace0 0x7f8fe406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.440+0000 7f8ffb7fe700 1 -- 172.21.15.6:0/4227319355 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8fec08a2a0 con 0x7f900414af80 2023-07-21T07:35:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.440+0000 7f9002ffd700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8fe406ace0 0x7f8fe406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.441+0000 7f9002ffd700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8fe406ace0 0x7f8fe406d1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4007fd0 tx=0x7f8ff4007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.445+0000 7f8ffb7fe700 1 -- 172.21.15.6:0/4227319355 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9004155850 con 0x7f900414af80 2023-07-21T07:35:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:32.690+0000 7f900968f700 1 -- 172.21.15.6:0/4227319355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9004155850 con 0x7f900414af80 2023-07-21T07:35:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.573+0000 7f8ffb7fe700 1 -- 172.21.15.6:0/4227319355 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9004155850 con 0x7f900414af80 2023-07-21T07:35:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.576+0000 7f900968f700 1 -- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8fe406ace0 msgr2=0x7f8fe406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.576+0000 7f900968f700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8fe406ace0 0x7f8fe406d1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4007fd0 tx=0x7f8ff4007de0 comp rx=0 tx=0).stop 2023-07-21T07:35:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.576+0000 7f900968f700 1 -- 172.21.15.6:0/4227319355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900414af80 msgr2=0x7f9004155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.576+0000 7f900968f700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900414af80 0x7f9004155b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009b90 tx=0x7f8fec004750 comp rx=0 tx=0).stop 2023-07-21T07:35:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.576+0000 7f900968f700 1 -- 172.21.15.6:0/4227319355 shutdown_connections 2023-07-21T07:35:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.576+0000 7f900968f700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8fe406ace0 0x7f8fe406d1a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.576+0000 7f900968f700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9004154ee0 0x7f9004156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.576+0000 7f900968f700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90040c6720 0x7f90040c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.576+0000 7f900968f700 1 --2- 172.21.15.6:0/4227319355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900414af80 0x7f9004155b30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.576+0000 7f900968f700 1 -- 172.21.15.6:0/4227319355 >> 172.21.15.6:0/4227319355 conn(0x7f90040ab8e0 msgr2=0x7f900406b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.576+0000 7f900968f700 1 -- 172.21.15.6:0/4227319355 shutdown_connections 2023-07-21T07:35:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.576+0000 7f900968f700 1 -- 172.21.15.6:0/4227319355 wait complete. 2023-07-21T07:35:33.642 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T07:35:33.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T07:35:33.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.726+0000 7f683aa55700 1 Processor -- start 2023-07-21T07:35:33.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.726+0000 7f683aa55700 1 -- start start 2023-07-21T07:35:33.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.727+0000 7f683aa55700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f68340c5260 0x7f6834151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:33.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.727+0000 7f683aa55700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68341517c0 con 0x7f68340c3f80 2023-07-21T07:35:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.727+0000 7f683aa55700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68340c4e50 con 0x7f68340c1860 2023-07-21T07:35:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.727+0000 7f683aa55700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68341519f0 con 0x7f68340c5260 2023-07-21T07:35:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.727+0000 7f68337fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f68340c5260 0x7f6834151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.727+0000 7f6838ff2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f68340c3f80 0x7f68340c3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42310/0 (socket says 172.21.15.6:42310) 2023-07-21T07:35:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.727+0000 7f6838ff2700 1 -- 172.21.15.6:0/2314357977 learned_addr learned my addr 172.21.15.6:0/2314357977 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.728+0000 7f6832ffd700 1 -- 172.21.15.6:0/2314357977 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666418218 0 0) 0x7f68341517c0 con 0x7f68340c3f80 2023-07-21T07:35:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.728+0000 7f6832ffd700 1 -- 172.21.15.6:0/2314357977 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68200035b0 con 0x7f68340c3f80 2023-07-21T07:35:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.728+0000 7f68337fe700 1 -- 172.21.15.6:0/2314357977 >> v1:172.21.15.86:6789/0 conn(0x7f68340c1860 legacy=0x7f683406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.728+0000 7f68337fe700 1 -- 172.21.15.6:0/2314357977 >> v1:172.21.15.6:6789/0 conn(0x7f68340c3f80 legacy=0x7f68340c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.728+0000 7f68337fe700 1 -- 172.21.15.6:0/2314357977 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6834151cd0 con 0x7f68340c5260 2023-07-21T07:35:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.728+0000 7f68337fe700 1 --2- 172.21.15.6:0/2314357977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68340c5260 0x7f6834151280 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6824009840 tx=0x7f6824009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d804384c9a0ad9ae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.728+0000 7f6832ffd700 1 -- 172.21.15.6:0/2314357977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824011830 con 0x7f68340c5260 2023-07-21T07:35:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.728+0000 7f6832ffd700 1 -- 172.21.15.6:0/2314357977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6824011990 con 0x7f68340c5260 2023-07-21T07:35:33.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.728+0000 7f6832ffd700 1 -- 172.21.15.6:0/2314357977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824011d20 con 0x7f68340c5260 2023-07-21T07:35:33.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.729+0000 7f683aa55700 1 -- 172.21.15.6:0/2314357977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68340c5260 msgr2=0x7f6834151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:33.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.729+0000 7f683aa55700 1 --2- 172.21.15.6:0/2314357977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68340c5260 0x7f6834151280 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6824009840 tx=0x7f6824009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:33.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.729+0000 7f683aa55700 1 -- 172.21.15.6:0/2314357977 shutdown_connections 2023-07-21T07:35:33.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.729+0000 7f683aa55700 1 --2- 172.21.15.6:0/2314357977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68340c5260 0x7f6834151280 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:33.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.729+0000 7f683aa55700 1 -- 172.21.15.6:0/2314357977 >> 172.21.15.6:0/2314357977 conn(0x7f68340a8660 msgr2=0x7f68340a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:33.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.729+0000 7f683aa55700 1 -- 172.21.15.6:0/2314357977 shutdown_connections 2023-07-21T07:35:33.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.729+0000 7f683aa55700 1 -- 172.21.15.6:0/2314357977 wait complete. 2023-07-21T07:35:33.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.730+0000 7f683aa55700 1 Processor -- start 2023-07-21T07:35:33.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.730+0000 7f683aa55700 1 -- start start 2023-07-21T07:35:33.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.731+0000 7f683aa55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68340c1860 0x7f68341e5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:33.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.731+0000 7f683aa55700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68340c3f80 0x7f68340c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.731+0000 7f683aa55700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68340c5260 0x7f683414f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.731+0000 7f683aa55700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6834150d80 con 0x7f68340c1860 2023-07-21T07:35:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.731+0000 7f683aa55700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6834151060 con 0x7f68340c3f80 2023-07-21T07:35:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.731+0000 7f683aa55700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6834151340 con 0x7f68340c5260 2023-07-21T07:35:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.731+0000 7f6833fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68340c1860 0x7f68341e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.731+0000 7f6833fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68340c1860 0x7f68341e5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34294/0 (socket says 172.21.15.6:34294) 2023-07-21T07:35:33.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.731+0000 7f6833fff700 1 -- 172.21.15.6:0/3476592062 learned_addr learned my addr 172.21.15.6:0/3476592062 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:33.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f68337fe700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68340c3f80 0x7f68340c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:33.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f6838ff2700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68340c5260 0x7f683414f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:33.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f6833fff700 1 -- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68340c5260 msgr2=0x7f683414f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:33.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f6833fff700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68340c5260 0x7f683414f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:33.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f6833fff700 1 -- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68340c3f80 msgr2=0x7f68340c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:33.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f6833fff700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68340c3f80 0x7f68340c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:33.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f6833fff700 1 -- 172.21.15.6:0/3476592062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68240094a0 con 0x7f68340c1860 2023-07-21T07:35:33.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f6838ff2700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68340c5260 0x7f683414f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:33.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f6833fff700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68340c1860 0x7f68341e5630 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c4d0 tx=0x7f681c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:33.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f6830ff9700 1 -- 172.21.15.6:0/3476592062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c0052d0 con 0x7f68340c1860 2023-07-21T07:35:33.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f6830ff9700 1 -- 172.21.15.6:0/3476592062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c005430 con 0x7f68340c1860 2023-07-21T07:35:33.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f683aa55700 1 -- 172.21.15.6:0/3476592062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6834151620 con 0x7f68340c1860 2023-07-21T07:35:33.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f6830ff9700 1 -- 172.21.15.6:0/3476592062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c003880 con 0x7f68340c1860 2023-07-21T07:35:33.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.732+0000 7f683aa55700 1 -- 172.21.15.6:0/3476592062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68340c7410 con 0x7f68340c1860 2023-07-21T07:35:33.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.733+0000 7f683aa55700 1 -- 172.21.15.6:0/3476592062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683414f330 con 0x7f68340c1860 2023-07-21T07:35:33.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.734+0000 7f6830ff9700 1 -- 172.21.15.6:0/3476592062 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f681c0039e0 con 0x7f68340c1860 2023-07-21T07:35:33.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.734+0000 7f6830ff9700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f681406ace0 0x7f681406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:33.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.734+0000 7f6830ff9700 1 -- 172.21.15.6:0/3476592062 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f681c0886f0 con 0x7f68340c1860 2023-07-21T07:35:33.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.734+0000 7f68337fe700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f681406ace0 0x7f681406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:33.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.735+0000 7f68337fe700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f681406ace0 0x7f681406d1a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f68240090b0 tx=0x7f6824008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:33.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.738+0000 7f6830ff9700 1 -- 172.21.15.6:0/3476592062 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f683414f330 con 0x7f68340c1860 2023-07-21T07:35:34.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:33.984+0000 7f683aa55700 1 -- 172.21.15.6:0/3476592062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6834074500 con 0x7f68340c1860 2023-07-21T07:35:34.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.574+0000 7f6830ff9700 1 -- 172.21.15.6:0/3476592062 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f681c0538e0 con 0x7f68340c1860 2023-07-21T07:35:34.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.577+0000 7f683aa55700 1 -- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f681406ace0 msgr2=0x7f681406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:34.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.577+0000 7f683aa55700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f681406ace0 0x7f681406d1a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f68240090b0 tx=0x7f6824008030 comp rx=0 tx=0).stop 2023-07-21T07:35:34.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.577+0000 7f683aa55700 1 -- 172.21.15.6:0/3476592062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68340c1860 msgr2=0x7f68341e5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:34.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.577+0000 7f683aa55700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68340c1860 0x7f68341e5630 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c4d0 tx=0x7f681c00c7e0 comp rx=0 tx=0).stop 2023-07-21T07:35:34.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.577+0000 7f683aa55700 1 -- 172.21.15.6:0/3476592062 shutdown_connections 2023-07-21T07:35:34.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.577+0000 7f683aa55700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f681406ace0 0x7f681406d1a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:34.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.577+0000 7f683aa55700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68340c5260 0x7f683414f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:34.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.577+0000 7f683aa55700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68340c1860 0x7f68341e5630 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:34.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.577+0000 7f683aa55700 1 --2- 172.21.15.6:0/3476592062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68340c3f80 0x7f68340c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:34.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.577+0000 7f683aa55700 1 -- 172.21.15.6:0/3476592062 >> 172.21.15.6:0/3476592062 conn(0x7f68340a8660 msgr2=0x7f68341489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:34.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.577+0000 7f683aa55700 1 -- 172.21.15.6:0/3476592062 shutdown_connections 2023-07-21T07:35:34.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.578+0000 7f683aa55700 1 -- 172.21.15.6:0/3476592062 wait complete. 2023-07-21T07:35:34.644 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T07:35:34.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:35:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.726+0000 7f77ce1f0700 1 Processor -- start 2023-07-21T07:35:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.726+0000 7f77ce1f0700 1 -- start start 2023-07-21T07:35:34.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.726+0000 7f77ce1f0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f77c806e830 0x7f77c81587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:34.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.726+0000 7f77ce1f0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c80c53a0 con 0x7f77c80c8010 2023-07-21T07:35:34.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.726+0000 7f77ce1f0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c80c40d0 con 0x7f77c806f1b0 2023-07-21T07:35:34.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.726+0000 7f77ce1f0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c8157cd0 con 0x7f77c806e830 2023-07-21T07:35:34.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.727+0000 7f77c77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f77c80c8010 0x7f77c81545b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42322/0 (socket says 172.21.15.6:42322) 2023-07-21T07:35:34.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.727+0000 7f77c77fe700 1 -- 172.21.15.6:0/2731636705 learned_addr learned my addr 172.21.15.6:0/2731636705 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:34.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.727+0000 7f77c7fff700 1 --2- 172.21.15.6:0/2731636705 >> v2:172.21.15.86:3300/0 conn(0x7f77c806e830 0x7f77c81587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:34.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.727+0000 7f77c67fc700 1 -- 172.21.15.6:0/2731636705 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244551199 0 0) 0x7f77c80c53a0 con 0x7f77c80c8010 2023-07-21T07:35:34.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.727+0000 7f77c67fc700 1 -- 172.21.15.6:0/2731636705 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77b00035b0 con 0x7f77c80c8010 2023-07-21T07:35:34.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.727+0000 7f77c67fc700 1 -- 172.21.15.6:0/2731636705 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662322839 0 0) 0x7f77c80c40d0 con 0x7f77c806f1b0 2023-07-21T07:35:34.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.727+0000 7f77c67fc700 1 -- 172.21.15.6:0/2731636705 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77c80c53a0 con 0x7f77c806f1b0 2023-07-21T07:35:34.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.727+0000 7f77c7fff700 1 -- 172.21.15.6:0/2731636705 >> v1:172.21.15.86:6789/0 conn(0x7f77c806f1b0 legacy=0x7f77c81519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:34.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.727+0000 7f77c7fff700 1 -- 172.21.15.6:0/2731636705 >> v1:172.21.15.6:6789/0 conn(0x7f77c80c8010 legacy=0x7f77c81545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:34.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.727+0000 7f77c67fc700 1 -- 172.21.15.6:0/2731636705 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3301116392 0 0) 0x7f77b00035b0 con 0x7f77c80c8010 2023-07-21T07:35:34.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.727+0000 7f77c7fff700 1 -- 172.21.15.6:0/2731636705 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c8157fb0 con 0x7f77c806e830 2023-07-21T07:35:34.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.727+0000 7f77c7fff700 1 --2- 172.21.15.6:0/2731636705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77c806e830 0x7f77c81587b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f77c806ece0 tx=0x7f77c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bf6df9bc9ca89f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:34.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.727+0000 7f77c67fc700 1 -- 172.21.15.6:0/2731636705 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000e070 con 0x7f77c806e830 2023-07-21T07:35:34.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.728+0000 7f77c67fc700 1 -- 172.21.15.6:0/2731636705 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c0003a20 con 0x7f77c806e830 2023-07-21T07:35:34.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.728+0000 7f77c67fc700 1 -- 172.21.15.6:0/2731636705 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8001670 con 0x7f77c806e830 2023-07-21T07:35:34.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.728+0000 7f77ce1f0700 1 -- 172.21.15.6:0/2731636705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77c806e830 msgr2=0x7f77c81587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:34.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.728+0000 7f77ce1f0700 1 --2- 172.21.15.6:0/2731636705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77c806e830 0x7f77c81587b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f77c806ece0 tx=0x7f77c000b330 comp rx=0 tx=0).stop 2023-07-21T07:35:34.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.728+0000 7f77ce1f0700 1 -- 172.21.15.6:0/2731636705 shutdown_connections 2023-07-21T07:35:34.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.728+0000 7f77ce1f0700 1 --2- 172.21.15.6:0/2731636705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77c806e830 0x7f77c81587b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:34.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.728+0000 7f77ce1f0700 1 -- 172.21.15.6:0/2731636705 >> 172.21.15.6:0/2731636705 conn(0x7f77c806a480 msgr2=0x7f77c806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:34.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.728+0000 7f77ce1f0700 1 -- 172.21.15.6:0/2731636705 shutdown_connections 2023-07-21T07:35:34.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.728+0000 7f77ce1f0700 1 -- 172.21.15.6:0/2731636705 wait complete. 2023-07-21T07:35:34.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.729+0000 7f77ce1f0700 1 Processor -- start 2023-07-21T07:35:34.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.729+0000 7f77ce1f0700 1 -- start start 2023-07-21T07:35:34.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.730+0000 7f77ce1f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c806e830 0x7f77c8150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:34.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.730+0000 7f77ce1f0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77c806f1b0 0x7f77c80aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:34.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.730+0000 7f77ce1f0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f77c80c8010 0x7f77c80bdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:34.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.730+0000 7f77ce1f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c8152fd0 con 0x7f77c806e830 2023-07-21T07:35:34.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.730+0000 7f77ce1f0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80ac9c0 con 0x7f77c806f1b0 2023-07-21T07:35:34.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.730+0000 7f77ce1f0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c81544e0 con 0x7f77c80c8010 2023-07-21T07:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.730+0000 7f77c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c806e830 0x7f77c8150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.730+0000 7f77c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c806e830 0x7f77c8150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34308/0 (socket says 172.21.15.6:34308) 2023-07-21T07:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.730+0000 7f77c77fe700 1 -- 172.21.15.6:0/193473863 learned_addr learned my addr 172.21.15.6:0/193473863 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.730+0000 7f77c77fe700 1 -- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f77c80c8010 msgr2=0x7f77c80bdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.730+0000 7f77c6ffd700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77c806f1b0 0x7f77c80aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.730+0000 7f77c7fff700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f77c80c8010 0x7f77c80bdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.731+0000 7f77c77fe700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f77c80c8010 0x7f77c80bdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.731+0000 7f77c77fe700 1 -- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77c806f1b0 msgr2=0x7f77c80aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.731+0000 7f77c77fe700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77c806f1b0 0x7f77c80aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.731+0000 7f77c77fe700 1 -- 172.21.15.6:0/193473863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0009a70 con 0x7f77c806e830 2023-07-21T07:35:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.731+0000 7f77c7fff700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f77c80c8010 0x7f77c80bdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.731+0000 7f77c6ffd700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77c806f1b0 0x7f77c80aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.731+0000 7f77c77fe700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c806e830 0x7f77c8150f50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f77b800c6d0 tx=0x7f77b800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.731+0000 7f77affff700 1 -- 172.21.15.6:0/193473863 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8004c80 con 0x7f77c806e830 2023-07-21T07:35:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.731+0000 7f77affff700 1 -- 172.21.15.6:0/193473863 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b8004de0 con 0x7f77c806e830 2023-07-21T07:35:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.731+0000 7f77ce1f0700 1 -- 172.21.15.6:0/193473863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c8150d00 con 0x7f77c806e830 2023-07-21T07:35:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.731+0000 7f77affff700 1 -- 172.21.15.6:0/193473863 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8007310 con 0x7f77c806e830 2023-07-21T07:35:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.731+0000 7f77ce1f0700 1 -- 172.21.15.6:0/193473863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c8150a20 con 0x7f77c806e830 2023-07-21T07:35:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.732+0000 7f77ce1f0700 1 -- 172.21.15.6:0/193473863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c8074500 con 0x7f77c806e830 2023-07-21T07:35:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.732+0000 7f77affff700 1 -- 172.21.15.6:0/193473863 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f77b8007470 con 0x7f77c806e830 2023-07-21T07:35:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.733+0000 7f77affff700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f77b406ace0 0x7f77b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.733+0000 7f77affff700 1 -- 172.21.15.6:0/193473863 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f77b80891a0 con 0x7f77c806e830 2023-07-21T07:35:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.733+0000 7f77c6ffd700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f77b406ace0 0x7f77b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.734+0000 7f77c6ffd700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f77b406ace0 0x7f77b406d1a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77c80c3f90 tx=0x7f77bc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.737+0000 7f77affff700 1 -- 172.21.15.6:0/193473863 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f77b80542e0 con 0x7f77c806e830 2023-07-21T07:35:35.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.986+0000 7f77ce1f0700 1 -- 172.21.15.6:0/193473863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77c80a9230 con 0x7f77c806e830 2023-07-21T07:35:35.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.986+0000 7f77affff700 1 -- 172.21.15.6:0/193473863 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4659 (secure 0 0 0) 0x7f77b8057900 con 0x7f77c806e830 2023-07-21T07:35:35.038 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:35.038 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1808819585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1808819585},{"type":"v1","addr":"172.21.15.6:6834","nonce":1808819585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/422116109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":422116109},{"type":"v1","addr":"172.21.15.86:6836","nonce":422116109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5067,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3328348149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3328348149},{"type":"v1","addr":"172.21.15.86:6837","nonce":3328348149}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:30.954456+0000","modified":"2023-07-21T07:35:34.571830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/459917011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":459917011},{"type":"v1","addr":"172.21.15.6:6835","nonce":459917011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T07:35:35.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.988+0000 7f77ce1f0700 1 -- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f77b406ace0 msgr2=0x7f77b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.988+0000 7f77ce1f0700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f77b406ace0 0x7f77b406d1a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77c80c3f90 tx=0x7f77bc009040 comp rx=0 tx=0).stop 2023-07-21T07:35:35.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.988+0000 7f77ce1f0700 1 -- 172.21.15.6:0/193473863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c806e830 msgr2=0x7f77c8150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.988+0000 7f77ce1f0700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c806e830 0x7f77c8150f50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f77b800c6d0 tx=0x7f77b800ca90 comp rx=0 tx=0).stop 2023-07-21T07:35:35.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.989+0000 7f77ce1f0700 1 -- 172.21.15.6:0/193473863 shutdown_connections 2023-07-21T07:35:35.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.989+0000 7f77ce1f0700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f77b406ace0 0x7f77b406d1a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.989+0000 7f77ce1f0700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f77c80c8010 0x7f77c80bdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.989+0000 7f77ce1f0700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c806e830 0x7f77c8150f50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.989+0000 7f77ce1f0700 1 --2- 172.21.15.6:0/193473863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77c806f1b0 0x7f77c80aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.989+0000 7f77ce1f0700 1 -- 172.21.15.6:0/193473863 >> 172.21.15.6:0/193473863 conn(0x7f77c806a480 msgr2=0x7f77c8151bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:35.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.989+0000 7f77ce1f0700 1 -- 172.21.15.6:0/193473863 shutdown_connections 2023-07-21T07:35:35.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:34.989+0000 7f77ce1f0700 1 -- 172.21.15.6:0/193473863 wait complete. 2023-07-21T07:35:35.043 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-07-21T07:35:35.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:35.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.126+0000 7fdd94374700 1 Processor -- start 2023-07-21T07:35:35.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.126+0000 7fdd94374700 1 -- start start 2023-07-21T07:35:35.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.127+0000 7fdd94374700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdd8c1542e0 0x7fdd8c0c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.127+0000 7fdd94374700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd8c14e490 0x7fdd8c070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.127+0000 7fdd94374700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c0c1b20 con 0x7fdd8c1546c0 2023-07-21T07:35:35.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.127+0000 7fdd94374700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c070d50 con 0x7fdd8c14e490 2023-07-21T07:35:35.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.127+0000 7fdd94374700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c154b90 con 0x7fdd8c1542e0 2023-07-21T07:35:35.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.127+0000 7fdd92911700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd8c14e490 0x7fdd8c070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.127+0000 7fdd92911700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd8c14e490 0x7fdd8c070810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34320/0 (socket says 172.21.15.6:34320) 2023-07-21T07:35:35.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.127+0000 7fdd9190f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdd8c1546c0 0x7fdd8c14dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42338/0 (socket says 172.21.15.6:42338) 2023-07-21T07:35:35.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.127+0000 7fdd92911700 1 -- 172.21.15.6:0/1785681858 learned_addr learned my addr 172.21.15.6:0/1785681858 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:35.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.127+0000 7fdd92110700 1 --2- 172.21.15.6:0/1785681858 >> v2:172.21.15.86:3300/0 conn(0x7fdd8c1542e0 0x7fdd8c0c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.128+0000 7fdd92911700 1 -- 172.21.15.6:0/1785681858 >> v2:172.21.15.86:3300/0 conn(0x7fdd8c1542e0 msgr2=0x7fdd8c0c25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:35.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.128+0000 7fdd92911700 1 --2- 172.21.15.6:0/1785681858 >> v2:172.21.15.86:3300/0 conn(0x7fdd8c1542e0 0x7fdd8c0c25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.128+0000 7fdd92911700 1 -- 172.21.15.6:0/1785681858 >> v1:172.21.15.6:6789/0 conn(0x7fdd8c1546c0 legacy=0x7fdd8c14dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.128+0000 7fdd92911700 1 -- 172.21.15.6:0/1785681858 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c154e70 con 0x7fdd8c14e490 2023-07-21T07:35:35.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.128+0000 7fdd9110e700 1 -- 172.21.15.6:0/1785681858 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536745524 0 0) 0x7fdd8c0c1b20 con 0x7fdd8c1546c0 2023-07-21T07:35:35.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.128+0000 7fdd92911700 1 --2- 172.21.15.6:0/1785681858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd8c14e490 0x7fdd8c070810 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0c2b20 tx=0x7fdd8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd31cda1ccdfc22 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:35.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.128+0000 7fdd9110e700 1 -- 172.21.15.6:0/1785681858 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400b910 con 0x7fdd8c14e490 2023-07-21T07:35:35.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.128+0000 7fdd9110e700 1 -- 172.21.15.6:0/1785681858 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8400ba70 con 0x7fdd8c14e490 2023-07-21T07:35:35.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.128+0000 7fdd9110e700 1 -- 172.21.15.6:0/1785681858 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400be20 con 0x7fdd8c14e490 2023-07-21T07:35:35.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.128+0000 7fdd94374700 1 -- 172.21.15.6:0/1785681858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd8c14e490 msgr2=0x7fdd8c070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.128+0000 7fdd94374700 1 --2- 172.21.15.6:0/1785681858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd8c14e490 0x7fdd8c070810 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0c2b20 tx=0x7fdd8400b330 comp rx=0 tx=0).stop 2023-07-21T07:35:35.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.129+0000 7fdd94374700 1 -- 172.21.15.6:0/1785681858 shutdown_connections 2023-07-21T07:35:35.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.129+0000 7fdd94374700 1 --2- 172.21.15.6:0/1785681858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd8c14e490 0x7fdd8c070810 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.129+0000 7fdd94374700 1 --2- 172.21.15.6:0/1785681858 >> v2:172.21.15.86:3300/0 conn(0x7fdd8c1542e0 0x7fdd8c0c25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.129+0000 7fdd94374700 1 -- 172.21.15.6:0/1785681858 >> 172.21.15.6:0/1785681858 conn(0x7fdd8c0c6140 msgr2=0x7fdd8c0c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:35.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.129+0000 7fdd94374700 1 -- 172.21.15.6:0/1785681858 shutdown_connections 2023-07-21T07:35:35.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.129+0000 7fdd94374700 1 -- 172.21.15.6:0/1785681858 wait complete. 2023-07-21T07:35:35.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.130+0000 7fdd94374700 1 Processor -- start 2023-07-21T07:35:35.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.130+0000 7fdd94374700 1 -- start start 2023-07-21T07:35:35.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.130+0000 7fdd94374700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd8c14e490 0x7fdd8c146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.130+0000 7fdd94374700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd8c1542e0 0x7fdd8c1de310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.130+0000 7fdd94374700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd8c1546c0 0x7fdd8c1eb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.130+0000 7fdd94374700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1dd750 con 0x7fdd8c1542e0 2023-07-21T07:35:35.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.130+0000 7fdd94374700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c146d90 con 0x7fdd8c1546c0 2023-07-21T07:35:35.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.130+0000 7fdd94374700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c147050 con 0x7fdd8c14e490 2023-07-21T07:35:35.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd9190f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd8c1542e0 0x7fdd8c1de310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd9190f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd8c1542e0 0x7fdd8c1de310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34324/0 (socket says 172.21.15.6:34324) 2023-07-21T07:35:35.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd9190f700 1 -- 172.21.15.6:0/826995106 learned_addr learned my addr 172.21.15.6:0/826995106 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:35.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd92911700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd8c1546c0 0x7fdd8c1eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd92110700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd8c14e490 0x7fdd8c146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd9190f700 1 -- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd8c14e490 msgr2=0x7fdd8c146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd9190f700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd8c14e490 0x7fdd8c146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd9190f700 1 -- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd8c1546c0 msgr2=0x7fdd8c1eb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd9190f700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd8c1546c0 0x7fdd8c1eb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd9190f700 1 -- 172.21.15.6:0/826995106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84009b30 con 0x7fdd8c1542e0 2023-07-21T07:35:35.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd9190f700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd8c1542e0 0x7fdd8c1de310 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800c520 tx=0x7fdd8800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:35.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd82ffd700 1 -- 172.21.15.6:0/826995106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd88004c80 con 0x7fdd8c1542e0 2023-07-21T07:35:35.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd82ffd700 1 -- 172.21.15.6:0/826995106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd88004de0 con 0x7fdd8c1542e0 2023-07-21T07:35:35.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd94374700 1 -- 172.21.15.6:0/826995106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c1dda50 con 0x7fdd8c1542e0 2023-07-21T07:35:35.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd82ffd700 1 -- 172.21.15.6:0/826995106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd880072d0 con 0x7fdd8c1542e0 2023-07-21T07:35:35.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.131+0000 7fdd94374700 1 -- 172.21.15.6:0/826995106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c0c0520 con 0x7fdd8c1542e0 2023-07-21T07:35:35.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.132+0000 7fdd94374700 1 -- 172.21.15.6:0/826995106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c074500 con 0x7fdd8c1542e0 2023-07-21T07:35:35.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.133+0000 7fdd82ffd700 1 -- 172.21.15.6:0/826995106 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd88007430 con 0x7fdd8c1542e0 2023-07-21T07:35:35.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.133+0000 7fdd82ffd700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdd7006ace0 0x7fdd7006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.133+0000 7fdd82ffd700 1 -- 172.21.15.6:0/826995106 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd88088fc0 con 0x7fdd8c1542e0 2023-07-21T07:35:35.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.133+0000 7fdd92110700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdd7006ace0 0x7fdd7006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.134+0000 7fdd92110700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdd7006ace0 0x7fdd7006d1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009be0 tx=0x7fdd7c009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:35.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.137+0000 7fdd82ffd700 1 -- 172.21.15.6:0/826995106 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd880bb310 con 0x7fdd8c1542e0 2023-07-21T07:35:35.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.336+0000 7fdd94374700 1 -- 172.21.15.6:0/826995106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd8c0ac1b0 con 0x7fdd8c1542e0 2023-07-21T07:35:35.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.337+0000 7fdd82ffd700 1 -- 172.21.15.6:0/826995106 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18243 (secure 0 0 0) 0x7fdd88054100 con 0x7fdd8c1542e0 2023-07-21T07:35:35.389 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:35.390 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":36,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:32.560845+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:35:29.385402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T07:35:29.920618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.339+0000 7fdd94374700 1 -- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdd7006ace0 msgr2=0x7fdd7006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.339+0000 7fdd94374700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdd7006ace0 0x7fdd7006d1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009be0 tx=0x7fdd7c009210 comp rx=0 tx=0).stop 2023-07-21T07:35:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.339+0000 7fdd94374700 1 -- 172.21.15.6:0/826995106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd8c1542e0 msgr2=0x7fdd8c1de310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.339+0000 7fdd94374700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd8c1542e0 0x7fdd8c1de310 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800c520 tx=0x7fdd8800c830 comp rx=0 tx=0).stop 2023-07-21T07:35:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.339+0000 7fdd94374700 1 -- 172.21.15.6:0/826995106 shutdown_connections 2023-07-21T07:35:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.339+0000 7fdd94374700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fdd7006ace0 0x7fdd7006d1a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.339+0000 7fdd94374700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd8c1546c0 0x7fdd8c1eb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.339+0000 7fdd94374700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd8c14e490 0x7fdd8c146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.339+0000 7fdd94374700 1 --2- 172.21.15.6:0/826995106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd8c1542e0 0x7fdd8c1de310 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.339+0000 7fdd94374700 1 -- 172.21.15.6:0/826995106 >> 172.21.15.6:0/826995106 conn(0x7fdd8c0c6140 msgr2=0x7fdd8c150c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:35.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.339+0000 7fdd94374700 1 -- 172.21.15.6:0/826995106 shutdown_connections 2023-07-21T07:35:35.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.339+0000 7fdd94374700 1 -- 172.21.15.6:0/826995106 wait complete. 2023-07-21T07:35:35.403 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T07:35:35.403 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:35:35.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.477+0000 7f8964391700 1 Processor -- start 2023-07-21T07:35:35.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.477+0000 7f8964391700 1 -- start start 2023-07-21T07:35:35.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.478+0000 7f8964391700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f895c06a300 0x7f895c06da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.478+0000 7f8964391700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f895c151e20 0x7f895c0c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.478+0000 7f8964391700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c0c2ab0 con 0x7f895c155050 2023-07-21T07:35:35.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.478+0000 7f8964391700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895c06e000 con 0x7f895c06a300 2023-07-21T07:35:35.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.478+0000 7f8964391700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c06e2e0 con 0x7f895c151e20 2023-07-21T07:35:35.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.478+0000 7f896212d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f895c06a300 0x7f895c06da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.478+0000 7f896192c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f895c155050 0x7f895c151710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42350/0 (socket says 172.21.15.6:42350) 2023-07-21T07:35:35.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.478+0000 7f896192c700 1 -- 172.21.15.6:0/3996104331 learned_addr learned my addr 172.21.15.6:0/3996104331 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:35.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.478+0000 7f896292e700 1 --2- 172.21.15.6:0/3996104331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f895c151e20 0x7f895c0c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.478+0000 7f896212d700 1 -- 172.21.15.6:0/3996104331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f895c151e20 msgr2=0x7f895c0c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:35.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.478+0000 7f896212d700 1 --2- 172.21.15.6:0/3996104331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f895c151e20 0x7f895c0c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.478+0000 7f896212d700 1 -- 172.21.15.6:0/3996104331 >> v1:172.21.15.6:6789/0 conn(0x7f895c155050 legacy=0x7f895c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.478+0000 7f896212d700 1 -- 172.21.15.6:0/3996104331 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c06e5c0 con 0x7f895c06a300 2023-07-21T07:35:35.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.479+0000 7f896212d700 1 --2- 172.21.15.6:0/3996104331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c06a300 0x7f895c06da20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f894c009870 tx=0x7f894c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830fcb8af7bb4929 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:35.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.479+0000 7f896112b700 1 -- 172.21.15.6:0/3996104331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c011830 con 0x7f895c06a300 2023-07-21T07:35:35.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.479+0000 7f896112b700 1 -- 172.21.15.6:0/3996104331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c011990 con 0x7f895c06a300 2023-07-21T07:35:35.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.479+0000 7f896112b700 1 -- 172.21.15.6:0/3996104331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c011d20 con 0x7f895c06a300 2023-07-21T07:35:35.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.479+0000 7f8964391700 1 -- 172.21.15.6:0/3996104331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c06a300 msgr2=0x7f895c06da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.479+0000 7f8964391700 1 --2- 172.21.15.6:0/3996104331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c06a300 0x7f895c06da20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f894c009870 tx=0x7f894c009b80 comp rx=0 tx=0).stop 2023-07-21T07:35:35.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.479+0000 7f8964391700 1 -- 172.21.15.6:0/3996104331 shutdown_connections 2023-07-21T07:35:35.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.479+0000 7f8964391700 1 --2- 172.21.15.6:0/3996104331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f895c151e20 0x7f895c0c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.479+0000 7f8964391700 1 --2- 172.21.15.6:0/3996104331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c06a300 0x7f895c06da20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.479+0000 7f8964391700 1 -- 172.21.15.6:0/3996104331 >> 172.21.15.6:0/3996104331 conn(0x7f895c0a8c90 msgr2=0x7f895c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:35.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.479+0000 7f8964391700 1 -- 172.21.15.6:0/3996104331 shutdown_connections 2023-07-21T07:35:35.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.479+0000 7f8964391700 1 -- 172.21.15.6:0/3996104331 wait complete. 2023-07-21T07:35:35.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.481+0000 7f8964391700 1 Processor -- start 2023-07-21T07:35:35.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.481+0000 7f8964391700 1 -- start start 2023-07-21T07:35:35.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.481+0000 7f8964391700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f895c06a300 0x7f895c155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.481+0000 7f8964391700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f895c155050 0x7f895c0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.481+0000 7f8964391700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c14ca40 0x7f895c0b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.481+0000 7f8964391700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c156610 con 0x7f895c14ca40 2023-07-21T07:35:35.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.481+0000 7f8964391700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c158a10 con 0x7f895c06a300 2023-07-21T07:35:35.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.481+0000 7f8964391700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c14cef0 con 0x7f895c155050 2023-07-21T07:35:35.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.481+0000 7f896292e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c14ca40 0x7f895c0b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.481+0000 7f896292e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c14ca40 0x7f895c0b8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34340/0 (socket says 172.21.15.6:34340) 2023-07-21T07:35:35.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.481+0000 7f896292e700 1 -- 172.21.15.6:0/1133444922 learned_addr learned my addr 172.21.15.6:0/1133444922 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:35.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f896212d700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f895c06a300 0x7f895c155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f896192c700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f895c155050 0x7f895c0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f896292e700 1 -- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f895c155050 msgr2=0x7f895c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f896292e700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f895c155050 0x7f895c0c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f896292e700 1 -- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f895c06a300 msgr2=0x7f895c155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f896292e700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f895c06a300 0x7f895c155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f896292e700 1 -- 172.21.15.6:0/1133444922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c0094a0 con 0x7f895c14ca40 2023-07-21T07:35:35.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f896212d700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f895c06a300 0x7f895c155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:35.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f896292e700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c14ca40 0x7f895c0b8e20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f895400efc0 tx=0x7f895400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:35.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f8952ffd700 1 -- 172.21.15.6:0/1133444922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895400cd40 con 0x7f895c14ca40 2023-07-21T07:35:35.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f8952ffd700 1 -- 172.21.15.6:0/1133444922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895400f040 con 0x7f895c14ca40 2023-07-21T07:35:35.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f8964391700 1 -- 172.21.15.6:0/1133444922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895c14c760 con 0x7f895c14ca40 2023-07-21T07:35:35.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f8952ffd700 1 -- 172.21.15.6:0/1133444922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89540146c0 con 0x7f895c14ca40 2023-07-21T07:35:35.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.482+0000 7f8964391700 1 -- 172.21.15.6:0/1133444922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895c06da70 con 0x7f895c14ca40 2023-07-21T07:35:35.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.483+0000 7f8964391700 1 -- 172.21.15.6:0/1133444922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895c074500 con 0x7f895c14ca40 2023-07-21T07:35:35.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.483+0000 7f8952ffd700 1 -- 172.21.15.6:0/1133444922 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8954014820 con 0x7f895c14ca40 2023-07-21T07:35:35.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.484+0000 7f8952ffd700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f894006ace0 0x7f894006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.484+0000 7f8952ffd700 1 -- 172.21.15.6:0/1133444922 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f895408a100 con 0x7f895c14ca40 2023-07-21T07:35:35.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.484+0000 7f896212d700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f894006ace0 0x7f894006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.485+0000 7f896212d700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f894006ace0 0x7f894006d1a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f894c0090b0 tx=0x7f894c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:35.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.488+0000 7f8952ffd700 1 -- 172.21.15.6:0/1133444922 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8954058cd0 con 0x7f895c14ca40 2023-07-21T07:35:35.566 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-07-21T07:35:35.515+0000 7f32dbf33700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T07:35:35.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.685+0000 7f8964391700 1 -- 172.21.15.6:0/1133444922 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f895c0c26b0 con 0x7f894006ace0 2023-07-21T07:35:35.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.695+0000 7f8952ffd700 1 -- 172.21.15.6:0/1133444922 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311167 (secure 0 0 0) 0x7f894c011c00 con 0x7f894006ace0 2023-07-21T07:35:35.749 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:35.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.698+0000 7f8964391700 1 -- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f894006ace0 msgr2=0x7f894006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.698+0000 7f8964391700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f894006ace0 0x7f894006d1a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f894c0090b0 tx=0x7f894c008030 comp rx=0 tx=0).stop 2023-07-21T07:35:35.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.698+0000 7f8964391700 1 -- 172.21.15.6:0/1133444922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c14ca40 msgr2=0x7f895c0b8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.698+0000 7f8964391700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c14ca40 0x7f895c0b8e20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f895400efc0 tx=0x7f895400c3a0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.698+0000 7f8964391700 1 -- 172.21.15.6:0/1133444922 shutdown_connections 2023-07-21T07:35:35.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.698+0000 7f8964391700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f894006ace0 0x7f894006d1a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.698+0000 7f8964391700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895c14ca40 0x7f895c0b8e20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.698+0000 7f8964391700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f895c06a300 0x7f895c155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.698+0000 7f8964391700 1 --2- 172.21.15.6:0/1133444922 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f895c155050 0x7f895c0c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.698+0000 7f8964391700 1 -- 172.21.15.6:0/1133444922 >> 172.21.15.6:0/1133444922 conn(0x7f895c0a8c90 msgr2=0x7f895c06b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:35.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.698+0000 7f8964391700 1 -- 172.21.15.6:0/1133444922 shutdown_connections 2023-07-21T07:35:35.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.698+0000 7f8964391700 1 -- 172.21.15.6:0/1133444922 wait complete. 2023-07-21T07:35:35.753 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:35:35.762 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-07-21T07:35:34.705078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220504,"kb_used_data":4328,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754216,"statfs":{"total":773094113280,"available":772868317184,"internally_reserved":0,"allocated":4431872,"data_stored":2476100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.176825"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569529+0000","last_change":"2023-07-21T07:35:31.572060+0000","last_active":"2023-07-21T07:35:32.569529+0000","last_peered":"2023-07-21T07:35:32.569529+0000","last_clean":"2023-07-21T07:35:32.569529+0000","last_became_active":"2023-07-21T07:35:31.571747+0000","last_became_peered":"2023-07-21T07:35:31.571747+0000","last_unstale":"2023-07-21T07:35:32.569529+0000","last_undegraded":"2023-07-21T07:35:32.569529+0000","last_fullsized":"2023-07-21T07:35:32.569529+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:02:56.930040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569080+0000","last_change":"2023-07-21T07:35:31.567420+0000","last_active":"2023-07-21T07:35:32.569080+0000","last_peered":"2023-07-21T07:35:32.569080+0000","last_clean":"2023-07-21T07:35:32.569080+0000","last_became_active":"2023-07-21T07:35:31.567119+0000","last_became_peered":"2023-07-21T07:35:31.567119+0000","last_unstale":"2023-07-21T07:35:32.569080+0000","last_undegraded":"2023-07-21T07:35:32.569080+0000","last_fullsized":"2023-07-21T07:35:32.569080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:21:11.083643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.577945+0000","last_change":"2023-07-21T07:35:31.572534+0000","last_active":"2023-07-21T07:35:31.577945+0000","last_peered":"2023-07-21T07:35:31.577945+0000","last_clean":"2023-07-21T07:35:31.577945+0000","last_became_active":"2023-07-21T07:35:31.572252+0000","last_became_peered":"2023-07-21T07:35:31.572252+0000","last_unstale":"2023-07-21T07:35:31.577945+0000","last_undegraded":"2023-07-21T07:35:31.577945+0000","last_fullsized":"2023-07-21T07:35:31.577945+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:48:55.711098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569296+0000","last_change":"2023-07-21T07:35:31.576630+0000","last_active":"2023-07-21T07:35:32.569296+0000","last_peered":"2023-07-21T07:35:32.569296+0000","last_clean":"2023-07-21T07:35:32.569296+0000","last_became_active":"2023-07-21T07:35:31.576116+0000","last_became_peered":"2023-07-21T07:35:31.576116+0000","last_unstale":"2023-07-21T07:35:32.569296+0000","last_undegraded":"2023-07-21T07:35:32.569296+0000","last_fullsized":"2023-07-21T07:35:32.569296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:34:55.239322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569126+0000","last_change":"2023-07-21T07:35:31.570813+0000","last_active":"2023-07-21T07:35:32.569126+0000","last_peered":"2023-07-21T07:35:32.569126+0000","last_clean":"2023-07-21T07:35:32.569126+0000","last_became_active":"2023-07-21T07:35:31.570509+0000","last_became_peered":"2023-07-21T07:35:31.570509+0000","last_unstale":"2023-07-21T07:35:32.569126+0000","last_undegraded":"2023-07-21T07:35:32.569126+0000","last_fullsized":"2023-07-21T07:35:32.569126+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:49:29.253329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.570072+0000","last_change":"2023-07-21T07:35:31.564194+0000","last_active":"2023-07-21T07:35:31.570072+0000","last_peered":"2023-07-21T07:35:31.570072+0000","last_clean":"2023-07-21T07:35:31.570072+0000","last_became_active":"2023-07-21T07:35:31.563915+0000","last_became_peered":"2023-07-21T07:35:31.563915+0000","last_unstale":"2023-07-21T07:35:31.570072+0000","last_undegraded":"2023-07-21T07:35:31.570072+0000","last_fullsized":"2023-07-21T07:35:31.570072+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:00:01.689136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589623+0000","last_change":"2023-07-21T07:35:31.585808+0000","last_active":"2023-07-21T07:35:31.589623+0000","last_peered":"2023-07-21T07:35:31.589623+0000","last_clean":"2023-07-21T07:35:31.589623+0000","last_became_active":"2023-07-21T07:35:31.585492+0000","last_became_peered":"2023-07-21T07:35:31.585492+0000","last_unstale":"2023-07-21T07:35:31.589623+0000","last_undegraded":"2023-07-21T07:35:31.589623+0000","last_fullsized":"2023-07-21T07:35:31.589623+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:43:23.157527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568845+0000","last_change":"2023-07-21T07:35:31.566207+0000","last_active":"2023-07-21T07:35:32.568845+0000","last_peered":"2023-07-21T07:35:32.568845+0000","last_clean":"2023-07-21T07:35:32.568845+0000","last_became_active":"2023-07-21T07:35:31.565950+0000","last_became_peered":"2023-07-21T07:35:31.565950+0000","last_unstale":"2023-07-21T07:35:32.568845+0000","last_undegraded":"2023-07-21T07:35:32.568845+0000","last_fullsized":"2023-07-21T07:35:32.568845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:59:26.816645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.577434+0000","last_change":"2023-07-21T07:35:31.568180+0000","last_active":"2023-07-21T07:35:31.577434+0000","last_peered":"2023-07-21T07:35:31.577434+0000","last_clean":"2023-07-21T07:35:31.577434+0000","last_became_active":"2023-07-21T07:35:31.567871+0000","last_became_peered":"2023-07-21T07:35:31.567871+0000","last_unstale":"2023-07-21T07:35:31.577434+0000","last_undegraded":"2023-07-21T07:35:31.577434+0000","last_fullsized":"2023-07-21T07:35:31.577434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:40:11.120511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.580010+0000","last_change":"2023-07-21T07:35:31.574487+0000","last_active":"2023-07-21T07:35:31.580010+0000","last_peered":"2023-07-21T07:35:31.580010+0000","last_clean":"2023-07-21T07:35:31.580010+0000","last_became_active":"2023-07-21T07:35:31.574154+0000","last_became_peered":"2023-07-21T07:35:31.574154+0000","last_unstale":"2023-07-21T07:35:31.580010+0000","last_undegraded":"2023-07-21T07:35:31.580010+0000","last_fullsized":"2023-07-21T07:35:31.580010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:45:13.967781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.576175+0000","last_change":"2023-07-21T07:35:31.569009+0000","last_active":"2023-07-21T07:35:31.576175+0000","last_peered":"2023-07-21T07:35:31.576175+0000","last_clean":"2023-07-21T07:35:31.576175+0000","last_became_active":"2023-07-21T07:35:31.568723+0000","last_became_peered":"2023-07-21T07:35:31.568723+0000","last_unstale":"2023-07-21T07:35:31.576175+0000","last_undegraded":"2023-07-21T07:35:31.576175+0000","last_fullsized":"2023-07-21T07:35:31.576175+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:46:01.679166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.578903+0000","last_change":"2023-07-21T07:35:31.574434+0000","last_active":"2023-07-21T07:35:31.578903+0000","last_peered":"2023-07-21T07:35:31.578903+0000","last_clean":"2023-07-21T07:35:31.578903+0000","last_became_active":"2023-07-21T07:35:31.574069+0000","last_became_peered":"2023-07-21T07:35:31.574069+0000","last_unstale":"2023-07-21T07:35:31.578903+0000","last_undegraded":"2023-07-21T07:35:31.578903+0000","last_fullsized":"2023-07-21T07:35:31.578903+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:38:33.688093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.580668+0000","last_change":"2023-07-21T07:35:31.574882+0000","last_active":"2023-07-21T07:35:31.580668+0000","last_peered":"2023-07-21T07:35:31.580668+0000","last_clean":"2023-07-21T07:35:31.580668+0000","last_became_active":"2023-07-21T07:35:31.574354+0000","last_became_peered":"2023-07-21T07:35:31.574354+0000","last_unstale":"2023-07-21T07:35:31.580668+0000","last_undegraded":"2023-07-21T07:35:31.580668+0000","last_fullsized":"2023-07-21T07:35:31.580668+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:25:25.061359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.582488+0000","last_change":"2023-07-21T07:35:31.579241+0000","last_active":"2023-07-21T07:35:31.582488+0000","last_peered":"2023-07-21T07:35:31.582488+0000","last_clean":"2023-07-21T07:35:31.582488+0000","last_became_active":"2023-07-21T07:35:31.578961+0000","last_became_peered":"2023-07-21T07:35:31.578961+0000","last_unstale":"2023-07-21T07:35:31.582488+0000","last_undegraded":"2023-07-21T07:35:31.582488+0000","last_fullsized":"2023-07-21T07:35:31.582488+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:45:13.967781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.586775+0000","last_change":"2023-07-21T07:35:31.580543+0000","last_active":"2023-07-21T07:35:31.586775+0000","last_peered":"2023-07-21T07:35:31.586775+0000","last_clean":"2023-07-21T07:35:31.586775+0000","last_became_active":"2023-07-21T07:35:31.580216+0000","last_became_peered":"2023-07-21T07:35:31.580216+0000","last_unstale":"2023-07-21T07:35:31.586775+0000","last_undegraded":"2023-07-21T07:35:31.586775+0000","last_fullsized":"2023-07-21T07:35:31.586775+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:24:17.732879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568157+0000","last_change":"2023-07-21T07:35:31.565812+0000","last_active":"2023-07-21T07:35:32.568157+0000","last_peered":"2023-07-21T07:35:32.568157+0000","last_clean":"2023-07-21T07:35:32.568157+0000","last_became_active":"2023-07-21T07:35:31.565496+0000","last_became_peered":"2023-07-21T07:35:31.565496+0000","last_unstale":"2023-07-21T07:35:32.568157+0000","last_undegraded":"2023-07-21T07:35:32.568157+0000","last_fullsized":"2023-07-21T07:35:32.568157+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:24:17.732879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.567986+0000","last_change":"2023-07-21T07:35:31.565879+0000","last_active":"2023-07-21T07:35:32.567986+0000","last_peered":"2023-07-21T07:35:32.567986+0000","last_clean":"2023-07-21T07:35:32.567986+0000","last_became_active":"2023-07-21T07:35:31.565592+0000","last_became_peered":"2023-07-21T07:35:31.565592+0000","last_unstale":"2023-07-21T07:35:32.567986+0000","last_undegraded":"2023-07-21T07:35:32.567986+0000","last_fullsized":"2023-07-21T07:35:32.567986+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:45.909102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589363+0000","last_change":"2023-07-21T07:35:31.583163+0000","last_active":"2023-07-21T07:35:31.589363+0000","last_peered":"2023-07-21T07:35:31.589363+0000","last_clean":"2023-07-21T07:35:31.589363+0000","last_became_active":"2023-07-21T07:35:31.582878+0000","last_became_peered":"2023-07-21T07:35:31.582878+0000","last_unstale":"2023-07-21T07:35:31.589363+0000","last_undegraded":"2023-07-21T07:35:31.589363+0000","last_fullsized":"2023-07-21T07:35:31.589363+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:43:37.553211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569678+0000","last_change":"2023-07-21T07:35:31.564789+0000","last_active":"2023-07-21T07:35:32.569678+0000","last_peered":"2023-07-21T07:35:32.569678+0000","last_clean":"2023-07-21T07:35:32.569678+0000","last_became_active":"2023-07-21T07:35:31.564503+0000","last_became_peered":"2023-07-21T07:35:31.564503+0000","last_unstale":"2023-07-21T07:35:32.569678+0000","last_undegraded":"2023-07-21T07:35:32.569678+0000","last_fullsized":"2023-07-21T07:35:32.569678+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:08:05.332681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.584125+0000","last_change":"2023-07-21T07:35:31.575679+0000","last_active":"2023-07-21T07:35:31.584125+0000","last_peered":"2023-07-21T07:35:31.584125+0000","last_clean":"2023-07-21T07:35:31.584125+0000","last_became_active":"2023-07-21T07:35:31.575365+0000","last_became_peered":"2023-07-21T07:35:31.575365+0000","last_unstale":"2023-07-21T07:35:31.584125+0000","last_undegraded":"2023-07-21T07:35:31.584125+0000","last_fullsized":"2023-07-21T07:35:31.584125+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:30:13.755912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.580646+0000","last_change":"2023-07-21T07:35:31.572474+0000","last_active":"2023-07-21T07:35:31.580646+0000","last_peered":"2023-07-21T07:35:31.580646+0000","last_clean":"2023-07-21T07:35:31.580646+0000","last_became_active":"2023-07-21T07:35:31.572214+0000","last_became_peered":"2023-07-21T07:35:31.572214+0000","last_unstale":"2023-07-21T07:35:31.580646+0000","last_undegraded":"2023-07-21T07:35:31.580646+0000","last_fullsized":"2023-07-21T07:35:31.580646+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:10:09.071976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.575125+0000","last_change":"2023-07-21T07:35:31.570945+0000","last_active":"2023-07-21T07:35:31.575125+0000","last_peered":"2023-07-21T07:35:31.575125+0000","last_clean":"2023-07-21T07:35:31.575125+0000","last_became_active":"2023-07-21T07:35:31.570678+0000","last_became_peered":"2023-07-21T07:35:31.570678+0000","last_unstale":"2023-07-21T07:35:31.575125+0000","last_undegraded":"2023-07-21T07:35:31.575125+0000","last_fullsized":"2023-07-21T07:35:31.575125+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:30:15.576980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.567827+0000","last_change":"2023-07-21T07:35:31.571165+0000","last_active":"2023-07-21T07:35:32.567827+0000","last_peered":"2023-07-21T07:35:32.567827+0000","last_clean":"2023-07-21T07:35:32.567827+0000","last_became_active":"2023-07-21T07:35:31.570834+0000","last_became_peered":"2023-07-21T07:35:31.570834+0000","last_unstale":"2023-07-21T07:35:32.567827+0000","last_undegraded":"2023-07-21T07:35:32.567827+0000","last_fullsized":"2023-07-21T07:35:32.567827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:28:42.691072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569122+0000","last_change":"2023-07-21T07:35:31.560958+0000","last_active":"2023-07-21T07:35:32.569122+0000","last_peered":"2023-07-21T07:35:32.569122+0000","last_clean":"2023-07-21T07:35:32.569122+0000","last_became_active":"2023-07-21T07:35:31.560610+0000","last_became_peered":"2023-07-21T07:35:31.560610+0000","last_unstale":"2023-07-21T07:35:32.569122+0000","last_undegraded":"2023-07-21T07:35:32.569122+0000","last_fullsized":"2023-07-21T07:35:32.569122+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:40:50.470477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.585036+0000","last_change":"2023-07-21T07:35:31.575695+0000","last_active":"2023-07-21T07:35:31.585036+0000","last_peered":"2023-07-21T07:35:31.585036+0000","last_clean":"2023-07-21T07:35:31.585036+0000","last_became_active":"2023-07-21T07:35:31.574995+0000","last_became_peered":"2023-07-21T07:35:31.574995+0000","last_unstale":"2023-07-21T07:35:31.585036+0000","last_undegraded":"2023-07-21T07:35:31.585036+0000","last_fullsized":"2023-07-21T07:35:31.585036+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:56:53.975472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.579597+0000","last_change":"2023-07-21T07:35:31.575204+0000","last_active":"2023-07-21T07:35:31.579597+0000","last_peered":"2023-07-21T07:35:31.579597+0000","last_clean":"2023-07-21T07:35:31.579597+0000","last_became_active":"2023-07-21T07:35:31.574935+0000","last_became_peered":"2023-07-21T07:35:31.574935+0000","last_unstale":"2023-07-21T07:35:31.579597+0000","last_undegraded":"2023-07-21T07:35:31.579597+0000","last_fullsized":"2023-07-21T07:35:31.579597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:07:37.523677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589201+0000","last_change":"2023-07-21T07:35:31.580409+0000","last_active":"2023-07-21T07:35:31.589201+0000","last_peered":"2023-07-21T07:35:31.589201+0000","last_clean":"2023-07-21T07:35:31.589201+0000","last_became_active":"2023-07-21T07:35:31.580078+0000","last_became_peered":"2023-07-21T07:35:31.580078+0000","last_unstale":"2023-07-21T07:35:31.589201+0000","last_undegraded":"2023-07-21T07:35:31.589201+0000","last_fullsized":"2023-07-21T07:35:31.589201+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:51:53.349193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589601+0000","last_change":"2023-07-21T07:35:31.583360+0000","last_active":"2023-07-21T07:35:31.589601+0000","last_peered":"2023-07-21T07:35:31.589601+0000","last_clean":"2023-07-21T07:35:31.589601+0000","last_became_active":"2023-07-21T07:35:31.582534+0000","last_became_peered":"2023-07-21T07:35:31.582534+0000","last_unstale":"2023-07-21T07:35:31.589601+0000","last_undegraded":"2023-07-21T07:35:31.589601+0000","last_fullsized":"2023-07-21T07:35:31.589601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:15:44.024314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589316+0000","last_change":"2023-07-21T07:35:31.582080+0000","last_active":"2023-07-21T07:35:31.589316+0000","last_peered":"2023-07-21T07:35:31.589316+0000","last_clean":"2023-07-21T07:35:31.589316+0000","last_became_active":"2023-07-21T07:35:31.581824+0000","last_became_peered":"2023-07-21T07:35:31.581824+0000","last_unstale":"2023-07-21T07:35:31.589316+0000","last_undegraded":"2023-07-21T07:35:31.589316+0000","last_fullsized":"2023-07-21T07:35:31.589316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:49:29.253329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.592039+0000","last_change":"2023-07-21T07:35:31.586191+0000","last_active":"2023-07-21T07:35:31.592039+0000","last_peered":"2023-07-21T07:35:31.592039+0000","last_clean":"2023-07-21T07:35:31.592039+0000","last_became_active":"2023-07-21T07:35:31.585881+0000","last_became_peered":"2023-07-21T07:35:31.585881+0000","last_unstale":"2023-07-21T07:35:31.592039+0000","last_undegraded":"2023-07-21T07:35:31.592039+0000","last_fullsized":"2023-07-21T07:35:31.592039+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:28:07.069571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568047+0000","last_change":"2023-07-21T07:35:31.566417+0000","last_active":"2023-07-21T07:35:32.568047+0000","last_peered":"2023-07-21T07:35:32.568047+0000","last_clean":"2023-07-21T07:35:32.568047+0000","last_became_active":"2023-07-21T07:35:31.565614+0000","last_became_peered":"2023-07-21T07:35:31.565614+0000","last_unstale":"2023-07-21T07:35:32.568047+0000","last_undegraded":"2023-07-21T07:35:32.568047+0000","last_fullsized":"2023-07-21T07:35:32.568047+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:29:55.040410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.575541+0000","last_change":"2023-07-21T07:35:31.568296+0000","last_active":"2023-07-21T07:35:31.575541+0000","last_peered":"2023-07-21T07:35:31.575541+0000","last_clean":"2023-07-21T07:35:31.575541+0000","last_became_active":"2023-07-21T07:35:31.567956+0000","last_became_peered":"2023-07-21T07:35:31.567956+0000","last_unstale":"2023-07-21T07:35:31.575541+0000","last_undegraded":"2023-07-21T07:35:31.575541+0000","last_fullsized":"2023-07-21T07:35:31.575541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:02:56.930040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.567982+0000","last_change":"2023-07-21T07:35:31.572362+0000","last_active":"2023-07-21T07:35:32.567982+0000","last_peered":"2023-07-21T07:35:32.567982+0000","last_clean":"2023-07-21T07:35:32.567982+0000","last_became_active":"2023-07-21T07:35:31.572080+0000","last_became_peered":"2023-07-21T07:35:31.572080+0000","last_unstale":"2023-07-21T07:35:32.567982+0000","last_undegraded":"2023-07-21T07:35:32.567982+0000","last_fullsized":"2023-07-21T07:35:32.567982+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:30:15.576980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.592494+0000","last_change":"2023-07-21T07:35:30.552422+0000","last_active":"2023-07-21T07:35:31.592494+0000","last_peered":"2023-07-21T07:35:31.592494+0000","last_clean":"2023-07-21T07:35:31.592494+0000","last_became_active":"2023-07-21T07:35:30.552153+0000","last_became_peered":"2023-07-21T07:35:30.552153+0000","last_unstale":"2023-07-21T07:35:31.592494+0000","last_undegraded":"2023-07-21T07:35:31.592494+0000","last_fullsized":"2023-07-21T07:35:31.592494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:26:51.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.577492+0000","last_change":"2023-07-21T07:35:31.572810+0000","last_active":"2023-07-21T07:35:31.577492+0000","last_peered":"2023-07-21T07:35:31.577492+0000","last_clean":"2023-07-21T07:35:31.577492+0000","last_became_active":"2023-07-21T07:35:31.572369+0000","last_became_peered":"2023-07-21T07:35:31.572369+0000","last_unstale":"2023-07-21T07:35:31.577492+0000","last_undegraded":"2023-07-21T07:35:31.577492+0000","last_fullsized":"2023-07-21T07:35:31.577492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:08:50.302036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.586953+0000","last_change":"2023-07-21T07:35:30.549262+0000","last_active":"2023-07-21T07:35:31.586953+0000","last_peered":"2023-07-21T07:35:31.586953+0000","last_clean":"2023-07-21T07:35:31.586953+0000","last_became_active":"2023-07-21T07:35:30.548946+0000","last_became_peered":"2023-07-21T07:35:30.548946+0000","last_unstale":"2023-07-21T07:35:31.586953+0000","last_undegraded":"2023-07-21T07:35:31.586953+0000","last_fullsized":"2023-07-21T07:35:31.586953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:14:52.904051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.582445+0000","last_change":"2023-07-21T07:35:31.579255+0000","last_active":"2023-07-21T07:35:31.582445+0000","last_peered":"2023-07-21T07:35:31.582445+0000","last_clean":"2023-07-21T07:35:31.582445+0000","last_became_active":"2023-07-21T07:35:31.578910+0000","last_became_peered":"2023-07-21T07:35:31.578910+0000","last_unstale":"2023-07-21T07:35:31.582445+0000","last_undegraded":"2023-07-21T07:35:31.582445+0000","last_fullsized":"2023-07-21T07:35:31.582445+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:43:23.157527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.585318+0000","last_change":"2023-07-21T07:35:30.550649+0000","last_active":"2023-07-21T07:35:31.585318+0000","last_peered":"2023-07-21T07:35:31.585318+0000","last_clean":"2023-07-21T07:35:31.585318+0000","last_became_active":"2023-07-21T07:35:30.550349+0000","last_became_peered":"2023-07-21T07:35:30.550349+0000","last_unstale":"2023-07-21T07:35:31.585318+0000","last_undegraded":"2023-07-21T07:35:31.585318+0000","last_fullsized":"2023-07-21T07:35:31.585318+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:43:08.098732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569653+0000","last_change":"2023-07-21T07:35:31.584271+0000","last_active":"2023-07-21T07:35:32.569653+0000","last_peered":"2023-07-21T07:35:32.569653+0000","last_clean":"2023-07-21T07:35:32.569653+0000","last_became_active":"2023-07-21T07:35:31.583788+0000","last_became_peered":"2023-07-21T07:35:31.583788+0000","last_unstale":"2023-07-21T07:35:32.569653+0000","last_undegraded":"2023-07-21T07:35:32.569653+0000","last_fullsized":"2023-07-21T07:35:32.569653+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:07:37.523677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.588519+0000","last_change":"2023-07-21T07:35:30.551432+0000","last_active":"2023-07-21T07:35:31.588519+0000","last_peered":"2023-07-21T07:35:31.588519+0000","last_clean":"2023-07-21T07:35:31.588519+0000","last_became_active":"2023-07-21T07:35:30.551141+0000","last_became_peered":"2023-07-21T07:35:30.551141+0000","last_unstale":"2023-07-21T07:35:31.588519+0000","last_undegraded":"2023-07-21T07:35:31.588519+0000","last_fullsized":"2023-07-21T07:35:31.588519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:40:10.620162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.577896+0000","last_change":"2023-07-21T07:35:31.568304+0000","last_active":"2023-07-21T07:35:31.577896+0000","last_peered":"2023-07-21T07:35:31.577896+0000","last_clean":"2023-07-21T07:35:31.577896+0000","last_became_active":"2023-07-21T07:35:31.567923+0000","last_became_peered":"2023-07-21T07:35:31.567923+0000","last_unstale":"2023-07-21T07:35:31.577896+0000","last_undegraded":"2023-07-21T07:35:31.577896+0000","last_fullsized":"2023-07-21T07:35:31.577896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:36:43.305253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.586748+0000","last_change":"2023-07-21T07:35:30.546712+0000","last_active":"2023-07-21T07:35:31.586748+0000","last_peered":"2023-07-21T07:35:31.586748+0000","last_clean":"2023-07-21T07:35:31.586748+0000","last_became_active":"2023-07-21T07:35:30.546408+0000","last_became_peered":"2023-07-21T07:35:30.546408+0000","last_unstale":"2023-07-21T07:35:31.586748+0000","last_undegraded":"2023-07-21T07:35:31.586748+0000","last_fullsized":"2023-07-21T07:35:31.586748+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:15:49.199967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.581557+0000","last_change":"2023-07-21T07:35:31.578102+0000","last_active":"2023-07-21T07:35:31.581557+0000","last_peered":"2023-07-21T07:35:31.581557+0000","last_clean":"2023-07-21T07:35:31.581557+0000","last_became_active":"2023-07-21T07:35:31.577824+0000","last_became_peered":"2023-07-21T07:35:31.577824+0000","last_unstale":"2023-07-21T07:35:31.581557+0000","last_undegraded":"2023-07-21T07:35:31.581557+0000","last_fullsized":"2023-07-21T07:35:31.581557+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:45.909102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568168+0000","last_change":"2023-07-21T07:35:30.550820+0000","last_active":"2023-07-21T07:35:32.568168+0000","last_peered":"2023-07-21T07:35:32.568168+0000","last_clean":"2023-07-21T07:35:32.568168+0000","last_became_active":"2023-07-21T07:35:30.550525+0000","last_became_peered":"2023-07-21T07:35:30.550525+0000","last_unstale":"2023-07-21T07:35:32.568168+0000","last_undegraded":"2023-07-21T07:35:32.568168+0000","last_fullsized":"2023-07-21T07:35:32.568168+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:11:40.377386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.581557+0000","last_change":"2023-07-21T07:35:31.577159+0000","last_active":"2023-07-21T07:35:31.581557+0000","last_peered":"2023-07-21T07:35:31.581557+0000","last_clean":"2023-07-21T07:35:31.581557+0000","last_became_active":"2023-07-21T07:35:31.576870+0000","last_became_peered":"2023-07-21T07:35:31.576870+0000","last_unstale":"2023-07-21T07:35:31.581557+0000","last_undegraded":"2023-07-21T07:35:31.581557+0000","last_fullsized":"2023-07-21T07:35:31.581557+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:45:59.419794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.553193+0000","last_change":"2023-07-21T07:35:30.542823+0000","last_active":"2023-07-21T07:35:31.553193+0000","last_peered":"2023-07-21T07:35:31.553193+0000","last_clean":"2023-07-21T07:35:31.553193+0000","last_became_active":"2023-07-21T07:35:30.542612+0000","last_became_peered":"2023-07-21T07:35:30.542612+0000","last_unstale":"2023-07-21T07:35:31.553193+0000","last_undegraded":"2023-07-21T07:35:31.553193+0000","last_fullsized":"2023-07-21T07:35:31.553193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:00:35.971652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569618+0000","last_change":"2023-07-21T07:35:31.561749+0000","last_active":"2023-07-21T07:35:32.569618+0000","last_peered":"2023-07-21T07:35:32.569618+0000","last_clean":"2023-07-21T07:35:32.569618+0000","last_became_active":"2023-07-21T07:35:31.561255+0000","last_became_peered":"2023-07-21T07:35:31.561255+0000","last_unstale":"2023-07-21T07:35:32.569618+0000","last_undegraded":"2023-07-21T07:35:32.569618+0000","last_fullsized":"2023-07-21T07:35:32.569618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:03:51.800900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.563377+0000","last_change":"2023-07-21T07:35:30.550858+0000","last_active":"2023-07-21T07:35:31.563377+0000","last_peered":"2023-07-21T07:35:31.563377+0000","last_clean":"2023-07-21T07:35:31.563377+0000","last_became_active":"2023-07-21T07:35:30.550540+0000","last_became_peered":"2023-07-21T07:35:30.550540+0000","last_unstale":"2023-07-21T07:35:31.563377+0000","last_undegraded":"2023-07-21T07:35:31.563377+0000","last_fullsized":"2023-07-21T07:35:31.563377+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:44.904085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569373+0000","last_change":"2023-07-21T07:35:31.576245+0000","last_active":"2023-07-21T07:35:32.569373+0000","last_peered":"2023-07-21T07:35:32.569373+0000","last_clean":"2023-07-21T07:35:32.569373+0000","last_became_active":"2023-07-21T07:35:31.575586+0000","last_became_peered":"2023-07-21T07:35:31.575586+0000","last_unstale":"2023-07-21T07:35:32.569373+0000","last_undegraded":"2023-07-21T07:35:32.569373+0000","last_fullsized":"2023-07-21T07:35:32.569373+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:26:49.227695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569762+0000","last_change":"2023-07-21T07:35:30.551290+0000","last_active":"2023-07-21T07:35:32.569762+0000","last_peered":"2023-07-21T07:35:32.569762+0000","last_clean":"2023-07-21T07:35:32.569762+0000","last_became_active":"2023-07-21T07:35:30.550872+0000","last_became_peered":"2023-07-21T07:35:30.550872+0000","last_unstale":"2023-07-21T07:35:32.569762+0000","last_undegraded":"2023-07-21T07:35:32.569762+0000","last_fullsized":"2023-07-21T07:35:32.569762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:32:35.489926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.567892+0000","last_change":"2023-07-21T07:35:31.581622+0000","last_active":"2023-07-21T07:35:32.567892+0000","last_peered":"2023-07-21T07:35:32.567892+0000","last_clean":"2023-07-21T07:35:32.567892+0000","last_became_active":"2023-07-21T07:35:31.581309+0000","last_became_peered":"2023-07-21T07:35:31.581309+0000","last_unstale":"2023-07-21T07:35:32.567892+0000","last_undegraded":"2023-07-21T07:35:32.567892+0000","last_fullsized":"2023-07-21T07:35:32.567892+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:45:59.419794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.569906+0000","last_change":"2023-07-21T07:35:30.547725+0000","last_active":"2023-07-21T07:35:31.569906+0000","last_peered":"2023-07-21T07:35:31.569906+0000","last_clean":"2023-07-21T07:35:31.569906+0000","last_became_active":"2023-07-21T07:35:30.547400+0000","last_became_peered":"2023-07-21T07:35:30.547400+0000","last_unstale":"2023-07-21T07:35:31.569906+0000","last_undegraded":"2023-07-21T07:35:31.569906+0000","last_fullsized":"2023-07-21T07:35:31.569906+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:47:44.087595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.578947+0000","last_change":"2023-07-21T07:35:31.574640+0000","last_active":"2023-07-21T07:35:31.578947+0000","last_peered":"2023-07-21T07:35:31.578947+0000","last_clean":"2023-07-21T07:35:31.578947+0000","last_became_active":"2023-07-21T07:35:31.574338+0000","last_became_peered":"2023-07-21T07:35:31.574338+0000","last_unstale":"2023-07-21T07:35:31.578947+0000","last_undegraded":"2023-07-21T07:35:31.578947+0000","last_fullsized":"2023-07-21T07:35:31.578947+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:14:47.829723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589483+0000","last_change":"2023-07-21T07:35:30.552297+0000","last_active":"2023-07-21T07:35:31.589483+0000","last_peered":"2023-07-21T07:35:31.589483+0000","last_clean":"2023-07-21T07:35:31.589483+0000","last_became_active":"2023-07-21T07:35:30.552039+0000","last_became_peered":"2023-07-21T07:35:30.552039+0000","last_unstale":"2023-07-21T07:35:31.589483+0000","last_undegraded":"2023-07-21T07:35:31.589483+0000","last_fullsized":"2023-07-21T07:35:31.589483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:30:14.571963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.581592+0000","last_change":"2023-07-21T07:35:31.577585+0000","last_active":"2023-07-21T07:35:31.581592+0000","last_peered":"2023-07-21T07:35:31.581592+0000","last_clean":"2023-07-21T07:35:31.581592+0000","last_became_active":"2023-07-21T07:35:31.577145+0000","last_became_peered":"2023-07-21T07:35:31.577145+0000","last_unstale":"2023-07-21T07:35:31.581592+0000","last_undegraded":"2023-07-21T07:35:31.581592+0000","last_fullsized":"2023-07-21T07:35:31.581592+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:24:17.732879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569923+0000","last_change":"2023-07-21T07:35:30.550443+0000","last_active":"2023-07-21T07:35:32.569923+0000","last_peered":"2023-07-21T07:35:32.569923+0000","last_clean":"2023-07-21T07:35:32.569923+0000","last_became_active":"2023-07-21T07:35:30.550126+0000","last_became_peered":"2023-07-21T07:35:30.550126+0000","last_unstale":"2023-07-21T07:35:32.569923+0000","last_undegraded":"2023-07-21T07:35:32.569923+0000","last_fullsized":"2023-07-21T07:35:32.569923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:08:49.297019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.574351+0000","last_change":"2023-07-21T07:35:31.567871+0000","last_active":"2023-07-21T07:35:31.574351+0000","last_peered":"2023-07-21T07:35:31.574351+0000","last_clean":"2023-07-21T07:35:31.574351+0000","last_became_active":"2023-07-21T07:35:31.567550+0000","last_became_peered":"2023-07-21T07:35:31.567550+0000","last_unstale":"2023-07-21T07:35:31.574351+0000","last_undegraded":"2023-07-21T07:35:31.574351+0000","last_fullsized":"2023-07-21T07:35:31.574351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:26:49.227695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569614+0000","last_change":"2023-07-21T07:35:30.548569+0000","last_active":"2023-07-21T07:35:32.569614+0000","last_peered":"2023-07-21T07:35:32.569614+0000","last_clean":"2023-07-21T07:35:32.569614+0000","last_became_active":"2023-07-21T07:35:30.548258+0000","last_became_peered":"2023-07-21T07:35:30.548258+0000","last_unstale":"2023-07-21T07:35:32.569614+0000","last_undegraded":"2023-07-21T07:35:32.569614+0000","last_fullsized":"2023-07-21T07:35:32.569614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:00:00.684119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568993+0000","last_change":"2023-07-21T07:35:31.569427+0000","last_active":"2023-07-21T07:35:32.568993+0000","last_peered":"2023-07-21T07:35:32.568993+0000","last_clean":"2023-07-21T07:35:32.568993+0000","last_became_active":"2023-07-21T07:35:31.569152+0000","last_became_peered":"2023-07-21T07:35:31.569152+0000","last_unstale":"2023-07-21T07:35:32.568993+0000","last_undegraded":"2023-07-21T07:35:32.568993+0000","last_fullsized":"2023-07-21T07:35:32.568993+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:29.762040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.553572+0000","last_change":"2023-07-21T07:35:30.542937+0000","last_active":"2023-07-21T07:35:31.553572+0000","last_peered":"2023-07-21T07:35:31.553572+0000","last_clean":"2023-07-21T07:35:31.553572+0000","last_became_active":"2023-07-21T07:35:30.542650+0000","last_became_peered":"2023-07-21T07:35:30.542650+0000","last_unstale":"2023-07-21T07:35:31.553572+0000","last_undegraded":"2023-07-21T07:35:31.553572+0000","last_fullsized":"2023-07-21T07:35:31.553572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:03:50.795883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568163+0000","last_change":"2023-07-21T07:35:31.566406+0000","last_active":"2023-07-21T07:35:32.568163+0000","last_peered":"2023-07-21T07:35:32.568163+0000","last_clean":"2023-07-21T07:35:32.568163+0000","last_became_active":"2023-07-21T07:35:31.566108+0000","last_became_peered":"2023-07-21T07:35:31.566108+0000","last_unstale":"2023-07-21T07:35:32.568163+0000","last_undegraded":"2023-07-21T07:35:32.568163+0000","last_fullsized":"2023-07-21T07:35:32.568163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:46:23.854550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.572666+0000","last_change":"2023-07-21T07:35:30.550924+0000","last_active":"2023-07-21T07:35:31.572666+0000","last_peered":"2023-07-21T07:35:31.572666+0000","last_clean":"2023-07-21T07:35:31.572666+0000","last_became_active":"2023-07-21T07:35:30.550606+0000","last_became_peered":"2023-07-21T07:35:30.550606+0000","last_unstale":"2023-07-21T07:35:31.572666+0000","last_undegraded":"2023-07-21T07:35:31.572666+0000","last_fullsized":"2023-07-21T07:35:31.572666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:57:13.788855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569321+0000","last_change":"2023-07-21T07:35:31.569072+0000","last_active":"2023-07-21T07:35:32.569321+0000","last_peered":"2023-07-21T07:35:32.569321+0000","last_clean":"2023-07-21T07:35:32.569321+0000","last_became_active":"2023-07-21T07:35:31.568900+0000","last_became_peered":"2023-07-21T07:35:31.568900+0000","last_unstale":"2023-07-21T07:35:32.569321+0000","last_undegraded":"2023-07-21T07:35:32.569321+0000","last_fullsized":"2023-07-21T07:35:32.569321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:00:36.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.567928+0000","last_change":"2023-07-21T07:35:30.550883+0000","last_active":"2023-07-21T07:35:32.567928+0000","last_peered":"2023-07-21T07:35:32.567928+0000","last_clean":"2023-07-21T07:35:32.567928+0000","last_became_active":"2023-07-21T07:35:30.550604+0000","last_became_peered":"2023-07-21T07:35:30.550604+0000","last_unstale":"2023-07-21T07:35:32.567928+0000","last_undegraded":"2023-07-21T07:35:32.567928+0000","last_fullsized":"2023-07-21T07:35:32.567928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:15:49.199967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569900+0000","last_change":"2023-07-21T07:35:31.581417+0000","last_active":"2023-07-21T07:35:32.569900+0000","last_peered":"2023-07-21T07:35:32.569900+0000","last_clean":"2023-07-21T07:35:32.569900+0000","last_became_active":"2023-07-21T07:35:31.581026+0000","last_became_peered":"2023-07-21T07:35:31.581026+0000","last_unstale":"2023-07-21T07:35:32.569900+0000","last_undegraded":"2023-07-21T07:35:32.569900+0000","last_fullsized":"2023-07-21T07:35:32.569900+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:43:09.103749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589517+0000","last_change":"2023-07-21T07:35:30.552874+0000","last_active":"2023-07-21T07:35:31.589517+0000","last_peered":"2023-07-21T07:35:31.589517+0000","last_clean":"2023-07-21T07:35:31.589517+0000","last_became_active":"2023-07-21T07:35:30.552612+0000","last_became_peered":"2023-07-21T07:35:30.552612+0000","last_unstale":"2023-07-21T07:35:31.589517+0000","last_undegraded":"2023-07-21T07:35:31.589517+0000","last_fullsized":"2023-07-21T07:35:31.589517+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:29:54.035393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.581232+0000","last_change":"2023-07-21T07:35:31.572905+0000","last_active":"2023-07-21T07:35:31.581232+0000","last_peered":"2023-07-21T07:35:31.581232+0000","last_clean":"2023-07-21T07:35:31.581232+0000","last_became_active":"2023-07-21T07:35:31.571995+0000","last_became_peered":"2023-07-21T07:35:31.571995+0000","last_unstale":"2023-07-21T07:35:31.581232+0000","last_undegraded":"2023-07-21T07:35:31.581232+0000","last_fullsized":"2023-07-21T07:35:31.581232+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:46:12.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.586958+0000","last_change":"2023-07-21T07:35:30.550575+0000","last_active":"2023-07-21T07:35:31.586958+0000","last_peered":"2023-07-21T07:35:31.586958+0000","last_clean":"2023-07-21T07:35:31.586958+0000","last_became_active":"2023-07-21T07:35:30.550269+0000","last_became_peered":"2023-07-21T07:35:30.550269+0000","last_unstale":"2023-07-21T07:35:31.586958+0000","last_undegraded":"2023-07-21T07:35:31.586958+0000","last_fullsized":"2023-07-21T07:35:31.586958+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:47:44.087595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.582202+0000","last_change":"2023-07-21T07:35:31.578142+0000","last_active":"2023-07-21T07:35:31.582202+0000","last_peered":"2023-07-21T07:35:31.582202+0000","last_clean":"2023-07-21T07:35:31.582202+0000","last_became_active":"2023-07-21T07:35:31.577865+0000","last_became_peered":"2023-07-21T07:35:31.577865+0000","last_unstale":"2023-07-21T07:35:31.582202+0000","last_undegraded":"2023-07-21T07:35:31.582202+0000","last_fullsized":"2023-07-21T07:35:31.582202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:29:55.040410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569602+0000","last_change":"2023-07-21T07:35:30.554225+0000","last_active":"2023-07-21T07:35:32.569602+0000","last_peered":"2023-07-21T07:35:32.569602+0000","last_clean":"2023-07-21T07:35:32.569602+0000","last_became_active":"2023-07-21T07:35:30.553952+0000","last_became_peered":"2023-07-21T07:35:30.553952+0000","last_unstale":"2023-07-21T07:35:32.569602+0000","last_undegraded":"2023-07-21T07:35:32.569602+0000","last_fullsized":"2023-07-21T07:35:32.569602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:40:10.115494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.570209+0000","last_change":"2023-07-21T07:35:31.571997+0000","last_active":"2023-07-21T07:35:32.570209+0000","last_peered":"2023-07-21T07:35:32.570209+0000","last_clean":"2023-07-21T07:35:32.570209+0000","last_became_active":"2023-07-21T07:35:31.571042+0000","last_became_peered":"2023-07-21T07:35:31.571042+0000","last_unstale":"2023-07-21T07:35:32.570209+0000","last_undegraded":"2023-07-21T07:35:32.570209+0000","last_fullsized":"2023-07-21T07:35:32.570209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:14:47.829723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.554312+0000","last_change":"2023-07-21T07:35:30.552149+0000","last_active":"2023-07-21T07:35:31.554312+0000","last_peered":"2023-07-21T07:35:31.554312+0000","last_clean":"2023-07-21T07:35:31.554312+0000","last_became_active":"2023-07-21T07:35:30.551872+0000","last_became_peered":"2023-07-21T07:35:30.551872+0000","last_unstale":"2023-07-21T07:35:31.554312+0000","last_undegraded":"2023-07-21T07:35:31.554312+0000","last_fullsized":"2023-07-21T07:35:31.554312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:10:08.066960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.567769+0000","last_change":"2023-07-21T07:35:31.570982+0000","last_active":"2023-07-21T07:35:32.567769+0000","last_peered":"2023-07-21T07:35:32.567769+0000","last_clean":"2023-07-21T07:35:32.567769+0000","last_became_active":"2023-07-21T07:35:31.570685+0000","last_became_peered":"2023-07-21T07:35:31.570685+0000","last_unstale":"2023-07-21T07:35:32.567769+0000","last_undegraded":"2023-07-21T07:35:32.567769+0000","last_fullsized":"2023-07-21T07:35:32.567769+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:45:13.967781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569209+0000","last_change":"2023-07-21T07:35:30.552311+0000","last_active":"2023-07-21T07:35:32.569209+0000","last_peered":"2023-07-21T07:35:32.569209+0000","last_clean":"2023-07-21T07:35:32.569209+0000","last_became_active":"2023-07-21T07:35:30.552023+0000","last_became_peered":"2023-07-21T07:35:30.552023+0000","last_unstale":"2023-07-21T07:35:32.569209+0000","last_undegraded":"2023-07-21T07:35:32.569209+0000","last_fullsized":"2023-07-21T07:35:32.569209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:26:51.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.579427+0000","last_change":"2023-07-21T07:35:31.575363+0000","last_active":"2023-07-21T07:35:31.579427+0000","last_peered":"2023-07-21T07:35:31.579427+0000","last_clean":"2023-07-21T07:35:31.579427+0000","last_became_active":"2023-07-21T07:35:31.575044+0000","last_became_peered":"2023-07-21T07:35:31.575044+0000","last_unstale":"2023-07-21T07:35:31.579427+0000","last_undegraded":"2023-07-21T07:35:31.579427+0000","last_fullsized":"2023-07-21T07:35:31.579427+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:49.296815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569097+0000","last_change":"2023-07-21T07:35:30.553310+0000","last_active":"2023-07-21T07:35:32.569097+0000","last_peered":"2023-07-21T07:35:32.569097+0000","last_clean":"2023-07-21T07:35:32.569097+0000","last_became_active":"2023-07-21T07:35:30.552922+0000","last_became_peered":"2023-07-21T07:35:30.552922+0000","last_unstale":"2023-07-21T07:35:32.569097+0000","last_undegraded":"2023-07-21T07:35:32.569097+0000","last_fullsized":"2023-07-21T07:35:32.569097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:57:13.788855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589331+0000","last_change":"2023-07-21T07:35:31.582343+0000","last_active":"2023-07-21T07:35:31.589331+0000","last_peered":"2023-07-21T07:35:31.589331+0000","last_clean":"2023-07-21T07:35:31.589331+0000","last_became_active":"2023-07-21T07:35:31.582111+0000","last_became_peered":"2023-07-21T07:35:31.582111+0000","last_unstale":"2023-07-21T07:35:31.589331+0000","last_undegraded":"2023-07-21T07:35:31.589331+0000","last_fullsized":"2023-07-21T07:35:31.589331+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:28:42.691072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568386+0000","last_change":"2023-07-21T07:35:30.548129+0000","last_active":"2023-07-21T07:35:32.568386+0000","last_peered":"2023-07-21T07:35:32.568386+0000","last_clean":"2023-07-21T07:35:32.568386+0000","last_became_active":"2023-07-21T07:35:30.547850+0000","last_became_peered":"2023-07-21T07:35:30.547850+0000","last_unstale":"2023-07-21T07:35:32.568386+0000","last_undegraded":"2023-07-21T07:35:32.568386+0000","last_fullsized":"2023-07-21T07:35:32.568386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:03:35.141755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569466+0000","last_change":"2023-07-21T07:35:31.561900+0000","last_active":"2023-07-21T07:35:32.569466+0000","last_peered":"2023-07-21T07:35:32.569466+0000","last_clean":"2023-07-21T07:35:32.569466+0000","last_became_active":"2023-07-21T07:35:31.561610+0000","last_became_peered":"2023-07-21T07:35:31.561610+0000","last_unstale":"2023-07-21T07:35:32.569466+0000","last_undegraded":"2023-07-21T07:35:32.569466+0000","last_fullsized":"2023-07-21T07:35:32.569466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:12:33.100080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568641+0000","last_change":"2023-07-21T07:35:30.553301+0000","last_active":"2023-07-21T07:35:32.568641+0000","last_peered":"2023-07-21T07:35:32.568641+0000","last_clean":"2023-07-21T07:35:32.568641+0000","last_became_active":"2023-07-21T07:35:30.552995+0000","last_became_peered":"2023-07-21T07:35:30.552995+0000","last_unstale":"2023-07-21T07:35:32.568641+0000","last_undegraded":"2023-07-21T07:35:32.568641+0000","last_fullsized":"2023-07-21T07:35:32.568641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:28:06.064555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.587840+0000","last_change":"2023-07-21T07:35:31.582790+0000","last_active":"2023-07-21T07:35:31.587840+0000","last_peered":"2023-07-21T07:35:31.587840+0000","last_clean":"2023-07-21T07:35:31.587840+0000","last_became_active":"2023-07-21T07:35:31.582479+0000","last_became_peered":"2023-07-21T07:35:31.582479+0000","last_unstale":"2023-07-21T07:35:31.587840+0000","last_undegraded":"2023-07-21T07:35:31.587840+0000","last_fullsized":"2023-07-21T07:35:31.587840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:08:05.332681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.566247+0000","last_change":"2023-07-21T07:35:30.548637+0000","last_active":"2023-07-21T07:35:31.566247+0000","last_peered":"2023-07-21T07:35:31.566247+0000","last_clean":"2023-07-21T07:35:31.566247+0000","last_became_active":"2023-07-21T07:35:30.548340+0000","last_became_peered":"2023-07-21T07:35:30.548340+0000","last_unstale":"2023-07-21T07:35:31.566247+0000","last_undegraded":"2023-07-21T07:35:31.566247+0000","last_fullsized":"2023-07-21T07:35:31.566247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:10:34.417662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.554171+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:35:31.554171+0000","last_peered":"2023-07-21T07:35:31.554171+0000","last_clean":"2023-07-21T07:35:31.554171+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:35:31.554171+0000","last_undegraded":"2023-07-21T07:35:31.554171+0000","last_fullsized":"2023-07-21T07:35:31.554171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:45:15.575956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569213+0000","last_change":"2023-07-21T07:35:31.581657+0000","last_active":"2023-07-21T07:35:32.569213+0000","last_peered":"2023-07-21T07:35:32.569213+0000","last_clean":"2023-07-21T07:35:32.569213+0000","last_became_active":"2023-07-21T07:35:31.581117+0000","last_became_peered":"2023-07-21T07:35:31.581117+0000","last_unstale":"2023-07-21T07:35:32.569213+0000","last_undegraded":"2023-07-21T07:35:32.569213+0000","last_fullsized":"2023-07-21T07:35:32.569213+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:27:49.705623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.565910+0000","last_change":"2023-07-21T07:35:30.552526+0000","last_active":"2023-07-21T07:35:31.565910+0000","last_peered":"2023-07-21T07:35:31.565910+0000","last_clean":"2023-07-21T07:35:31.565910+0000","last_became_active":"2023-07-21T07:35:30.552173+0000","last_became_peered":"2023-07-21T07:35:30.552173+0000","last_unstale":"2023-07-21T07:35:31.565910+0000","last_undegraded":"2023-07-21T07:35:31.565910+0000","last_fullsized":"2023-07-21T07:35:31.565910+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:05:01.281243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.569565+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:35:31.569565+0000","last_peered":"2023-07-21T07:35:31.569565+0000","last_clean":"2023-07-21T07:35:31.569565+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:35:31.569565+0000","last_undegraded":"2023-07-21T07:35:31.569565+0000","last_fullsized":"2023-07-21T07:35:31.569565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:39:14.936186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568005+0000","last_change":"2023-07-21T07:35:31.576484+0000","last_active":"2023-07-21T07:35:32.568005+0000","last_peered":"2023-07-21T07:35:32.568005+0000","last_clean":"2023-07-21T07:35:32.568005+0000","last_became_active":"2023-07-21T07:35:31.576171+0000","last_became_peered":"2023-07-21T07:35:31.576171+0000","last_unstale":"2023-07-21T07:35:32.568005+0000","last_undegraded":"2023-07-21T07:35:32.568005+0000","last_fullsized":"2023-07-21T07:35:32.568005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:40:11.625179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569257+0000","last_change":"2023-07-21T07:35:30.549185+0000","last_active":"2023-07-21T07:35:32.569257+0000","last_peered":"2023-07-21T07:35:32.569257+0000","last_clean":"2023-07-21T07:35:32.569257+0000","last_became_active":"2023-07-21T07:35:30.548890+0000","last_became_peered":"2023-07-21T07:35:30.548890+0000","last_unstale":"2023-07-21T07:35:32.569257+0000","last_undegraded":"2023-07-21T07:35:32.569257+0000","last_fullsized":"2023-07-21T07:35:32.569257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:10:36.746295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568773+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:35:32.568773+0000","last_peered":"2023-07-21T07:35:32.568773+0000","last_clean":"2023-07-21T07:35:32.568773+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:35:32.568773+0000","last_undegraded":"2023-07-21T07:35:32.568773+0000","last_fullsized":"2023-07-21T07:35:32.568773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:42:40.864219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589567+0000","last_change":"2023-07-21T07:35:31.583146+0000","last_active":"2023-07-21T07:35:31.589567+0000","last_peered":"2023-07-21T07:35:31.589567+0000","last_clean":"2023-07-21T07:35:31.589567+0000","last_became_active":"2023-07-21T07:35:31.582823+0000","last_became_peered":"2023-07-21T07:35:31.582823+0000","last_unstale":"2023-07-21T07:35:31.589567+0000","last_undegraded":"2023-07-21T07:35:31.589567+0000","last_fullsized":"2023-07-21T07:35:31.589567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:08:50.302036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568094+0000","last_change":"2023-07-21T07:35:30.553624+0000","last_active":"2023-07-21T07:35:32.568094+0000","last_peered":"2023-07-21T07:35:32.568094+0000","last_clean":"2023-07-21T07:35:32.568094+0000","last_became_active":"2023-07-21T07:35:30.553307+0000","last_became_peered":"2023-07-21T07:35:30.553307+0000","last_unstale":"2023-07-21T07:35:32.568094+0000","last_undegraded":"2023-07-21T07:35:32.568094+0000","last_fullsized":"2023-07-21T07:35:32.568094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:43:22.152510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.569274+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:35:31.569274+0000","last_peered":"2023-07-21T07:35:31.569274+0000","last_clean":"2023-07-21T07:35:31.569274+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:35:31.569274+0000","last_undegraded":"2023-07-21T07:35:31.569274+0000","last_fullsized":"2023-07-21T07:35:31.569274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:45:02.730802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568334+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:35:32.568334+0000","last_peered":"2023-07-21T07:35:32.568334+0000","last_clean":"2023-07-21T07:35:32.568334+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:35:32.568334+0000","last_undegraded":"2023-07-21T07:35:32.568334+0000","last_fullsized":"2023-07-21T07:35:32.568334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:56:20.211255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.577083+0000","last_change":"2023-07-21T07:35:31.572728+0000","last_active":"2023-07-21T07:35:31.577083+0000","last_peered":"2023-07-21T07:35:31.577083+0000","last_clean":"2023-07-21T07:35:31.577083+0000","last_became_active":"2023-07-21T07:35:31.572409+0000","last_became_peered":"2023-07-21T07:35:31.572409+0000","last_unstale":"2023-07-21T07:35:31.577083+0000","last_undegraded":"2023-07-21T07:35:31.577083+0000","last_fullsized":"2023-07-21T07:35:31.577083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:46:01.679166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.588922+0000","last_change":"2023-07-21T07:35:30.552592+0000","last_active":"2023-07-21T07:35:31.588922+0000","last_peered":"2023-07-21T07:35:31.588922+0000","last_clean":"2023-07-21T07:35:31.588922+0000","last_became_active":"2023-07-21T07:35:30.552218+0000","last_became_peered":"2023-07-21T07:35:30.552218+0000","last_unstale":"2023-07-21T07:35:31.588922+0000","last_undegraded":"2023-07-21T07:35:31.588922+0000","last_fullsized":"2023-07-21T07:35:31.588922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:46:22.849533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568240+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:35:32.568240+0000","last_peered":"2023-07-21T07:35:32.568240+0000","last_clean":"2023-07-21T07:35:32.568240+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:35:32.568240+0000","last_undegraded":"2023-07-21T07:35:32.568240+0000","last_fullsized":"2023-07-21T07:35:32.568240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:56:34.888918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.581972+0000","last_change":"2023-07-21T07:35:31.576629+0000","last_active":"2023-07-21T07:35:31.581972+0000","last_peered":"2023-07-21T07:35:31.581972+0000","last_clean":"2023-07-21T07:35:31.581972+0000","last_became_active":"2023-07-21T07:35:31.575947+0000","last_became_peered":"2023-07-21T07:35:31.575947+0000","last_unstale":"2023-07-21T07:35:31.581972+0000","last_undegraded":"2023-07-21T07:35:31.581972+0000","last_fullsized":"2023-07-21T07:35:31.581972+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:12:33.100080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.573458+0000","last_change":"2023-07-21T07:35:30.546891+0000","last_active":"2023-07-21T07:35:31.573458+0000","last_peered":"2023-07-21T07:35:31.573458+0000","last_clean":"2023-07-21T07:35:31.573458+0000","last_became_active":"2023-07-21T07:35:30.546607+0000","last_became_peered":"2023-07-21T07:35:30.546607+0000","last_unstale":"2023-07-21T07:35:31.573458+0000","last_undegraded":"2023-07-21T07:35:31.573458+0000","last_fullsized":"2023-07-21T07:35:31.573458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:40:49.465460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568044+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:35:32.568044+0000","last_peered":"2023-07-21T07:35:32.568044+0000","last_clean":"2023-07-21T07:35:32.568044+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:35:32.568044+0000","last_undegraded":"2023-07-21T07:35:32.568044+0000","last_fullsized":"2023-07-21T07:35:32.568044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:46:48.403619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589663+0000","last_change":"2023-07-21T07:35:31.583748+0000","last_active":"2023-07-21T07:35:31.589663+0000","last_peered":"2023-07-21T07:35:31.589663+0000","last_clean":"2023-07-21T07:35:31.589663+0000","last_became_active":"2023-07-21T07:35:31.583463+0000","last_became_peered":"2023-07-21T07:35:31.583463+0000","last_unstale":"2023-07-21T07:35:31.589663+0000","last_undegraded":"2023-07-21T07:35:31.589663+0000","last_fullsized":"2023-07-21T07:35:31.589663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:28:42.691072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.562006+0000","last_change":"2023-07-21T07:35:30.551446+0000","last_active":"2023-07-21T07:35:31.562006+0000","last_peered":"2023-07-21T07:35:31.562006+0000","last_clean":"2023-07-21T07:35:31.562006+0000","last_became_active":"2023-07-21T07:35:30.551160+0000","last_became_peered":"2023-07-21T07:35:30.551160+0000","last_unstale":"2023-07-21T07:35:31.562006+0000","last_undegraded":"2023-07-21T07:35:31.562006+0000","last_fullsized":"2023-07-21T07:35:31.562006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:15:49.199967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.553584+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:35:31.553584+0000","last_peered":"2023-07-21T07:35:31.553584+0000","last_clean":"2023-07-21T07:35:31.553584+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:35:31.553584+0000","last_undegraded":"2023-07-21T07:35:31.553584+0000","last_fullsized":"2023-07-21T07:35:31.553584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:31:39.805950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568245+0000","last_change":"2023-07-21T07:35:31.576679+0000","last_active":"2023-07-21T07:35:32.568245+0000","last_peered":"2023-07-21T07:35:32.568245+0000","last_clean":"2023-07-21T07:35:32.568245+0000","last_became_active":"2023-07-21T07:35:31.576259+0000","last_became_peered":"2023-07-21T07:35:31.576259+0000","last_unstale":"2023-07-21T07:35:32.568245+0000","last_undegraded":"2023-07-21T07:35:32.568245+0000","last_fullsized":"2023-07-21T07:35:32.568245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:11:16.968024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568996+0000","last_change":"2023-07-21T07:35:30.551889+0000","last_active":"2023-07-21T07:35:32.568996+0000","last_peered":"2023-07-21T07:35:32.568996+0000","last_clean":"2023-07-21T07:35:32.568996+0000","last_became_active":"2023-07-21T07:35:30.551571+0000","last_became_peered":"2023-07-21T07:35:30.551571+0000","last_unstale":"2023-07-21T07:35:32.568996+0000","last_undegraded":"2023-07-21T07:35:32.568996+0000","last_fullsized":"2023-07-21T07:35:32.568996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:46:37.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.573967+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:35:31.573967+0000","last_peered":"2023-07-21T07:35:31.573967+0000","last_clean":"2023-07-21T07:35:31.573967+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:35:31.573967+0000","last_undegraded":"2023-07-21T07:35:31.573967+0000","last_fullsized":"2023-07-21T07:35:31.573967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:09:41.062320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1007616,"data_stored":753332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.498},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42999999999999999}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":161912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.4990000000000006,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.4039999999999999,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":0.70799999999999996}]},{"osd":1,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.621},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":161420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.309},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.46899999999999997}]},{"osd":6,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.54000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":751732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.29299999999999998}]},{"osd":2,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.314},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.496}]},{"osd":5,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.52100000000000002}]},{"osd":7,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.54600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":161400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.376},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.28699999999999998}]},{"osd":1,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.307},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33400000000000002}]},{"osd":4,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.57899999999999996}]},{"osd":5,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.625},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.63900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":162928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.377}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44600000000000001}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.753},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.79000000000000004}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.74299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":161934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":10.18,"5min":10.18,"15min":10.18},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":10.207000000000001,"5min":10.207000000000001,"15min":10.207000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":0.51800000000000002}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.36799999999999999}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45700000000000002}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.499},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.54600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":161442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.625}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.499},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:35:35.769 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:35:35.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.875+0000 7f6f57f4f700 1 Processor -- start 2023-07-21T07:35:35.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.875+0000 7f6f57f4f700 1 -- start start 2023-07-21T07:35:35.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f57f4f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6f500c3750 0x7f6f500c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f57f4f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f500c6170 0x7f6f5014e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f57f4f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500ba440 con 0x7f6f5014eb90 2023-07-21T07:35:35.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f57f4f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f500c15d0 con 0x7f6f500c3750 2023-07-21T07:35:35.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f57f4f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500c18b0 con 0x7f6f500c6170 2023-07-21T07:35:35.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f55ceb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6f500c3750 0x7f6f500c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f554ea700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f500c6170 0x7f6f5014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f564ec700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6f5014eb90 0x7f6f50154c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:45610/0 (socket says 172.21.15.6:45610) 2023-07-21T07:35:35.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f564ec700 1 -- 172.21.15.6:0/3442076910 learned_addr learned my addr 172.21.15.6:0/3442076910 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:35.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f554ea700 1 -- 172.21.15.6:0/3442076910 >> v2:172.21.15.86:3300/0 conn(0x7f6f500c3750 msgr2=0x7f6f500c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:35.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f554ea700 1 --2- 172.21.15.6:0/3442076910 >> v2:172.21.15.86:3300/0 conn(0x7f6f500c3750 0x7f6f500c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f554ea700 1 -- 172.21.15.6:0/3442076910 >> v1:172.21.15.86:6789/0 conn(0x7f6f5014eb90 legacy=0x7f6f50154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f554ea700 1 -- 172.21.15.6:0/3442076910 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f500c1b90 con 0x7f6f500c6170 2023-07-21T07:35:35.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f54ce9700 1 -- 172.21.15.6:0/3442076910 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231745160 0 0) 0x7f6f500ba440 con 0x7f6f5014eb90 2023-07-21T07:35:35.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.876+0000 7f6f55ceb700 1 --2- 172.21.15.6:0/3442076910 >> v2:172.21.15.86:3300/0 conn(0x7f6f500c3750 0x7f6f500c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:35.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.877+0000 7f6f554ea700 1 --2- 172.21.15.6:0/3442076910 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f500c6170 0x7f6f5014e650 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009840 tx=0x7f6f40009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d255d51eb8e1e034 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:35.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.877+0000 7f6f54ce9700 1 -- 172.21.15.6:0/3442076910 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40011830 con 0x7f6f500c6170 2023-07-21T07:35:35.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.877+0000 7f6f54ce9700 1 -- 172.21.15.6:0/3442076910 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f40011990 con 0x7f6f500c6170 2023-07-21T07:35:35.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.877+0000 7f6f54ce9700 1 -- 172.21.15.6:0/3442076910 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40011d20 con 0x7f6f500c6170 2023-07-21T07:35:35.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.877+0000 7f6f57f4f700 1 -- 172.21.15.6:0/3442076910 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f500c6170 msgr2=0x7f6f5014e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.877+0000 7f6f57f4f700 1 --2- 172.21.15.6:0/3442076910 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f500c6170 0x7f6f5014e650 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009840 tx=0x7f6f40009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:35.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.877+0000 7f6f57f4f700 1 -- 172.21.15.6:0/3442076910 shutdown_connections 2023-07-21T07:35:35.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.877+0000 7f6f57f4f700 1 --2- 172.21.15.6:0/3442076910 >> v2:172.21.15.86:3300/0 conn(0x7f6f500c3750 0x7f6f500c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.877+0000 7f6f57f4f700 1 --2- 172.21.15.6:0/3442076910 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f500c6170 0x7f6f5014e650 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.877+0000 7f6f57f4f700 1 -- 172.21.15.6:0/3442076910 >> 172.21.15.6:0/3442076910 conn(0x7f6f500a8c90 msgr2=0x7f6f5006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:35.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.878+0000 7f6f57f4f700 1 -- 172.21.15.6:0/3442076910 shutdown_connections 2023-07-21T07:35:35.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.878+0000 7f6f57f4f700 1 -- 172.21.15.6:0/3442076910 wait complete. 2023-07-21T07:35:35.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.879+0000 7f6f57f4f700 1 Processor -- start 2023-07-21T07:35:35.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.879+0000 7f6f57f4f700 1 -- start start 2023-07-21T07:35:35.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.879+0000 7f6f57f4f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f500c3750 0x7f6f501eb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.879+0000 7f6f57f4f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f500c6170 0x7f6f50150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.879+0000 7f6f57f4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f5014eb90 0x7f6f500c0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.879+0000 7f6f57f4f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50150570 con 0x7f6f5014eb90 2023-07-21T07:35:35.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.879+0000 7f6f57f4f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500ab940 con 0x7f6f500c3750 2023-07-21T07:35:35.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.879+0000 7f6f57f4f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500ab0a0 con 0x7f6f500c6170 2023-07-21T07:35:35.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.879+0000 7f6f564ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f5014eb90 0x7f6f500c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f564ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f5014eb90 0x7f6f500c0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34354/0 (socket says 172.21.15.6:34354) 2023-07-21T07:35:35.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f564ec700 1 -- 172.21.15.6:0/1949290193 learned_addr learned my addr 172.21.15.6:0/1949290193 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:35.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f55ceb700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f500c3750 0x7f6f501eb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f554ea700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f500c6170 0x7f6f50150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f564ec700 1 -- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f500c6170 msgr2=0x7f6f50150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f564ec700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f500c6170 0x7f6f50150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f564ec700 1 -- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f500c3750 msgr2=0x7f6f501eb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:35.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f564ec700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f500c3750 0x7f6f501eb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:35.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f564ec700 1 -- 172.21.15.6:0/1949290193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c0094a0 con 0x7f6f5014eb90 2023-07-21T07:35:35.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f564ec700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f5014eb90 0x7f6f500c0660 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800cba0 tx=0x7f6f4800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:35.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f467fc700 1 -- 172.21.15.6:0/1949290193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4800aaa0 con 0x7f6f5014eb90 2023-07-21T07:35:35.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f467fc700 1 -- 172.21.15.6:0/1949290193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4800ac20 con 0x7f6f5014eb90 2023-07-21T07:35:35.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f57f4f700 1 -- 172.21.15.6:0/1949290193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f400094a0 con 0x7f6f5014eb90 2023-07-21T07:35:35.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f467fc700 1 -- 172.21.15.6:0/1949290193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480070d0 con 0x7f6f5014eb90 2023-07-21T07:35:35.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.880+0000 7f6f57f4f700 1 -- 172.21.15.6:0/1949290193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f500ab660 con 0x7f6f5014eb90 2023-07-21T07:35:35.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.881+0000 7f6f57f4f700 1 -- 172.21.15.6:0/1949290193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f501506e0 con 0x7f6f5014eb90 2023-07-21T07:35:35.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.882+0000 7f6f467fc700 1 -- 172.21.15.6:0/1949290193 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f48007230 con 0x7f6f5014eb90 2023-07-21T07:35:35.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.883+0000 7f6f467fc700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6f3406ace0 0x7f6f3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:35.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.883+0000 7f6f467fc700 1 -- 172.21.15.6:0/1949290193 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f48089310 con 0x7f6f5014eb90 2023-07-21T07:35:35.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.883+0000 7f6f55ceb700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6f3406ace0 0x7f6f3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:35.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.883+0000 7f6f55ceb700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6f3406ace0 0x7f6f3406d1a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6f5006c370 tx=0x7f6f4c009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:35.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:35.886+0000 7f6f467fc700 1 -- 172.21.15.6:0/1949290193 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6f48054450 con 0x7f6f5014eb90 2023-07-21T07:35:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.080+0000 7f6f57f4f700 1 -- 172.21.15.6:0/1949290193 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f5014efc0 con 0x7f6f3406ace0 2023-07-21T07:35:36.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.088+0000 7f6f467fc700 1 -- 172.21.15.6:0/1949290193 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311167 (secure 0 0 0) 0x7f6f4c011b40 con 0x7f6f3406ace0 2023-07-21T07:35:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:36.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.092+0000 7f6f57f4f700 1 -- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6f3406ace0 msgr2=0x7f6f3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:36.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.092+0000 7f6f57f4f700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6f3406ace0 0x7f6f3406d1a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6f5006c370 tx=0x7f6f4c009210 comp rx=0 tx=0).stop 2023-07-21T07:35:36.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.092+0000 7f6f57f4f700 1 -- 172.21.15.6:0/1949290193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f5014eb90 msgr2=0x7f6f500c0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:36.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.092+0000 7f6f57f4f700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f5014eb90 0x7f6f500c0660 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800cba0 tx=0x7f6f4800ceb0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.092+0000 7f6f57f4f700 1 -- 172.21.15.6:0/1949290193 shutdown_connections 2023-07-21T07:35:36.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.092+0000 7f6f57f4f700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6f3406ace0 0x7f6f3406d1a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.092+0000 7f6f57f4f700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f5014eb90 0x7f6f500c0660 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.092+0000 7f6f57f4f700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f500c3750 0x7f6f501eb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.092+0000 7f6f57f4f700 1 --2- 172.21.15.6:0/1949290193 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f500c6170 0x7f6f50150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.092+0000 7f6f57f4f700 1 -- 172.21.15.6:0/1949290193 >> 172.21.15.6:0/1949290193 conn(0x7f6f500a8c90 msgr2=0x7f6f501dba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:36.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.092+0000 7f6f57f4f700 1 -- 172.21.15.6:0/1949290193 shutdown_connections 2023-07-21T07:35:36.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.092+0000 7f6f57f4f700 1 -- 172.21.15.6:0/1949290193 wait complete. 2023-07-21T07:35:36.151 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:35:36.155 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-07-21T07:35:34.705078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220504,"kb_used_data":4328,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754216,"statfs":{"total":773094113280,"available":772868317184,"internally_reserved":0,"allocated":4431872,"data_stored":2476100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.176825"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569529+0000","last_change":"2023-07-21T07:35:31.572060+0000","last_active":"2023-07-21T07:35:32.569529+0000","last_peered":"2023-07-21T07:35:32.569529+0000","last_clean":"2023-07-21T07:35:32.569529+0000","last_became_active":"2023-07-21T07:35:31.571747+0000","last_became_peered":"2023-07-21T07:35:31.571747+0000","last_unstale":"2023-07-21T07:35:32.569529+0000","last_undegraded":"2023-07-21T07:35:32.569529+0000","last_fullsized":"2023-07-21T07:35:32.569529+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:02:56.930040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569080+0000","last_change":"2023-07-21T07:35:31.567420+0000","last_active":"2023-07-21T07:35:32.569080+0000","last_peered":"2023-07-21T07:35:32.569080+0000","last_clean":"2023-07-21T07:35:32.569080+0000","last_became_active":"2023-07-21T07:35:31.567119+0000","last_became_peered":"2023-07-21T07:35:31.567119+0000","last_unstale":"2023-07-21T07:35:32.569080+0000","last_undegraded":"2023-07-21T07:35:32.569080+0000","last_fullsized":"2023-07-21T07:35:32.569080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:21:11.083643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.577945+0000","last_change":"2023-07-21T07:35:31.572534+0000","last_active":"2023-07-21T07:35:31.577945+0000","last_peered":"2023-07-21T07:35:31.577945+0000","last_clean":"2023-07-21T07:35:31.577945+0000","last_became_active":"2023-07-21T07:35:31.572252+0000","last_became_peered":"2023-07-21T07:35:31.572252+0000","last_unstale":"2023-07-21T07:35:31.577945+0000","last_undegraded":"2023-07-21T07:35:31.577945+0000","last_fullsized":"2023-07-21T07:35:31.577945+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:48:55.711098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569296+0000","last_change":"2023-07-21T07:35:31.576630+0000","last_active":"2023-07-21T07:35:32.569296+0000","last_peered":"2023-07-21T07:35:32.569296+0000","last_clean":"2023-07-21T07:35:32.569296+0000","last_became_active":"2023-07-21T07:35:31.576116+0000","last_became_peered":"2023-07-21T07:35:31.576116+0000","last_unstale":"2023-07-21T07:35:32.569296+0000","last_undegraded":"2023-07-21T07:35:32.569296+0000","last_fullsized":"2023-07-21T07:35:32.569296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:34:55.239322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569126+0000","last_change":"2023-07-21T07:35:31.570813+0000","last_active":"2023-07-21T07:35:32.569126+0000","last_peered":"2023-07-21T07:35:32.569126+0000","last_clean":"2023-07-21T07:35:32.569126+0000","last_became_active":"2023-07-21T07:35:31.570509+0000","last_became_peered":"2023-07-21T07:35:31.570509+0000","last_unstale":"2023-07-21T07:35:32.569126+0000","last_undegraded":"2023-07-21T07:35:32.569126+0000","last_fullsized":"2023-07-21T07:35:32.569126+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:49:29.253329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.570072+0000","last_change":"2023-07-21T07:35:31.564194+0000","last_active":"2023-07-21T07:35:31.570072+0000","last_peered":"2023-07-21T07:35:31.570072+0000","last_clean":"2023-07-21T07:35:31.570072+0000","last_became_active":"2023-07-21T07:35:31.563915+0000","last_became_peered":"2023-07-21T07:35:31.563915+0000","last_unstale":"2023-07-21T07:35:31.570072+0000","last_undegraded":"2023-07-21T07:35:31.570072+0000","last_fullsized":"2023-07-21T07:35:31.570072+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:00:01.689136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589623+0000","last_change":"2023-07-21T07:35:31.585808+0000","last_active":"2023-07-21T07:35:31.589623+0000","last_peered":"2023-07-21T07:35:31.589623+0000","last_clean":"2023-07-21T07:35:31.589623+0000","last_became_active":"2023-07-21T07:35:31.585492+0000","last_became_peered":"2023-07-21T07:35:31.585492+0000","last_unstale":"2023-07-21T07:35:31.589623+0000","last_undegraded":"2023-07-21T07:35:31.589623+0000","last_fullsized":"2023-07-21T07:35:31.589623+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:43:23.157527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568845+0000","last_change":"2023-07-21T07:35:31.566207+0000","last_active":"2023-07-21T07:35:32.568845+0000","last_peered":"2023-07-21T07:35:32.568845+0000","last_clean":"2023-07-21T07:35:32.568845+0000","last_became_active":"2023-07-21T07:35:31.565950+0000","last_became_peered":"2023-07-21T07:35:31.565950+0000","last_unstale":"2023-07-21T07:35:32.568845+0000","last_undegraded":"2023-07-21T07:35:32.568845+0000","last_fullsized":"2023-07-21T07:35:32.568845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:59:26.816645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.577434+0000","last_change":"2023-07-21T07:35:31.568180+0000","last_active":"2023-07-21T07:35:31.577434+0000","last_peered":"2023-07-21T07:35:31.577434+0000","last_clean":"2023-07-21T07:35:31.577434+0000","last_became_active":"2023-07-21T07:35:31.567871+0000","last_became_peered":"2023-07-21T07:35:31.567871+0000","last_unstale":"2023-07-21T07:35:31.577434+0000","last_undegraded":"2023-07-21T07:35:31.577434+0000","last_fullsized":"2023-07-21T07:35:31.577434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:40:11.120511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.580010+0000","last_change":"2023-07-21T07:35:31.574487+0000","last_active":"2023-07-21T07:35:31.580010+0000","last_peered":"2023-07-21T07:35:31.580010+0000","last_clean":"2023-07-21T07:35:31.580010+0000","last_became_active":"2023-07-21T07:35:31.574154+0000","last_became_peered":"2023-07-21T07:35:31.574154+0000","last_unstale":"2023-07-21T07:35:31.580010+0000","last_undegraded":"2023-07-21T07:35:31.580010+0000","last_fullsized":"2023-07-21T07:35:31.580010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:45:13.967781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.576175+0000","last_change":"2023-07-21T07:35:31.569009+0000","last_active":"2023-07-21T07:35:31.576175+0000","last_peered":"2023-07-21T07:35:31.576175+0000","last_clean":"2023-07-21T07:35:31.576175+0000","last_became_active":"2023-07-21T07:35:31.568723+0000","last_became_peered":"2023-07-21T07:35:31.568723+0000","last_unstale":"2023-07-21T07:35:31.576175+0000","last_undegraded":"2023-07-21T07:35:31.576175+0000","last_fullsized":"2023-07-21T07:35:31.576175+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:46:01.679166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.578903+0000","last_change":"2023-07-21T07:35:31.574434+0000","last_active":"2023-07-21T07:35:31.578903+0000","last_peered":"2023-07-21T07:35:31.578903+0000","last_clean":"2023-07-21T07:35:31.578903+0000","last_became_active":"2023-07-21T07:35:31.574069+0000","last_became_peered":"2023-07-21T07:35:31.574069+0000","last_unstale":"2023-07-21T07:35:31.578903+0000","last_undegraded":"2023-07-21T07:35:31.578903+0000","last_fullsized":"2023-07-21T07:35:31.578903+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:38:33.688093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.580668+0000","last_change":"2023-07-21T07:35:31.574882+0000","last_active":"2023-07-21T07:35:31.580668+0000","last_peered":"2023-07-21T07:35:31.580668+0000","last_clean":"2023-07-21T07:35:31.580668+0000","last_became_active":"2023-07-21T07:35:31.574354+0000","last_became_peered":"2023-07-21T07:35:31.574354+0000","last_unstale":"2023-07-21T07:35:31.580668+0000","last_undegraded":"2023-07-21T07:35:31.580668+0000","last_fullsized":"2023-07-21T07:35:31.580668+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:25:25.061359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.582488+0000","last_change":"2023-07-21T07:35:31.579241+0000","last_active":"2023-07-21T07:35:31.582488+0000","last_peered":"2023-07-21T07:35:31.582488+0000","last_clean":"2023-07-21T07:35:31.582488+0000","last_became_active":"2023-07-21T07:35:31.578961+0000","last_became_peered":"2023-07-21T07:35:31.578961+0000","last_unstale":"2023-07-21T07:35:31.582488+0000","last_undegraded":"2023-07-21T07:35:31.582488+0000","last_fullsized":"2023-07-21T07:35:31.582488+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:45:13.967781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.586775+0000","last_change":"2023-07-21T07:35:31.580543+0000","last_active":"2023-07-21T07:35:31.586775+0000","last_peered":"2023-07-21T07:35:31.586775+0000","last_clean":"2023-07-21T07:35:31.586775+0000","last_became_active":"2023-07-21T07:35:31.580216+0000","last_became_peered":"2023-07-21T07:35:31.580216+0000","last_unstale":"2023-07-21T07:35:31.586775+0000","last_undegraded":"2023-07-21T07:35:31.586775+0000","last_fullsized":"2023-07-21T07:35:31.586775+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:24:17.732879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568157+0000","last_change":"2023-07-21T07:35:31.565812+0000","last_active":"2023-07-21T07:35:32.568157+0000","last_peered":"2023-07-21T07:35:32.568157+0000","last_clean":"2023-07-21T07:35:32.568157+0000","last_became_active":"2023-07-21T07:35:31.565496+0000","last_became_peered":"2023-07-21T07:35:31.565496+0000","last_unstale":"2023-07-21T07:35:32.568157+0000","last_undegraded":"2023-07-21T07:35:32.568157+0000","last_fullsized":"2023-07-21T07:35:32.568157+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:24:17.732879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.567986+0000","last_change":"2023-07-21T07:35:31.565879+0000","last_active":"2023-07-21T07:35:32.567986+0000","last_peered":"2023-07-21T07:35:32.567986+0000","last_clean":"2023-07-21T07:35:32.567986+0000","last_became_active":"2023-07-21T07:35:31.565592+0000","last_became_peered":"2023-07-21T07:35:31.565592+0000","last_unstale":"2023-07-21T07:35:32.567986+0000","last_undegraded":"2023-07-21T07:35:32.567986+0000","last_fullsized":"2023-07-21T07:35:32.567986+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:45.909102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589363+0000","last_change":"2023-07-21T07:35:31.583163+0000","last_active":"2023-07-21T07:35:31.589363+0000","last_peered":"2023-07-21T07:35:31.589363+0000","last_clean":"2023-07-21T07:35:31.589363+0000","last_became_active":"2023-07-21T07:35:31.582878+0000","last_became_peered":"2023-07-21T07:35:31.582878+0000","last_unstale":"2023-07-21T07:35:31.589363+0000","last_undegraded":"2023-07-21T07:35:31.589363+0000","last_fullsized":"2023-07-21T07:35:31.589363+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:43:37.553211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569678+0000","last_change":"2023-07-21T07:35:31.564789+0000","last_active":"2023-07-21T07:35:32.569678+0000","last_peered":"2023-07-21T07:35:32.569678+0000","last_clean":"2023-07-21T07:35:32.569678+0000","last_became_active":"2023-07-21T07:35:31.564503+0000","last_became_peered":"2023-07-21T07:35:31.564503+0000","last_unstale":"2023-07-21T07:35:32.569678+0000","last_undegraded":"2023-07-21T07:35:32.569678+0000","last_fullsized":"2023-07-21T07:35:32.569678+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:08:05.332681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.584125+0000","last_change":"2023-07-21T07:35:31.575679+0000","last_active":"2023-07-21T07:35:31.584125+0000","last_peered":"2023-07-21T07:35:31.584125+0000","last_clean":"2023-07-21T07:35:31.584125+0000","last_became_active":"2023-07-21T07:35:31.575365+0000","last_became_peered":"2023-07-21T07:35:31.575365+0000","last_unstale":"2023-07-21T07:35:31.584125+0000","last_undegraded":"2023-07-21T07:35:31.584125+0000","last_fullsized":"2023-07-21T07:35:31.584125+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:30:13.755912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.580646+0000","last_change":"2023-07-21T07:35:31.572474+0000","last_active":"2023-07-21T07:35:31.580646+0000","last_peered":"2023-07-21T07:35:31.580646+0000","last_clean":"2023-07-21T07:35:31.580646+0000","last_became_active":"2023-07-21T07:35:31.572214+0000","last_became_peered":"2023-07-21T07:35:31.572214+0000","last_unstale":"2023-07-21T07:35:31.580646+0000","last_undegraded":"2023-07-21T07:35:31.580646+0000","last_fullsized":"2023-07-21T07:35:31.580646+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:10:09.071976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.575125+0000","last_change":"2023-07-21T07:35:31.570945+0000","last_active":"2023-07-21T07:35:31.575125+0000","last_peered":"2023-07-21T07:35:31.575125+0000","last_clean":"2023-07-21T07:35:31.575125+0000","last_became_active":"2023-07-21T07:35:31.570678+0000","last_became_peered":"2023-07-21T07:35:31.570678+0000","last_unstale":"2023-07-21T07:35:31.575125+0000","last_undegraded":"2023-07-21T07:35:31.575125+0000","last_fullsized":"2023-07-21T07:35:31.575125+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:30:15.576980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.567827+0000","last_change":"2023-07-21T07:35:31.571165+0000","last_active":"2023-07-21T07:35:32.567827+0000","last_peered":"2023-07-21T07:35:32.567827+0000","last_clean":"2023-07-21T07:35:32.567827+0000","last_became_active":"2023-07-21T07:35:31.570834+0000","last_became_peered":"2023-07-21T07:35:31.570834+0000","last_unstale":"2023-07-21T07:35:32.567827+0000","last_undegraded":"2023-07-21T07:35:32.567827+0000","last_fullsized":"2023-07-21T07:35:32.567827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:28:42.691072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569122+0000","last_change":"2023-07-21T07:35:31.560958+0000","last_active":"2023-07-21T07:35:32.569122+0000","last_peered":"2023-07-21T07:35:32.569122+0000","last_clean":"2023-07-21T07:35:32.569122+0000","last_became_active":"2023-07-21T07:35:31.560610+0000","last_became_peered":"2023-07-21T07:35:31.560610+0000","last_unstale":"2023-07-21T07:35:32.569122+0000","last_undegraded":"2023-07-21T07:35:32.569122+0000","last_fullsized":"2023-07-21T07:35:32.569122+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:40:50.470477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.585036+0000","last_change":"2023-07-21T07:35:31.575695+0000","last_active":"2023-07-21T07:35:31.585036+0000","last_peered":"2023-07-21T07:35:31.585036+0000","last_clean":"2023-07-21T07:35:31.585036+0000","last_became_active":"2023-07-21T07:35:31.574995+0000","last_became_peered":"2023-07-21T07:35:31.574995+0000","last_unstale":"2023-07-21T07:35:31.585036+0000","last_undegraded":"2023-07-21T07:35:31.585036+0000","last_fullsized":"2023-07-21T07:35:31.585036+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:56:53.975472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.579597+0000","last_change":"2023-07-21T07:35:31.575204+0000","last_active":"2023-07-21T07:35:31.579597+0000","last_peered":"2023-07-21T07:35:31.579597+0000","last_clean":"2023-07-21T07:35:31.579597+0000","last_became_active":"2023-07-21T07:35:31.574935+0000","last_became_peered":"2023-07-21T07:35:31.574935+0000","last_unstale":"2023-07-21T07:35:31.579597+0000","last_undegraded":"2023-07-21T07:35:31.579597+0000","last_fullsized":"2023-07-21T07:35:31.579597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:07:37.523677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589201+0000","last_change":"2023-07-21T07:35:31.580409+0000","last_active":"2023-07-21T07:35:31.589201+0000","last_peered":"2023-07-21T07:35:31.589201+0000","last_clean":"2023-07-21T07:35:31.589201+0000","last_became_active":"2023-07-21T07:35:31.580078+0000","last_became_peered":"2023-07-21T07:35:31.580078+0000","last_unstale":"2023-07-21T07:35:31.589201+0000","last_undegraded":"2023-07-21T07:35:31.589201+0000","last_fullsized":"2023-07-21T07:35:31.589201+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:51:53.349193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589601+0000","last_change":"2023-07-21T07:35:31.583360+0000","last_active":"2023-07-21T07:35:31.589601+0000","last_peered":"2023-07-21T07:35:31.589601+0000","last_clean":"2023-07-21T07:35:31.589601+0000","last_became_active":"2023-07-21T07:35:31.582534+0000","last_became_peered":"2023-07-21T07:35:31.582534+0000","last_unstale":"2023-07-21T07:35:31.589601+0000","last_undegraded":"2023-07-21T07:35:31.589601+0000","last_fullsized":"2023-07-21T07:35:31.589601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:15:44.024314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589316+0000","last_change":"2023-07-21T07:35:31.582080+0000","last_active":"2023-07-21T07:35:31.589316+0000","last_peered":"2023-07-21T07:35:31.589316+0000","last_clean":"2023-07-21T07:35:31.589316+0000","last_became_active":"2023-07-21T07:35:31.581824+0000","last_became_peered":"2023-07-21T07:35:31.581824+0000","last_unstale":"2023-07-21T07:35:31.589316+0000","last_undegraded":"2023-07-21T07:35:31.589316+0000","last_fullsized":"2023-07-21T07:35:31.589316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:49:29.253329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.592039+0000","last_change":"2023-07-21T07:35:31.586191+0000","last_active":"2023-07-21T07:35:31.592039+0000","last_peered":"2023-07-21T07:35:31.592039+0000","last_clean":"2023-07-21T07:35:31.592039+0000","last_became_active":"2023-07-21T07:35:31.585881+0000","last_became_peered":"2023-07-21T07:35:31.585881+0000","last_unstale":"2023-07-21T07:35:31.592039+0000","last_undegraded":"2023-07-21T07:35:31.592039+0000","last_fullsized":"2023-07-21T07:35:31.592039+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:28:07.069571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568047+0000","last_change":"2023-07-21T07:35:31.566417+0000","last_active":"2023-07-21T07:35:32.568047+0000","last_peered":"2023-07-21T07:35:32.568047+0000","last_clean":"2023-07-21T07:35:32.568047+0000","last_became_active":"2023-07-21T07:35:31.565614+0000","last_became_peered":"2023-07-21T07:35:31.565614+0000","last_unstale":"2023-07-21T07:35:32.568047+0000","last_undegraded":"2023-07-21T07:35:32.568047+0000","last_fullsized":"2023-07-21T07:35:32.568047+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:29:55.040410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.575541+0000","last_change":"2023-07-21T07:35:31.568296+0000","last_active":"2023-07-21T07:35:31.575541+0000","last_peered":"2023-07-21T07:35:31.575541+0000","last_clean":"2023-07-21T07:35:31.575541+0000","last_became_active":"2023-07-21T07:35:31.567956+0000","last_became_peered":"2023-07-21T07:35:31.567956+0000","last_unstale":"2023-07-21T07:35:31.575541+0000","last_undegraded":"2023-07-21T07:35:31.575541+0000","last_fullsized":"2023-07-21T07:35:31.575541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:02:56.930040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.567982+0000","last_change":"2023-07-21T07:35:31.572362+0000","last_active":"2023-07-21T07:35:32.567982+0000","last_peered":"2023-07-21T07:35:32.567982+0000","last_clean":"2023-07-21T07:35:32.567982+0000","last_became_active":"2023-07-21T07:35:31.572080+0000","last_became_peered":"2023-07-21T07:35:31.572080+0000","last_unstale":"2023-07-21T07:35:32.567982+0000","last_undegraded":"2023-07-21T07:35:32.567982+0000","last_fullsized":"2023-07-21T07:35:32.567982+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:30:15.576980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.592494+0000","last_change":"2023-07-21T07:35:30.552422+0000","last_active":"2023-07-21T07:35:31.592494+0000","last_peered":"2023-07-21T07:35:31.592494+0000","last_clean":"2023-07-21T07:35:31.592494+0000","last_became_active":"2023-07-21T07:35:30.552153+0000","last_became_peered":"2023-07-21T07:35:30.552153+0000","last_unstale":"2023-07-21T07:35:31.592494+0000","last_undegraded":"2023-07-21T07:35:31.592494+0000","last_fullsized":"2023-07-21T07:35:31.592494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:26:51.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.577492+0000","last_change":"2023-07-21T07:35:31.572810+0000","last_active":"2023-07-21T07:35:31.577492+0000","last_peered":"2023-07-21T07:35:31.577492+0000","last_clean":"2023-07-21T07:35:31.577492+0000","last_became_active":"2023-07-21T07:35:31.572369+0000","last_became_peered":"2023-07-21T07:35:31.572369+0000","last_unstale":"2023-07-21T07:35:31.577492+0000","last_undegraded":"2023-07-21T07:35:31.577492+0000","last_fullsized":"2023-07-21T07:35:31.577492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:08:50.302036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.586953+0000","last_change":"2023-07-21T07:35:30.549262+0000","last_active":"2023-07-21T07:35:31.586953+0000","last_peered":"2023-07-21T07:35:31.586953+0000","last_clean":"2023-07-21T07:35:31.586953+0000","last_became_active":"2023-07-21T07:35:30.548946+0000","last_became_peered":"2023-07-21T07:35:30.548946+0000","last_unstale":"2023-07-21T07:35:31.586953+0000","last_undegraded":"2023-07-21T07:35:31.586953+0000","last_fullsized":"2023-07-21T07:35:31.586953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:14:52.904051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.582445+0000","last_change":"2023-07-21T07:35:31.579255+0000","last_active":"2023-07-21T07:35:31.582445+0000","last_peered":"2023-07-21T07:35:31.582445+0000","last_clean":"2023-07-21T07:35:31.582445+0000","last_became_active":"2023-07-21T07:35:31.578910+0000","last_became_peered":"2023-07-21T07:35:31.578910+0000","last_unstale":"2023-07-21T07:35:31.582445+0000","last_undegraded":"2023-07-21T07:35:31.582445+0000","last_fullsized":"2023-07-21T07:35:31.582445+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:43:23.157527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.585318+0000","last_change":"2023-07-21T07:35:30.550649+0000","last_active":"2023-07-21T07:35:31.585318+0000","last_peered":"2023-07-21T07:35:31.585318+0000","last_clean":"2023-07-21T07:35:31.585318+0000","last_became_active":"2023-07-21T07:35:30.550349+0000","last_became_peered":"2023-07-21T07:35:30.550349+0000","last_unstale":"2023-07-21T07:35:31.585318+0000","last_undegraded":"2023-07-21T07:35:31.585318+0000","last_fullsized":"2023-07-21T07:35:31.585318+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:43:08.098732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569653+0000","last_change":"2023-07-21T07:35:31.584271+0000","last_active":"2023-07-21T07:35:32.569653+0000","last_peered":"2023-07-21T07:35:32.569653+0000","last_clean":"2023-07-21T07:35:32.569653+0000","last_became_active":"2023-07-21T07:35:31.583788+0000","last_became_peered":"2023-07-21T07:35:31.583788+0000","last_unstale":"2023-07-21T07:35:32.569653+0000","last_undegraded":"2023-07-21T07:35:32.569653+0000","last_fullsized":"2023-07-21T07:35:32.569653+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:07:37.523677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.588519+0000","last_change":"2023-07-21T07:35:30.551432+0000","last_active":"2023-07-21T07:35:31.588519+0000","last_peered":"2023-07-21T07:35:31.588519+0000","last_clean":"2023-07-21T07:35:31.588519+0000","last_became_active":"2023-07-21T07:35:30.551141+0000","last_became_peered":"2023-07-21T07:35:30.551141+0000","last_unstale":"2023-07-21T07:35:31.588519+0000","last_undegraded":"2023-07-21T07:35:31.588519+0000","last_fullsized":"2023-07-21T07:35:31.588519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:40:10.620162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.577896+0000","last_change":"2023-07-21T07:35:31.568304+0000","last_active":"2023-07-21T07:35:31.577896+0000","last_peered":"2023-07-21T07:35:31.577896+0000","last_clean":"2023-07-21T07:35:31.577896+0000","last_became_active":"2023-07-21T07:35:31.567923+0000","last_became_peered":"2023-07-21T07:35:31.567923+0000","last_unstale":"2023-07-21T07:35:31.577896+0000","last_undegraded":"2023-07-21T07:35:31.577896+0000","last_fullsized":"2023-07-21T07:35:31.577896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:36:43.305253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.586748+0000","last_change":"2023-07-21T07:35:30.546712+0000","last_active":"2023-07-21T07:35:31.586748+0000","last_peered":"2023-07-21T07:35:31.586748+0000","last_clean":"2023-07-21T07:35:31.586748+0000","last_became_active":"2023-07-21T07:35:30.546408+0000","last_became_peered":"2023-07-21T07:35:30.546408+0000","last_unstale":"2023-07-21T07:35:31.586748+0000","last_undegraded":"2023-07-21T07:35:31.586748+0000","last_fullsized":"2023-07-21T07:35:31.586748+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:15:49.199967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.581557+0000","last_change":"2023-07-21T07:35:31.578102+0000","last_active":"2023-07-21T07:35:31.581557+0000","last_peered":"2023-07-21T07:35:31.581557+0000","last_clean":"2023-07-21T07:35:31.581557+0000","last_became_active":"2023-07-21T07:35:31.577824+0000","last_became_peered":"2023-07-21T07:35:31.577824+0000","last_unstale":"2023-07-21T07:35:31.581557+0000","last_undegraded":"2023-07-21T07:35:31.581557+0000","last_fullsized":"2023-07-21T07:35:31.581557+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:45.909102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568168+0000","last_change":"2023-07-21T07:35:30.550820+0000","last_active":"2023-07-21T07:35:32.568168+0000","last_peered":"2023-07-21T07:35:32.568168+0000","last_clean":"2023-07-21T07:35:32.568168+0000","last_became_active":"2023-07-21T07:35:30.550525+0000","last_became_peered":"2023-07-21T07:35:30.550525+0000","last_unstale":"2023-07-21T07:35:32.568168+0000","last_undegraded":"2023-07-21T07:35:32.568168+0000","last_fullsized":"2023-07-21T07:35:32.568168+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:11:40.377386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.581557+0000","last_change":"2023-07-21T07:35:31.577159+0000","last_active":"2023-07-21T07:35:31.581557+0000","last_peered":"2023-07-21T07:35:31.581557+0000","last_clean":"2023-07-21T07:35:31.581557+0000","last_became_active":"2023-07-21T07:35:31.576870+0000","last_became_peered":"2023-07-21T07:35:31.576870+0000","last_unstale":"2023-07-21T07:35:31.581557+0000","last_undegraded":"2023-07-21T07:35:31.581557+0000","last_fullsized":"2023-07-21T07:35:31.581557+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:45:59.419794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.553193+0000","last_change":"2023-07-21T07:35:30.542823+0000","last_active":"2023-07-21T07:35:31.553193+0000","last_peered":"2023-07-21T07:35:31.553193+0000","last_clean":"2023-07-21T07:35:31.553193+0000","last_became_active":"2023-07-21T07:35:30.542612+0000","last_became_peered":"2023-07-21T07:35:30.542612+0000","last_unstale":"2023-07-21T07:35:31.553193+0000","last_undegraded":"2023-07-21T07:35:31.553193+0000","last_fullsized":"2023-07-21T07:35:31.553193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:00:35.971652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569618+0000","last_change":"2023-07-21T07:35:31.561749+0000","last_active":"2023-07-21T07:35:32.569618+0000","last_peered":"2023-07-21T07:35:32.569618+0000","last_clean":"2023-07-21T07:35:32.569618+0000","last_became_active":"2023-07-21T07:35:31.561255+0000","last_became_peered":"2023-07-21T07:35:31.561255+0000","last_unstale":"2023-07-21T07:35:32.569618+0000","last_undegraded":"2023-07-21T07:35:32.569618+0000","last_fullsized":"2023-07-21T07:35:32.569618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:03:51.800900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.563377+0000","last_change":"2023-07-21T07:35:30.550858+0000","last_active":"2023-07-21T07:35:31.563377+0000","last_peered":"2023-07-21T07:35:31.563377+0000","last_clean":"2023-07-21T07:35:31.563377+0000","last_became_active":"2023-07-21T07:35:30.550540+0000","last_became_peered":"2023-07-21T07:35:30.550540+0000","last_unstale":"2023-07-21T07:35:31.563377+0000","last_undegraded":"2023-07-21T07:35:31.563377+0000","last_fullsized":"2023-07-21T07:35:31.563377+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:01:44.904085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569373+0000","last_change":"2023-07-21T07:35:31.576245+0000","last_active":"2023-07-21T07:35:32.569373+0000","last_peered":"2023-07-21T07:35:32.569373+0000","last_clean":"2023-07-21T07:35:32.569373+0000","last_became_active":"2023-07-21T07:35:31.575586+0000","last_became_peered":"2023-07-21T07:35:31.575586+0000","last_unstale":"2023-07-21T07:35:32.569373+0000","last_undegraded":"2023-07-21T07:35:32.569373+0000","last_fullsized":"2023-07-21T07:35:32.569373+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:26:49.227695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569762+0000","last_change":"2023-07-21T07:35:30.551290+0000","last_active":"2023-07-21T07:35:32.569762+0000","last_peered":"2023-07-21T07:35:32.569762+0000","last_clean":"2023-07-21T07:35:32.569762+0000","last_became_active":"2023-07-21T07:35:30.550872+0000","last_became_peered":"2023-07-21T07:35:30.550872+0000","last_unstale":"2023-07-21T07:35:32.569762+0000","last_undegraded":"2023-07-21T07:35:32.569762+0000","last_fullsized":"2023-07-21T07:35:32.569762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:32:35.489926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.567892+0000","last_change":"2023-07-21T07:35:31.581622+0000","last_active":"2023-07-21T07:35:32.567892+0000","last_peered":"2023-07-21T07:35:32.567892+0000","last_clean":"2023-07-21T07:35:32.567892+0000","last_became_active":"2023-07-21T07:35:31.581309+0000","last_became_peered":"2023-07-21T07:35:31.581309+0000","last_unstale":"2023-07-21T07:35:32.567892+0000","last_undegraded":"2023-07-21T07:35:32.567892+0000","last_fullsized":"2023-07-21T07:35:32.567892+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:45:59.419794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.569906+0000","last_change":"2023-07-21T07:35:30.547725+0000","last_active":"2023-07-21T07:35:31.569906+0000","last_peered":"2023-07-21T07:35:31.569906+0000","last_clean":"2023-07-21T07:35:31.569906+0000","last_became_active":"2023-07-21T07:35:30.547400+0000","last_became_peered":"2023-07-21T07:35:30.547400+0000","last_unstale":"2023-07-21T07:35:31.569906+0000","last_undegraded":"2023-07-21T07:35:31.569906+0000","last_fullsized":"2023-07-21T07:35:31.569906+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:47:44.087595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.578947+0000","last_change":"2023-07-21T07:35:31.574640+0000","last_active":"2023-07-21T07:35:31.578947+0000","last_peered":"2023-07-21T07:35:31.578947+0000","last_clean":"2023-07-21T07:35:31.578947+0000","last_became_active":"2023-07-21T07:35:31.574338+0000","last_became_peered":"2023-07-21T07:35:31.574338+0000","last_unstale":"2023-07-21T07:35:31.578947+0000","last_undegraded":"2023-07-21T07:35:31.578947+0000","last_fullsized":"2023-07-21T07:35:31.578947+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:14:47.829723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589483+0000","last_change":"2023-07-21T07:35:30.552297+0000","last_active":"2023-07-21T07:35:31.589483+0000","last_peered":"2023-07-21T07:35:31.589483+0000","last_clean":"2023-07-21T07:35:31.589483+0000","last_became_active":"2023-07-21T07:35:30.552039+0000","last_became_peered":"2023-07-21T07:35:30.552039+0000","last_unstale":"2023-07-21T07:35:31.589483+0000","last_undegraded":"2023-07-21T07:35:31.589483+0000","last_fullsized":"2023-07-21T07:35:31.589483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:30:14.571963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.581592+0000","last_change":"2023-07-21T07:35:31.577585+0000","last_active":"2023-07-21T07:35:31.581592+0000","last_peered":"2023-07-21T07:35:31.581592+0000","last_clean":"2023-07-21T07:35:31.581592+0000","last_became_active":"2023-07-21T07:35:31.577145+0000","last_became_peered":"2023-07-21T07:35:31.577145+0000","last_unstale":"2023-07-21T07:35:31.581592+0000","last_undegraded":"2023-07-21T07:35:31.581592+0000","last_fullsized":"2023-07-21T07:35:31.581592+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:24:17.732879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569923+0000","last_change":"2023-07-21T07:35:30.550443+0000","last_active":"2023-07-21T07:35:32.569923+0000","last_peered":"2023-07-21T07:35:32.569923+0000","last_clean":"2023-07-21T07:35:32.569923+0000","last_became_active":"2023-07-21T07:35:30.550126+0000","last_became_peered":"2023-07-21T07:35:30.550126+0000","last_unstale":"2023-07-21T07:35:32.569923+0000","last_undegraded":"2023-07-21T07:35:32.569923+0000","last_fullsized":"2023-07-21T07:35:32.569923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:08:49.297019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.574351+0000","last_change":"2023-07-21T07:35:31.567871+0000","last_active":"2023-07-21T07:35:31.574351+0000","last_peered":"2023-07-21T07:35:31.574351+0000","last_clean":"2023-07-21T07:35:31.574351+0000","last_became_active":"2023-07-21T07:35:31.567550+0000","last_became_peered":"2023-07-21T07:35:31.567550+0000","last_unstale":"2023-07-21T07:35:31.574351+0000","last_undegraded":"2023-07-21T07:35:31.574351+0000","last_fullsized":"2023-07-21T07:35:31.574351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:26:49.227695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569614+0000","last_change":"2023-07-21T07:35:30.548569+0000","last_active":"2023-07-21T07:35:32.569614+0000","last_peered":"2023-07-21T07:35:32.569614+0000","last_clean":"2023-07-21T07:35:32.569614+0000","last_became_active":"2023-07-21T07:35:30.548258+0000","last_became_peered":"2023-07-21T07:35:30.548258+0000","last_unstale":"2023-07-21T07:35:32.569614+0000","last_undegraded":"2023-07-21T07:35:32.569614+0000","last_fullsized":"2023-07-21T07:35:32.569614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:00:00.684119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568993+0000","last_change":"2023-07-21T07:35:31.569427+0000","last_active":"2023-07-21T07:35:32.568993+0000","last_peered":"2023-07-21T07:35:32.568993+0000","last_clean":"2023-07-21T07:35:32.568993+0000","last_became_active":"2023-07-21T07:35:31.569152+0000","last_became_peered":"2023-07-21T07:35:31.569152+0000","last_unstale":"2023-07-21T07:35:32.568993+0000","last_undegraded":"2023-07-21T07:35:32.568993+0000","last_fullsized":"2023-07-21T07:35:32.568993+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:29.762040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.553572+0000","last_change":"2023-07-21T07:35:30.542937+0000","last_active":"2023-07-21T07:35:31.553572+0000","last_peered":"2023-07-21T07:35:31.553572+0000","last_clean":"2023-07-21T07:35:31.553572+0000","last_became_active":"2023-07-21T07:35:30.542650+0000","last_became_peered":"2023-07-21T07:35:30.542650+0000","last_unstale":"2023-07-21T07:35:31.553572+0000","last_undegraded":"2023-07-21T07:35:31.553572+0000","last_fullsized":"2023-07-21T07:35:31.553572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:03:50.795883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568163+0000","last_change":"2023-07-21T07:35:31.566406+0000","last_active":"2023-07-21T07:35:32.568163+0000","last_peered":"2023-07-21T07:35:32.568163+0000","last_clean":"2023-07-21T07:35:32.568163+0000","last_became_active":"2023-07-21T07:35:31.566108+0000","last_became_peered":"2023-07-21T07:35:31.566108+0000","last_unstale":"2023-07-21T07:35:32.568163+0000","last_undegraded":"2023-07-21T07:35:32.568163+0000","last_fullsized":"2023-07-21T07:35:32.568163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:46:23.854550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.572666+0000","last_change":"2023-07-21T07:35:30.550924+0000","last_active":"2023-07-21T07:35:31.572666+0000","last_peered":"2023-07-21T07:35:31.572666+0000","last_clean":"2023-07-21T07:35:31.572666+0000","last_became_active":"2023-07-21T07:35:30.550606+0000","last_became_peered":"2023-07-21T07:35:30.550606+0000","last_unstale":"2023-07-21T07:35:31.572666+0000","last_undegraded":"2023-07-21T07:35:31.572666+0000","last_fullsized":"2023-07-21T07:35:31.572666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:57:13.788855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569321+0000","last_change":"2023-07-21T07:35:31.569072+0000","last_active":"2023-07-21T07:35:32.569321+0000","last_peered":"2023-07-21T07:35:32.569321+0000","last_clean":"2023-07-21T07:35:32.569321+0000","last_became_active":"2023-07-21T07:35:31.568900+0000","last_became_peered":"2023-07-21T07:35:31.568900+0000","last_unstale":"2023-07-21T07:35:32.569321+0000","last_undegraded":"2023-07-21T07:35:32.569321+0000","last_fullsized":"2023-07-21T07:35:32.569321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:00:36.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.567928+0000","last_change":"2023-07-21T07:35:30.550883+0000","last_active":"2023-07-21T07:35:32.567928+0000","last_peered":"2023-07-21T07:35:32.567928+0000","last_clean":"2023-07-21T07:35:32.567928+0000","last_became_active":"2023-07-21T07:35:30.550604+0000","last_became_peered":"2023-07-21T07:35:30.550604+0000","last_unstale":"2023-07-21T07:35:32.567928+0000","last_undegraded":"2023-07-21T07:35:32.567928+0000","last_fullsized":"2023-07-21T07:35:32.567928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:15:49.199967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569900+0000","last_change":"2023-07-21T07:35:31.581417+0000","last_active":"2023-07-21T07:35:32.569900+0000","last_peered":"2023-07-21T07:35:32.569900+0000","last_clean":"2023-07-21T07:35:32.569900+0000","last_became_active":"2023-07-21T07:35:31.581026+0000","last_became_peered":"2023-07-21T07:35:31.581026+0000","last_unstale":"2023-07-21T07:35:32.569900+0000","last_undegraded":"2023-07-21T07:35:32.569900+0000","last_fullsized":"2023-07-21T07:35:32.569900+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:43:09.103749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589517+0000","last_change":"2023-07-21T07:35:30.552874+0000","last_active":"2023-07-21T07:35:31.589517+0000","last_peered":"2023-07-21T07:35:31.589517+0000","last_clean":"2023-07-21T07:35:31.589517+0000","last_became_active":"2023-07-21T07:35:30.552612+0000","last_became_peered":"2023-07-21T07:35:30.552612+0000","last_unstale":"2023-07-21T07:35:31.589517+0000","last_undegraded":"2023-07-21T07:35:31.589517+0000","last_fullsized":"2023-07-21T07:35:31.589517+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:29:54.035393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.581232+0000","last_change":"2023-07-21T07:35:31.572905+0000","last_active":"2023-07-21T07:35:31.581232+0000","last_peered":"2023-07-21T07:35:31.581232+0000","last_clean":"2023-07-21T07:35:31.581232+0000","last_became_active":"2023-07-21T07:35:31.571995+0000","last_became_peered":"2023-07-21T07:35:31.571995+0000","last_unstale":"2023-07-21T07:35:31.581232+0000","last_undegraded":"2023-07-21T07:35:31.581232+0000","last_fullsized":"2023-07-21T07:35:31.581232+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:46:12.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.586958+0000","last_change":"2023-07-21T07:35:30.550575+0000","last_active":"2023-07-21T07:35:31.586958+0000","last_peered":"2023-07-21T07:35:31.586958+0000","last_clean":"2023-07-21T07:35:31.586958+0000","last_became_active":"2023-07-21T07:35:30.550269+0000","last_became_peered":"2023-07-21T07:35:30.550269+0000","last_unstale":"2023-07-21T07:35:31.586958+0000","last_undegraded":"2023-07-21T07:35:31.586958+0000","last_fullsized":"2023-07-21T07:35:31.586958+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:47:44.087595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.582202+0000","last_change":"2023-07-21T07:35:31.578142+0000","last_active":"2023-07-21T07:35:31.582202+0000","last_peered":"2023-07-21T07:35:31.582202+0000","last_clean":"2023-07-21T07:35:31.582202+0000","last_became_active":"2023-07-21T07:35:31.577865+0000","last_became_peered":"2023-07-21T07:35:31.577865+0000","last_unstale":"2023-07-21T07:35:31.582202+0000","last_undegraded":"2023-07-21T07:35:31.582202+0000","last_fullsized":"2023-07-21T07:35:31.582202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:29:55.040410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569602+0000","last_change":"2023-07-21T07:35:30.554225+0000","last_active":"2023-07-21T07:35:32.569602+0000","last_peered":"2023-07-21T07:35:32.569602+0000","last_clean":"2023-07-21T07:35:32.569602+0000","last_became_active":"2023-07-21T07:35:30.553952+0000","last_became_peered":"2023-07-21T07:35:30.553952+0000","last_unstale":"2023-07-21T07:35:32.569602+0000","last_undegraded":"2023-07-21T07:35:32.569602+0000","last_fullsized":"2023-07-21T07:35:32.569602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:40:10.115494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.570209+0000","last_change":"2023-07-21T07:35:31.571997+0000","last_active":"2023-07-21T07:35:32.570209+0000","last_peered":"2023-07-21T07:35:32.570209+0000","last_clean":"2023-07-21T07:35:32.570209+0000","last_became_active":"2023-07-21T07:35:31.571042+0000","last_became_peered":"2023-07-21T07:35:31.571042+0000","last_unstale":"2023-07-21T07:35:32.570209+0000","last_undegraded":"2023-07-21T07:35:32.570209+0000","last_fullsized":"2023-07-21T07:35:32.570209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:14:47.829723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.554312+0000","last_change":"2023-07-21T07:35:30.552149+0000","last_active":"2023-07-21T07:35:31.554312+0000","last_peered":"2023-07-21T07:35:31.554312+0000","last_clean":"2023-07-21T07:35:31.554312+0000","last_became_active":"2023-07-21T07:35:30.551872+0000","last_became_peered":"2023-07-21T07:35:30.551872+0000","last_unstale":"2023-07-21T07:35:31.554312+0000","last_undegraded":"2023-07-21T07:35:31.554312+0000","last_fullsized":"2023-07-21T07:35:31.554312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:10:08.066960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.567769+0000","last_change":"2023-07-21T07:35:31.570982+0000","last_active":"2023-07-21T07:35:32.567769+0000","last_peered":"2023-07-21T07:35:32.567769+0000","last_clean":"2023-07-21T07:35:32.567769+0000","last_became_active":"2023-07-21T07:35:31.570685+0000","last_became_peered":"2023-07-21T07:35:31.570685+0000","last_unstale":"2023-07-21T07:35:32.567769+0000","last_undegraded":"2023-07-21T07:35:32.567769+0000","last_fullsized":"2023-07-21T07:35:32.567769+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:45:13.967781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569209+0000","last_change":"2023-07-21T07:35:30.552311+0000","last_active":"2023-07-21T07:35:32.569209+0000","last_peered":"2023-07-21T07:35:32.569209+0000","last_clean":"2023-07-21T07:35:32.569209+0000","last_became_active":"2023-07-21T07:35:30.552023+0000","last_became_peered":"2023-07-21T07:35:30.552023+0000","last_unstale":"2023-07-21T07:35:32.569209+0000","last_undegraded":"2023-07-21T07:35:32.569209+0000","last_fullsized":"2023-07-21T07:35:32.569209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:26:51.538294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.579427+0000","last_change":"2023-07-21T07:35:31.575363+0000","last_active":"2023-07-21T07:35:31.579427+0000","last_peered":"2023-07-21T07:35:31.579427+0000","last_clean":"2023-07-21T07:35:31.579427+0000","last_became_active":"2023-07-21T07:35:31.575044+0000","last_became_peered":"2023-07-21T07:35:31.575044+0000","last_unstale":"2023-07-21T07:35:31.579427+0000","last_undegraded":"2023-07-21T07:35:31.579427+0000","last_fullsized":"2023-07-21T07:35:31.579427+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:49.296815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569097+0000","last_change":"2023-07-21T07:35:30.553310+0000","last_active":"2023-07-21T07:35:32.569097+0000","last_peered":"2023-07-21T07:35:32.569097+0000","last_clean":"2023-07-21T07:35:32.569097+0000","last_became_active":"2023-07-21T07:35:30.552922+0000","last_became_peered":"2023-07-21T07:35:30.552922+0000","last_unstale":"2023-07-21T07:35:32.569097+0000","last_undegraded":"2023-07-21T07:35:32.569097+0000","last_fullsized":"2023-07-21T07:35:32.569097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:57:13.788855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589331+0000","last_change":"2023-07-21T07:35:31.582343+0000","last_active":"2023-07-21T07:35:31.589331+0000","last_peered":"2023-07-21T07:35:31.589331+0000","last_clean":"2023-07-21T07:35:31.589331+0000","last_became_active":"2023-07-21T07:35:31.582111+0000","last_became_peered":"2023-07-21T07:35:31.582111+0000","last_unstale":"2023-07-21T07:35:31.589331+0000","last_undegraded":"2023-07-21T07:35:31.589331+0000","last_fullsized":"2023-07-21T07:35:31.589331+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:28:42.691072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568386+0000","last_change":"2023-07-21T07:35:30.548129+0000","last_active":"2023-07-21T07:35:32.568386+0000","last_peered":"2023-07-21T07:35:32.568386+0000","last_clean":"2023-07-21T07:35:32.568386+0000","last_became_active":"2023-07-21T07:35:30.547850+0000","last_became_peered":"2023-07-21T07:35:30.547850+0000","last_unstale":"2023-07-21T07:35:32.568386+0000","last_undegraded":"2023-07-21T07:35:32.568386+0000","last_fullsized":"2023-07-21T07:35:32.568386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:03:35.141755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569466+0000","last_change":"2023-07-21T07:35:31.561900+0000","last_active":"2023-07-21T07:35:32.569466+0000","last_peered":"2023-07-21T07:35:32.569466+0000","last_clean":"2023-07-21T07:35:32.569466+0000","last_became_active":"2023-07-21T07:35:31.561610+0000","last_became_peered":"2023-07-21T07:35:31.561610+0000","last_unstale":"2023-07-21T07:35:32.569466+0000","last_undegraded":"2023-07-21T07:35:32.569466+0000","last_fullsized":"2023-07-21T07:35:32.569466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:12:33.100080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568641+0000","last_change":"2023-07-21T07:35:30.553301+0000","last_active":"2023-07-21T07:35:32.568641+0000","last_peered":"2023-07-21T07:35:32.568641+0000","last_clean":"2023-07-21T07:35:32.568641+0000","last_became_active":"2023-07-21T07:35:30.552995+0000","last_became_peered":"2023-07-21T07:35:30.552995+0000","last_unstale":"2023-07-21T07:35:32.568641+0000","last_undegraded":"2023-07-21T07:35:32.568641+0000","last_fullsized":"2023-07-21T07:35:32.568641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:28:06.064555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.587840+0000","last_change":"2023-07-21T07:35:31.582790+0000","last_active":"2023-07-21T07:35:31.587840+0000","last_peered":"2023-07-21T07:35:31.587840+0000","last_clean":"2023-07-21T07:35:31.587840+0000","last_became_active":"2023-07-21T07:35:31.582479+0000","last_became_peered":"2023-07-21T07:35:31.582479+0000","last_unstale":"2023-07-21T07:35:31.587840+0000","last_undegraded":"2023-07-21T07:35:31.587840+0000","last_fullsized":"2023-07-21T07:35:31.587840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:08:05.332681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.566247+0000","last_change":"2023-07-21T07:35:30.548637+0000","last_active":"2023-07-21T07:35:31.566247+0000","last_peered":"2023-07-21T07:35:31.566247+0000","last_clean":"2023-07-21T07:35:31.566247+0000","last_became_active":"2023-07-21T07:35:30.548340+0000","last_became_peered":"2023-07-21T07:35:30.548340+0000","last_unstale":"2023-07-21T07:35:31.566247+0000","last_undegraded":"2023-07-21T07:35:31.566247+0000","last_fullsized":"2023-07-21T07:35:31.566247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:10:34.417662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.554171+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:35:31.554171+0000","last_peered":"2023-07-21T07:35:31.554171+0000","last_clean":"2023-07-21T07:35:31.554171+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:35:31.554171+0000","last_undegraded":"2023-07-21T07:35:31.554171+0000","last_fullsized":"2023-07-21T07:35:31.554171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:45:15.575956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569213+0000","last_change":"2023-07-21T07:35:31.581657+0000","last_active":"2023-07-21T07:35:32.569213+0000","last_peered":"2023-07-21T07:35:32.569213+0000","last_clean":"2023-07-21T07:35:32.569213+0000","last_became_active":"2023-07-21T07:35:31.581117+0000","last_became_peered":"2023-07-21T07:35:31.581117+0000","last_unstale":"2023-07-21T07:35:32.569213+0000","last_undegraded":"2023-07-21T07:35:32.569213+0000","last_fullsized":"2023-07-21T07:35:32.569213+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:27:49.705623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.565910+0000","last_change":"2023-07-21T07:35:30.552526+0000","last_active":"2023-07-21T07:35:31.565910+0000","last_peered":"2023-07-21T07:35:31.565910+0000","last_clean":"2023-07-21T07:35:31.565910+0000","last_became_active":"2023-07-21T07:35:30.552173+0000","last_became_peered":"2023-07-21T07:35:30.552173+0000","last_unstale":"2023-07-21T07:35:31.565910+0000","last_undegraded":"2023-07-21T07:35:31.565910+0000","last_fullsized":"2023-07-21T07:35:31.565910+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:05:01.281243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.569565+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:35:31.569565+0000","last_peered":"2023-07-21T07:35:31.569565+0000","last_clean":"2023-07-21T07:35:31.569565+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:35:31.569565+0000","last_undegraded":"2023-07-21T07:35:31.569565+0000","last_fullsized":"2023-07-21T07:35:31.569565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:39:14.936186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568005+0000","last_change":"2023-07-21T07:35:31.576484+0000","last_active":"2023-07-21T07:35:32.568005+0000","last_peered":"2023-07-21T07:35:32.568005+0000","last_clean":"2023-07-21T07:35:32.568005+0000","last_became_active":"2023-07-21T07:35:31.576171+0000","last_became_peered":"2023-07-21T07:35:31.576171+0000","last_unstale":"2023-07-21T07:35:32.568005+0000","last_undegraded":"2023-07-21T07:35:32.568005+0000","last_fullsized":"2023-07-21T07:35:32.568005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:40:11.625179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.569257+0000","last_change":"2023-07-21T07:35:30.549185+0000","last_active":"2023-07-21T07:35:32.569257+0000","last_peered":"2023-07-21T07:35:32.569257+0000","last_clean":"2023-07-21T07:35:32.569257+0000","last_became_active":"2023-07-21T07:35:30.548890+0000","last_became_peered":"2023-07-21T07:35:30.548890+0000","last_unstale":"2023-07-21T07:35:32.569257+0000","last_undegraded":"2023-07-21T07:35:32.569257+0000","last_fullsized":"2023-07-21T07:35:32.569257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:10:36.746295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568773+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:35:32.568773+0000","last_peered":"2023-07-21T07:35:32.568773+0000","last_clean":"2023-07-21T07:35:32.568773+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:35:32.568773+0000","last_undegraded":"2023-07-21T07:35:32.568773+0000","last_fullsized":"2023-07-21T07:35:32.568773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:42:40.864219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589567+0000","last_change":"2023-07-21T07:35:31.583146+0000","last_active":"2023-07-21T07:35:31.589567+0000","last_peered":"2023-07-21T07:35:31.589567+0000","last_clean":"2023-07-21T07:35:31.589567+0000","last_became_active":"2023-07-21T07:35:31.582823+0000","last_became_peered":"2023-07-21T07:35:31.582823+0000","last_unstale":"2023-07-21T07:35:31.589567+0000","last_undegraded":"2023-07-21T07:35:31.589567+0000","last_fullsized":"2023-07-21T07:35:31.589567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:08:50.302036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568094+0000","last_change":"2023-07-21T07:35:30.553624+0000","last_active":"2023-07-21T07:35:32.568094+0000","last_peered":"2023-07-21T07:35:32.568094+0000","last_clean":"2023-07-21T07:35:32.568094+0000","last_became_active":"2023-07-21T07:35:30.553307+0000","last_became_peered":"2023-07-21T07:35:30.553307+0000","last_unstale":"2023-07-21T07:35:32.568094+0000","last_undegraded":"2023-07-21T07:35:32.568094+0000","last_fullsized":"2023-07-21T07:35:32.568094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:43:22.152510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.569274+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:35:31.569274+0000","last_peered":"2023-07-21T07:35:31.569274+0000","last_clean":"2023-07-21T07:35:31.569274+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:35:31.569274+0000","last_undegraded":"2023-07-21T07:35:31.569274+0000","last_fullsized":"2023-07-21T07:35:31.569274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:45:02.730802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568334+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:35:32.568334+0000","last_peered":"2023-07-21T07:35:32.568334+0000","last_clean":"2023-07-21T07:35:32.568334+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:35:32.568334+0000","last_undegraded":"2023-07-21T07:35:32.568334+0000","last_fullsized":"2023-07-21T07:35:32.568334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:56:20.211255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.577083+0000","last_change":"2023-07-21T07:35:31.572728+0000","last_active":"2023-07-21T07:35:31.577083+0000","last_peered":"2023-07-21T07:35:31.577083+0000","last_clean":"2023-07-21T07:35:31.577083+0000","last_became_active":"2023-07-21T07:35:31.572409+0000","last_became_peered":"2023-07-21T07:35:31.572409+0000","last_unstale":"2023-07-21T07:35:31.577083+0000","last_undegraded":"2023-07-21T07:35:31.577083+0000","last_fullsized":"2023-07-21T07:35:31.577083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:46:01.679166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.588922+0000","last_change":"2023-07-21T07:35:30.552592+0000","last_active":"2023-07-21T07:35:31.588922+0000","last_peered":"2023-07-21T07:35:31.588922+0000","last_clean":"2023-07-21T07:35:31.588922+0000","last_became_active":"2023-07-21T07:35:30.552218+0000","last_became_peered":"2023-07-21T07:35:30.552218+0000","last_unstale":"2023-07-21T07:35:31.588922+0000","last_undegraded":"2023-07-21T07:35:31.588922+0000","last_fullsized":"2023-07-21T07:35:31.588922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:46:22.849533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568240+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:35:32.568240+0000","last_peered":"2023-07-21T07:35:32.568240+0000","last_clean":"2023-07-21T07:35:32.568240+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:35:32.568240+0000","last_undegraded":"2023-07-21T07:35:32.568240+0000","last_fullsized":"2023-07-21T07:35:32.568240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:56:34.888918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.581972+0000","last_change":"2023-07-21T07:35:31.576629+0000","last_active":"2023-07-21T07:35:31.581972+0000","last_peered":"2023-07-21T07:35:31.581972+0000","last_clean":"2023-07-21T07:35:31.581972+0000","last_became_active":"2023-07-21T07:35:31.575947+0000","last_became_peered":"2023-07-21T07:35:31.575947+0000","last_unstale":"2023-07-21T07:35:31.581972+0000","last_undegraded":"2023-07-21T07:35:31.581972+0000","last_fullsized":"2023-07-21T07:35:31.581972+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:12:33.100080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.573458+0000","last_change":"2023-07-21T07:35:30.546891+0000","last_active":"2023-07-21T07:35:31.573458+0000","last_peered":"2023-07-21T07:35:31.573458+0000","last_clean":"2023-07-21T07:35:31.573458+0000","last_became_active":"2023-07-21T07:35:30.546607+0000","last_became_peered":"2023-07-21T07:35:30.546607+0000","last_unstale":"2023-07-21T07:35:31.573458+0000","last_undegraded":"2023-07-21T07:35:31.573458+0000","last_fullsized":"2023-07-21T07:35:31.573458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:40:49.465460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568044+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:35:32.568044+0000","last_peered":"2023-07-21T07:35:32.568044+0000","last_clean":"2023-07-21T07:35:32.568044+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:35:32.568044+0000","last_undegraded":"2023-07-21T07:35:32.568044+0000","last_fullsized":"2023-07-21T07:35:32.568044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:46:48.403619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.589663+0000","last_change":"2023-07-21T07:35:31.583748+0000","last_active":"2023-07-21T07:35:31.589663+0000","last_peered":"2023-07-21T07:35:31.589663+0000","last_clean":"2023-07-21T07:35:31.589663+0000","last_became_active":"2023-07-21T07:35:31.583463+0000","last_became_peered":"2023-07-21T07:35:31.583463+0000","last_unstale":"2023-07-21T07:35:31.589663+0000","last_undegraded":"2023-07-21T07:35:31.589663+0000","last_fullsized":"2023-07-21T07:35:31.589663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:28:42.691072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.562006+0000","last_change":"2023-07-21T07:35:30.551446+0000","last_active":"2023-07-21T07:35:31.562006+0000","last_peered":"2023-07-21T07:35:31.562006+0000","last_clean":"2023-07-21T07:35:31.562006+0000","last_became_active":"2023-07-21T07:35:30.551160+0000","last_became_peered":"2023-07-21T07:35:30.551160+0000","last_unstale":"2023-07-21T07:35:31.562006+0000","last_undegraded":"2023-07-21T07:35:31.562006+0000","last_fullsized":"2023-07-21T07:35:31.562006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:15:49.199967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.553584+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:35:31.553584+0000","last_peered":"2023-07-21T07:35:31.553584+0000","last_clean":"2023-07-21T07:35:31.553584+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:35:31.553584+0000","last_undegraded":"2023-07-21T07:35:31.553584+0000","last_fullsized":"2023-07-21T07:35:31.553584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:31:39.805950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568245+0000","last_change":"2023-07-21T07:35:31.576679+0000","last_active":"2023-07-21T07:35:32.568245+0000","last_peered":"2023-07-21T07:35:32.568245+0000","last_clean":"2023-07-21T07:35:32.568245+0000","last_became_active":"2023-07-21T07:35:31.576259+0000","last_became_peered":"2023-07-21T07:35:31.576259+0000","last_unstale":"2023-07-21T07:35:32.568245+0000","last_undegraded":"2023-07-21T07:35:32.568245+0000","last_fullsized":"2023-07-21T07:35:32.568245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:11:16.968024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T07:35:32.568996+0000","last_change":"2023-07-21T07:35:30.551889+0000","last_active":"2023-07-21T07:35:32.568996+0000","last_peered":"2023-07-21T07:35:32.568996+0000","last_clean":"2023-07-21T07:35:32.568996+0000","last_became_active":"2023-07-21T07:35:30.551571+0000","last_became_peered":"2023-07-21T07:35:30.551571+0000","last_unstale":"2023-07-21T07:35:32.568996+0000","last_undegraded":"2023-07-21T07:35:32.568996+0000","last_fullsized":"2023-07-21T07:35:32.568996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:46:37.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-21T07:35:31.573967+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:35:31.573967+0000","last_peered":"2023-07-21T07:35:31.573967+0000","last_clean":"2023-07-21T07:35:31.573967+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:35:31.573967+0000","last_undegraded":"2023-07-21T07:35:31.573967+0000","last_fullsized":"2023-07-21T07:35:31.573967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:09:41.062320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1007616,"data_stored":753332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.498},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42999999999999999}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":161912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.4990000000000006,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.4039999999999999,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":0.70799999999999996}]},{"osd":1,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.621},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":161420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.309},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.46899999999999997}]},{"osd":6,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.54000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":751732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.29299999999999998}]},{"osd":2,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.314},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.496}]},{"osd":5,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.52100000000000002}]},{"osd":7,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.54600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":161400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.376},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.28699999999999998}]},{"osd":1,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.307},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33400000000000002}]},{"osd":4,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.57899999999999996}]},{"osd":5,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.625},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.63900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":162928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.377}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44600000000000001}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.753},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.79000000000000004}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.74299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":161934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":10.18,"5min":10.18,"15min":10.18},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":10.207000000000001,"5min":10.207000000000001,"15min":10.207000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":0.51800000000000002}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.36799999999999999}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45700000000000002}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.499},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.54600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":161442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.625}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.499},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:35:36.163 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T07:35:36.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T07:35:36.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.277+0000 7f1c0a485700 1 Processor -- start 2023-07-21T07:35:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.277+0000 7f1c0a485700 1 -- start start 2023-07-21T07:35:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.277+0000 7f1c0a485700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1c040c1860 0x7f1c04151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c0a485700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c040c3f80 0x7f1c040c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c0a485700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c041517c0 con 0x7f1c040c5260 2023-07-21T07:35:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c0a485700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c040c4e50 con 0x7f1c040c1860 2023-07-21T07:35:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c0a485700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c041519f0 con 0x7f1c040c3f80 2023-07-21T07:35:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c08a22700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c040c3f80 0x7f1c040c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c03fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1c040c1860 0x7f1c04151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c08a22700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c040c3f80 0x7f1c040c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:59986/0 (socket says 172.21.15.6:59986) 2023-07-21T07:35:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c08a22700 1 -- 172.21.15.6:0/786325348 learned_addr learned my addr 172.21.15.6:0/786325348 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c037fe700 1 --1- 172.21.15.6:0/786325348 >> v1:172.21.15.86:6789/0 conn(0x7f1c040c5260 0x7f1c0406dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:45620/0 (socket says 172.21.15.6:45620) 2023-07-21T07:35:36.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c03fff700 1 -- 172.21.15.6:0/786325348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c040c3f80 msgr2=0x7f1c040c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:36.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c03fff700 1 --2- 172.21.15.6:0/786325348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c040c3f80 0x7f1c040c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c03fff700 1 -- 172.21.15.6:0/786325348 >> v1:172.21.15.86:6789/0 conn(0x7f1c040c5260 legacy=0x7f1c0406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:36.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c03fff700 1 -- 172.21.15.6:0/786325348 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c04151cd0 con 0x7f1c040c1860 2023-07-21T07:35:36.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c08a22700 1 --2- 172.21.15.6:0/786325348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c040c3f80 0x7f1c040c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:36.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.278+0000 7f1c03fff700 1 --2- 172.21.15.6:0/786325348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c040c1860 0x7f1c04151280 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009840 tx=0x7f1bec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b58578c1c562f577 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:36.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.279+0000 7f1c02ffd700 1 -- 172.21.15.6:0/786325348 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec011830 con 0x7f1c040c1860 2023-07-21T07:35:36.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.279+0000 7f1c02ffd700 1 -- 172.21.15.6:0/786325348 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec011990 con 0x7f1c040c1860 2023-07-21T07:35:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.279+0000 7f1c02ffd700 1 -- 172.21.15.6:0/786325348 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec011d20 con 0x7f1c040c1860 2023-07-21T07:35:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.279+0000 7f1c0a485700 1 -- 172.21.15.6:0/786325348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c040c1860 msgr2=0x7f1c04151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.279+0000 7f1c0a485700 1 --2- 172.21.15.6:0/786325348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c040c1860 0x7f1c04151280 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009840 tx=0x7f1bec009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.279+0000 7f1c0a485700 1 -- 172.21.15.6:0/786325348 shutdown_connections 2023-07-21T07:35:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.279+0000 7f1c0a485700 1 --2- 172.21.15.6:0/786325348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c040c3f80 0x7f1c040c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.279+0000 7f1c0a485700 1 --2- 172.21.15.6:0/786325348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c040c1860 0x7f1c04151280 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.279+0000 7f1c0a485700 1 -- 172.21.15.6:0/786325348 >> 172.21.15.6:0/786325348 conn(0x7f1c040a8660 msgr2=0x7f1c040a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.279+0000 7f1c0a485700 1 -- 172.21.15.6:0/786325348 shutdown_connections 2023-07-21T07:35:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.279+0000 7f1c0a485700 1 -- 172.21.15.6:0/786325348 wait complete. 2023-07-21T07:35:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.280+0000 7f1c0a485700 1 Processor -- start 2023-07-21T07:35:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.281+0000 7f1c0a485700 1 -- start start 2023-07-21T07:35:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.281+0000 7f1c0a485700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c040c1860 0x7f1c04150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.281+0000 7f1c0a485700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c040c3f80 0x7f1c0414a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.281+0000 7f1c0a485700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c040c5260 0x7f1c0414aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.281+0000 7f1c0a485700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c041557f0 con 0x7f1c040c1860 2023-07-21T07:35:36.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.281+0000 7f1c0a485700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c041edf80 con 0x7f1c040c5260 2023-07-21T07:35:36.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.281+0000 7f1c0a485700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040a9c00 con 0x7f1c040c3f80 2023-07-21T07:35:36.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c03fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c040c1860 0x7f1c04150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:36.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c03fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c040c1860 0x7f1c04150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34362/0 (socket says 172.21.15.6:34362) 2023-07-21T07:35:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c03fff700 1 -- 172.21.15.6:0/1414860286 learned_addr learned my addr 172.21.15.6:0/1414860286 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c08a22700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c040c5260 0x7f1c0414aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c037fe700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c040c3f80 0x7f1c0414a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c03fff700 1 -- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c040c3f80 msgr2=0x7f1c0414a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c03fff700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c040c3f80 0x7f1c0414a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c03fff700 1 -- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c040c5260 msgr2=0x7f1c0414aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c03fff700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c040c5260 0x7f1c0414aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c03fff700 1 -- 172.21.15.6:0/1414860286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc009b30 con 0x7f1c040c1860 2023-07-21T07:35:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c08a22700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c040c5260 0x7f1c0414aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c03fff700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c040c1860 0x7f1c04150cf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009fd0 tx=0x7f1bec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c00ff9700 1 -- 172.21.15.6:0/1414860286 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0036a0 con 0x7f1c040c1860 2023-07-21T07:35:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c00ff9700 1 -- 172.21.15.6:0/1414860286 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec01e070 con 0x7f1c040c1860 2023-07-21T07:35:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c0a485700 1 -- 172.21.15.6:0/1414860286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bec0094a0 con 0x7f1c040c1860 2023-07-21T07:35:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c00ff9700 1 -- 172.21.15.6:0/1414860286 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec003a40 con 0x7f1c040c1860 2023-07-21T07:35:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.282+0000 7f1c0a485700 1 -- 172.21.15.6:0/1414860286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0414ddb0 con 0x7f1c040c1860 2023-07-21T07:35:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.283+0000 7f1c0a485700 1 -- 172.21.15.6:0/1414860286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c040c4680 con 0x7f1c040c1860 2023-07-21T07:35:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.284+0000 7f1c00ff9700 1 -- 172.21.15.6:0/1414860286 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1bec003ba0 con 0x7f1c040c1860 2023-07-21T07:35:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.284+0000 7f1c00ff9700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1be406ace0 0x7f1be406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.284+0000 7f1c00ff9700 1 -- 172.21.15.6:0/1414860286 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1bec08a450 con 0x7f1c040c1860 2023-07-21T07:35:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.284+0000 7f1c037fe700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1be406ace0 0x7f1be406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.285+0000 7f1c037fe700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1be406ace0 0x7f1be406d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1c040725b0 tx=0x7f1bf4007d10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:36.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.288+0000 7f1c00ff9700 1 -- 172.21.15.6:0/1414860286 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1bec055590 con 0x7f1c040c1860 2023-07-21T07:35:36.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.565+0000 7f1c0a485700 1 -- 172.21.15.6:0/1414860286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1c0406d7d0 con 0x7f1c040c1860 2023-07-21T07:35:36.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.568+0000 7f1c00ff9700 1 -- 172.21.15.6:0/1414860286 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7f1bec058bb0 con 0x7f1c040c1860 2023-07-21T07:35:36.620 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T07:35:36.621 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDVNLpkoWkHNxAAuz8SyrpFX/iEiqy/znfHAQ== 2023-07-21T07:35:36.621 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T07:35:36.621 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T07:35:36.621 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T07:35:36.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.570+0000 7f1c0a485700 1 -- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1be406ace0 msgr2=0x7f1be406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:36.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.570+0000 7f1c0a485700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1be406ace0 0x7f1be406d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1c040725b0 tx=0x7f1bf4007d10 comp rx=0 tx=0).stop 2023-07-21T07:35:36.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.570+0000 7f1c0a485700 1 -- 172.21.15.6:0/1414860286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c040c1860 msgr2=0x7f1c04150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:36.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.570+0000 7f1c0a485700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c040c1860 0x7f1c04150cf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009fd0 tx=0x7f1bec004750 comp rx=0 tx=0).stop 2023-07-21T07:35:36.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.570+0000 7f1c0a485700 1 -- 172.21.15.6:0/1414860286 shutdown_connections 2023-07-21T07:35:36.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.570+0000 7f1c0a485700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1be406ace0 0x7f1be406d1a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.570+0000 7f1c0a485700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c040c5260 0x7f1c0414aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.570+0000 7f1c0a485700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c040c1860 0x7f1c04150cf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.570+0000 7f1c0a485700 1 --2- 172.21.15.6:0/1414860286 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c040c3f80 0x7f1c0414a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.570+0000 7f1c0a485700 1 -- 172.21.15.6:0/1414860286 >> 172.21.15.6:0/1414860286 conn(0x7f1c040a8660 msgr2=0x7f1c040719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:36.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.570+0000 7f1c0a485700 1 -- 172.21.15.6:0/1414860286 shutdown_connections 2023-07-21T07:35:36.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.570+0000 7f1c0a485700 1 -- 172.21.15.6:0/1414860286 wait complete. 2023-07-21T07:35:36.627 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-07-21T07:35:36.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:35:36.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.707+0000 7f4b85741700 1 Processor -- start 2023-07-21T07:35:36.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.707+0000 7f4b85741700 1 -- start start 2023-07-21T07:35:36.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.708+0000 7f4b85741700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b800c6c70 0x7f4b80151840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.708+0000 7f4b85741700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b800c5a60 0x7f4b80151d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.708+0000 7f4b85741700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b800c45a0 con 0x7f4b800c5ed0 2023-07-21T07:35:36.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.708+0000 7f4b85741700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b801522c0 con 0x7f4b800c5a60 2023-07-21T07:35:36.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.708+0000 7f4b85741700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8006b0c0 con 0x7f4b800c6c70 2023-07-21T07:35:36.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.708+0000 7f4b7f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4b800c5ed0 0x7f4b80157b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42394/0 (socket says 172.21.15.6:42394) 2023-07-21T07:35:36.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.708+0000 7f4b7f7fe700 1 -- 172.21.15.6:0/2463063360 learned_addr learned my addr 172.21.15.6:0/2463063360 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:36.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.708+0000 7f4b7e7fc700 1 --2- 172.21.15.6:0/2463063360 >> v2:172.21.15.86:3300/0 conn(0x7f4b800c5a60 0x7f4b80151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:36.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.708+0000 7f4b7effd700 1 --2- 172.21.15.6:0/2463063360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b800c6c70 0x7f4b80151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:36.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.708+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523270360 0 0) 0x7f4b800c45a0 con 0x7f4b800c5ed0 2023-07-21T07:35:36.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.708+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b680035b0 con 0x7f4b800c5ed0 2023-07-21T07:35:36.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.708+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3632071317 0 0) 0x7f4b680035b0 con 0x7f4b800c5ed0 2023-07-21T07:35:36.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b800c6c70 msgr2=0x7f4b80151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:36.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 --2- 172.21.15.6:0/2463063360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b800c6c70 0x7f4b80151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 >> v2:172.21.15.86:3300/0 conn(0x7f4b800c5a60 msgr2=0x7f4b80151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 --2- 172.21.15.6:0/2463063360 >> v2:172.21.15.86:3300/0 conn(0x7f4b800c5a60 0x7f4b80151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800c5150 con 0x7f4b800c5ed0 2023-07-21T07:35:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f4b780019f0 con 0x7f4b800c5ed0 2023-07-21T07:35:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 >> v1:172.21.15.6:6789/0 conn(0x7f4b800c5ed0 legacy=0x7f4b80157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:36.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 --2- 172.21.15.6:0/2463063360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b68003a00 0x7f4b68003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 --2- 172.21.15.6:0/2463063360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b68004850 0x7f4b68004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 --2- 172.21.15.6:0/2463063360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68005210 0x7f4b6800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b801522c0 con 0x7f4b68003a00 2023-07-21T07:35:36.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8006b0c0 con 0x7f4b68004850 2023-07-21T07:35:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6800bf50 con 0x7f4b68005210 2023-07-21T07:35:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7e7fc700 1 --2- 172.21.15.6:0/2463063360 >> v2:172.21.15.86:3300/0 conn(0x7f4b800c5a60 0x7f4b80151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7effd700 1 --2- 172.21.15.6:0/2463063360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b800c6c70 0x7f4b80151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7effd700 1 --2- 172.21.15.6:0/2463063360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b68003a00 0x7f4b68003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7f7fe700 1 --2- 172.21.15.6:0/2463063360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68005210 0x7f4b6800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7e7fc700 1 --2- 172.21.15.6:0/2463063360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b68004850 0x7f4b68004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7effd700 1 -- 172.21.15.6:0/2463063360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68005210 msgr2=0x7f4b6800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7effd700 1 --2- 172.21.15.6:0/2463063360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68005210 0x7f4b6800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7effd700 1 -- 172.21.15.6:0/2463063360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b68004850 msgr2=0x7f4b68004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7effd700 1 --2- 172.21.15.6:0/2463063360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b68004850 0x7f4b68004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7effd700 1 -- 172.21.15.6:0/2463063360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b680035b0 con 0x7f4b68003a00 2023-07-21T07:35:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7effd700 1 --2- 172.21.15.6:0/2463063360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b68003a00 0x7f4b68003e20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009ba0 tx=0x7f4b68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8019f58a5028e6d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.709+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70004030 con 0x7f4b68003a00 2023-07-21T07:35:36.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.710+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b70004190 con 0x7f4b68003a00 2023-07-21T07:35:36.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.710+0000 7f4b7dffb700 1 -- 172.21.15.6:0/2463063360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70004540 con 0x7f4b68003a00 2023-07-21T07:35:36.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.710+0000 7f4b85741700 1 -- 172.21.15.6:0/2463063360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b68003a00 msgr2=0x7f4b68003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:36.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.710+0000 7f4b85741700 1 --2- 172.21.15.6:0/2463063360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b68003a00 0x7f4b68003e20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009ba0 tx=0x7f4b68005880 comp rx=0 tx=0).stop 2023-07-21T07:35:36.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.710+0000 7f4b7f7fe700 1 -- 172.21.15.6:0/2463063360 reap_dead start 2023-07-21T07:35:36.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.710+0000 7f4b85741700 1 -- 172.21.15.6:0/2463063360 shutdown_connections 2023-07-21T07:35:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.710+0000 7f4b85741700 1 -- 172.21.15.6:0/2463063360 >> 172.21.15.6:0/2463063360 conn(0x7f4b800ca040 msgr2=0x7f4b800ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.710+0000 7f4b85741700 1 -- 172.21.15.6:0/2463063360 shutdown_connections 2023-07-21T07:35:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.710+0000 7f4b85741700 1 -- 172.21.15.6:0/2463063360 wait complete. 2023-07-21T07:35:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.711+0000 7f4b85741700 1 Processor -- start 2023-07-21T07:35:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.712+0000 7f4b85741700 1 -- start start 2023-07-21T07:35:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.712+0000 7f4b85741700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b801e9a70 0x7f4b801e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.712+0000 7f4b85741700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b8014af40 0x7f4b8014b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.712+0000 7f4b85741700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b80153c00 0x7f4b801540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.712+0000 7f4b85741700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800ae3e0 con 0x7f4b801e9a70 2023-07-21T07:35:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.712+0000 7f4b85741700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b80153470 con 0x7f4b8014af40 2023-07-21T07:35:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.712+0000 7f4b85741700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8014b900 con 0x7f4b80153c00 2023-07-21T07:35:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.712+0000 7f4b7effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b801e9a70 0x7f4b801e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.712+0000 7f4b7effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b801e9a70 0x7f4b801e9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34382/0 (socket says 172.21.15.6:34382) 2023-07-21T07:35:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.712+0000 7f4b7effd700 1 -- 172.21.15.6:0/351173492 learned_addr learned my addr 172.21.15.6:0/351173492 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.713+0000 7f4b7effd700 1 -- 172.21.15.6:0/351173492 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b80153c00 msgr2=0x7f4b801540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.713+0000 7f4b7effd700 1 --2- 172.21.15.6:0/351173492 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b80153c00 0x7f4b801540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.713+0000 7f4b7effd700 1 -- 172.21.15.6:0/351173492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b8014af40 msgr2=0x7f4b8014b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.713+0000 7f4b7effd700 1 --2- 172.21.15.6:0/351173492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b8014af40 0x7f4b8014b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.713+0000 7f4b7effd700 1 -- 172.21.15.6:0/351173492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800ad7d0 con 0x7f4b801e9a70 2023-07-21T07:35:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.713+0000 7f4b7effd700 1 --2- 172.21.15.6:0/351173492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b801e9a70 0x7f4b801e9e50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000e4b0 tx=0x7f4b700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.713+0000 7f4b677fe700 1 -- 172.21.15.6:0/351173492 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70003ab0 con 0x7f4b801e9a70 2023-07-21T07:35:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.713+0000 7f4b677fe700 1 -- 172.21.15.6:0/351173492 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7000ee90 con 0x7f4b801e9a70 2023-07-21T07:35:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.713+0000 7f4b85741700 1 -- 172.21.15.6:0/351173492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b800adab0 con 0x7f4b801e9a70 2023-07-21T07:35:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.713+0000 7f4b677fe700 1 -- 172.21.15.6:0/351173492 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70003e50 con 0x7f4b801e9a70 2023-07-21T07:35:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.713+0000 7f4b85741700 1 -- 172.21.15.6:0/351173492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b800ae070 con 0x7f4b801e9a70 2023-07-21T07:35:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.714+0000 7f4b85741700 1 -- 172.21.15.6:0/351173492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b80074500 con 0x7f4b801e9a70 2023-07-21T07:35:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.714+0000 7f4b677fe700 1 -- 172.21.15.6:0/351173492 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b70013470 con 0x7f4b801e9a70 2023-07-21T07:35:36.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.715+0000 7f4b677fe700 1 --2- 172.21.15.6:0/351173492 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b6c06ace0 0x7f4b6c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:36.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.715+0000 7f4b677fe700 1 -- 172.21.15.6:0/351173492 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b70000e40 con 0x7f4b801e9a70 2023-07-21T07:35:36.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.715+0000 7f4b7e7fc700 1 --2- 172.21.15.6:0/351173492 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b6c06ace0 0x7f4b6c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:36.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.715+0000 7f4b7e7fc700 1 --2- 172.21.15.6:0/351173492 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b6c06ace0 0x7f4b6c06d1a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4b80150f60 tx=0x7f4b74006cc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:36.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.719+0000 7f4b677fe700 1 -- 172.21.15.6:0/351173492 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b70055d20 con 0x7f4b801e9a70 2023-07-21T07:35:37.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.962+0000 7f4b85741700 1 -- 172.21.15.6:0/351173492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b80073960 con 0x7f4b801e9a70 2023-07-21T07:35:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.962+0000 7f4b677fe700 1 -- 172.21.15.6:0/351173492 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4659 (secure 0 0 0) 0x7f4b70059340 con 0x7f4b801e9a70 2023-07-21T07:35:37.014 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:37.014 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1808819585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1808819585},{"type":"v1","addr":"172.21.15.6:6834","nonce":1808819585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/422116109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":422116109},{"type":"v1","addr":"172.21.15.86:6836","nonce":422116109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5067,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3328348149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3328348149},{"type":"v1","addr":"172.21.15.86:6837","nonce":3328348149}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:30.954456+0000","modified":"2023-07-21T07:35:34.571830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/459917011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":459917011},{"type":"v1","addr":"172.21.15.6:6835","nonce":459917011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T07:35:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.964+0000 7f4b85741700 1 -- 172.21.15.6:0/351173492 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b6c06ace0 msgr2=0x7f4b6c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.964+0000 7f4b85741700 1 --2- 172.21.15.6:0/351173492 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b6c06ace0 0x7f4b6c06d1a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4b80150f60 tx=0x7f4b74006cc0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.964+0000 7f4b85741700 1 -- 172.21.15.6:0/351173492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b801e9a70 msgr2=0x7f4b801e9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.964+0000 7f4b85741700 1 --2- 172.21.15.6:0/351173492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b801e9a70 0x7f4b801e9e50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000e4b0 tx=0x7f4b700047c0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.964+0000 7f4b85741700 1 -- 172.21.15.6:0/351173492 shutdown_connections 2023-07-21T07:35:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.964+0000 7f4b85741700 1 --2- 172.21.15.6:0/351173492 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b6c06ace0 0x7f4b6c06d1a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.964+0000 7f4b85741700 1 --2- 172.21.15.6:0/351173492 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b80153c00 0x7f4b801540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.964+0000 7f4b85741700 1 --2- 172.21.15.6:0/351173492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b801e9a70 0x7f4b801e9e50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.964+0000 7f4b85741700 1 --2- 172.21.15.6:0/351173492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b8014af40 0x7f4b8014b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.964+0000 7f4b85741700 1 -- 172.21.15.6:0/351173492 >> 172.21.15.6:0/351173492 conn(0x7f4b800ca040 msgr2=0x7f4b801dec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.964+0000 7f4b85741700 1 -- 172.21.15.6:0/351173492 shutdown_connections 2023-07-21T07:35:37.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:36.964+0000 7f4b85741700 1 -- 172.21.15.6:0/351173492 wait complete. 2023-07-21T07:35:37.018 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-07-21T07:35:37.430 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T07:35:30.954456+0000', 'modified': '2023-07-21T07:35:34.571830+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5070}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5070': {'gid': 5070, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/459917011', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 459917011}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 459917011}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T07:35:37.431 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T07:35:37.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-21T07:35:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.510+0000 7f65f2c18700 1 Processor -- start 2023-07-21T07:35:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.510+0000 7f65f2c18700 1 -- start start 2023-07-21T07:35:37.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.510+0000 7f65f2c18700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65ec0c1330 0x7f65ec151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.510+0000 7f65f2c18700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ec152160 con 0x7f65ec155110 2023-07-21T07:35:37.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.510+0000 7f65f2c18700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ec0c4b70 con 0x7f65ec0c6c90 2023-07-21T07:35:37.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.510+0000 7f65f2c18700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec0c17d0 con 0x7f65ec0c1330 2023-07-21T07:35:37.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.511+0000 7f65f11b5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f65ec155110 0x7f65ec14e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42414/0 (socket says 172.21.15.6:42414) 2023-07-21T07:35:37.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.511+0000 7f65f11b5700 1 -- 172.21.15.6:0/1996906864 learned_addr learned my addr 172.21.15.6:0/1996906864 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:37.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.511+0000 7f65ebfff700 1 --2- 172.21.15.6:0/1996906864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65ec0c1330 0x7f65ec151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.511+0000 7f65eb7fe700 1 -- 172.21.15.6:0/1996906864 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593222160 0 0) 0x7f65ec152160 con 0x7f65ec155110 2023-07-21T07:35:37.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.511+0000 7f65eb7fe700 1 -- 172.21.15.6:0/1996906864 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65dc0035b0 con 0x7f65ec155110 2023-07-21T07:35:37.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.511+0000 7f65eb7fe700 1 -- 172.21.15.6:0/1996906864 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635204185 0 0) 0x7f65ec0c4b70 con 0x7f65ec0c6c90 2023-07-21T07:35:37.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.511+0000 7f65eb7fe700 1 -- 172.21.15.6:0/1996906864 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65ec152160 con 0x7f65ec0c6c90 2023-07-21T07:35:37.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.511+0000 7f65ebfff700 1 -- 172.21.15.6:0/1996906864 >> v1:172.21.15.86:6789/0 conn(0x7f65ec0c6c90 legacy=0x7f65ec0c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.511+0000 7f65ebfff700 1 -- 172.21.15.6:0/1996906864 >> v1:172.21.15.6:6789/0 conn(0x7f65ec155110 legacy=0x7f65ec14e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.511+0000 7f65ebfff700 1 -- 172.21.15.6:0/1996906864 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec0c1ab0 con 0x7f65ec0c1330 2023-07-21T07:35:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.511+0000 7f65ebfff700 1 --2- 172.21.15.6:0/1996906864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65ec0c1330 0x7f65ec151c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65d80098a0 tx=0x7f65d8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28e355c1a6997bac server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.511+0000 7f65eb7fe700 1 -- 172.21.15.6:0/1996906864 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8011830 con 0x7f65ec0c1330 2023-07-21T07:35:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.512+0000 7f65eb7fe700 1 -- 172.21.15.6:0/1996906864 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d8011990 con 0x7f65ec0c1330 2023-07-21T07:35:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.512+0000 7f65eb7fe700 1 -- 172.21.15.6:0/1996906864 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8011d20 con 0x7f65ec0c1330 2023-07-21T07:35:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.512+0000 7f65f2c18700 1 -- 172.21.15.6:0/1996906864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65ec0c1330 msgr2=0x7f65ec151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.512+0000 7f65f2c18700 1 --2- 172.21.15.6:0/1996906864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65ec0c1330 0x7f65ec151c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65d80098a0 tx=0x7f65d8009bb0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.512+0000 7f65f2c18700 1 -- 172.21.15.6:0/1996906864 shutdown_connections 2023-07-21T07:35:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.512+0000 7f65f2c18700 1 --2- 172.21.15.6:0/1996906864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65ec0c1330 0x7f65ec151c20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.512+0000 7f65f2c18700 1 -- 172.21.15.6:0/1996906864 >> 172.21.15.6:0/1996906864 conn(0x7f65ec06b1a0 msgr2=0x7f65ec06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.512+0000 7f65f2c18700 1 -- 172.21.15.6:0/1996906864 shutdown_connections 2023-07-21T07:35:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.512+0000 7f65f2c18700 1 -- 172.21.15.6:0/1996906864 wait complete. 2023-07-21T07:35:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.514+0000 7f65f2c18700 1 Processor -- start 2023-07-21T07:35:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.514+0000 7f65f2c18700 1 -- start start 2023-07-21T07:35:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f2c18700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65ec0c1330 0x7f65ec0a8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f2c18700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0c6c90 0x7f65ec0abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f2c18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec155110 0x7f65ec0ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f2c18700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec14df80 con 0x7f65ec155110 2023-07-21T07:35:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f2c18700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec1ea2c0 con 0x7f65ec0c6c90 2023-07-21T07:35:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f2c18700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec1ea5a0 con 0x7f65ec0c1330 2023-07-21T07:35:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f11b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec155110 0x7f65ec0ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f11b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec155110 0x7f65ec0ac030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34400/0 (socket says 172.21.15.6:34400) 2023-07-21T07:35:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f11b5700 1 -- 172.21.15.6:0/1787912145 learned_addr learned my addr 172.21.15.6:0/1787912145 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f09b4700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65ec0c1330 0x7f65ec0a8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65ebfff700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0c6c90 0x7f65ec0abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f11b5700 1 -- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65ec0c1330 msgr2=0x7f65ec0a8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f11b5700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65ec0c1330 0x7f65ec0a8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f11b5700 1 -- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0c6c90 msgr2=0x7f65ec0abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f11b5700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0c6c90 0x7f65ec0abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f11b5700 1 -- 172.21.15.6:0/1787912145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d80094a0 con 0x7f65ec155110 2023-07-21T07:35:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65f11b5700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec155110 0x7f65ec0ac030 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f65e400caf0 tx=0x7f65e400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.515+0000 7f65e97fa700 1 -- 172.21.15.6:0/1787912145 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400a9e0 con 0x7f65ec155110 2023-07-21T07:35:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.516+0000 7f65e97fa700 1 -- 172.21.15.6:0/1787912145 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e400ab40 con 0x7f65ec155110 2023-07-21T07:35:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.516+0000 7f65f2c18700 1 -- 172.21.15.6:0/1787912145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ec1ea880 con 0x7f65ec155110 2023-07-21T07:35:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.516+0000 7f65e97fa700 1 -- 172.21.15.6:0/1787912145 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4012400 con 0x7f65ec155110 2023-07-21T07:35:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.516+0000 7f65f2c18700 1 -- 172.21.15.6:0/1787912145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ec0a8f70 con 0x7f65ec155110 2023-07-21T07:35:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.517+0000 7f65e97fa700 1 -- 172.21.15.6:0/1787912145 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f65e401b3b0 con 0x7f65ec155110 2023-07-21T07:35:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.518+0000 7f65e97fa700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f65d006ace0 0x7f65d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.518+0000 7f65e97fa700 1 -- 172.21.15.6:0/1787912145 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f65e40890d0 con 0x7f65ec155110 2023-07-21T07:35:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.518+0000 7f65f09b4700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f65d006ace0 0x7f65d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.519+0000 7f65f09b4700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f65d006ace0 0x7f65d006d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f65e00011e0 tx=0x7f65e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.520+0000 7f65fedb0b80 1 Processor -- start 2023-07-21T07:35:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.520+0000 7f65fedb0b80 1 -- start start 2023-07-21T07:35:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.520+0000 7f65fedb0b80 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 0x55ac7aef5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.520+0000 7f65fedb0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 0x55ac7af41570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.520+0000 7f65fedb0b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefacf0 0x55ac7af43670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.520+0000 7f65fedb0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7adf2b80 con 0x55ac7aefbc90 2023-07-21T07:35:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.520+0000 7f65fedb0b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7ae52540 con 0x55ac7aefacf0 2023-07-21T07:35:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.520+0000 7f65fedb0b80 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac7ae4fe60 con 0x55ac7aefa910 2023-07-21T07:35:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.520+0000 7f65ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 0x55ac7af41570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.520+0000 7f65ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 0x55ac7af41570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34406/0 (socket says 172.21.15.6:34406) 2023-07-21T07:35:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.520+0000 7f65ebfff700 1 -- 172.21.15.6:0/391145529 learned_addr learned my addr 172.21.15.6:0/391145529 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.520+0000 7f65f09b4700 1 --2- 172.21.15.6:0/391145529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 0x55ac7aef5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.520+0000 7f65f11b5700 1 --2- 172.21.15.6:0/391145529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefacf0 0x55ac7af43670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.521+0000 7f65ebfff700 1 -- 172.21.15.6:0/391145529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 msgr2=0x55ac7aef5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.521+0000 7f65ebfff700 1 --2- 172.21.15.6:0/391145529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 0x55ac7aef5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.521+0000 7f65ebfff700 1 -- 172.21.15.6:0/391145529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefacf0 msgr2=0x55ac7af43670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.521+0000 7f65ebfff700 1 --2- 172.21.15.6:0/391145529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefacf0 0x55ac7af43670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.521+0000 7f65ebfff700 1 -- 172.21.15.6:0/391145529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac7accc5e0 con 0x55ac7aefbc90 2023-07-21T07:35:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.521+0000 7f65ebfff700 1 --2- 172.21.15.6:0/391145529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 0x55ac7af41570 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000c00 tx=0x7f65d8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacba61c94e1561f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.521+0000 7f65d67fc700 1 -- 172.21.15.6:0/391145529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8011b00 con 0x55ac7aefbc90 2023-07-21T07:35:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.521+0000 7f65d67fc700 1 -- 172.21.15.6:0/391145529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d8011c60 con 0x55ac7aefbc90 2023-07-21T07:35:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.521+0000 7f65d67fc700 1 -- 172.21.15.6:0/391145529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d801a660 con 0x55ac7aefbc90 2023-07-21T07:35:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.522+0000 7f65fedb0b80 1 -- 172.21.15.6:0/391145529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 msgr2=0x55ac7af41570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.522+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/391145529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 0x55ac7af41570 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000c00 tx=0x7f65d8008030 comp rx=0 tx=0).stop 2023-07-21T07:35:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.522+0000 7f65fedb0b80 1 -- 172.21.15.6:0/391145529 shutdown_connections 2023-07-21T07:35:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.522+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/391145529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefacf0 0x55ac7af43670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.522+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/391145529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 0x55ac7aef5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.522+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/391145529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 0x55ac7af41570 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.522+0000 7f65fedb0b80 1 -- 172.21.15.6:0/391145529 >> 172.21.15.6:0/391145529 conn(0x55ac7ae57c80 msgr2=0x55ac7aef8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.522+0000 7f65fedb0b80 1 -- 172.21.15.6:0/391145529 shutdown_connections 2023-07-21T07:35:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.522+0000 7f65fedb0b80 1 -- 172.21.15.6:0/391145529 wait complete. 2023-07-21T07:35:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.522+0000 7f65fedb0b80 1 -- start start 2023-07-21T07:35:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.523+0000 7f65fedb0b80 1 Processor -- start 2023-07-21T07:35:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65fedb0b80 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 0x55ac7af4df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65fedb0b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefacf0 0x55ac7af38790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65fedb0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 0x55ac7af36760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65fedb0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7ae4b750 con 0x55ac7aefbc90 2023-07-21T07:35:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65fedb0b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7adeaa70 con 0x55ac7aefacf0 2023-07-21T07:35:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65fedb0b80 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac7adea770 con 0x55ac7aefa910 2023-07-21T07:35:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65fedb0b80 10 client.0 _ll_register_callbacks cb 0x55ac7ade8630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T07:35:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65f11b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 0x55ac7af36760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65f11b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 0x55ac7af36760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34412/0 (socket says 172.21.15.6:34412) 2023-07-21T07:35:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65f11b5700 1 -- 172.21.15.6:0/1952360052 learned_addr learned my addr 172.21.15.6:0/1952360052 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65ebfff700 1 --2- 172.21.15.6:0/1952360052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefacf0 0x55ac7af38790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65f09b4700 1 --2- 172.21.15.6:0/1952360052 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 0x55ac7af4df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65f11b5700 1 -- 172.21.15.6:0/1952360052 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 msgr2=0x55ac7af4df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65f11b5700 1 --2- 172.21.15.6:0/1952360052 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 0x55ac7af4df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65f11b5700 1 -- 172.21.15.6:0/1952360052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefacf0 msgr2=0x55ac7af38790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65f11b5700 1 --2- 172.21.15.6:0/1952360052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefacf0 0x55ac7af38790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65f11b5700 1 -- 172.21.15.6:0/1952360052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ec0c1ab0 con 0x55ac7aefbc90 2023-07-21T07:35:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65f11b5700 1 --2- 172.21.15.6:0/1952360052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 0x55ac7af36760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f65e4057b40 tx=0x7f65e405bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9d6a0292c0ef58 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.524+0000 7f65cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T07:35:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65cb7fe700 1 -- 172.21.15.6:0/1952360052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4053e30 con 0x55ac7aefbc90 2023-07-21T07:35:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65cb7fe700 1 -- 172.21.15.6:0/1952360052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f65e4053f90 con 0x55ac7aefbc90 2023-07-21T07:35:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65fedb0b80 1 -- 172.21.15.6:0/1952360052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac7aec9b40 con 0x55ac7aefbc90 2023-07-21T07:35:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65cb7fe700 1 -- 172.21.15.6:0/1952360052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65e4056da0 con 0x55ac7aefbc90 2023-07-21T07:35:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65fedb0b80 10 client.5238 fetch_fsmap learned FSMap version 17 2023-07-21T07:35:37.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65fedb0b80 1 -- 172.21.15.6:0/1952360052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ac7ac78d90 con 0x55ac7aefbc90 2023-07-21T07:35:37.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65cb7fe700 1 -- 172.21.15.6:0/1952360052 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e4073070 con 0x55ac7aefbc90 2023-07-21T07:35:37.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65cb7fe700 1 -- 172.21.15.6:0/1952360052 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f65e4056f00 con 0x55ac7aefbc90 2023-07-21T07:35:37.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65fedb0b80 10 client.5238 fetch_fsmap finished waiting for FSMap version 17 2023-07-21T07:35:37.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65fedb0b80 10 client.5238 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T07:35:37.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65fedb0b80 20 client.5238 populate_metadata read hostname 'smithi006' 2023-07-21T07:35:37.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/1952360052 >> [v2:172.21.15.6:6832/459917011,v1:172.21.15.6:6835/459917011] conn(0x55ac7af56020 0x55ac7af58410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65fedb0b80 4 client.5238 mds_command: new command op to 5070 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T07:35:37.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65fedb0b80 1 -- 172.21.15.6:0/1952360052 --> [v2:172.21.15.6:6832/459917011,v1:172.21.15.6:6835/459917011] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac7ae75d40 con 0x55ac7af56020 2023-07-21T07:35:37.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65f09b4700 1 --2- 172.21.15.6:0/1952360052 >> [v2:172.21.15.6:6832/459917011,v1:172.21.15.6:6835/459917011] conn(0x55ac7af56020 0x55ac7af58410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65f09b4700 1 --2- 172.21.15.6:0/1952360052 >> [v2:172.21.15.6:6832/459917011,v1:172.21.15.6:6835/459917011] conn(0x55ac7af56020 0x55ac7af58410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8753186c2386a992 server_cookie=d2dbea567c7f6948 in_seq=0 out_seq=0 2023-07-21T07:35:37.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.525+0000 7f65cb7fe700 10 client.5238 ms_handle_connect on v2:172.21.15.6:6832/459917011 2023-07-21T07:35:37.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65cb7fe700 1 -- 172.21.15.6:0/1952360052 <== mds.0 v2:172.21.15.6:6832/459917011 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55ac7ae75d40 con 0x55ac7af56020 2023-07-21T07:35:37.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65cb7fe700 10 client.5238 handle_command_reply: tid=0 2023-07-21T07:35:37.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65fedb0b80 1 client.5238 shutdown 2023-07-21T07:35:37.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65fedb0b80 1 -- 172.21.15.6:0/1952360052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 msgr2=0x55ac7af36760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/1952360052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 0x55ac7af36760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f65e4057b40 tx=0x7f65e405bf80 comp rx=0 tx=0).stop 2023-07-21T07:35:37.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65fedb0b80 1 -- 172.21.15.6:0/1952360052 shutdown_connections 2023-07-21T07:35:37.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/1952360052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefbc90 0x55ac7af36760 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/1952360052 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 0x55ac7af4df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/1952360052 >> [v2:172.21.15.6:6832/459917011,v1:172.21.15.6:6835/459917011] conn(0x55ac7af56020 0x55ac7af58410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/1952360052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefacf0 0x55ac7af38790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65cb7fe700 0 client.5238 ms_handle_reset on v2:172.21.15.6:6832/459917011 2023-07-21T07:35:37.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65fedb0b80 1 -- 172.21.15.6:0/1952360052 >> 172.21.15.6:0/1952360052 conn(0x55ac7ae57c80 msgr2=0x55ac7aef3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:37.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65fedb0b80 1 -- 172.21.15.6:0/1952360052 shutdown_connections 2023-07-21T07:35:37.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.526+0000 7f65fedb0b80 1 -- 172.21.15.6:0/1952360052 wait complete. 2023-07-21T07:35:37.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.527+0000 7f65fedb0b80 20 client.5238 trim_cache size 0 max 16384 2023-07-21T07:35:37.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.544+0000 7f65fedb0b80 1 Processor -- start 2023-07-21T07:35:37.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.544+0000 7f65fedb0b80 1 -- start start 2023-07-21T07:35:37.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65fedb0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefa910 0x55ac7af3a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65fedb0b80 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefacf0 0x55ac7af37ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65fedb0b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefbc90 0x55ac7af38400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65fedb0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7acce8d0 con 0x55ac7aefa910 2023-07-21T07:35:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65fedb0b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7af5ce40 con 0x55ac7aefbc90 2023-07-21T07:35:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65fedb0b80 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac7af16ec0 con 0x55ac7aefacf0 2023-07-21T07:35:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65f09b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefa910 0x55ac7af3a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65f09b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefa910 0x55ac7af3a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34418/0 (socket says 172.21.15.6:34418) 2023-07-21T07:35:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65f09b4700 1 -- 172.21.15.6:0/22004560 learned_addr learned my addr 172.21.15.6:0/22004560 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65ebfff700 1 --2- 172.21.15.6:0/22004560 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefacf0 0x55ac7af37ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65f11b5700 1 --2- 172.21.15.6:0/22004560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefbc90 0x55ac7af38400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65f09b4700 1 -- 172.21.15.6:0/22004560 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefacf0 msgr2=0x55ac7af37ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65f09b4700 1 --2- 172.21.15.6:0/22004560 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefacf0 0x55ac7af37ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65f09b4700 1 -- 172.21.15.6:0/22004560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefbc90 msgr2=0x55ac7af38400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65f09b4700 1 --2- 172.21.15.6:0/22004560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefbc90 0x55ac7af38400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65f09b4700 1 -- 172.21.15.6:0/22004560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac7ac61c10 con 0x55ac7aefa910 2023-07-21T07:35:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65ebfff700 1 --2- 172.21.15.6:0/22004560 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefacf0 0x55ac7af37ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65f11b5700 1 --2- 172.21.15.6:0/22004560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefbc90 0x55ac7af38400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65f09b4700 1 --2- 172.21.15.6:0/22004560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefa910 0x55ac7af3a020 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55ac7af3ab70 tx=0x7f65e0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf8769fce899e6d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.545+0000 7f65d6ffd700 1 -- 172.21.15.6:0/22004560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e000fd10 con 0x55ac7aefa910 2023-07-21T07:35:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.546+0000 7f65d6ffd700 1 -- 172.21.15.6:0/22004560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e000fe70 con 0x55ac7aefa910 2023-07-21T07:35:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.546+0000 7f65d6ffd700 1 -- 172.21.15.6:0/22004560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0006a60 con 0x55ac7aefa910 2023-07-21T07:35:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.546+0000 7f65fedb0b80 1 -- 172.21.15.6:0/22004560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefa910 msgr2=0x55ac7af3a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.546+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/22004560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefa910 0x55ac7af3a020 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55ac7af3ab70 tx=0x7f65e0012000 comp rx=0 tx=0).stop 2023-07-21T07:35:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.546+0000 7f65fedb0b80 1 -- 172.21.15.6:0/22004560 shutdown_connections 2023-07-21T07:35:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.546+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/22004560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefbc90 0x55ac7af38400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.546+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/22004560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefa910 0x55ac7af3a020 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.546+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/22004560 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefacf0 0x55ac7af37ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.546+0000 7f65fedb0b80 1 -- 172.21.15.6:0/22004560 >> 172.21.15.6:0/22004560 conn(0x55ac7ae57c80 msgr2=0x55ac7af1cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:37.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.546+0000 7f65fedb0b80 1 -- 172.21.15.6:0/22004560 shutdown_connections 2023-07-21T07:35:37.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.546+0000 7f65fedb0b80 1 -- 172.21.15.6:0/22004560 wait complete. 2023-07-21T07:35:37.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.547+0000 7f65fedb0b80 1 -- start start 2023-07-21T07:35:37.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.547+0000 7f65fedb0b80 1 Processor -- start 2023-07-21T07:35:37.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65fedb0b80 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 0x55ac7af1cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65fedb0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefacf0 0x55ac7afa5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65fedb0b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefbc90 0x55ac7af9b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65fedb0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7af15e50 con 0x55ac7aefacf0 2023-07-21T07:35:37.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65fedb0b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac7af15980 con 0x55ac7aefbc90 2023-07-21T07:35:37.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65fedb0b80 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac7af144b0 con 0x55ac7aefa910 2023-07-21T07:35:37.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65fedb0b80 10 client.0 _ll_register_callbacks cb 0x55ac7ade8630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T07:35:37.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefacf0 0x55ac7afa5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefacf0 0x55ac7afa5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34426/0 (socket says 172.21.15.6:34426) 2023-07-21T07:35:37.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65ebfff700 1 -- 172.21.15.6:0/2442439028 learned_addr learned my addr 172.21.15.6:0/2442439028 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:37.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65f09b4700 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 0x55ac7af1cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65f11b5700 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefbc90 0x55ac7af9b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65ebfff700 1 -- 172.21.15.6:0/2442439028 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 msgr2=0x55ac7af1cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65ebfff700 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 0x55ac7af1cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65ebfff700 1 -- 172.21.15.6:0/2442439028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefbc90 msgr2=0x55ac7af9b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65ebfff700 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefbc90 0x55ac7af9b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65ebfff700 1 -- 172.21.15.6:0/2442439028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ec152160 con 0x55ac7aefacf0 2023-07-21T07:35:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65f11b5700 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefbc90 0x55ac7af9b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65ebfff700 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefacf0 0x55ac7afa5840 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000c00 tx=0x7f65d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ba28316c62b0bc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T07:35:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65cb7fe700 1 -- 172.21.15.6:0/2442439028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8004240 con 0x55ac7aefacf0 2023-07-21T07:35:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65cb7fe700 1 -- 172.21.15.6:0/2442439028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f65d801f040 con 0x55ac7aefacf0 2023-07-21T07:35:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.548+0000 7f65fedb0b80 1 -- 172.21.15.6:0/2442439028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac7aeecfe0 con 0x55ac7aefacf0 2023-07-21T07:35:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65cb7fe700 1 -- 172.21.15.6:0/2442439028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65d8011d10 con 0x55ac7aefacf0 2023-07-21T07:35:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65fedb0b80 10 client.5244 fetch_fsmap learned FSMap version 17 2023-07-21T07:35:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65fedb0b80 1 -- 172.21.15.6:0/2442439028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ac7ac9f200 con 0x55ac7aefacf0 2023-07-21T07:35:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65cb7fe700 1 -- 172.21.15.6:0/2442439028 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ac7aeecfe0 con 0x55ac7aefacf0 2023-07-21T07:35:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65cb7fe700 1 -- 172.21.15.6:0/2442439028 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f65d8023070 con 0x55ac7aefacf0 2023-07-21T07:35:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65fedb0b80 10 client.5244 fetch_fsmap finished waiting for FSMap version 17 2023-07-21T07:35:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65fedb0b80 10 client.5244 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T07:35:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65fedb0b80 20 client.5244 populate_metadata read hostname 'smithi006' 2023-07-21T07:35:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.6:6832/459917011,v1:172.21.15.6:6835/459917011] conn(0x55ac7af9b960 0x55ac7af32e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65fedb0b80 4 client.5244 mds_command: new command op to 5070 tid=0[{"prefix": "status"}] 2023-07-21T07:35:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65fedb0b80 1 -- 172.21.15.6:0/2442439028 --> [v2:172.21.15.6:6832/459917011,v1:172.21.15.6:6835/459917011] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ac7ae44730 con 0x55ac7af9b960 2023-07-21T07:35:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65f09b4700 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.6:6832/459917011,v1:172.21.15.6:6835/459917011] conn(0x55ac7af9b960 0x55ac7af32e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65cb7fe700 10 client.5244 ms_handle_connect on v2:172.21.15.6:6832/459917011 2023-07-21T07:35:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.549+0000 7f65f09b4700 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.6:6832/459917011,v1:172.21.15.6:6835/459917011] conn(0x55ac7af9b960 0x55ac7af32e50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=439d6fe59bc614cb server_cookie=749b24781883b28a in_seq=0 out_seq=0 2023-07-21T07:35:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65cb7fe700 1 -- 172.21.15.6:0/2442439028 <== mds.0 v2:172.21.15.6:6832/459917011 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55ac7ae44730 con 0x55ac7af9b960 2023-07-21T07:35:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65cb7fe700 10 client.5244 handle_command_reply: tid=0 2023-07-21T07:35:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65fedb0b80 1 client.5244 shutdown 2023-07-21T07:35:37.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65fedb0b80 1 -- 172.21.15.6:0/2442439028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefacf0 msgr2=0x55ac7afa5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefacf0 0x55ac7afa5840 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000c00 tx=0x7f65d80047c0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65fedb0b80 1 -- 172.21.15.6:0/2442439028 shutdown_connections 2023-07-21T07:35:37.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.6:6832/459917011,v1:172.21.15.6:6835/459917011] conn(0x55ac7af9b960 0x55ac7af32e50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac7aefbc90 0x55ac7af9b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ac7aefa910 0x55ac7af1cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65fedb0b80 1 --2- 172.21.15.6:0/2442439028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac7aefacf0 0x55ac7afa5840 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65cb7fe700 0 client.5244 ms_handle_reset on v2:172.21.15.6:6832/459917011 2023-07-21T07:35:37.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65fedb0b80 1 -- 172.21.15.6:0/2442439028 >> 172.21.15.6:0/2442439028 conn(0x55ac7ae57c80 msgr2=0x55ac7aef3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:37.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65fedb0b80 1 -- 172.21.15.6:0/2442439028 shutdown_connections 2023-07-21T07:35:37.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65fedb0b80 1 -- 172.21.15.6:0/2442439028 wait complete. 2023-07-21T07:35:37.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65fedb0b80 20 client.5244 trim_cache size 0 max 16384 2023-07-21T07:35:37.612 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T07:35:37.613 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "8c602ac0-17b3-4df5-8928-640a7524b3b3", 2023-07-21T07:35:37.613 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T07:35:37.613 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5070, 2023-07-21T07:35:37.613 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T07:35:37.613 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T07:35:37.613 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T07:35:37.614 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.9891192950000001, 2023-07-21T07:35:37.614 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 17, 2023-07-21T07:35:37.614 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 36, 2023-07-21T07:35:37.614 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 36, 2023-07-21T07:35:37.614 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 13.873670011 2023-07-21T07:35:37.614 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T07:35:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65f2c18700 1 -- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f65d006ace0 msgr2=0x7f65d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65f2c18700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f65d006ace0 0x7f65d006d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f65e00011e0 tx=0x7f65e0009040 comp rx=0 tx=0).stop 2023-07-21T07:35:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65f2c18700 1 -- 172.21.15.6:0/1787912145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec155110 msgr2=0x7f65ec0ac030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.550+0000 7f65f2c18700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec155110 0x7f65ec0ac030 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f65e400caf0 tx=0x7f65e400ce00 comp rx=0 tx=0).stop 2023-07-21T07:35:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.551+0000 7f65f2c18700 1 -- 172.21.15.6:0/1787912145 shutdown_connections 2023-07-21T07:35:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.551+0000 7f65f2c18700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f65d006ace0 0x7f65d006d1a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.551+0000 7f65f2c18700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec155110 0x7f65ec0ac030 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.551+0000 7f65f2c18700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65ec0c1330 0x7f65ec0a8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.551+0000 7f65f2c18700 1 --2- 172.21.15.6:0/1787912145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65ec0c6c90 0x7f65ec0abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.551+0000 7f65f2c18700 1 -- 172.21.15.6:0/1787912145 >> 172.21.15.6:0/1787912145 conn(0x7f65ec06b1a0 msgr2=0x7f65ec071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.551+0000 7f65f2c18700 1 -- 172.21.15.6:0/1787912145 shutdown_connections 2023-07-21T07:35:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.551+0000 7f65f2c18700 1 -- 172.21.15.6:0/1787912145 wait complete. 2023-07-21T07:35:37.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T07:35:37.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.693+0000 7fac8d28c700 1 Processor -- start 2023-07-21T07:35:37.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.693+0000 7fac8d28c700 1 -- start start 2023-07-21T07:35:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.693+0000 7fac8d28c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fac8814f7b0 0x7fac880717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.693+0000 7fac8d28c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fac880c7540 0x7fac88155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.693+0000 7fac8d28c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac88156430 con 0x7fac88071d00 2023-07-21T07:35:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.693+0000 7fac8d28c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac88152230 con 0x7fac8814f7b0 2023-07-21T07:35:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.693+0000 7fac8d28c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac881524f0 con 0x7fac880c7540 2023-07-21T07:35:37.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.694+0000 7fac86ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fac8814f7b0 0x7fac880717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.694+0000 7fac867fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fac88071d00 0x7fac881557e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42454/0 (socket says 172.21.15.6:42454) 2023-07-21T07:35:37.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.694+0000 7fac867fc700 1 -- 172.21.15.6:0/2479523763 learned_addr learned my addr 172.21.15.6:0/2479523763 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:37.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.694+0000 7fac877fe700 1 --2- 172.21.15.6:0/2479523763 >> v2:172.21.15.86:3300/0 conn(0x7fac880c7540 0x7fac88155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.694+0000 7fac86ffd700 1 -- 172.21.15.6:0/2479523763 >> v2:172.21.15.86:3300/0 conn(0x7fac880c7540 msgr2=0x7fac88155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:37.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.694+0000 7fac86ffd700 1 --2- 172.21.15.6:0/2479523763 >> v2:172.21.15.86:3300/0 conn(0x7fac880c7540 0x7fac88155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.694+0000 7fac86ffd700 1 -- 172.21.15.6:0/2479523763 >> v1:172.21.15.6:6789/0 conn(0x7fac88071d00 legacy=0x7fac881557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.694+0000 7fac85ffb700 1 -- 172.21.15.6:0/2479523763 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071610428 0 0) 0x7fac88156430 con 0x7fac88071d00 2023-07-21T07:35:37.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.694+0000 7fac86ffd700 1 -- 172.21.15.6:0/2479523763 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac881527d0 con 0x7fac8814f7b0 2023-07-21T07:35:37.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.694+0000 7fac86ffd700 1 --2- 172.21.15.6:0/2479523763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8814f7b0 0x7fac880717c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fac88072180 tx=0x7fac78009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d030ceb0a7e3768f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:37.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.694+0000 7fac85ffb700 1 -- 172.21.15.6:0/2479523763 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac78011830 con 0x7fac8814f7b0 2023-07-21T07:35:37.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.694+0000 7fac85ffb700 1 -- 172.21.15.6:0/2479523763 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac78011990 con 0x7fac8814f7b0 2023-07-21T07:35:37.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.694+0000 7fac85ffb700 1 -- 172.21.15.6:0/2479523763 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac78011d20 con 0x7fac8814f7b0 2023-07-21T07:35:37.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.695+0000 7fac8d28c700 1 -- 172.21.15.6:0/2479523763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8814f7b0 msgr2=0x7fac880717c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.695+0000 7fac8d28c700 1 --2- 172.21.15.6:0/2479523763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8814f7b0 0x7fac880717c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fac88072180 tx=0x7fac78009b20 comp rx=0 tx=0).stop 2023-07-21T07:35:37.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.695+0000 7fac8d28c700 1 -- 172.21.15.6:0/2479523763 shutdown_connections 2023-07-21T07:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.695+0000 7fac8d28c700 1 --2- 172.21.15.6:0/2479523763 >> v2:172.21.15.86:3300/0 conn(0x7fac880c7540 0x7fac88155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.695+0000 7fac8d28c700 1 --2- 172.21.15.6:0/2479523763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8814f7b0 0x7fac880717c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.695+0000 7fac8d28c700 1 -- 172.21.15.6:0/2479523763 >> 172.21.15.6:0/2479523763 conn(0x7fac880c7b60 msgr2=0x7fac880c7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.695+0000 7fac8d28c700 1 -- 172.21.15.6:0/2479523763 shutdown_connections 2023-07-21T07:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.695+0000 7fac8d28c700 1 -- 172.21.15.6:0/2479523763 wait complete. 2023-07-21T07:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.696+0000 7fac8d28c700 1 Processor -- start 2023-07-21T07:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.696+0000 7fac8d28c700 1 -- start start 2023-07-21T07:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac8d28c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac88071d00 0x7fac881e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac8d28c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac880c7540 0x7fac880c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac8d28c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8814f7b0 0x7fac8806b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac8d28c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8806cec0 con 0x7fac8814f7b0 2023-07-21T07:35:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac8d28c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac881ed0d0 con 0x7fac88071d00 2023-07-21T07:35:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac8d28c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac881ed3b0 con 0x7fac880c7540 2023-07-21T07:35:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac877fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8814f7b0 0x7fac8806b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac877fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8814f7b0 0x7fac8806b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34442/0 (socket says 172.21.15.6:34442) 2023-07-21T07:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac877fe700 1 -- 172.21.15.6:0/2534604646 learned_addr learned my addr 172.21.15.6:0/2534604646 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac86ffd700 1 --2- 172.21.15.6:0/2534604646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac88071d00 0x7fac881e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac877fe700 1 -- 172.21.15.6:0/2534604646 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac880c7540 msgr2=0x7fac880c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac877fe700 1 --2- 172.21.15.6:0/2534604646 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac880c7540 0x7fac880c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac877fe700 1 -- 172.21.15.6:0/2534604646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac88071d00 msgr2=0x7fac881e6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac877fe700 1 --2- 172.21.15.6:0/2534604646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac88071d00 0x7fac881e6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.697+0000 7fac877fe700 1 -- 172.21.15.6:0/2534604646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac780094a0 con 0x7fac8814f7b0 2023-07-21T07:35:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.698+0000 7fac877fe700 1 --2- 172.21.15.6:0/2534604646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8814f7b0 0x7fac8806b2a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fac8000efc0 tx=0x7fac8000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.698+0000 7fac6f7fe700 1 -- 172.21.15.6:0/2534604646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8000cd40 con 0x7fac8814f7b0 2023-07-21T07:35:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.698+0000 7fac6f7fe700 1 -- 172.21.15.6:0/2534604646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8000f040 con 0x7fac8814f7b0 2023-07-21T07:35:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.698+0000 7fac8d28c700 1 -- 172.21.15.6:0/2534604646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac881ed690 con 0x7fac8814f7b0 2023-07-21T07:35:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.698+0000 7fac6f7fe700 1 -- 172.21.15.6:0/2534604646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac800146c0 con 0x7fac8814f7b0 2023-07-21T07:35:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.698+0000 7fac8d28c700 1 -- 172.21.15.6:0/2534604646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac881edc50 con 0x7fac8814f7b0 2023-07-21T07:35:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.699+0000 7fac8d28c700 1 -- 172.21.15.6:0/2534604646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac88074500 con 0x7fac8814f7b0 2023-07-21T07:35:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.699+0000 7fac6f7fe700 1 -- 172.21.15.6:0/2534604646 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac80014820 con 0x7fac8814f7b0 2023-07-21T07:35:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.700+0000 7fac6f7fe700 1 --2- 172.21.15.6:0/2534604646 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac7406ace0 0x7fac7406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.700+0000 7fac6f7fe700 1 -- 172.21.15.6:0/2534604646 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac80089d50 con 0x7fac8814f7b0 2023-07-21T07:35:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.700+0000 7fac86ffd700 1 --2- 172.21.15.6:0/2534604646 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac7406ace0 0x7fac7406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.700+0000 7fac86ffd700 1 --2- 172.21.15.6:0/2534604646 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac7406ace0 0x7fac7406d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac780090b0 tx=0x7fac78008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.704+0000 7fac6f7fe700 1 -- 172.21.15.6:0/2534604646 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fac8008d030 con 0x7fac8814f7b0 2023-07-21T07:35:37.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.948+0000 7fac8d28c700 1 -- 172.21.15.6:0/2534604646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fac880a74c0 con 0x7fac8814f7b0 2023-07-21T07:35:38.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.948+0000 7fac6f7fe700 1 -- 172.21.15.6:0/2534604646 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fac80058920 con 0x7fac8814f7b0 2023-07-21T07:35:38.155 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T07:35:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.950+0000 7fac8d28c700 1 -- 172.21.15.6:0/2534604646 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac7406ace0 msgr2=0x7fac7406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.950+0000 7fac8d28c700 1 --2- 172.21.15.6:0/2534604646 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac7406ace0 0x7fac7406d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac780090b0 tx=0x7fac78008030 comp rx=0 tx=0).stop 2023-07-21T07:35:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.950+0000 7fac8d28c700 1 -- 172.21.15.6:0/2534604646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8814f7b0 msgr2=0x7fac8806b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.950+0000 7fac8d28c700 1 --2- 172.21.15.6:0/2534604646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8814f7b0 0x7fac8806b2a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fac8000efc0 tx=0x7fac8000c3a0 comp rx=0 tx=0).stop 2023-07-21T07:35:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.950+0000 7fac8d28c700 1 -- 172.21.15.6:0/2534604646 shutdown_connections 2023-07-21T07:35:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.950+0000 7fac8d28c700 1 --2- 172.21.15.6:0/2534604646 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac7406ace0 0x7fac7406d1a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.950+0000 7fac8d28c700 1 --2- 172.21.15.6:0/2534604646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8814f7b0 0x7fac8806b2a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.950+0000 7fac8d28c700 1 --2- 172.21.15.6:0/2534604646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac88071d00 0x7fac881e6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:38.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.950+0000 7fac8d28c700 1 --2- 172.21.15.6:0/2534604646 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac880c7540 0x7fac880c0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:38.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.950+0000 7fac8d28c700 1 -- 172.21.15.6:0/2534604646 >> 172.21.15.6:0/2534604646 conn(0x7fac880c7b60 msgr2=0x7fac880c23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:38.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.950+0000 7fac8d28c700 1 -- 172.21.15.6:0/2534604646 shutdown_connections 2023-07-21T07:35:38.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:37.950+0000 7fac8d28c700 1 -- 172.21.15.6:0/2534604646 wait complete. 2023-07-21T07:35:38.158 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T07:35:38.158 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T07:35:38.159 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T07:35:38.159 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T07:35:38.160 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T07:35:38.160 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T07:35:38.161 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T07:35:38.161 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T07:35:38.161 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T07:35:38.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:38.162 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T07:35:38.181 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T07:35:38.182 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T07:35:38.182 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T07:35:38.182 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:38.182 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T07:35:38.182 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:38.183 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:35:38.183 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:38.183 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:35:38.183 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:38.183 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T07:35:38.183 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:38.183 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-21T07:35:38.184 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41871sec preferred_lft 41871sec 2023-07-21T07:35:38.184 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T07:35:38.184 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:38.184 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:35:38.184 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:38.184 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T07:35:38.184 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 92:ed:19:c0:57:d2 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:38.185 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T07:35:38.185 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:38.185 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::98ec:6eff:fe8a:86bb/64 scope link 2023-07-21T07:35:38.185 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:38.185 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T07:35:38.185 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 92:ed:19:c0:57:d2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T07:35:38.185 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::90ed:19ff:fec0:57d2/64 scope link 2023-07-21T07:35:38.186 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:38.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:38.186 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T07:35:38.248 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T07:35:38.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:38.250 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T07:35:38.309 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T07:35:38.310 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T07:35:38.310 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-21T07:35:38.310 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-21T07:35:38.310 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T07:35:38.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:38.311 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T07:35:38.311 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T07:35:38.312 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T07:35:38.312 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T07:35:38.313 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T07:35:38.313 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T07:35:38.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:38.417 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T07:35:38.434 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T07:35:38.434 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T07:35:38.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:38.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T07:35:38.502 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:35:38.502 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T07:35:38.559 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T07:35:38.560 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:35:38.560 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T07:35:38.617 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-21T07:35:38.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:38.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:38.704 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:38.704 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:35:38.734 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:38.734 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:35:38.734 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:35:38.734 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs=/ 2023-07-21T07:35:38.734 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:35:38.734 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:35:38.735 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:35:38.735 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:35:38.789 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:38.790 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:35:38.790 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:35:38.790 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs=/ 2023-07-21T07:35:38.790 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:35:38.791 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:35:38.791 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:35:38.791 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:35:38.792 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790" 2023-07-21T07:35:38.792 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2023-07-21T07:35:38.792 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=8c602ac0-17b3-4df5-8928-640a7524b3b3" will pass to kernel 2023-07-21T07:35:38.795 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T07:35:38.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:38.796 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T07:35:38.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:38.823 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T07:35:38.906 INFO:teuthology.orchestra.run.smithi006.stdout:client5256 2023-07-21T07:35:38.907 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:35:38.907 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:38.964 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T07:35:39.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:35:39.102 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:35:39.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.078+0000 7f25c26b0700 1 Processor -- start 2023-07-21T07:35:39.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.078+0000 7f25c26b0700 1 -- start start 2023-07-21T07:35:39.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.079+0000 7f25c26b0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25bc0c42a0 0x7f25bc0c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.079+0000 7f25c26b0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25bc0a4e10 0x7f25bc0a9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.079+0000 7f25c26b0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f25bc0aa230 0x7f25bc153b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.079+0000 7f25c26b0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25bc0a95d0 con 0x7f25bc0a4e10 2023-07-21T07:35:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.079+0000 7f25c26b0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25bc0c27e0 con 0x7f25bc0aa230 2023-07-21T07:35:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.079+0000 7f25c26b0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc0c5190 con 0x7f25bc0c42a0 2023-07-21T07:35:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.079+0000 7f25bb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25bc0a4e10 0x7f25bc0a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.079+0000 7f25bb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25bc0a4e10 0x7f25bc0a9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34454/0 (socket says 172.21.15.6:34454) 2023-07-21T07:35:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.079+0000 7f25bb7fe700 1 -- 172.21.15.6:0/4164515566 learned_addr learned my addr 172.21.15.6:0/4164515566 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.079+0000 7f25c0c4d700 1 --2- 172.21.15.6:0/4164515566 >> v2:172.21.15.86:3300/0 conn(0x7f25bc0aa230 0x7f25bc153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.079+0000 7f25bbfff700 1 --2- 172.21.15.6:0/4164515566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25bc0c42a0 0x7f25bc0c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.080+0000 7f25bb7fe700 1 -- 172.21.15.6:0/4164515566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25bc0c42a0 msgr2=0x7f25bc0c22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.080+0000 7f25bb7fe700 1 --2- 172.21.15.6:0/4164515566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25bc0c42a0 0x7f25bc0c22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.080+0000 7f25bb7fe700 1 -- 172.21.15.6:0/4164515566 >> v2:172.21.15.86:3300/0 conn(0x7f25bc0aa230 msgr2=0x7f25bc153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.080+0000 7f25bb7fe700 1 --2- 172.21.15.6:0/4164515566 >> v2:172.21.15.86:3300/0 conn(0x7f25bc0aa230 0x7f25bc153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.080+0000 7f25bb7fe700 1 -- 172.21.15.6:0/4164515566 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc0c5470 con 0x7f25bc0a4e10 2023-07-21T07:35:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.080+0000 7f25bb7fe700 1 --2- 172.21.15.6:0/4164515566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25bc0a4e10 0x7f25bc0a9a60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0c3de0 tx=0x7f25b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85339df9eac4aacb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.080+0000 7f25baffd700 1 -- 172.21.15.6:0/4164515566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0011830 con 0x7f25bc0a4e10 2023-07-21T07:35:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.080+0000 7f25baffd700 1 -- 172.21.15.6:0/4164515566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b0011990 con 0x7f25bc0a4e10 2023-07-21T07:35:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.080+0000 7f25baffd700 1 -- 172.21.15.6:0/4164515566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0011d20 con 0x7f25bc0a4e10 2023-07-21T07:35:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.080+0000 7f25c26b0700 1 -- 172.21.15.6:0/4164515566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25bc0a4e10 msgr2=0x7f25bc0a9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.080+0000 7f25c26b0700 1 --2- 172.21.15.6:0/4164515566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25bc0a4e10 0x7f25bc0a9a60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0c3de0 tx=0x7f25b0009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.080+0000 7f25c26b0700 1 -- 172.21.15.6:0/4164515566 shutdown_connections 2023-07-21T07:35:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.081+0000 7f25c26b0700 1 --2- 172.21.15.6:0/4164515566 >> v2:172.21.15.86:3300/0 conn(0x7f25bc0aa230 0x7f25bc153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.081+0000 7f25c26b0700 1 --2- 172.21.15.6:0/4164515566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25bc0c42a0 0x7f25bc0c22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.081+0000 7f25c26b0700 1 --2- 172.21.15.6:0/4164515566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25bc0a4e10 0x7f25bc0a9a60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.081+0000 7f25c26b0700 1 -- 172.21.15.6:0/4164515566 >> 172.21.15.6:0/4164515566 conn(0x7f25bc06a090 msgr2=0x7f25bc06a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.081+0000 7f25c26b0700 1 -- 172.21.15.6:0/4164515566 shutdown_connections 2023-07-21T07:35:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.081+0000 7f25c26b0700 1 -- 172.21.15.6:0/4164515566 wait complete. 2023-07-21T07:35:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.082+0000 7f25c26b0700 1 Processor -- start 2023-07-21T07:35:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.082+0000 7f25c26b0700 1 -- start start 2023-07-21T07:35:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25c26b0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25bc0a4e10 0x7f25bc06c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25c26b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25bc0aa230 0x7f25bc149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25c26b0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25bc0c42a0 0x7f25bc14a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25c26b0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc0a63e0 con 0x7f25bc0aa230 2023-07-21T07:35:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25c26b0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc149710 con 0x7f25bc0c42a0 2023-07-21T07:35:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25c26b0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc13e080 con 0x7f25bc0a4e10 2023-07-21T07:35:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25bb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25bc0aa230 0x7f25bc149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25bb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25bc0aa230 0x7f25bc149b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34458/0 (socket says 172.21.15.6:34458) 2023-07-21T07:35:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25bb7fe700 1 -- 172.21.15.6:0/3746121822 learned_addr learned my addr 172.21.15.6:0/3746121822 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25bbfff700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25bc0a4e10 0x7f25bc06c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25c0c4d700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25bc0c42a0 0x7f25bc14a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25bb7fe700 1 -- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25bc0a4e10 msgr2=0x7f25bc06c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25bb7fe700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25bc0a4e10 0x7f25bc06c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25bb7fe700 1 -- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25bc0c42a0 msgr2=0x7f25bc14a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25bb7fe700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25bc0c42a0 0x7f25bc14a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25bb7fe700 1 -- 172.21.15.6:0/3746121822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b0009550 con 0x7f25bc0aa230 2023-07-21T07:35:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25bb7fe700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25bc0aa230 0x7f25bc149b60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f25b0014040 tx=0x7f25b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25b8ff9700 1 -- 172.21.15.6:0/3746121822 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0004450 con 0x7f25bc0aa230 2023-07-21T07:35:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25b8ff9700 1 -- 172.21.15.6:0/3746121822 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b001e070 con 0x7f25bc0aa230 2023-07-21T07:35:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25b8ff9700 1 -- 172.21.15.6:0/3746121822 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b00038e0 con 0x7f25bc0aa230 2023-07-21T07:35:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.083+0000 7f25c26b0700 1 -- 172.21.15.6:0/3746121822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25bc0a7370 con 0x7f25bc0aa230 2023-07-21T07:35:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.084+0000 7f25c26b0700 1 -- 172.21.15.6:0/3746121822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25bc072270 con 0x7f25bc0aa230 2023-07-21T07:35:39.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.084+0000 7f25c26b0700 1 -- 172.21.15.6:0/3746121822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25bc149880 con 0x7f25bc0aa230 2023-07-21T07:35:39.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.085+0000 7f25b8ff9700 1 -- 172.21.15.6:0/3746121822 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f25b0003a40 con 0x7f25bc0aa230 2023-07-21T07:35:39.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.086+0000 7f25b8ff9700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f25a806ace0 0x7f25a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:39.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.086+0000 7f25b8ff9700 1 -- 172.21.15.6:0/3746121822 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f25b008a870 con 0x7f25bc0aa230 2023-07-21T07:35:39.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.086+0000 7f25bbfff700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f25a806ace0 0x7f25a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:39.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.086+0000 7f25bbfff700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f25a806ace0 0x7f25a806d1a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0c23f0 tx=0x7f25ac009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:39.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.090+0000 7f25b8ff9700 1 -- 172.21.15.6:0/3746121822 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f25b0055990 con 0x7f25bc0aa230 2023-07-21T07:35:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.336+0000 7f25c26b0700 1 -- 172.21.15.6:0/3746121822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f25bc149880 con 0x7f25bc0aa230 2023-07-21T07:35:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.336+0000 7f25b8ff9700 1 -- 172.21.15.6:0/3746121822 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f25bc149880 con 0x7f25bc0aa230 2023-07-21T07:35:39.388 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.338+0000 7f25c26b0700 1 -- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f25a806ace0 msgr2=0x7f25a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.338+0000 7f25c26b0700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f25a806ace0 0x7f25a806d1a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0c23f0 tx=0x7f25ac009210 comp rx=0 tx=0).stop 2023-07-21T07:35:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.338+0000 7f25c26b0700 1 -- 172.21.15.6:0/3746121822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25bc0aa230 msgr2=0x7f25bc149b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.338+0000 7f25c26b0700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25bc0aa230 0x7f25bc149b60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f25b0014040 tx=0x7f25b0004750 comp rx=0 tx=0).stop 2023-07-21T07:35:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.338+0000 7f25c26b0700 1 -- 172.21.15.6:0/3746121822 shutdown_connections 2023-07-21T07:35:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.338+0000 7f25c26b0700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f25a806ace0 0x7f25a806d1a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.338+0000 7f25c26b0700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25bc0c42a0 0x7f25bc14a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.338+0000 7f25c26b0700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25bc0a4e10 0x7f25bc06c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.338+0000 7f25c26b0700 1 --2- 172.21.15.6:0/3746121822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25bc0aa230 0x7f25bc149b60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.338+0000 7f25c26b0700 1 -- 172.21.15.6:0/3746121822 >> 172.21.15.6:0/3746121822 conn(0x7f25bc06a090 msgr2=0x7f25bc0c1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.338+0000 7f25c26b0700 1 -- 172.21.15.6:0/3746121822 shutdown_connections 2023-07-21T07:35:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:39.339+0000 7f25c26b0700 1 -- 172.21.15.6:0/3746121822 wait complete. 2023-07-21T07:35:39.402 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T07:35:39.402 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T07:35:39.403 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-07-21T07:35:39.403 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-21T07:35:39.403 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-21T07:35:39.404 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T07:35:39.404 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T07:35:39.404 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T07:35:39.405 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:35:39.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:39.405 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-07-21T07:35:39.426 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T07:35:39.427 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T07:35:39.427 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T07:35:39.427 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:39.427 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-07-21T07:35:39.427 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:39.428 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:35:39.428 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:39.428 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:35:39.428 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:39.428 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:35:39.428 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:39.428 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T07:35:39.429 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:39.429 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-21T07:35:39.429 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41928sec preferred_lft 41928sec 2023-07-21T07:35:39.429 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::c182:1cf2:777e:c99f/64 scope link noprefixroute 2023-07-21T07:35:39.429 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:39.429 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T07:35:39.429 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 6e:29:3e:ed:f1:91 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:39.429 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T07:35:39.430 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:39.430 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::88c2:92ff:fec4:e7d6/64 scope link 2023-07-21T07:35:39.430 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:39.430 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T07:35:39.430 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 6e:29:3e:ed:f1:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-21T07:35:39.430 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::6c29:3eff:feed:f191/64 scope link 2023-07-21T07:35:39.430 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:39.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:39.431 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T07:35:39.496 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-07-21T07:35:39.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:39.498 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-07-21T07:35:39.558 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-07-21T07:35:39.558 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T07:35:39.559 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T07:35:39.559 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-21T07:35:39.559 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T07:35:39.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:39.560 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-07-21T07:35:39.560 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-07-21T07:35:39.560 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T07:35:39.561 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T07:35:39.561 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T07:35:39.561 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-07-21T07:35:39.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:39.669 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-07-21T07:35:39.686 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-21T07:35:39.686 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:35:39.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:39.687 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-07-21T07:35:39.753 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:35:39.753 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-21T07:35:39.809 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:35:39.810 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:35:39.810 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-21T07:35:39.865 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-21T07:35:39.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:39.866 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:39.950 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:39.950 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:35:39.977 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:39.977 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:35:39.977 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:35:39.977 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 1@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs=/ 2023-07-21T07:35:39.978 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:35:39.978 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:35:39.978 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:35:39.978 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:35:40.005 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 1@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs=/ 2023-07-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:35:40.006 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:35:40.007 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:35:40.007 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:35:40.007 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790" 2023-07-21T07:35:40.007 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2023-07-21T07:35:40.007 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=8c602ac0-17b3-4df5-8928-640a7524b3b3" will pass to kernel 2023-07-21T07:35:40.012 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T07:35:40.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:40.013 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-21T07:35:40.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:40.043 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T07:35:40.115 INFO:teuthology.orchestra.run.smithi086.stdout:client5140 2023-07-21T07:35:40.115 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:35:40.115 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:40.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-07-21T07:35:40.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.260+0000 7f6cb5864700 1 Processor -- start 2023-07-21T07:35:40.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.260+0000 7f6cb5864700 1 -- start start 2023-07-21T07:35:40.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6cb5864700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6cb00c48c0 0x7f6cb0154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6cb5864700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb0151660 0x7f6cb0151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6cb5864700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6cb006ba40 0x7f6cb006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6cb5864700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb006b2d0 con 0x7f6cb006ba40 2023-07-21T07:35:40.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6cb5864700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb006b5b0 con 0x7f6cb00c48c0 2023-07-21T07:35:40.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6cb5864700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00ab750 con 0x7f6cb0151660 2023-07-21T07:35:40.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6caf7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6cb006ba40 0x7f6cb006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6caf7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6cb006ba40 0x7f6cb006bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34466/0 (socket says 172.21.15.6:34466) 2023-07-21T07:35:40.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6caf7fe700 1 -- 172.21.15.6:0/2563820731 learned_addr learned my addr 172.21.15.6:0/2563820731 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:40.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6cae7fc700 1 --2- 172.21.15.6:0/2563820731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb0151660 0x7f6cb0151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6caeffd700 1 --2- 172.21.15.6:0/2563820731 >> v2:172.21.15.86:3300/0 conn(0x7f6cb00c48c0 0x7f6cb0154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6caf7fe700 1 -- 172.21.15.6:0/2563820731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb0151660 msgr2=0x7f6cb0151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6caf7fe700 1 --2- 172.21.15.6:0/2563820731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb0151660 0x7f6cb0151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6caf7fe700 1 -- 172.21.15.6:0/2563820731 >> v2:172.21.15.86:3300/0 conn(0x7f6cb00c48c0 msgr2=0x7f6cb0154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6caf7fe700 1 --2- 172.21.15.6:0/2563820731 >> v2:172.21.15.86:3300/0 conn(0x7f6cb00c48c0 0x7f6cb0154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.261+0000 7f6caf7fe700 1 -- 172.21.15.6:0/2563820731 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb01553f0 con 0x7f6cb006ba40 2023-07-21T07:35:40.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.262+0000 7f6caf7fe700 1 --2- 172.21.15.6:0/2563820731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb006ba40 0x7f6cb006bed0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00ac410 tx=0x7f6ca800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a9519be7b5c98f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:40.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.262+0000 7f6cadffb700 1 -- 172.21.15.6:0/2563820731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800e070 con 0x7f6cb006ba40 2023-07-21T07:35:40.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.262+0000 7f6cadffb700 1 -- 172.21.15.6:0/2563820731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca800b910 con 0x7f6cb006ba40 2023-07-21T07:35:40.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.262+0000 7f6cadffb700 1 -- 172.21.15.6:0/2563820731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800bcc0 con 0x7f6cb006ba40 2023-07-21T07:35:40.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.262+0000 7f6cb5864700 1 -- 172.21.15.6:0/2563820731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb006ba40 msgr2=0x7f6cb006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:40.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.262+0000 7f6cb5864700 1 --2- 172.21.15.6:0/2563820731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb006ba40 0x7f6cb006bed0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00ac410 tx=0x7f6ca800b330 comp rx=0 tx=0).stop 2023-07-21T07:35:40.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.262+0000 7f6cb5864700 1 -- 172.21.15.6:0/2563820731 shutdown_connections 2023-07-21T07:35:40.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.262+0000 7f6cb5864700 1 --2- 172.21.15.6:0/2563820731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb006ba40 0x7f6cb006bed0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.262+0000 7f6cb5864700 1 --2- 172.21.15.6:0/2563820731 >> v2:172.21.15.86:3300/0 conn(0x7f6cb00c48c0 0x7f6cb0154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.262+0000 7f6cb5864700 1 --2- 172.21.15.6:0/2563820731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb0151660 0x7f6cb0151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.262+0000 7f6cb5864700 1 -- 172.21.15.6:0/2563820731 >> 172.21.15.6:0/2563820731 conn(0x7f6cb00c9cd0 msgr2=0x7f6cb00ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:40.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.262+0000 7f6cb5864700 1 -- 172.21.15.6:0/2563820731 shutdown_connections 2023-07-21T07:35:40.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.262+0000 7f6cb5864700 1 -- 172.21.15.6:0/2563820731 wait complete. 2023-07-21T07:35:40.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.264+0000 7f6cb5864700 1 Processor -- start 2023-07-21T07:35:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.264+0000 7f6cb5864700 1 -- start start 2023-07-21T07:35:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.265+0000 7f6cb5864700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb006ba40 0x7f6cb01ea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.265+0000 7f6cb5864700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb00c48c0 0x7f6cb00c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.265+0000 7f6cb5864700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb0151660 0x7f6cb014ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.265+0000 7f6cb5864700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb0157f20 con 0x7f6cb0151660 2023-07-21T07:35:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.265+0000 7f6cb5864700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb0158490 con 0x7f6cb00c48c0 2023-07-21T07:35:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.265+0000 7f6cb5864700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00c1410 con 0x7f6cb006ba40 2023-07-21T07:35:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.265+0000 7f6caf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb0151660 0x7f6cb014ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.265+0000 7f6caf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb0151660 0x7f6cb014ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34472/0 (socket says 172.21.15.6:34472) 2023-07-21T07:35:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.265+0000 7f6caf7fe700 1 -- 172.21.15.6:0/447371005 learned_addr learned my addr 172.21.15.6:0/447371005 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.265+0000 7f6caeffd700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb006ba40 0x7f6cb01ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.265+0000 7f6cae7fc700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb00c48c0 0x7f6cb00c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.266+0000 7f6caf7fe700 1 -- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb006ba40 msgr2=0x7f6cb01ea100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.266+0000 7f6caf7fe700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb006ba40 0x7f6cb01ea100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.266+0000 7f6caf7fe700 1 -- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb00c48c0 msgr2=0x7f6cb00c2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.266+0000 7f6caf7fe700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb00c48c0 0x7f6cb00c2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.266+0000 7f6caf7fe700 1 -- 172.21.15.6:0/447371005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8009b30 con 0x7f6cb0151660 2023-07-21T07:35:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.266+0000 7f6caf7fe700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb0151660 0x7f6cb014ef20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00cab10 tx=0x7f6ca8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.266+0000 7f6c97fff700 1 -- 172.21.15.6:0/447371005 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80092e0 con 0x7f6cb0151660 2023-07-21T07:35:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.266+0000 7f6c97fff700 1 -- 172.21.15.6:0/447371005 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca800ce80 con 0x7f6cb0151660 2023-07-21T07:35:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.266+0000 7f6cb5864700 1 -- 172.21.15.6:0/447371005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb0158170 con 0x7f6cb0151660 2023-07-21T07:35:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.266+0000 7f6c97fff700 1 -- 172.21.15.6:0/447371005 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80044b0 con 0x7f6cb0151660 2023-07-21T07:35:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.266+0000 7f6cb5864700 1 -- 172.21.15.6:0/447371005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb01586e0 con 0x7f6cb0151660 2023-07-21T07:35:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.267+0000 7f6cb5864700 1 -- 172.21.15.6:0/447371005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb004ecc0 con 0x7f6cb0151660 2023-07-21T07:35:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.267+0000 7f6c97fff700 1 -- 172.21.15.6:0/447371005 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ca8004610 con 0x7f6cb0151660 2023-07-21T07:35:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.268+0000 7f6c97fff700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6c9c06ad10 0x7f6c9c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.268+0000 7f6c97fff700 1 -- 172.21.15.6:0/447371005 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ca808a3d0 con 0x7f6cb0151660 2023-07-21T07:35:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.268+0000 7f6caeffd700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6c9c06ad10 0x7f6c9c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.268+0000 7f6caeffd700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6c9c06ad10 0x7f6c9c06d1d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009b40 tx=0x7f6ca40091c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.272+0000 7f6c97fff700 1 -- 172.21.15.6:0/447371005 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6ca80555c0 con 0x7f6cb0151660 2023-07-21T07:35:40.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.552+0000 7f6cb5864700 1 -- 172.21.15.6:0/447371005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f6cb006c8f0 con 0x7f6cb0151660 2023-07-21T07:35:40.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.552+0000 7f6c97fff700 1 -- 172.21.15.6:0/447371005 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v9) v1 ==== 84+0+0 (secure 0 0 0) 0x7f6ca8058be0 con 0x7f6cb0151660 2023-07-21T07:35:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.554+0000 7f6cb5864700 1 -- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6c9c06ad10 msgr2=0x7f6c9c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.554+0000 7f6cb5864700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6c9c06ad10 0x7f6c9c06d1d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009b40 tx=0x7f6ca40091c0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.554+0000 7f6cb5864700 1 -- 172.21.15.6:0/447371005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb0151660 msgr2=0x7f6cb014ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.554+0000 7f6cb5864700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb0151660 0x7f6cb014ef20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00cab10 tx=0x7f6ca8004ad0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.554+0000 7f6cb5864700 1 -- 172.21.15.6:0/447371005 shutdown_connections 2023-07-21T07:35:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.554+0000 7f6cb5864700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6c9c06ad10 0x7f6c9c06d1d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.554+0000 7f6cb5864700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb0151660 0x7f6cb014ef20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.554+0000 7f6cb5864700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cb006ba40 0x7f6cb01ea100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.554+0000 7f6cb5864700 1 --2- 172.21.15.6:0/447371005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb00c48c0 0x7f6cb00c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.554+0000 7f6cb5864700 1 -- 172.21.15.6:0/447371005 >> 172.21.15.6:0/447371005 conn(0x7f6cb00c9cd0 msgr2=0x7f6cb0150a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.554+0000 7f6cb5864700 1 -- 172.21.15.6:0/447371005 shutdown_connections 2023-07-21T07:35:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.554+0000 7f6cb5864700 1 -- 172.21.15.6:0/447371005 wait complete. 2023-07-21T07:35:40.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.691+0000 7f2c4e3fd700 1 Processor -- start 2023-07-21T07:35:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.691+0000 7f2c4e3fd700 1 -- start start 2023-07-21T07:35:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c4e3fd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2c4806a300 0x7f2c480c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c4e3fd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2c480c2bf0 0x7f2c481516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c4e3fd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c48151be0 0x7f2c48157b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c4e3fd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c480c1e60 con 0x7f2c480c2bf0 2023-07-21T07:35:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c4e3fd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c480c3120 con 0x7f2c4806a300 2023-07-21T07:35:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c4e3fd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48154860 con 0x7f2c48151be0 2023-07-21T07:35:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c477fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2c480c2bf0 0x7f2c481516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c477fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2c480c2bf0 0x7f2c481516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34476/0 (socket says 172.21.15.6:34476) 2023-07-21T07:35:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c477fe700 1 -- 172.21.15.6:0/2555241186 learned_addr learned my addr 172.21.15.6:0/2555241186 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c47fff700 1 --2- 172.21.15.6:0/2555241186 >> v2:172.21.15.86:3300/0 conn(0x7f2c4806a300 0x7f2c480c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c4c99a700 1 --2- 172.21.15.6:0/2555241186 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c48151be0 0x7f2c48157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c477fe700 1 -- 172.21.15.6:0/2555241186 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c48151be0 msgr2=0x7f2c48157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c477fe700 1 --2- 172.21.15.6:0/2555241186 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c48151be0 0x7f2c48157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c477fe700 1 -- 172.21.15.6:0/2555241186 >> v2:172.21.15.86:3300/0 conn(0x7f2c4806a300 msgr2=0x7f2c480c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c477fe700 1 --2- 172.21.15.6:0/2555241186 >> v2:172.21.15.86:3300/0 conn(0x7f2c4806a300 0x7f2c480c26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c477fe700 1 -- 172.21.15.6:0/2555241186 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c48154b40 con 0x7f2c480c2bf0 2023-07-21T07:35:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c477fe700 1 --2- 172.21.15.6:0/2555241186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c480c2bf0 0x7f2c481516a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2c480c45e0 tx=0x7f2c38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50cdda60b241dae0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.692+0000 7f2c46ffd700 1 -- 172.21.15.6:0/2555241186 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3800b870 con 0x7f2c480c2bf0 2023-07-21T07:35:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.693+0000 7f2c46ffd700 1 -- 172.21.15.6:0/2555241186 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3800b9d0 con 0x7f2c480c2bf0 2023-07-21T07:35:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.693+0000 7f2c46ffd700 1 -- 172.21.15.6:0/2555241186 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3800bd60 con 0x7f2c480c2bf0 2023-07-21T07:35:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.693+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/2555241186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c480c2bf0 msgr2=0x7f2c481516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.693+0000 7f2c4e3fd700 1 --2- 172.21.15.6:0/2555241186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c480c2bf0 0x7f2c481516a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2c480c45e0 tx=0x7f2c38009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.693+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/2555241186 shutdown_connections 2023-07-21T07:35:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.693+0000 7f2c4e3fd700 1 --2- 172.21.15.6:0/2555241186 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c48151be0 0x7f2c48157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.693+0000 7f2c4e3fd700 1 --2- 172.21.15.6:0/2555241186 >> v2:172.21.15.86:3300/0 conn(0x7f2c4806a300 0x7f2c480c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.693+0000 7f2c4e3fd700 1 --2- 172.21.15.6:0/2555241186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c480c2bf0 0x7f2c481516a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.693+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/2555241186 >> 172.21.15.6:0/2555241186 conn(0x7f2c480a8c90 msgr2=0x7f2c4806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.693+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/2555241186 shutdown_connections 2023-07-21T07:35:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.693+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/2555241186 wait complete. 2023-07-21T07:35:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.694+0000 7f2c4e3fd700 1 Processor -- start 2023-07-21T07:35:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.694+0000 7f2c4e3fd700 1 -- start start 2023-07-21T07:35:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.695+0000 7f2c4e3fd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c4806a300 0x7f2c4814a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.695+0000 7f2c4e3fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c480c2bf0 0x7f2c48071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.695+0000 7f2c4e3fd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c48151be0 0x7f2c480bca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.695+0000 7f2c4e3fd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4814b800 con 0x7f2c480c2bf0 2023-07-21T07:35:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.695+0000 7f2c4e3fd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c481edcd0 con 0x7f2c48151be0 2023-07-21T07:35:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.695+0000 7f2c4e3fd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c481ed0c0 con 0x7f2c4806a300 2023-07-21T07:35:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.695+0000 7f2c477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c480c2bf0 0x7f2c48071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.695+0000 7f2c477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c480c2bf0 0x7f2c48071550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34484/0 (socket says 172.21.15.6:34484) 2023-07-21T07:35:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.695+0000 7f2c477fe700 1 -- 172.21.15.6:0/739403479 learned_addr learned my addr 172.21.15.6:0/739403479 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.695+0000 7f2c47fff700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c4806a300 0x7f2c4814a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.695+0000 7f2c4c99a700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c48151be0 0x7f2c480bca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.696+0000 7f2c477fe700 1 -- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c4806a300 msgr2=0x7f2c4814a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.696+0000 7f2c477fe700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c4806a300 0x7f2c4814a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.696+0000 7f2c477fe700 1 -- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c48151be0 msgr2=0x7f2c480bca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.696+0000 7f2c477fe700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c48151be0 0x7f2c480bca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.696+0000 7f2c477fe700 1 -- 172.21.15.6:0/739403479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c38009550 con 0x7f2c480c2bf0 2023-07-21T07:35:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.696+0000 7f2c4c99a700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c48151be0 0x7f2c480bca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.696+0000 7f2c477fe700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c480c2bf0 0x7f2c48071550 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2c38000c00 tx=0x7f2c38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.696+0000 7f2c44ff9700 1 -- 172.21.15.6:0/739403479 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38004540 con 0x7f2c480c2bf0 2023-07-21T07:35:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.696+0000 7f2c44ff9700 1 -- 172.21.15.6:0/739403479 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c380036a0 con 0x7f2c480c2bf0 2023-07-21T07:35:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.696+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/739403479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c481ed3a0 con 0x7f2c480c2bf0 2023-07-21T07:35:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.696+0000 7f2c44ff9700 1 -- 172.21.15.6:0/739403479 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38003a50 con 0x7f2c480c2bf0 2023-07-21T07:35:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.696+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/739403479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c481ed960 con 0x7f2c480c2bf0 2023-07-21T07:35:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.697+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/739403479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c481edb20 con 0x7f2c480c2bf0 2023-07-21T07:35:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.697+0000 7f2c44ff9700 1 -- 172.21.15.6:0/739403479 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c38021070 con 0x7f2c480c2bf0 2023-07-21T07:35:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.698+0000 7f2c44ff9700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2c3406ace0 0x7f2c3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.698+0000 7f2c44ff9700 1 -- 172.21.15.6:0/739403479 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c3808ab10 con 0x7f2c480c2bf0 2023-07-21T07:35:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.698+0000 7f2c47fff700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2c3406ace0 0x7f2c3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.699+0000 7f2c47fff700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2c3406ace0 0x7f2c3406d1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00c900 tx=0x7f2c3c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.702+0000 7f2c44ff9700 1 -- 172.21.15.6:0/739403479 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2c38055c50 con 0x7f2c480c2bf0 2023-07-21T07:35:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.902+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/739403479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c481ede40 con 0x7f2c480c2bf0 2023-07-21T07:35:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.903+0000 7f2c44ff9700 1 -- 172.21.15.6:0/739403479 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18243 (secure 0 0 0) 0x7f2c38015090 con 0x7f2c480c2bf0 2023-07-21T07:35:40.955 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:40.955 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":36,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:32.560845+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:35:29.385402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T07:35:29.920618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.905+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2c3406ace0 msgr2=0x7f2c3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.905+0000 7f2c4e3fd700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2c3406ace0 0x7f2c3406d1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00c900 tx=0x7f2c3c008040 comp rx=0 tx=0).stop 2023-07-21T07:35:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.905+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/739403479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c480c2bf0 msgr2=0x7f2c48071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.905+0000 7f2c4e3fd700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c480c2bf0 0x7f2c48071550 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2c38000c00 tx=0x7f2c38004750 comp rx=0 tx=0).stop 2023-07-21T07:35:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.905+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/739403479 shutdown_connections 2023-07-21T07:35:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.905+0000 7f2c4e3fd700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2c3406ace0 0x7f2c3406d1a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.905+0000 7f2c4e3fd700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c48151be0 0x7f2c480bca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.905+0000 7f2c4e3fd700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c4806a300 0x7f2c4814a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.905+0000 7f2c4e3fd700 1 --2- 172.21.15.6:0/739403479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c480c2bf0 0x7f2c48071550 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.905+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/739403479 >> 172.21.15.6:0/739403479 conn(0x7f2c480a8c90 msgr2=0x7f2c4814f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.905+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/739403479 shutdown_connections 2023-07-21T07:35:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:40.905+0000 7f2c4e3fd700 1 -- 172.21.15.6:0/739403479 wait complete. 2023-07-21T07:35:40.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:35:29.385402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:35:29.920618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:35:40.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:35:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.046+0000 7f1a702f9700 1 Processor -- start 2023-07-21T07:35:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.046+0000 7f1a702f9700 1 -- start start 2023-07-21T07:35:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.047+0000 7f1a702f9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1a680c1860 0x7f1a68151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.047+0000 7f1a702f9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a681517c0 con 0x7f1a680c5260 2023-07-21T07:35:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.047+0000 7f1a702f9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a680c4e50 con 0x7f1a680c3f80 2023-07-21T07:35:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.047+0000 7f1a702f9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a681519f0 con 0x7f1a680c1860 2023-07-21T07:35:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.047+0000 7f1a6d894700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1a680c5260 0x7f1a6806dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42512/0 (socket says 172.21.15.6:42512) 2023-07-21T07:35:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.047+0000 7f1a6d894700 1 -- 172.21.15.6:0/1576535495 learned_addr learned my addr 172.21.15.6:0/1576535495 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.047+0000 7f1a6e095700 1 --2- 172.21.15.6:0/1576535495 >> v2:172.21.15.86:3300/0 conn(0x7f1a680c1860 0x7f1a68151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.047+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224494764 0 0) 0x7f1a681517c0 con 0x7f1a680c5260 2023-07-21T07:35:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.047+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a540035b0 con 0x7f1a680c5260 2023-07-21T07:35:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2606540310 0 0) 0x7f1a540035b0 con 0x7f1a680c5260 2023-07-21T07:35:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 >> v2:172.21.15.86:3300/0 conn(0x7f1a680c1860 msgr2=0x7f1a68151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d093700 1 --2- 172.21.15.6:0/1576535495 >> v2:172.21.15.86:3300/0 conn(0x7f1a680c1860 0x7f1a68151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 >> v1:172.21.15.86:6789/0 conn(0x7f1a680c3f80 legacy=0x7f1a680c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a68151cd0 con 0x7f1a680c5260 2023-07-21T07:35:41.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f1a64001670 con 0x7f1a680c5260 2023-07-21T07:35:41.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 >> v1:172.21.15.6:6789/0 conn(0x7f1a680c5260 legacy=0x7f1a6806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d093700 1 --2- 172.21.15.6:0/1576535495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a54003a00 0x7f1a54003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d093700 1 --2- 172.21.15.6:0/1576535495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a54004850 0x7f1a54004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d093700 1 --2- 172.21.15.6:0/1576535495 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a54005210 0x7f1a5400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a681519f0 con 0x7f1a54003a00 2023-07-21T07:35:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5400c0b0 con 0x7f1a54004850 2023-07-21T07:35:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5400c270 con 0x7f1a54005210 2023-07-21T07:35:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6e095700 1 --2- 172.21.15.6:0/1576535495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a54003a00 0x7f1a54003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6d894700 1 --2- 172.21.15.6:0/1576535495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a54004850 0x7f1a54004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6e896700 1 --2- 172.21.15.6:0/1576535495 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a54005210 0x7f1a5400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6e095700 1 -- 172.21.15.6:0/1576535495 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a54005210 msgr2=0x7f1a5400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6e095700 1 --2- 172.21.15.6:0/1576535495 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a54005210 0x7f1a5400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6e095700 1 -- 172.21.15.6:0/1576535495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a54004850 msgr2=0x7f1a54004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6e095700 1 --2- 172.21.15.6:0/1576535495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a54004850 0x7f1a54004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6e896700 1 -- 172.21.15.6:0/1576535495 reap_dead start 2023-07-21T07:35:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6e095700 1 -- 172.21.15.6:0/1576535495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a540035b0 con 0x7f1a54003a00 2023-07-21T07:35:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.048+0000 7f1a6e095700 1 --2- 172.21.15.6:0/1576535495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a54003a00 0x7f1a54003e20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009b60 tx=0x7f1a54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580cbe10f8f304d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.049+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800e6c0 con 0x7f1a54003a00 2023-07-21T07:35:41.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.049+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5800e820 con 0x7f1a54003a00 2023-07-21T07:35:41.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.049+0000 7f1a6d093700 1 -- 172.21.15.6:0/1576535495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800eb90 con 0x7f1a54003a00 2023-07-21T07:35:41.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.049+0000 7f1a702f9700 1 -- 172.21.15.6:0/1576535495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a54003a00 msgr2=0x7f1a54003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.049+0000 7f1a702f9700 1 --2- 172.21.15.6:0/1576535495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a54003a00 0x7f1a54003e20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009b60 tx=0x7f1a54005880 comp rx=0 tx=0).stop 2023-07-21T07:35:41.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.049+0000 7f1a702f9700 1 -- 172.21.15.6:0/1576535495 shutdown_connections 2023-07-21T07:35:41.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.049+0000 7f1a702f9700 1 --2- 172.21.15.6:0/1576535495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a54003a00 0x7f1a54003e20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.049+0000 7f1a702f9700 1 -- 172.21.15.6:0/1576535495 >> 172.21.15.6:0/1576535495 conn(0x7f1a680a8660 msgr2=0x7f1a680a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:41.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.049+0000 7f1a702f9700 1 -- 172.21.15.6:0/1576535495 shutdown_connections 2023-07-21T07:35:41.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.049+0000 7f1a702f9700 1 -- 172.21.15.6:0/1576535495 wait complete. 2023-07-21T07:35:41.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.051+0000 7f1a702f9700 1 Processor -- start 2023-07-21T07:35:41.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.051+0000 7f1a702f9700 1 -- start start 2023-07-21T07:35:41.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a702f9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a54003a00 0x7f1a681e6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a702f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a68155300 0x7f1a680c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a702f9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a68152930 0x7f1a680a9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a702f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a68152650 con 0x7f1a68155300 2023-07-21T07:35:41.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a702f9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a681e5aa0 con 0x7f1a68152930 2023-07-21T07:35:41.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a702f9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a681e5d80 con 0x7f1a54003a00 2023-07-21T07:35:41.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a6d894700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a68155300 0x7f1a680c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a6d894700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a68155300 0x7f1a680c6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34504/0 (socket says 172.21.15.6:34504) 2023-07-21T07:35:41.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a6d894700 1 -- 172.21.15.6:0/825847550 learned_addr learned my addr 172.21.15.6:0/825847550 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:41.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a6e095700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a54003a00 0x7f1a681e6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a6e896700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a68152930 0x7f1a680a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a6d894700 1 -- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a54003a00 msgr2=0x7f1a681e6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a6d894700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a54003a00 0x7f1a681e6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a6d894700 1 -- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a68152930 msgr2=0x7f1a680a9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a6d894700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a68152930 0x7f1a680a9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a6d894700 1 -- 172.21.15.6:0/825847550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a681e6060 con 0x7f1a68155300 2023-07-21T07:35:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.052+0000 7f1a6d894700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a68155300 0x7f1a680c6e60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1a640017a0 tx=0x7f1a64007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.053+0000 7f1a5effd700 1 -- 172.21.15.6:0/825847550 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a64011580 con 0x7f1a68155300 2023-07-21T07:35:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.053+0000 7f1a5effd700 1 -- 172.21.15.6:0/825847550 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a640116e0 con 0x7f1a68155300 2023-07-21T07:35:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.053+0000 7f1a702f9700 1 -- 172.21.15.6:0/825847550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a680c73a0 con 0x7f1a68155300 2023-07-21T07:35:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.053+0000 7f1a5effd700 1 -- 172.21.15.6:0/825847550 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a64011a90 con 0x7f1a68155300 2023-07-21T07:35:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.053+0000 7f1a702f9700 1 -- 172.21.15.6:0/825847550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a68152de0 con 0x7f1a68155300 2023-07-21T07:35:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.054+0000 7f1a702f9700 1 -- 172.21.15.6:0/825847550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6814ffc0 con 0x7f1a68155300 2023-07-21T07:35:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.054+0000 7f1a5effd700 1 -- 172.21.15.6:0/825847550 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a64011bf0 con 0x7f1a68155300 2023-07-21T07:35:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.054+0000 7f1a5effd700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1a4c06ad10 0x7f1a4c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.055+0000 7f1a5effd700 1 -- 172.21.15.6:0/825847550 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a640893c0 con 0x7f1a68155300 2023-07-21T07:35:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.055+0000 7f1a6e095700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1a4c06ad10 0x7f1a4c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.055+0000 7f1a6e095700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1a4c06ad10 0x7f1a4c06d1d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1a580090b0 tx=0x7f1a5801e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.059+0000 7f1a5effd700 1 -- 172.21.15.6:0/825847550 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1a64054480 con 0x7f1a68155300 2023-07-21T07:35:41.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.255+0000 7f1a702f9700 1 -- 172.21.15.6:0/825847550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a6804e470 con 0x7f1a68155300 2023-07-21T07:35:41.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.256+0000 7f1a5effd700 1 -- 172.21.15.6:0/825847550 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a64057aa0 con 0x7f1a68155300 2023-07-21T07:35:41.308 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:35:41.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.258+0000 7f1a702f9700 1 -- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1a4c06ad10 msgr2=0x7f1a4c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.258+0000 7f1a702f9700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1a4c06ad10 0x7f1a4c06d1d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1a580090b0 tx=0x7f1a5801e040 comp rx=0 tx=0).stop 2023-07-21T07:35:41.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.258+0000 7f1a702f9700 1 -- 172.21.15.6:0/825847550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a68155300 msgr2=0x7f1a680c6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.258+0000 7f1a702f9700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a68155300 0x7f1a680c6e60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1a640017a0 tx=0x7f1a64007570 comp rx=0 tx=0).stop 2023-07-21T07:35:41.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.258+0000 7f1a702f9700 1 -- 172.21.15.6:0/825847550 shutdown_connections 2023-07-21T07:35:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.258+0000 7f1a702f9700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1a4c06ad10 0x7f1a4c06d1d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.258+0000 7f1a702f9700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a68152930 0x7f1a680a9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.258+0000 7f1a702f9700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a54003a00 0x7f1a681e6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.258+0000 7f1a702f9700 1 --2- 172.21.15.6:0/825847550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a68155300 0x7f1a680c6e60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.258+0000 7f1a702f9700 1 -- 172.21.15.6:0/825847550 >> 172.21.15.6:0/825847550 conn(0x7f1a680a8660 msgr2=0x7f1a6814d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.258+0000 7f1a702f9700 1 -- 172.21.15.6:0/825847550 shutdown_connections 2023-07-21T07:35:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.258+0000 7f1a702f9700 1 -- 172.21.15.6:0/825847550 wait complete. 2023-07-21T07:35:41.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:35:41.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.399+0000 7fe8b30f3700 1 Processor -- start 2023-07-21T07:35:41.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.399+0000 7fe8b30f3700 1 -- start start 2023-07-21T07:35:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.399+0000 7fe8b30f3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0c1860 0x7fe8ac151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.399+0000 7fe8b30f3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8ac0c3f80 0x7fe8ac0c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.399+0000 7fe8b30f3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac1517c0 con 0x7fe8ac0c5260 2023-07-21T07:35:41.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.399+0000 7fe8b30f3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ac0c4e50 con 0x7fe8ac0c3f80 2023-07-21T07:35:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.399+0000 7fe8b30f3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac1519f0 con 0x7fe8ac0c1860 2023-07-21T07:35:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8b0e8f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0c1860 0x7fe8ac151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8b1690700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8ac0c3f80 0x7fe8ac0c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8abfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe8ac0c5260 0x7fe8ac06dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:45774/0 (socket says 172.21.15.6:45774) 2023-07-21T07:35:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8abfff700 1 -- 172.21.15.6:0/428481637 learned_addr learned my addr 172.21.15.6:0/428481637 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8ab7fe700 1 -- 172.21.15.6:0/428481637 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087671195 0 0) 0x7fe8ac1517c0 con 0x7fe8ac0c5260 2023-07-21T07:35:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8ab7fe700 1 -- 172.21.15.6:0/428481637 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe89c0035b0 con 0x7fe8ac0c5260 2023-07-21T07:35:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8b0e8f700 1 -- 172.21.15.6:0/428481637 >> v2:172.21.15.86:3300/0 conn(0x7fe8ac0c3f80 msgr2=0x7fe8ac0c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8b0e8f700 1 --2- 172.21.15.6:0/428481637 >> v2:172.21.15.86:3300/0 conn(0x7fe8ac0c3f80 0x7fe8ac0c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8b0e8f700 1 -- 172.21.15.6:0/428481637 >> v1:172.21.15.86:6789/0 conn(0x7fe8ac0c5260 legacy=0x7fe8ac06dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8b0e8f700 1 -- 172.21.15.6:0/428481637 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac151cd0 con 0x7fe8ac0c1860 2023-07-21T07:35:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8b1690700 1 --2- 172.21.15.6:0/428481637 >> v2:172.21.15.86:3300/0 conn(0x7fe8ac0c3f80 0x7fe8ac0c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:41.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8b0e8f700 1 --2- 172.21.15.6:0/428481637 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0c1860 0x7fe8ac151280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0009840 tx=0x7fe8a0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78dd2ff91f7e4ed8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:41.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8ab7fe700 1 -- 172.21.15.6:0/428481637 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0011830 con 0x7fe8ac0c1860 2023-07-21T07:35:41.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8ab7fe700 1 -- 172.21.15.6:0/428481637 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a0011990 con 0x7fe8ac0c1860 2023-07-21T07:35:41.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.400+0000 7fe8ab7fe700 1 -- 172.21.15.6:0/428481637 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0011d20 con 0x7fe8ac0c1860 2023-07-21T07:35:41.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.401+0000 7fe8b30f3700 1 -- 172.21.15.6:0/428481637 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0c1860 msgr2=0x7fe8ac151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.401+0000 7fe8b30f3700 1 --2- 172.21.15.6:0/428481637 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0c1860 0x7fe8ac151280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0009840 tx=0x7fe8a0009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:41.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.401+0000 7fe8b30f3700 1 -- 172.21.15.6:0/428481637 shutdown_connections 2023-07-21T07:35:41.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.401+0000 7fe8b30f3700 1 --2- 172.21.15.6:0/428481637 >> v2:172.21.15.86:3300/0 conn(0x7fe8ac0c3f80 0x7fe8ac0c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.401+0000 7fe8b30f3700 1 --2- 172.21.15.6:0/428481637 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0c1860 0x7fe8ac151280 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.401+0000 7fe8b30f3700 1 -- 172.21.15.6:0/428481637 >> 172.21.15.6:0/428481637 conn(0x7fe8ac0a8660 msgr2=0x7fe8ac0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:41.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.401+0000 7fe8b30f3700 1 -- 172.21.15.6:0/428481637 shutdown_connections 2023-07-21T07:35:41.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.401+0000 7fe8b30f3700 1 -- 172.21.15.6:0/428481637 wait complete. 2023-07-21T07:35:41.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.402+0000 7fe8b30f3700 1 Processor -- start 2023-07-21T07:35:41.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.402+0000 7fe8b30f3700 1 -- start start 2023-07-21T07:35:41.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b30f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8ac0c1860 0x7fe8ac148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b30f3700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac0c3f80 0x7fe8ac06a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b30f3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0c5260 0x7fe8ac1e9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b30f3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0a9910 con 0x7fe8ac0c1860 2023-07-21T07:35:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b30f3700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac1ed970 con 0x7fe8ac0c3f80 2023-07-21T07:35:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b30f3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0be7b0 con 0x7fe8ac0c5260 2023-07-21T07:35:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b0e8f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8ac0c1860 0x7fe8ac148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b0e8f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8ac0c1860 0x7fe8ac148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34516/0 (socket says 172.21.15.6:34516) 2023-07-21T07:35:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b0e8f700 1 -- 172.21.15.6:0/1196515801 learned_addr learned my addr 172.21.15.6:0/1196515801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8abfff700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac0c3f80 0x7fe8ac06a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b1690700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0c5260 0x7fe8ac1e9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b0e8f700 1 -- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0c5260 msgr2=0x7fe8ac1e9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b0e8f700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0c5260 0x7fe8ac1e9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b0e8f700 1 -- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac0c3f80 msgr2=0x7fe8ac06a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b0e8f700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac0c3f80 0x7fe8ac06a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b0e8f700 1 -- 172.21.15.6:0/1196515801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a4009a70 con 0x7fe8ac0c1860 2023-07-21T07:35:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8b1690700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0c5260 0x7fe8ac1e9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.403+0000 7fe8abfff700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac0c3f80 0x7fe8ac06a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.404+0000 7fe8b0e8f700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8ac0c1860 0x7fe8ac148d60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0000c00 tx=0x7fe8a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.404+0000 7fe8a97fa700 1 -- 172.21.15.6:0/1196515801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a00036a0 con 0x7fe8ac0c1860 2023-07-21T07:35:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.404+0000 7fe8a97fa700 1 -- 172.21.15.6:0/1196515801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a001f070 con 0x7fe8ac0c1860 2023-07-21T07:35:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.404+0000 7fe8b30f3700 1 -- 172.21.15.6:0/1196515801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a00094a0 con 0x7fe8ac0c1860 2023-07-21T07:35:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.404+0000 7fe8a97fa700 1 -- 172.21.15.6:0/1196515801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0003a60 con 0x7fe8ac0c1860 2023-07-21T07:35:41.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.404+0000 7fe8b30f3700 1 -- 172.21.15.6:0/1196515801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac06ab50 con 0x7fe8ac0c1860 2023-07-21T07:35:41.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.405+0000 7fe8b30f3700 1 -- 172.21.15.6:0/1196515801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac074500 con 0x7fe8ac0c1860 2023-07-21T07:35:41.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.405+0000 7fe8a97fa700 1 -- 172.21.15.6:0/1196515801 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe8a0003bc0 con 0x7fe8ac0c1860 2023-07-21T07:35:41.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.406+0000 7fe8a97fa700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe89006ace0 0x7fe89006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.406+0000 7fe8a97fa700 1 -- 172.21.15.6:0/1196515801 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8a0021070 con 0x7fe8ac0c1860 2023-07-21T07:35:41.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.406+0000 7fe8abfff700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe89006ace0 0x7fe89006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.406+0000 7fe8abfff700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe89006ace0 0x7fe89006d1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac1492a0 tx=0x7fe898009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:41.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.410+0000 7fe8a97fa700 1 -- 172.21.15.6:0/1196515801 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe8a0055dd0 con 0x7fe8ac0c1860 2023-07-21T07:35:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.606+0000 7fe8b30f3700 1 -- 172.21.15.6:0/1196515801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe8ac0c49b0 con 0x7fe8ac0c1860 2023-07-21T07:35:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.607+0000 7fe8a97fa700 1 -- 172.21.15.6:0/1196515801 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe8a00593f0 con 0x7fe8ac0c1860 2023-07-21T07:35:41.659 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:35:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.609+0000 7fe8b30f3700 1 -- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe89006ace0 msgr2=0x7fe89006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.609+0000 7fe8b30f3700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe89006ace0 0x7fe89006d1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac1492a0 tx=0x7fe898009040 comp rx=0 tx=0).stop 2023-07-21T07:35:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.609+0000 7fe8b30f3700 1 -- 172.21.15.6:0/1196515801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8ac0c1860 msgr2=0x7fe8ac148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.609+0000 7fe8b30f3700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8ac0c1860 0x7fe8ac148d60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0000c00 tx=0x7fe8a0004750 comp rx=0 tx=0).stop 2023-07-21T07:35:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.609+0000 7fe8b30f3700 1 -- 172.21.15.6:0/1196515801 shutdown_connections 2023-07-21T07:35:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.609+0000 7fe8b30f3700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe89006ace0 0x7fe89006d1a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.609+0000 7fe8b30f3700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0c5260 0x7fe8ac1e9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.609+0000 7fe8b30f3700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8ac0c1860 0x7fe8ac148d60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.609+0000 7fe8b30f3700 1 --2- 172.21.15.6:0/1196515801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac0c3f80 0x7fe8ac06a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.609+0000 7fe8b30f3700 1 -- 172.21.15.6:0/1196515801 >> 172.21.15.6:0/1196515801 conn(0x7fe8ac0a8660 msgr2=0x7fe8ac1510d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.609+0000 7fe8b30f3700 1 -- 172.21.15.6:0/1196515801 shutdown_connections 2023-07-21T07:35:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.609+0000 7fe8b30f3700 1 -- 172.21.15.6:0/1196515801 wait complete. 2023-07-21T07:35:41.673 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:35:41.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.749+0000 7fe9c9591700 1 Processor -- start 2023-07-21T07:35:41.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.749+0000 7fe9c9591700 1 -- start start 2023-07-21T07:35:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.750+0000 7fe9c9591700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe9c4151d50 0x7fe9c40ca010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.750+0000 7fe9c9591700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9c40c82e0 0x7fe9c4158230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.750+0000 7fe9c9591700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c40c7e50 con 0x7fe9c40ca550 2023-07-21T07:35:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.750+0000 7fe9c9591700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c4154640 con 0x7fe9c4151d50 2023-07-21T07:35:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.750+0000 7fe9c9591700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c4154920 con 0x7fe9c40c82e0 2023-07-21T07:35:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.750+0000 7fe9c2ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe9c4151d50 0x7fe9c40ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.750+0000 7fe9c37fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9c40c82e0 0x7fe9c4158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.750+0000 7fe9c27fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe9c40ca550 0x7fe9c4157b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:45786/0 (socket says 172.21.15.6:45786) 2023-07-21T07:35:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.750+0000 7fe9c27fc700 1 -- 172.21.15.6:0/4209824560 learned_addr learned my addr 172.21.15.6:0/4209824560 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:41.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.751+0000 7fe9c2ffd700 1 -- 172.21.15.6:0/4209824560 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9c40c82e0 msgr2=0x7fe9c4158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:41.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.751+0000 7fe9c2ffd700 1 --2- 172.21.15.6:0/4209824560 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9c40c82e0 0x7fe9c4158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.751+0000 7fe9c2ffd700 1 -- 172.21.15.6:0/4209824560 >> v1:172.21.15.86:6789/0 conn(0x7fe9c40ca550 legacy=0x7fe9c4157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.751+0000 7fe9c2ffd700 1 -- 172.21.15.6:0/4209824560 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c4154c00 con 0x7fe9c4151d50 2023-07-21T07:35:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.751+0000 7fe9c1ffb700 1 -- 172.21.15.6:0/4209824560 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860618188 0 0) 0x7fe9c40c7e50 con 0x7fe9c40ca550 2023-07-21T07:35:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.751+0000 7fe9c37fe700 1 --2- 172.21.15.6:0/4209824560 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9c40c82e0 0x7fe9c4158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.751+0000 7fe9c2ffd700 1 --2- 172.21.15.6:0/4209824560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c4151d50 0x7fe9c40ca010 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009840 tx=0x7fe9b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6844907939c3b01 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.751+0000 7fe9c1ffb700 1 -- 172.21.15.6:0/4209824560 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8011830 con 0x7fe9c4151d50 2023-07-21T07:35:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.751+0000 7fe9c1ffb700 1 -- 172.21.15.6:0/4209824560 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b8011990 con 0x7fe9c4151d50 2023-07-21T07:35:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.751+0000 7fe9c1ffb700 1 -- 172.21.15.6:0/4209824560 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8011d20 con 0x7fe9c4151d50 2023-07-21T07:35:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.752+0000 7fe9c9591700 1 -- 172.21.15.6:0/4209824560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c4151d50 msgr2=0x7fe9c40ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.752+0000 7fe9c9591700 1 --2- 172.21.15.6:0/4209824560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c4151d50 0x7fe9c40ca010 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009840 tx=0x7fe9b8009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.752+0000 7fe9c9591700 1 -- 172.21.15.6:0/4209824560 shutdown_connections 2023-07-21T07:35:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.752+0000 7fe9c9591700 1 --2- 172.21.15.6:0/4209824560 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9c40c82e0 0x7fe9c4158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.752+0000 7fe9c9591700 1 --2- 172.21.15.6:0/4209824560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c4151d50 0x7fe9c40ca010 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.752+0000 7fe9c9591700 1 -- 172.21.15.6:0/4209824560 >> 172.21.15.6:0/4209824560 conn(0x7fe9c40719a0 msgr2=0x7fe9c4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.752+0000 7fe9c9591700 1 -- 172.21.15.6:0/4209824560 shutdown_connections 2023-07-21T07:35:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.752+0000 7fe9c9591700 1 -- 172.21.15.6:0/4209824560 wait complete. 2023-07-21T07:35:41.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.753+0000 7fe9c9591700 1 Processor -- start 2023-07-21T07:35:41.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.753+0000 7fe9c9591700 1 -- start start 2023-07-21T07:35:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.754+0000 7fe9c9591700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c40c82e0 0x7fe9c40c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.754+0000 7fe9c9591700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9c40ca550 0x7fe9c41ed330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.754+0000 7fe9c9591700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9c4151d50 0x7fe9c41ed870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.754+0000 7fe9c9591700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c41571d0 con 0x7fe9c40ca550 2023-07-21T07:35:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.754+0000 7fe9c9591700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c414af90 con 0x7fe9c40c82e0 2023-07-21T07:35:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.754+0000 7fe9c9591700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c41478a0 con 0x7fe9c4151d50 2023-07-21T07:35:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.754+0000 7fe9c27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9c40ca550 0x7fe9c41ed330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9c27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9c40ca550 0x7fe9c41ed330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34532/0 (socket says 172.21.15.6:34532) 2023-07-21T07:35:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9c27fc700 1 -- 172.21.15.6:0/1523176143 learned_addr learned my addr 172.21.15.6:0/1523176143 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9c37fe700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9c4151d50 0x7fe9c41ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9c2ffd700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c40c82e0 0x7fe9c40c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9c27fc700 1 -- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9c4151d50 msgr2=0x7fe9c41ed870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9c27fc700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9c4151d50 0x7fe9c41ed870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9c27fc700 1 -- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c40c82e0 msgr2=0x7fe9c40c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9c27fc700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c40c82e0 0x7fe9c40c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9c27fc700 1 -- 172.21.15.6:0/1523176143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc009a70 con 0x7fe9c40ca550 2023-07-21T07:35:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9c27fc700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9c40ca550 0x7fe9c41ed330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40011e0 tx=0x7fe9b400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9ab7fe700 1 -- 172.21.15.6:0/1523176143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4004c80 con 0x7fe9c40ca550 2023-07-21T07:35:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9ab7fe700 1 -- 172.21.15.6:0/1523176143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b4004de0 con 0x7fe9c40ca550 2023-07-21T07:35:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9c9591700 1 -- 172.21.15.6:0/1523176143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b80094a0 con 0x7fe9c40ca550 2023-07-21T07:35:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9ab7fe700 1 -- 172.21.15.6:0/1523176143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4007310 con 0x7fe9c40ca550 2023-07-21T07:35:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.755+0000 7fe9c9591700 1 -- 172.21.15.6:0/1523176143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c41ee150 con 0x7fe9c40ca550 2023-07-21T07:35:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.756+0000 7fe9c9591700 1 -- 172.21.15.6:0/1523176143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c40c4d90 con 0x7fe9c40ca550 2023-07-21T07:35:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.757+0000 7fe9ab7fe700 1 -- 172.21.15.6:0/1523176143 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe9b4007470 con 0x7fe9c40ca550 2023-07-21T07:35:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.757+0000 7fe9ab7fe700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe9b006ace0 0x7fe9b006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.757+0000 7fe9ab7fe700 1 -- 172.21.15.6:0/1523176143 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe9b4089090 con 0x7fe9c40ca550 2023-07-21T07:35:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.757+0000 7fe9c2ffd700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe9b006ace0 0x7fe9b006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.758+0000 7fe9c2ffd700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe9b006ace0 0x7fe9b006d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80090b0 tx=0x7fe9b8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.761+0000 7fe9ab7fe700 1 -- 172.21.15.6:0/1523176143 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe9b40541d0 con 0x7fe9c40ca550 2023-07-21T07:35:42.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.962+0000 7fe9c9591700 1 -- 172.21.15.6:0/1523176143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9c4074500 con 0x7fe9c40ca550 2023-07-21T07:35:42.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.963+0000 7fe9ab7fe700 1 -- 172.21.15.6:0/1523176143 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe9b40577f0 con 0x7fe9c40ca550 2023-07-21T07:35:42.015 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:35:42.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.965+0000 7fe9c9591700 1 -- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe9b006ace0 msgr2=0x7fe9b006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.965+0000 7fe9c9591700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe9b006ace0 0x7fe9b006d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80090b0 tx=0x7fe9b8008030 comp rx=0 tx=0).stop 2023-07-21T07:35:42.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.965+0000 7fe9c9591700 1 -- 172.21.15.6:0/1523176143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9c40ca550 msgr2=0x7fe9c41ed330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.965+0000 7fe9c9591700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9c40ca550 0x7fe9c41ed330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40011e0 tx=0x7fe9b400ca30 comp rx=0 tx=0).stop 2023-07-21T07:35:42.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.965+0000 7fe9c9591700 1 -- 172.21.15.6:0/1523176143 shutdown_connections 2023-07-21T07:35:42.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.965+0000 7fe9c9591700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe9b006ace0 0x7fe9b006d1a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.965+0000 7fe9c9591700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9c4151d50 0x7fe9c41ed870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.965+0000 7fe9c9591700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c40c82e0 0x7fe9c40c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.965+0000 7fe9c9591700 1 --2- 172.21.15.6:0/1523176143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9c40ca550 0x7fe9c41ed330 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.965+0000 7fe9c9591700 1 -- 172.21.15.6:0/1523176143 >> 172.21.15.6:0/1523176143 conn(0x7fe9c40719a0 msgr2=0x7fe9c4071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:42.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.965+0000 7fe9c9591700 1 -- 172.21.15.6:0/1523176143 shutdown_connections 2023-07-21T07:35:42.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:41.965+0000 7fe9c9591700 1 -- 172.21.15.6:0/1523176143 wait complete. 2023-07-21T07:35:42.028 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:35:42.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.104+0000 7f54be28f700 1 Processor -- start 2023-07-21T07:35:42.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.105+0000 7f54be28f700 1 -- start start 2023-07-21T07:35:42.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.105+0000 7f54be28f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f54b80a6f80 0x7f54b8152380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.105+0000 7f54be28f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b8072160 0x7f54b814f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.105+0000 7f54be28f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b80c3c90 con 0x7f54b80c4120 2023-07-21T07:35:42.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.105+0000 7f54be28f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b80c26e0 con 0x7f54b80a6f80 2023-07-21T07:35:42.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.105+0000 7f54be28f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b80c3680 con 0x7f54b8072160 2023-07-21T07:35:42.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54b77fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b8072160 0x7f54b814f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54b77fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b8072160 0x7f54b814f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:60164/0 (socket says 172.21.15.6:60164) 2023-07-21T07:35:42.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54b7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f54b80a6f80 0x7f54b8152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54b77fe700 1 -- 172.21.15.6:0/872550754 learned_addr learned my addr 172.21.15.6:0/872550754 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:42.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54bc82c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f54b80c4120 0x7f54b80c5a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:45804/0 (socket says 172.21.15.6:45804) 2023-07-21T07:35:42.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54b77fe700 1 -- 172.21.15.6:0/872550754 >> v2:172.21.15.86:3300/0 conn(0x7f54b80a6f80 msgr2=0x7f54b8152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:42.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54b77fe700 1 --2- 172.21.15.6:0/872550754 >> v2:172.21.15.86:3300/0 conn(0x7f54b80a6f80 0x7f54b8152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54b77fe700 1 -- 172.21.15.6:0/872550754 >> v1:172.21.15.86:6789/0 conn(0x7f54b80c4120 legacy=0x7f54b80c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54b77fe700 1 -- 172.21.15.6:0/872550754 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80c6fe0 con 0x7f54b8072160 2023-07-21T07:35:42.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54b7fff700 1 --2- 172.21.15.6:0/872550754 >> v2:172.21.15.86:3300/0 conn(0x7f54b80a6f80 0x7f54b8152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:42.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54b77fe700 1 --2- 172.21.15.6:0/872550754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b8072160 0x7f54b814f420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f54a80098f0 tx=0x7f54a8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e18b18635fd4008 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:42.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54b6ffd700 1 -- 172.21.15.6:0/872550754 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8011830 con 0x7f54b8072160 2023-07-21T07:35:42.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54b6ffd700 1 -- 172.21.15.6:0/872550754 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a8011990 con 0x7f54b8072160 2023-07-21T07:35:42.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.106+0000 7f54b6ffd700 1 -- 172.21.15.6:0/872550754 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8011d20 con 0x7f54b8072160 2023-07-21T07:35:42.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.107+0000 7f54be28f700 1 -- 172.21.15.6:0/872550754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b8072160 msgr2=0x7f54b814f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.107+0000 7f54be28f700 1 --2- 172.21.15.6:0/872550754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b8072160 0x7f54b814f420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f54a80098f0 tx=0x7f54a8009c00 comp rx=0 tx=0).stop 2023-07-21T07:35:42.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.107+0000 7f54be28f700 1 -- 172.21.15.6:0/872550754 shutdown_connections 2023-07-21T07:35:42.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.107+0000 7f54be28f700 1 --2- 172.21.15.6:0/872550754 >> v2:172.21.15.86:3300/0 conn(0x7f54b80a6f80 0x7f54b8152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.107+0000 7f54be28f700 1 --2- 172.21.15.6:0/872550754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b8072160 0x7f54b814f420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.107+0000 7f54be28f700 1 -- 172.21.15.6:0/872550754 >> 172.21.15.6:0/872550754 conn(0x7f54b80c7b50 msgr2=0x7f54b80c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:42.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.107+0000 7f54be28f700 1 -- 172.21.15.6:0/872550754 shutdown_connections 2023-07-21T07:35:42.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.107+0000 7f54be28f700 1 -- 172.21.15.6:0/872550754 wait complete. 2023-07-21T07:35:42.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.108+0000 7f54be28f700 1 Processor -- start 2023-07-21T07:35:42.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.108+0000 7f54be28f700 1 -- start start 2023-07-21T07:35:42.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.109+0000 7f54be28f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b8072160 0x7f54b81e3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.109+0000 7f54be28f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b80a6f80 0x7f54b80c0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.109+0000 7f54be28f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b80c4120 0x7f54b806b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.109+0000 7f54be28f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b8145aa0 con 0x7f54b80c4120 2023-07-21T07:35:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.109+0000 7f54be28f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b806ccf0 con 0x7f54b80a6f80 2023-07-21T07:35:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.109+0000 7f54be28f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b81e41f0 con 0x7f54b8072160 2023-07-21T07:35:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.109+0000 7f54bc82c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b80c4120 0x7f54b806b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.109+0000 7f54bc82c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b80c4120 0x7f54b806b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34546/0 (socket says 172.21.15.6:34546) 2023-07-21T07:35:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.109+0000 7f54bc82c700 1 -- 172.21.15.6:0/2306520384 learned_addr learned my addr 172.21.15.6:0/2306520384 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.109+0000 7f54b77fe700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b80a6f80 0x7f54b80c0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.109+0000 7f54b7fff700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b8072160 0x7f54b81e3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.110+0000 7f54bc82c700 1 -- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b8072160 msgr2=0x7f54b81e3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.110+0000 7f54bc82c700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b8072160 0x7f54b81e3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.110+0000 7f54bc82c700 1 -- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b80a6f80 msgr2=0x7f54b80c0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.110+0000 7f54bc82c700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b80a6f80 0x7f54b80c0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.110+0000 7f54bc82c700 1 -- 172.21.15.6:0/2306520384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac0094a0 con 0x7f54b80c4120 2023-07-21T07:35:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.110+0000 7f54b77fe700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b80a6f80 0x7f54b80c0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.110+0000 7f54bc82c700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b80c4120 0x7f54b806b480 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f54b000cbc0 tx=0x7f54b000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.110+0000 7f54b4ff9700 1 -- 172.21.15.6:0/2306520384 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b000ab50 con 0x7f54b80c4120 2023-07-21T07:35:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.110+0000 7f54b4ff9700 1 -- 172.21.15.6:0/2306520384 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b000acb0 con 0x7f54b80c4120 2023-07-21T07:35:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.110+0000 7f54be28f700 1 -- 172.21.15.6:0/2306520384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a8009550 con 0x7f54b80c4120 2023-07-21T07:35:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.110+0000 7f54b4ff9700 1 -- 172.21.15.6:0/2306520384 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0007270 con 0x7f54b80c4120 2023-07-21T07:35:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.110+0000 7f54be28f700 1 -- 172.21.15.6:0/2306520384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b8150320 con 0x7f54b80c4120 2023-07-21T07:35:42.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.111+0000 7f54be28f700 1 -- 172.21.15.6:0/2306520384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b806b1a0 con 0x7f54b80c4120 2023-07-21T07:35:42.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.112+0000 7f54b4ff9700 1 -- 172.21.15.6:0/2306520384 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f54b00073d0 con 0x7f54b80c4120 2023-07-21T07:35:42.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.112+0000 7f54b4ff9700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f54a406ace0 0x7f54a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.112+0000 7f54b4ff9700 1 -- 172.21.15.6:0/2306520384 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54b0089130 con 0x7f54b80c4120 2023-07-21T07:35:42.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.112+0000 7f54b7fff700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f54a406ace0 0x7f54a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.113+0000 7f54b7fff700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f54a406ace0 0x7f54a406d1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009d00 tx=0x7f54ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:42.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.116+0000 7f54b4ff9700 1 -- 172.21.15.6:0/2306520384 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f54b806b1a0 con 0x7f54b80c4120 2023-07-21T07:35:42.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.315+0000 7f54be28f700 1 -- 172.21.15.6:0/2306520384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54b806b1a0 con 0x7f54b80c4120 2023-07-21T07:35:42.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.315+0000 7f54b4ff9700 1 -- 172.21.15.6:0/2306520384 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f54b806b1a0 con 0x7f54b80c4120 2023-07-21T07:35:42.368 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:35:42.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.317+0000 7f54be28f700 1 -- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f54a406ace0 msgr2=0x7f54a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.317+0000 7f54be28f700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f54a406ace0 0x7f54a406d1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009d00 tx=0x7f54ac008040 comp rx=0 tx=0).stop 2023-07-21T07:35:42.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.317+0000 7f54be28f700 1 -- 172.21.15.6:0/2306520384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b80c4120 msgr2=0x7f54b806b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.317+0000 7f54be28f700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b80c4120 0x7f54b806b480 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f54b000cbc0 tx=0x7f54b000cf80 comp rx=0 tx=0).stop 2023-07-21T07:35:42.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.318+0000 7f54be28f700 1 -- 172.21.15.6:0/2306520384 shutdown_connections 2023-07-21T07:35:42.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.318+0000 7f54be28f700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f54a406ace0 0x7f54a406d1a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.318+0000 7f54be28f700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b80c4120 0x7f54b806b480 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.318+0000 7f54be28f700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b8072160 0x7f54b81e3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.318+0000 7f54be28f700 1 --2- 172.21.15.6:0/2306520384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b80a6f80 0x7f54b80c0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.318+0000 7f54be28f700 1 -- 172.21.15.6:0/2306520384 >> 172.21.15.6:0/2306520384 conn(0x7f54b80c7b50 msgr2=0x7f54b814f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.318+0000 7f54be28f700 1 -- 172.21.15.6:0/2306520384 shutdown_connections 2023-07-21T07:35:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.318+0000 7f54be28f700 1 -- 172.21.15.6:0/2306520384 wait complete. 2023-07-21T07:35:42.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T07:35:42.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.454+0000 7fd5789a4700 1 Processor -- start 2023-07-21T07:35:42.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.454+0000 7fd5789a4700 1 -- start start 2023-07-21T07:35:42.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd5789a4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd5741584d0 0x7fd57406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd5789a4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd57406a090 0x7fd57406a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd5789a4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57406e260 con 0x7fd574154a00 2023-07-21T07:35:42.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd5789a4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5741588b0 con 0x7fd57406a090 2023-07-21T07:35:42.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd5789a4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57406e500 con 0x7fd5741584d0 2023-07-21T07:35:42.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd571d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd57406a090 0x7fd57406a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd572d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd574154a00 0x7fd574154e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42576/0 (socket says 172.21.15.6:42576) 2023-07-21T07:35:42.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd571d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd57406a090 0x7fd57406a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34552/0 (socket says 172.21.15.6:34552) 2023-07-21T07:35:42.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd572d9d700 1 -- 172.21.15.6:0/634187793 learned_addr learned my addr 172.21.15.6:0/634187793 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:42.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd57259c700 1 --2- 172.21.15.6:0/634187793 >> v2:172.21.15.86:3300/0 conn(0x7fd5741584d0 0x7fd57406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd571d9b700 1 -- 172.21.15.6:0/634187793 >> v2:172.21.15.86:3300/0 conn(0x7fd5741584d0 msgr2=0x7fd57406dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:42.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd571d9b700 1 --2- 172.21.15.6:0/634187793 >> v2:172.21.15.86:3300/0 conn(0x7fd5741584d0 0x7fd57406dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd571d9b700 1 -- 172.21.15.6:0/634187793 >> v1:172.21.15.6:6789/0 conn(0x7fd574154a00 legacy=0x7fd574154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd57159a700 1 -- 172.21.15.6:0/634187793 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228537661 0 0) 0x7fd57406e260 con 0x7fd574154a00 2023-07-21T07:35:42.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd571d9b700 1 -- 172.21.15.6:0/634187793 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57406d680 con 0x7fd57406a090 2023-07-21T07:35:42.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.455+0000 7fd571d9b700 1 --2- 172.21.15.6:0/634187793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd57406a090 0x7fd57406a4f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd57406c100 tx=0x7fd568009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1eb449f725bfba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:42.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.456+0000 7fd57159a700 1 -- 172.21.15.6:0/634187793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568011830 con 0x7fd57406a090 2023-07-21T07:35:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.456+0000 7fd57159a700 1 -- 172.21.15.6:0/634187793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd568011990 con 0x7fd57406a090 2023-07-21T07:35:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.456+0000 7fd57159a700 1 -- 172.21.15.6:0/634187793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568011d20 con 0x7fd57406a090 2023-07-21T07:35:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.456+0000 7fd5789a4700 1 -- 172.21.15.6:0/634187793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd57406a090 msgr2=0x7fd57406a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.456+0000 7fd5789a4700 1 --2- 172.21.15.6:0/634187793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd57406a090 0x7fd57406a4f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd57406c100 tx=0x7fd568009b20 comp rx=0 tx=0).stop 2023-07-21T07:35:42.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.456+0000 7fd5789a4700 1 -- 172.21.15.6:0/634187793 shutdown_connections 2023-07-21T07:35:42.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.456+0000 7fd5789a4700 1 --2- 172.21.15.6:0/634187793 >> v2:172.21.15.86:3300/0 conn(0x7fd5741584d0 0x7fd57406dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.456+0000 7fd5789a4700 1 --2- 172.21.15.6:0/634187793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd57406a090 0x7fd57406a4f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.456+0000 7fd5789a4700 1 -- 172.21.15.6:0/634187793 >> 172.21.15.6:0/634187793 conn(0x7fd5740a8510 msgr2=0x7fd5740a88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.457+0000 7fd5789a4700 1 -- 172.21.15.6:0/634187793 shutdown_connections 2023-07-21T07:35:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.457+0000 7fd5789a4700 1 -- 172.21.15.6:0/634187793 wait complete. 2023-07-21T07:35:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.458+0000 7fd5789a4700 1 Processor -- start 2023-07-21T07:35:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.458+0000 7fd5789a4700 1 -- start start 2023-07-21T07:35:42.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd5789a4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd57406a090 0x7fd574150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd5789a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574154a00 0x7fd57414e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd5789a4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5741584d0 0x7fd57414ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd5789a4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740be5a0 con 0x7fd574154a00 2023-07-21T07:35:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd5789a4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574072390 con 0x7fd57406a090 2023-07-21T07:35:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd5789a4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740ba380 con 0x7fd5741584d0 2023-07-21T07:35:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd571d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574154a00 0x7fd57414e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd571d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574154a00 0x7fd57414e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34560/0 (socket says 172.21.15.6:34560) 2023-07-21T07:35:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd571d9b700 1 -- 172.21.15.6:0/3997485279 learned_addr learned my addr 172.21.15.6:0/3997485279 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd57259c700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd57406a090 0x7fd574150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd572d9d700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5741584d0 0x7fd57414ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd571d9b700 1 -- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5741584d0 msgr2=0x7fd57414ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd571d9b700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5741584d0 0x7fd57414ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd571d9b700 1 -- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd57406a090 msgr2=0x7fd574150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd571d9b700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd57406a090 0x7fd574150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd571d9b700 1 -- 172.21.15.6:0/3997485279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680094a0 con 0x7fd574154a00 2023-07-21T07:35:42.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd57259c700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd57406a090 0x7fd574150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:42.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd571d9b700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574154a00 0x7fd57414e6d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd5680090b0 tx=0x7fd568004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:42.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd562ffd700 1 -- 172.21.15.6:0/3997485279 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5680038a0 con 0x7fd574154a00 2023-07-21T07:35:42.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd562ffd700 1 -- 172.21.15.6:0/3997485279 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56801e070 con 0x7fd574154a00 2023-07-21T07:35:42.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd562ffd700 1 -- 172.21.15.6:0/3997485279 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568003c20 con 0x7fd574154a00 2023-07-21T07:35:42.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd5789a4700 1 -- 172.21.15.6:0/3997485279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd574071040 con 0x7fd574154a00 2023-07-21T07:35:42.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.459+0000 7fd5789a4700 1 -- 172.21.15.6:0/3997485279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5740be7b0 con 0x7fd574154a00 2023-07-21T07:35:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.460+0000 7fd5789a4700 1 -- 172.21.15.6:0/3997485279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5740ba150 con 0x7fd574154a00 2023-07-21T07:35:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.461+0000 7fd562ffd700 1 -- 172.21.15.6:0/3997485279 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd56801a420 con 0x7fd574154a00 2023-07-21T07:35:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.461+0000 7fd562ffd700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd55406ace0 0x7fd55406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.461+0000 7fd562ffd700 1 -- 172.21.15.6:0/3997485279 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd56808a3c0 con 0x7fd574154a00 2023-07-21T07:35:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.461+0000 7fd57259c700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd55406ace0 0x7fd55406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.462+0000 7fd57259c700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd55406ace0 0x7fd55406d1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd564009b60 tx=0x7fd564008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.466+0000 7fd562ffd700 1 -- 172.21.15.6:0/3997485279 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd5740ba150 con 0x7fd574154a00 2023-07-21T07:35:42.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.667+0000 7fd5789a4700 1 -- 172.21.15.6:0/3997485279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd5740ba150 con 0x7fd574154a00 2023-07-21T07:35:42.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.668+0000 7fd562ffd700 1 -- 172.21.15.6:0/3997485279 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+268 (secure 0 0 0) 0x7fd568020120 con 0x7fd574154a00 2023-07-21T07:35:42.720 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:42.720 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T07:35:42.720 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:42.720 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T07:35:42.720 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T07:35:42.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:42.720 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:42.721 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T07:35:42.721 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T07:35:42.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:42.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:42.721 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 5, 2023-07-21T07:35:42.721 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "cephfs_metadata" 2023-07-21T07:35:42.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:35:42.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:35:42.722 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 6, 2023-07-21T07:35:42.722 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "cephfs_data" 2023-07-21T07:35:42.722 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:35:42.722 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T07:35:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.670+0000 7fd5789a4700 1 -- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd55406ace0 msgr2=0x7fd55406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.670+0000 7fd5789a4700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd55406ace0 0x7fd55406d1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd564009b60 tx=0x7fd564008040 comp rx=0 tx=0).stop 2023-07-21T07:35:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.670+0000 7fd5789a4700 1 -- 172.21.15.6:0/3997485279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574154a00 msgr2=0x7fd57414e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.670+0000 7fd5789a4700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574154a00 0x7fd57414e6d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd5680090b0 tx=0x7fd568004750 comp rx=0 tx=0).stop 2023-07-21T07:35:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.670+0000 7fd5789a4700 1 -- 172.21.15.6:0/3997485279 shutdown_connections 2023-07-21T07:35:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.670+0000 7fd5789a4700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd55406ace0 0x7fd55406d1a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.670+0000 7fd5789a4700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5741584d0 0x7fd57414ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.670+0000 7fd5789a4700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd57406a090 0x7fd574150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.670+0000 7fd5789a4700 1 --2- 172.21.15.6:0/3997485279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd574154a00 0x7fd57414e6d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.670+0000 7fd5789a4700 1 -- 172.21.15.6:0/3997485279 >> 172.21.15.6:0/3997485279 conn(0x7fd5740a8510 msgr2=0x7fd5740a8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.670+0000 7fd5789a4700 1 -- 172.21.15.6:0/3997485279 shutdown_connections 2023-07-21T07:35:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.670+0000 7fd5789a4700 1 -- 172.21.15.6:0/3997485279 wait complete. 2023-07-21T07:35:42.733 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-07-21T07:35:42.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-07-21T07:35:42.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.811+0000 7f6bf426f700 1 Processor -- start 2023-07-21T07:35:42.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.811+0000 7f6bf426f700 1 -- start start 2023-07-21T07:35:42.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.812+0000 7f6bf426f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6bec151b20 0x7f6bec06a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.812+0000 7f6bf426f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6bec0ba0d0 0x7f6bec154690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.812+0000 7f6bf426f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bec0c2270 con 0x7f6bec0c3450 2023-07-21T07:35:42.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.812+0000 7f6bf426f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec151f00 con 0x7f6bec0ba0d0 2023-07-21T07:35:42.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.812+0000 7f6bf426f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec0c24a0 con 0x7f6bec151b20 2023-07-21T07:35:42.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.812+0000 7f6bf180a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6bec0ba0d0 0x7f6bec154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.812+0000 7f6bf280c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6bec0c3450 0x7f6bec154bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42590/0 (socket says 172.21.15.6:42590) 2023-07-21T07:35:42.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.812+0000 7f6bf180a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6bec0ba0d0 0x7f6bec154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34568/0 (socket says 172.21.15.6:34568) 2023-07-21T07:35:42.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.812+0000 7f6bf280c700 1 -- 172.21.15.6:0/1633200056 learned_addr learned my addr 172.21.15.6:0/1633200056 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:42.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.812+0000 7f6bf200b700 1 --2- 172.21.15.6:0/1633200056 >> v2:172.21.15.86:3300/0 conn(0x7f6bec151b20 0x7f6bec06a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.812+0000 7f6bf180a700 1 -- 172.21.15.6:0/1633200056 >> v2:172.21.15.86:3300/0 conn(0x7f6bec151b20 msgr2=0x7f6bec06a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:42.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf180a700 1 --2- 172.21.15.6:0/1633200056 >> v2:172.21.15.86:3300/0 conn(0x7f6bec151b20 0x7f6bec06a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf180a700 1 -- 172.21.15.6:0/1633200056 >> v1:172.21.15.6:6789/0 conn(0x7f6bec0c3450 legacy=0x7f6bec154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf180a700 1 -- 172.21.15.6:0/1633200056 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec0c2780 con 0x7f6bec0ba0d0 2023-07-21T07:35:42.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf1009700 1 -- 172.21.15.6:0/1633200056 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814287054 0 0) 0x7f6bec0c2270 con 0x7f6bec0c3450 2023-07-21T07:35:42.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf200b700 1 --2- 172.21.15.6:0/1633200056 >> v2:172.21.15.86:3300/0 conn(0x7f6bec151b20 0x7f6bec06a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:42.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf180a700 1 --2- 172.21.15.6:0/1633200056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bec0ba0d0 0x7f6bec154690 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009840 tx=0x7f6be8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e0dac18cf3dea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:42.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf1009700 1 -- 172.21.15.6:0/1633200056 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8011830 con 0x7f6bec0ba0d0 2023-07-21T07:35:42.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf1009700 1 -- 172.21.15.6:0/1633200056 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be8011990 con 0x7f6bec0ba0d0 2023-07-21T07:35:42.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf1009700 1 -- 172.21.15.6:0/1633200056 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8011d20 con 0x7f6bec0ba0d0 2023-07-21T07:35:42.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf426f700 1 -- 172.21.15.6:0/1633200056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bec0ba0d0 msgr2=0x7f6bec154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf426f700 1 --2- 172.21.15.6:0/1633200056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bec0ba0d0 0x7f6bec154690 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009840 tx=0x7f6be8009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:42.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf426f700 1 -- 172.21.15.6:0/1633200056 shutdown_connections 2023-07-21T07:35:42.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf426f700 1 --2- 172.21.15.6:0/1633200056 >> v2:172.21.15.86:3300/0 conn(0x7f6bec151b20 0x7f6bec06a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf426f700 1 --2- 172.21.15.6:0/1633200056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bec0ba0d0 0x7f6bec154690 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.813+0000 7f6bf426f700 1 -- 172.21.15.6:0/1633200056 >> 172.21.15.6:0/1633200056 conn(0x7f6bec0a85f0 msgr2=0x7f6bec0a8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:42.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.814+0000 7f6bf426f700 1 -- 172.21.15.6:0/1633200056 shutdown_connections 2023-07-21T07:35:42.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.814+0000 7f6bf426f700 1 -- 172.21.15.6:0/1633200056 wait complete. 2023-07-21T07:35:42.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.815+0000 7f6bf426f700 1 Processor -- start 2023-07-21T07:35:42.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.815+0000 7f6bf426f700 1 -- start start 2023-07-21T07:35:42.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.815+0000 7f6bf426f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bec0ba0d0 0x7f6bec155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.815+0000 7f6bf426f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bec0c3450 0x7f6bec14f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.815+0000 7f6bf426f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec151b20 0x7f6bec14fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.815+0000 7f6bf426f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0bcff0 con 0x7f6bec0c3450 2023-07-21T07:35:42.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.815+0000 7f6bf426f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec156ef0 con 0x7f6bec151b20 2023-07-21T07:35:42.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.815+0000 7f6bf426f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0bc9c0 con 0x7f6bec0ba0d0 2023-07-21T07:35:42.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.815+0000 7f6bf180a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bec0c3450 0x7f6bec14f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.815+0000 7f6bf180a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bec0c3450 0x7f6bec14f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34574/0 (socket says 172.21.15.6:34574) 2023-07-21T07:35:42.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6bf180a700 1 -- 172.21.15.6:0/2115296101 learned_addr learned my addr 172.21.15.6:0/2115296101 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:42.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6bf280c700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec151b20 0x7f6bec14fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6bf200b700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bec0ba0d0 0x7f6bec155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6bf180a700 1 -- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bec0ba0d0 msgr2=0x7f6bec155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6bf180a700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bec0ba0d0 0x7f6bec155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6bf180a700 1 -- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec151b20 msgr2=0x7f6bec14fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:42.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6bf180a700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec151b20 0x7f6bec14fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:42.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6bf180a700 1 -- 172.21.15.6:0/2115296101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be80094a0 con 0x7f6bec0c3450 2023-07-21T07:35:42.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6bf280c700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec151b20 0x7f6bec14fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:42.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6bf180a700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bec0c3450 0x7f6bec14f6d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6be80090b0 tx=0x7f6be8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:42.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6be2ffd700 1 -- 172.21.15.6:0/2115296101 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be80038a0 con 0x7f6bec0c3450 2023-07-21T07:35:42.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6be2ffd700 1 -- 172.21.15.6:0/2115296101 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be801f070 con 0x7f6bec0c3450 2023-07-21T07:35:42.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6bf426f700 1 -- 172.21.15.6:0/2115296101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec0bbc00 con 0x7f6bec0c3450 2023-07-21T07:35:42.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6be2ffd700 1 -- 172.21.15.6:0/2115296101 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8003c40 con 0x7f6bec0c3450 2023-07-21T07:35:42.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.816+0000 7f6bf426f700 1 -- 172.21.15.6:0/2115296101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec0bcc10 con 0x7f6bec0c3450 2023-07-21T07:35:42.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.817+0000 7f6bf426f700 1 -- 172.21.15.6:0/2115296101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec0bd130 con 0x7f6bec0c3450 2023-07-21T07:35:42.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.818+0000 7f6be2ffd700 1 -- 172.21.15.6:0/2115296101 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6be8026480 con 0x7f6bec0c3450 2023-07-21T07:35:42.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.818+0000 7f6be2ffd700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6bd006ace0 0x7f6bd006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:42.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.818+0000 7f6be2ffd700 1 -- 172.21.15.6:0/2115296101 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6be8021070 con 0x7f6bec0c3450 2023-07-21T07:35:42.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.818+0000 7f6bf200b700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6bd006ace0 0x7f6bd006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:42.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.819+0000 7f6bf200b700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6bd006ace0 0x7f6bd006d1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc006fd0 tx=0x7f6bdc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:42.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:42.822+0000 7f6be2ffd700 1 -- 172.21.15.6:0/2115296101 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6bec0bd130 con 0x7f6bec0c3450 2023-07-21T07:35:43.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.022+0000 7f6bf426f700 1 -- 172.21.15.6:0/2115296101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6bec0bd130 con 0x7f6bec0c3450 2023-07-21T07:35:43.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.865+0000 7f6be2ffd700 1 -- 172.21.15.6:0/2115296101 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v37) v1 ==== 140+0+0 (secure 0 0 0) 0x7f6bec0bd130 con 0x7f6bec0c3450 2023-07-21T07:35:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.870+0000 7f6bf426f700 1 -- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6bd006ace0 msgr2=0x7f6bd006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:43.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.870+0000 7f6bf426f700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6bd006ace0 0x7f6bd006d1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc006fd0 tx=0x7f6bdc008040 comp rx=0 tx=0).stop 2023-07-21T07:35:43.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.870+0000 7f6bf426f700 1 -- 172.21.15.6:0/2115296101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bec0c3450 msgr2=0x7f6bec14f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:43.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.870+0000 7f6bf426f700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bec0c3450 0x7f6bec14f6d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6be80090b0 tx=0x7f6be8004750 comp rx=0 tx=0).stop 2023-07-21T07:35:43.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.871+0000 7f6bf426f700 1 -- 172.21.15.6:0/2115296101 shutdown_connections 2023-07-21T07:35:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.871+0000 7f6bf426f700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6bd006ace0 0x7f6bd006d1a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.871+0000 7f6bf426f700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec151b20 0x7f6bec14fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.871+0000 7f6bf426f700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bec0ba0d0 0x7f6bec155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.871+0000 7f6bf426f700 1 --2- 172.21.15.6:0/2115296101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bec0c3450 0x7f6bec14f6d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:43.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.871+0000 7f6bf426f700 1 -- 172.21.15.6:0/2115296101 >> 172.21.15.6:0/2115296101 conn(0x7f6bec0a85f0 msgr2=0x7f6bec1539d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.873+0000 7f6bf426f700 1 -- 172.21.15.6:0/2115296101 shutdown_connections 2023-07-21T07:35:43.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:43.874+0000 7f6bf426f700 1 -- 172.21.15.6:0/2115296101 wait complete. 2023-07-21T07:35:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs2_metadata' created 2023-07-21T07:35:43.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T07:35:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.027+0000 7f5e3c1ec700 1 Processor -- start 2023-07-21T07:35:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.027+0000 7f5e3c1ec700 1 -- start start 2023-07-21T07:35:44.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.028+0000 7f5e3c1ec700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5e340abd40 0x7f5e340aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:44.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.028+0000 7f5e3c1ec700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e34066050 con 0x7f5e340aae10 2023-07-21T07:35:44.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.028+0000 7f5e3c1ec700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3414c960 con 0x7f5e3414c580 2023-07-21T07:35:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.028+0000 7f5e3c1ec700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e34066580 con 0x7f5e340abd40 2023-07-21T07:35:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.028+0000 7f5e3a789700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5e340aae10 0x7f5e3415cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42604/0 (socket says 172.21.15.6:42604) 2023-07-21T07:35:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.028+0000 7f5e3a789700 1 -- 172.21.15.6:0/2400988707 learned_addr learned my addr 172.21.15.6:0/2400988707 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e39787700 1 --2- 172.21.15.6:0/2400988707 >> v2:172.21.15.86:3300/0 conn(0x7f5e340abd40 0x7f5e340aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818127398 0 0) 0x7f5e34066050 con 0x7f5e340aae10 2023-07-21T07:35:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e200035b0 con 0x7f5e340aae10 2023-07-21T07:35:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3423323172 0 0) 0x7f5e200035b0 con 0x7f5e340aae10 2023-07-21T07:35:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 >> v2:172.21.15.86:3300/0 conn(0x7f5e340abd40 msgr2=0x7f5e340aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 --2- 172.21.15.6:0/2400988707 >> v2:172.21.15.86:3300/0 conn(0x7f5e340abd40 0x7f5e340aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 >> v1:172.21.15.86:6789/0 conn(0x7f5e3414c580 legacy=0x7f5e340c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e340ac1f0 con 0x7f5e340aae10 2023-07-21T07:35:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f5e2c0019f0 con 0x7f5e340aae10 2023-07-21T07:35:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 >> v1:172.21.15.6:6789/0 conn(0x7f5e340aae10 legacy=0x7f5e3415cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 --2- 172.21.15.6:0/2400988707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e20003a00 0x7f5e20003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 --2- 172.21.15.6:0/2400988707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e20004850 0x7f5e20004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 --2- 172.21.15.6:0/2400988707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e20005210 0x7f5e2000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34066580 con 0x7f5e20003a00 2023-07-21T07:35:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2000c1b0 con 0x7f5e20005210 2023-07-21T07:35:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2000c370 con 0x7f5e20004850 2023-07-21T07:35:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e39f88700 1 --2- 172.21.15.6:0/2400988707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e20003a00 0x7f5e20003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e39787700 1 --2- 172.21.15.6:0/2400988707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e20004850 0x7f5e20004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e3a789700 1 --2- 172.21.15.6:0/2400988707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e20005210 0x7f5e2000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e39f88700 1 -- 172.21.15.6:0/2400988707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e20004850 msgr2=0x7f5e20004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e39f88700 1 --2- 172.21.15.6:0/2400988707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e20004850 0x7f5e20004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e39f88700 1 -- 172.21.15.6:0/2400988707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e20005210 msgr2=0x7f5e2000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e39f88700 1 --2- 172.21.15.6:0/2400988707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e20005210 0x7f5e2000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e3a789700 1 -- 172.21.15.6:0/2400988707 reap_dead start 2023-07-21T07:35:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.029+0000 7f5e39f88700 1 -- 172.21.15.6:0/2400988707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e200035b0 con 0x7f5e20003a00 2023-07-21T07:35:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.030+0000 7f5e39f88700 1 --2- 172.21.15.6:0/2400988707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e20003a00 0x7f5e20003e20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5e240017c0 tx=0x7f5e20005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54562839f77eabdf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.030+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e240052d0 con 0x7f5e20003a00 2023-07-21T07:35:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.030+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e24005450 con 0x7f5e20003a00 2023-07-21T07:35:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.030+0000 7f5e38f86700 1 -- 172.21.15.6:0/2400988707 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e240038c0 con 0x7f5e20003a00 2023-07-21T07:35:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.030+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/2400988707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e20003a00 msgr2=0x7f5e20003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.030+0000 7f5e3c1ec700 1 --2- 172.21.15.6:0/2400988707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e20003a00 0x7f5e20003e20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5e240017c0 tx=0x7f5e20005880 comp rx=0 tx=0).stop 2023-07-21T07:35:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.030+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/2400988707 shutdown_connections 2023-07-21T07:35:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.030+0000 7f5e3c1ec700 1 --2- 172.21.15.6:0/2400988707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e20003a00 0x7f5e20003e20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.030+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/2400988707 >> 172.21.15.6:0/2400988707 conn(0x7f5e340c2c20 msgr2=0x7f5e340c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.030+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/2400988707 shutdown_connections 2023-07-21T07:35:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.030+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/2400988707 wait complete. 2023-07-21T07:35:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.032+0000 7f5e3c1ec700 1 Processor -- start 2023-07-21T07:35:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.032+0000 7f5e3c1ec700 1 -- start start 2023-07-21T07:35:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3c1ec700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e20003a00 0x7f5e34143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3c1ec700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e34149da0 0x7f5e34141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3c1ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3414a5f0 0x7f5e34141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3c1ec700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34152f50 con 0x7f5e3414a5f0 2023-07-21T07:35:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3c1ec700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e341eb630 con 0x7f5e20003a00 2023-07-21T07:35:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3c1ec700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3414a230 con 0x7f5e34149da0 2023-07-21T07:35:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3a789700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3414a5f0 0x7f5e34141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3a789700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3414a5f0 0x7f5e34141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34596/0 (socket says 172.21.15.6:34596) 2023-07-21T07:35:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3a789700 1 -- 172.21.15.6:0/440859924 learned_addr learned my addr 172.21.15.6:0/440859924 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e39787700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e34149da0 0x7f5e34141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e39f88700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e20003a00 0x7f5e34143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:44.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3a789700 1 -- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e34149da0 msgr2=0x7f5e34141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3a789700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e34149da0 0x7f5e34141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3a789700 1 -- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e20003a00 msgr2=0x7f5e34143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3a789700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e20003a00 0x7f5e34143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.033+0000 7f5e3a789700 1 -- 172.21.15.6:0/440859924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e341eb880 con 0x7f5e3414a5f0 2023-07-21T07:35:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.034+0000 7f5e3a789700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3414a5f0 0x7f5e34141fc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0013d0 tx=0x7f5e2c00e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.034+0000 7f5e2a7fc700 1 -- 172.21.15.6:0/440859924 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c00ebc0 con 0x7f5e3414a5f0 2023-07-21T07:35:44.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.034+0000 7f5e2a7fc700 1 -- 172.21.15.6:0/440859924 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c00ed60 con 0x7f5e3414a5f0 2023-07-21T07:35:44.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.034+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/440859924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e341ebb60 con 0x7f5e3414a5f0 2023-07-21T07:35:44.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.034+0000 7f5e2a7fc700 1 -- 172.21.15.6:0/440859924 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c013660 con 0x7f5e3414a5f0 2023-07-21T07:35:44.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.034+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/440859924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e34143fe0 con 0x7f5e3414a5f0 2023-07-21T07:35:44.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.035+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/440859924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e341ec080 con 0x7f5e3414a5f0 2023-07-21T07:35:44.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.035+0000 7f5e2a7fc700 1 -- 172.21.15.6:0/440859924 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e2c0137c0 con 0x7f5e3414a5f0 2023-07-21T07:35:44.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.036+0000 7f5e2a7fc700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e1806ace0 0x7f5e1806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:44.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.036+0000 7f5e2a7fc700 1 -- 172.21.15.6:0/440859924 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f5e2c089ab0 con 0x7f5e3414a5f0 2023-07-21T07:35:44.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.036+0000 7f5e39f88700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e1806ace0 0x7f5e1806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:44.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.036+0000 7f5e39f88700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e1806ace0 0x7f5e1806d1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5e24005040 tx=0x7f5e24009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:44.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.040+0000 7f5e2a7fc700 1 -- 172.21.15.6:0/440859924 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5e341ec080 con 0x7f5e3414a5f0 2023-07-21T07:35:44.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.239+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/440859924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5e341ec080 con 0x7f5e3414a5f0 2023-07-21T07:35:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.872+0000 7f5e2a7fc700 1 -- 172.21.15.6:0/440859924 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v38) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5e341ec080 con 0x7f5e3414a5f0 2023-07-21T07:35:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.877+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e1806ace0 msgr2=0x7f5e1806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:44.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.877+0000 7f5e3c1ec700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e1806ace0 0x7f5e1806d1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5e24005040 tx=0x7f5e24009030 comp rx=0 tx=0).stop 2023-07-21T07:35:44.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.877+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/440859924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3414a5f0 msgr2=0x7f5e34141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:44.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.877+0000 7f5e3c1ec700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3414a5f0 0x7f5e34141fc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0013d0 tx=0x7f5e2c00e440 comp rx=0 tx=0).stop 2023-07-21T07:35:44.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.878+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/440859924 shutdown_connections 2023-07-21T07:35:44.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.878+0000 7f5e3c1ec700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e1806ace0 0x7f5e1806d1a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:44.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.878+0000 7f5e3c1ec700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3414a5f0 0x7f5e34141fc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:44.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.878+0000 7f5e3c1ec700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e20003a00 0x7f5e34143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:44.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.878+0000 7f5e3c1ec700 1 --2- 172.21.15.6:0/440859924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e34149da0 0x7f5e34141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:44.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.878+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/440859924 >> 172.21.15.6:0/440859924 conn(0x7f5e340c2c20 msgr2=0x7f5e34151a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:44.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.880+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/440859924 shutdown_connections 2023-07-21T07:35:44.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:44.881+0000 7f5e3c1ec700 1 -- 172.21.15.6:0/440859924 wait complete. 2023-07-21T07:35:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs2_data' created 2023-07-21T07:35:44.960 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-07-21T07:35:45.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.042+0000 7f2cc5166700 1 Processor -- start 2023-07-21T07:35:45.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.042+0000 7f2cc5166700 1 -- start start 2023-07-21T07:35:45.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cc5166700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2cc00703f0 0x7f2cc00c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cc5166700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2cc00c18c0 0x7f2cc014dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cc5166700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc00c0b20 con 0x7f2cc0072130 2023-07-21T07:35:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cc5166700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc0151820 con 0x7f2cc00c18c0 2023-07-21T07:35:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cc5166700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc00c0de0 con 0x7f2cc00703f0 2023-07-21T07:35:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cbe59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2cc00c18c0 0x7f2cc014dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cbe59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2cc00c18c0 0x7f2cc014dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34600/0 (socket says 172.21.15.6:34600) 2023-07-21T07:35:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cbe59c700 1 -- 172.21.15.6:0/884301893 learned_addr learned my addr 172.21.15.6:0/884301893 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cbed9d700 1 --2- 172.21.15.6:0/884301893 >> v2:172.21.15.86:3300/0 conn(0x7f2cc00703f0 0x7f2cc00c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cbe59c700 1 -- 172.21.15.6:0/884301893 >> v2:172.21.15.86:3300/0 conn(0x7f2cc00703f0 msgr2=0x7f2cc00c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cbe59c700 1 --2- 172.21.15.6:0/884301893 >> v2:172.21.15.86:3300/0 conn(0x7f2cc00703f0 0x7f2cc00c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cbe59c700 1 -- 172.21.15.6:0/884301893 >> v1:172.21.15.86:6789/0 conn(0x7f2cc0072130 legacy=0x7f2cc006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cbe59c700 1 -- 172.21.15.6:0/884301893 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00c10c0 con 0x7f2cc00c18c0 2023-07-21T07:35:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.043+0000 7f2cbed9d700 1 --2- 172.21.15.6:0/884301893 >> v2:172.21.15.86:3300/0 conn(0x7f2cc00703f0 0x7f2cc00c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.044+0000 7f2cbe59c700 1 --2- 172.21.15.6:0/884301893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cc00c18c0 0x7f2cc014dde0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0073a80 tx=0x7f2cb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759d7f5097aebfa8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:45.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.044+0000 7f2cbdd9b700 1 -- 172.21.15.6:0/884301893 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb000b870 con 0x7f2cc00c18c0 2023-07-21T07:35:45.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.044+0000 7f2cbdd9b700 1 -- 172.21.15.6:0/884301893 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb000b9d0 con 0x7f2cc00c18c0 2023-07-21T07:35:45.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.044+0000 7f2cbdd9b700 1 -- 172.21.15.6:0/884301893 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb000bd60 con 0x7f2cc00c18c0 2023-07-21T07:35:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.044+0000 7f2cc5166700 1 -- 172.21.15.6:0/884301893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cc00c18c0 msgr2=0x7f2cc014dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.044+0000 7f2cc5166700 1 --2- 172.21.15.6:0/884301893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cc00c18c0 0x7f2cc014dde0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0073a80 tx=0x7f2cb0009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.044+0000 7f2cc5166700 1 -- 172.21.15.6:0/884301893 shutdown_connections 2023-07-21T07:35:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.044+0000 7f2cc5166700 1 --2- 172.21.15.6:0/884301893 >> v2:172.21.15.86:3300/0 conn(0x7f2cc00703f0 0x7f2cc00c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.044+0000 7f2cc5166700 1 --2- 172.21.15.6:0/884301893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cc00c18c0 0x7f2cc014dde0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.044+0000 7f2cc5166700 1 -- 172.21.15.6:0/884301893 >> 172.21.15.6:0/884301893 conn(0x7f2cc00c2c20 msgr2=0x7f2cc00c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.044+0000 7f2cc5166700 1 -- 172.21.15.6:0/884301893 shutdown_connections 2023-07-21T07:35:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.044+0000 7f2cc5166700 1 -- 172.21.15.6:0/884301893 wait complete. 2023-07-21T07:35:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.046+0000 7f2cc5166700 1 Processor -- start 2023-07-21T07:35:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.046+0000 7f2cc5166700 1 -- start start 2023-07-21T07:35:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.046+0000 7f2cc5166700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cc00703f0 0x7f2cc01505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.046+0000 7f2cc5166700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc0072130 0x7f2cc00ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.046+0000 7f2cc5166700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cc00c18c0 0x7f2cc00bf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.046+0000 7f2cc5166700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0143af0 con 0x7f2cc00703f0 2023-07-21T07:35:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.046+0000 7f2cc5166700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0150140 con 0x7f2cc0072130 2023-07-21T07:35:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.046+0000 7f2cc5166700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc014fb60 con 0x7f2cc00c18c0 2023-07-21T07:35:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2cbed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cc00703f0 0x7f2cc01505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2cbed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cc00703f0 0x7f2cc01505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34606/0 (socket says 172.21.15.6:34606) 2023-07-21T07:35:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2cbed9d700 1 -- 172.21.15.6:0/2623987894 learned_addr learned my addr 172.21.15.6:0/2623987894 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2cbe59c700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc0072130 0x7f2cc00ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2cbf59e700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cc00c18c0 0x7f2cc00bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2cbed9d700 1 -- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cc00c18c0 msgr2=0x7f2cc00bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2cbed9d700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cc00c18c0 0x7f2cc00bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2cbed9d700 1 -- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc0072130 msgr2=0x7f2cc00ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2cbed9d700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc0072130 0x7f2cc00ab3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2cbed9d700 1 -- 172.21.15.6:0/2623987894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb0009550 con 0x7f2cc00703f0 2023-07-21T07:35:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2cbed9d700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cc00703f0 0x7f2cc01505d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400e840 tx=0x7f2cb400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2ca77fe700 1 -- 172.21.15.6:0/2623987894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4004230 con 0x7f2cc00703f0 2023-07-21T07:35:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2ca77fe700 1 -- 172.21.15.6:0/2623987894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb4004390 con 0x7f2cc00703f0 2023-07-21T07:35:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2cc5166700 1 -- 172.21.15.6:0/2623987894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc00ab920 con 0x7f2cc00703f0 2023-07-21T07:35:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2ca77fe700 1 -- 172.21.15.6:0/2623987894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb40036a0 con 0x7f2cc00703f0 2023-07-21T07:35:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.047+0000 7f2cc5166700 1 -- 172.21.15.6:0/2623987894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc00abec0 con 0x7f2cc00703f0 2023-07-21T07:35:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.048+0000 7f2cc5166700 1 -- 172.21.15.6:0/2623987894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc0074500 con 0x7f2cc00703f0 2023-07-21T07:35:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.049+0000 7f2ca77fe700 1 -- 172.21.15.6:0/2623987894 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2cb4003800 con 0x7f2cc00703f0 2023-07-21T07:35:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.050+0000 7f2ca77fe700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2cac06ace0 0x7f2cac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.050+0000 7f2ca77fe700 1 -- 172.21.15.6:0/2623987894 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6816+0+0 (secure 0 0 0) 0x7f2cb40895e0 con 0x7f2cc00703f0 2023-07-21T07:35:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.050+0000 7f2cbe59c700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2cac06ace0 0x7f2cac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.050+0000 7f2cbe59c700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2cac06ace0 0x7f2cac06d1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0073a80 tx=0x7f2cb0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.054+0000 7f2ca77fe700 1 -- 172.21.15.6:0/2623987894 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2cb40543b0 con 0x7f2cc00703f0 2023-07-21T07:35:45.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.297+0000 7f2cc5166700 1 -- 172.21.15.6:0/2623987894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f2cc0150e50 con 0x7f2cc00703f0 2023-07-21T07:35:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.872+0000 7f2ca77fe700 1 -- 172.21.15.6:0/2623987894 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 7 and data pool 8 v18) v1 ==== 175+0+0 (secure 0 0 0) 0x7f2cb40579d0 con 0x7f2cc00703f0 2023-07-21T07:35:45.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.879+0000 7f2cc5166700 1 -- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2cac06ace0 msgr2=0x7f2cac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:45.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.879+0000 7f2cc5166700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2cac06ace0 0x7f2cac06d1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0073a80 tx=0x7f2cb0008030 comp rx=0 tx=0).stop 2023-07-21T07:35:45.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.879+0000 7f2cc5166700 1 -- 172.21.15.6:0/2623987894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cc00703f0 msgr2=0x7f2cc01505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:45.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.879+0000 7f2cc5166700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cc00703f0 0x7f2cc01505d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400e840 tx=0x7f2cb400eb50 comp rx=0 tx=0).stop 2023-07-21T07:35:45.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.879+0000 7f2cc5166700 1 -- 172.21.15.6:0/2623987894 shutdown_connections 2023-07-21T07:35:45.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.879+0000 7f2cc5166700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2cac06ace0 0x7f2cac06d1a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:45.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.879+0000 7f2cc5166700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cc00c18c0 0x7f2cc00bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:45.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.879+0000 7f2cc5166700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cc00703f0 0x7f2cc01505d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:45.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.879+0000 7f2cc5166700 1 --2- 172.21.15.6:0/2623987894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cc0072130 0x7f2cc00ab3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:45.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.879+0000 7f2cc5166700 1 -- 172.21.15.6:0/2623987894 >> 172.21.15.6:0/2623987894 conn(0x7f2cc00c2c20 msgr2=0x7f2cc014c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:45.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.879+0000 7f2cc5166700 1 -- 172.21.15.6:0/2623987894 shutdown_connections 2023-07-21T07:35:45.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:45.880+0000 7f2cc5166700 1 -- 172.21.15.6:0/2623987894 wait complete. 2023-07-21T07:35:45.936 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 7 and data pool 8 2023-07-21T07:35:45.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:46.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.040+0000 7f3a216bd700 1 Processor -- start 2023-07-21T07:35:46.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.040+0000 7f3a216bd700 1 -- start start 2023-07-21T07:35:46.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.041+0000 7f3a216bd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3a1c151ac0 0x7f3a1c0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.041+0000 7f3a216bd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3a1c0c47d0 0x7f3a1c0c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.041+0000 7f3a216bd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c155390 con 0x7f3a1c0c67d0 2023-07-21T07:35:46.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.041+0000 7f3a216bd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c0bd7b0 con 0x7f3a1c151ac0 2023-07-21T07:35:46.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.041+0000 7f3a216bd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c154570 con 0x7f3a1c0c47d0 2023-07-21T07:35:46.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.041+0000 7f3a1b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3a1c0c67d0 0x7f3a1c0c6c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42638/0 (socket says 172.21.15.6:42638) 2023-07-21T07:35:46.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.041+0000 7f3a1b7fe700 1 -- 172.21.15.6:0/69644519 learned_addr learned my addr 172.21.15.6:0/69644519 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:46.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.041+0000 7f3a1affd700 1 --2- 172.21.15.6:0/69644519 >> v2:172.21.15.86:3300/0 conn(0x7f3a1c151ac0 0x7f3a1c0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.041+0000 7f3a1a7fc700 1 --2- 172.21.15.6:0/69644519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3a1c0c47d0 0x7f3a1c0c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.041+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738535287 0 0) 0x7f3a1c155390 con 0x7f3a1c0c67d0 2023-07-21T07:35:46.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.041+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a040035b0 con 0x7f3a1c0c67d0 2023-07-21T07:35:46.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2678382719 0 0) 0x7f3a040035b0 con 0x7f3a1c0c67d0 2023-07-21T07:35:46.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3a1c0c47d0 msgr2=0x7f3a1c0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:46.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 --2- 172.21.15.6:0/69644519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3a1c0c47d0 0x7f3a1c0c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 >> v2:172.21.15.86:3300/0 conn(0x7f3a1c151ac0 msgr2=0x7f3a1c0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:46.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 --2- 172.21.15.6:0/69644519 >> v2:172.21.15.86:3300/0 conn(0x7f3a1c151ac0 0x7f3a1c0c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c0c83e0 con 0x7f3a1c0c67d0 2023-07-21T07:35:46.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f3a140019f0 con 0x7f3a1c0c67d0 2023-07-21T07:35:46.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 >> v1:172.21.15.6:6789/0 conn(0x7f3a1c0c67d0 legacy=0x7f3a1c0c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 --2- 172.21.15.6:0/69644519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003a00 0x7f3a04003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 --2- 172.21.15.6:0/69644519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a04004850 0x7f3a04004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 --2- 172.21.15.6:0/69644519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3a1c0c47d0 0x7f3a04005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c154570 con 0x7f3a04003a00 2023-07-21T07:35:46.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0400ba10 con 0x7f3a04004850 2023-07-21T07:35:46.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0400bb50 con 0x7f3a1c0c47d0 2023-07-21T07:35:46.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a1affd700 1 --2- 172.21.15.6:0/69644519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003a00 0x7f3a04003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a1a7fc700 1 --2- 172.21.15.6:0/69644519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a04004850 0x7f3a04004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a1b7fe700 1 --2- 172.21.15.6:0/69644519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3a1c0c47d0 0x7f3a04005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a1affd700 1 -- 172.21.15.6:0/69644519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3a1c0c47d0 msgr2=0x7f3a04005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:46.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a1affd700 1 --2- 172.21.15.6:0/69644519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3a1c0c47d0 0x7f3a04005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a1affd700 1 -- 172.21.15.6:0/69644519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a04004850 msgr2=0x7f3a04004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:46.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a1affd700 1 --2- 172.21.15.6:0/69644519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a04004850 0x7f3a04004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a1affd700 1 -- 172.21.15.6:0/69644519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a040035b0 con 0x7f3a04003a00 2023-07-21T07:35:46.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a1affd700 1 --2- 172.21.15.6:0/69644519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003a00 0x7f3a04003e20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009b90 tx=0x7f3a04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81890bf992c07309 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:46.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00e6c0 con 0x7f3a04003a00 2023-07-21T07:35:46.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.042+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c00e820 con 0x7f3a04003a00 2023-07-21T07:35:46.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.043+0000 7f3a19ffb700 1 -- 172.21.15.6:0/69644519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00eb90 con 0x7f3a04003a00 2023-07-21T07:35:46.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.043+0000 7f3a216bd700 1 -- 172.21.15.6:0/69644519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003a00 msgr2=0x7f3a04003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.043+0000 7f3a216bd700 1 --2- 172.21.15.6:0/69644519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a04003a00 0x7f3a04003e20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009b90 tx=0x7f3a04005880 comp rx=0 tx=0).stop 2023-07-21T07:35:46.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.043+0000 7f3a1b7fe700 1 -- 172.21.15.6:0/69644519 reap_dead start 2023-07-21T07:35:46.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.043+0000 7f3a216bd700 1 -- 172.21.15.6:0/69644519 shutdown_connections 2023-07-21T07:35:46.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.043+0000 7f3a216bd700 1 -- 172.21.15.6:0/69644519 >> 172.21.15.6:0/69644519 conn(0x7f3a1c0717c0 msgr2=0x7f3a1c071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:46.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.043+0000 7f3a216bd700 1 -- 172.21.15.6:0/69644519 shutdown_connections 2023-07-21T07:35:46.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.043+0000 7f3a216bd700 1 -- 172.21.15.6:0/69644519 wait complete. 2023-07-21T07:35:46.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.045+0000 7f3a216bd700 1 Processor -- start 2023-07-21T07:35:46.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.045+0000 7f3a216bd700 1 -- start start 2023-07-21T07:35:46.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a216bd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a04003a00 0x7f3a1c0aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a216bd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3a1c147450 0x7f3a1c1e9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a216bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a1c1e9f60 0x7f3a1c1441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a216bd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c150640 con 0x7f3a1c1e9f60 2023-07-21T07:35:46.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a216bd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c1e95d0 con 0x7f3a04003a00 2023-07-21T07:35:46.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a216bd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c14f2c0 con 0x7f3a1c147450 2023-07-21T07:35:46.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a1c1e9f60 0x7f3a1c1441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a1c1e9f60 0x7f3a1c1441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34630/0 (socket says 172.21.15.6:34630) 2023-07-21T07:35:46.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a1b7fe700 1 -- 172.21.15.6:0/993227924 learned_addr learned my addr 172.21.15.6:0/993227924 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:46.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a1affd700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a04003a00 0x7f3a1c0aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a1a7fc700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3a1c147450 0x7f3a1c1e9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a1b7fe700 1 -- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3a1c147450 msgr2=0x7f3a1c1e9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a1b7fe700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3a1c147450 0x7f3a1c1e9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a1b7fe700 1 -- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a04003a00 msgr2=0x7f3a1c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a1b7fe700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a04003a00 0x7f3a1c0aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a1b7fe700 1 -- 172.21.15.6:0/993227924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c14f7f0 con 0x7f3a1c1e9f60 2023-07-21T07:35:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a1affd700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a04003a00 0x7f3a1c0aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a1b7fe700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a1c1e9f60 0x7f3a1c1441c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0cac00 tx=0x7f3a1400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.046+0000 7f3a037fe700 1 -- 172.21.15.6:0/993227924 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400ae10 con 0x7f3a1c1e9f60 2023-07-21T07:35:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.047+0000 7f3a037fe700 1 -- 172.21.15.6:0/993227924 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a140133f0 con 0x7f3a1c1e9f60 2023-07-21T07:35:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.047+0000 7f3a216bd700 1 -- 172.21.15.6:0/993227924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c14f510 con 0x7f3a1c1e9f60 2023-07-21T07:35:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.047+0000 7f3a037fe700 1 -- 172.21.15.6:0/993227924 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a140137a0 con 0x7f3a1c1e9f60 2023-07-21T07:35:46.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.047+0000 7f3a216bd700 1 -- 172.21.15.6:0/993227924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c150f00 con 0x7f3a1c1e9f60 2023-07-21T07:35:46.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.047+0000 7f3a216bd700 1 -- 172.21.15.6:0/993227924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c074500 con 0x7f3a1c1e9f60 2023-07-21T07:35:46.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.048+0000 7f3a037fe700 1 -- 172.21.15.6:0/993227924 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a14013900 con 0x7f3a1c1e9f60 2023-07-21T07:35:46.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.048+0000 7f3a037fe700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3a0806ace0 0x7f3a0806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.048+0000 7f3a037fe700 1 -- 172.21.15.6:0/993227924 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f3a1408a440 con 0x7f3a1c1e9f60 2023-07-21T07:35:46.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.049+0000 7f3a1affd700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3a0806ace0 0x7f3a0806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.049+0000 7f3a1affd700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3a0806ace0 0x7f3a0806d1a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0090b0 tx=0x7f3a0c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.053+0000 7f3a037fe700 1 -- 172.21.15.6:0/993227924 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3a14055220 con 0x7f3a1c1e9f60 2023-07-21T07:35:46.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.252+0000 7f3a216bd700 1 -- 172.21.15.6:0/993227924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a1c06c090 con 0x7f3a1c1e9f60 2023-07-21T07:35:46.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.253+0000 7f3a037fe700 1 -- 172.21.15.6:0/993227924 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+21972 (secure 0 0 0) 0x7f3a14017090 con 0x7f3a1c1e9f60 2023-07-21T07:35:46.305 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:46.306 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":39,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:45.298701+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:35:29.385402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T07:35:29.920618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:35:43.052752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:35:44.270260+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:46.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.256+0000 7f3a216bd700 1 -- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3a0806ace0 msgr2=0x7f3a0806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.256+0000 7f3a216bd700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3a0806ace0 0x7f3a0806d1a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0090b0 tx=0x7f3a0c008030 comp rx=0 tx=0).stop 2023-07-21T07:35:46.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.256+0000 7f3a216bd700 1 -- 172.21.15.6:0/993227924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a1c1e9f60 msgr2=0x7f3a1c1441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.256+0000 7f3a216bd700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a1c1e9f60 0x7f3a1c1441c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0cac00 tx=0x7f3a1400a640 comp rx=0 tx=0).stop 2023-07-21T07:35:46.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.256+0000 7f3a216bd700 1 -- 172.21.15.6:0/993227924 shutdown_connections 2023-07-21T07:35:46.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.256+0000 7f3a216bd700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3a0806ace0 0x7f3a0806d1a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.256+0000 7f3a216bd700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a1c1e9f60 0x7f3a1c1441c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.256+0000 7f3a216bd700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a04003a00 0x7f3a1c0aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.256+0000 7f3a216bd700 1 --2- 172.21.15.6:0/993227924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3a1c147450 0x7f3a1c1e9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.256+0000 7f3a216bd700 1 -- 172.21.15.6:0/993227924 >> 172.21.15.6:0/993227924 conn(0x7f3a1c0717c0 msgr2=0x7f3a1c0c8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:46.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.256+0000 7f3a216bd700 1 -- 172.21.15.6:0/993227924 shutdown_connections 2023-07-21T07:35:46.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.256+0000 7f3a216bd700 1 -- 172.21.15.6:0/993227924 wait complete. 2023-07-21T07:35:46.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:46.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.393+0000 7fb19e605700 1 Processor -- start 2023-07-21T07:35:46.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.393+0000 7fb19e605700 1 -- start start 2023-07-21T07:35:46.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb19e605700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb19806bf00 0x7fb1980c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb19e605700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb19806b8b0 0x7fb1980c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb19e605700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb198153270 con 0x7fb19814fa60 2023-07-21T07:35:46.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb19e605700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb198152d80 con 0x7fb19806b8b0 2023-07-21T07:35:46.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb19e605700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980c4b00 con 0x7fb19806bf00 2023-07-21T07:35:46.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb19cba2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb19806b8b0 0x7fb1980c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb19cba2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb19806b8b0 0x7fb1980c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34638/0 (socket says 172.21.15.6:34638) 2023-07-21T07:35:46.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb19cba2700 1 -- 172.21.15.6:0/2926130555 learned_addr learned my addr 172.21.15.6:0/2926130555 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:46.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb1977fe700 1 --2- 172.21.15.6:0/2926130555 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb19806bf00 0x7fb1980c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb19cba2700 1 -- 172.21.15.6:0/2926130555 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb19806bf00 msgr2=0x7fb1980c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:46.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb19cba2700 1 --2- 172.21.15.6:0/2926130555 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb19806bf00 0x7fb1980c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb19cba2700 1 -- 172.21.15.6:0/2926130555 >> v1:172.21.15.86:6789/0 conn(0x7fb19814fa60 legacy=0x7fb19806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:46.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb19cba2700 1 -- 172.21.15.6:0/2926130555 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19806de30 con 0x7fb19806b8b0 2023-07-21T07:35:46.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb1977fe700 1 --2- 172.21.15.6:0/2926130555 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb19806bf00 0x7fb1980c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:46.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb19cba2700 1 --2- 172.21.15.6:0/2926130555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19806b8b0 0x7fb1980c5490 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb190009e50 tx=0x7fb19000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8a58da5f7955e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:46.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.394+0000 7fb196ffd700 1 -- 172.21.15.6:0/2926130555 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19000e070 con 0x7fb19806b8b0 2023-07-21T07:35:46.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.395+0000 7fb196ffd700 1 -- 172.21.15.6:0/2926130555 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb190003a20 con 0x7fb19806b8b0 2023-07-21T07:35:46.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.395+0000 7fb196ffd700 1 -- 172.21.15.6:0/2926130555 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190003dd0 con 0x7fb19806b8b0 2023-07-21T07:35:46.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.395+0000 7fb19e605700 1 -- 172.21.15.6:0/2926130555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19806b8b0 msgr2=0x7fb1980c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.395+0000 7fb19e605700 1 --2- 172.21.15.6:0/2926130555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19806b8b0 0x7fb1980c5490 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb190009e50 tx=0x7fb19000b330 comp rx=0 tx=0).stop 2023-07-21T07:35:46.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.395+0000 7fb19e605700 1 -- 172.21.15.6:0/2926130555 shutdown_connections 2023-07-21T07:35:46.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.395+0000 7fb19e605700 1 --2- 172.21.15.6:0/2926130555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19806b8b0 0x7fb1980c5490 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.395+0000 7fb19e605700 1 --2- 172.21.15.6:0/2926130555 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb19806bf00 0x7fb1980c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.395+0000 7fb19e605700 1 -- 172.21.15.6:0/2926130555 >> 172.21.15.6:0/2926130555 conn(0x7fb1980a8c90 msgr2=0x7fb19806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:46.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.395+0000 7fb19e605700 1 -- 172.21.15.6:0/2926130555 shutdown_connections 2023-07-21T07:35:46.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.395+0000 7fb19e605700 1 -- 172.21.15.6:0/2926130555 wait complete. 2023-07-21T07:35:46.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.396+0000 7fb19e605700 1 Processor -- start 2023-07-21T07:35:46.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.396+0000 7fb19e605700 1 -- start start 2023-07-21T07:35:46.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19e605700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb19806b8b0 0x7fb1981ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19e605700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb19806bf00 0x7fb1980bddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19e605700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19814fa60 0x7fb198151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19e605700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb198071990 con 0x7fb19814fa60 2023-07-21T07:35:46.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19e605700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1981e75d0 con 0x7fb19806b8b0 2023-07-21T07:35:46.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19e605700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb198071ba0 con 0x7fb19806bf00 2023-07-21T07:35:46.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19cba2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19814fa60 0x7fb198151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19cba2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19814fa60 0x7fb198151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34642/0 (socket says 172.21.15.6:34642) 2023-07-21T07:35:46.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19cba2700 1 -- 172.21.15.6:0/62605622 learned_addr learned my addr 172.21.15.6:0/62605622 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:46.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb1977fe700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb19806bf00 0x7fb1980bddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb197fff700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb19806b8b0 0x7fb1981ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19cba2700 1 -- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb19806bf00 msgr2=0x7fb1980bddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19cba2700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb19806bf00 0x7fb1980bddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19cba2700 1 -- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb19806b8b0 msgr2=0x7fb1981ed8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19cba2700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb19806b8b0 0x7fb1981ed8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.397+0000 7fb19cba2700 1 -- 172.21.15.6:0/62605622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb190009b30 con 0x7fb19814fa60 2023-07-21T07:35:46.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.398+0000 7fb197fff700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb19806b8b0 0x7fb1981ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:46.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.398+0000 7fb1977fe700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb19806bf00 0x7fb1980bddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:46.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.398+0000 7fb19cba2700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19814fa60 0x7fb198151100 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb190004000 tx=0x7fb190004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:46.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.398+0000 7fb194ff9700 1 -- 172.21.15.6:0/62605622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190004440 con 0x7fb19814fa60 2023-07-21T07:35:46.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.398+0000 7fb194ff9700 1 -- 172.21.15.6:0/62605622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1900045a0 con 0x7fb19814fa60 2023-07-21T07:35:46.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.398+0000 7fb19e605700 1 -- 172.21.15.6:0/62605622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb198071e80 con 0x7fb19814fa60 2023-07-21T07:35:46.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.398+0000 7fb194ff9700 1 -- 172.21.15.6:0/62605622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190004950 con 0x7fb19814fa60 2023-07-21T07:35:46.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.398+0000 7fb19e605700 1 -- 172.21.15.6:0/62605622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb198151640 con 0x7fb19814fa60 2023-07-21T07:35:46.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.399+0000 7fb19e605700 1 -- 172.21.15.6:0/62605622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb198074500 con 0x7fb19814fa60 2023-07-21T07:35:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.399+0000 7fb194ff9700 1 -- 172.21.15.6:0/62605622 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb190012430 con 0x7fb19814fa60 2023-07-21T07:35:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.400+0000 7fb194ff9700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb18406ad10 0x7fb18406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.400+0000 7fb194ff9700 1 -- 172.21.15.6:0/62605622 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fb19008acd0 con 0x7fb19814fa60 2023-07-21T07:35:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.400+0000 7fb197fff700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb18406ad10 0x7fb18406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.400+0000 7fb197fff700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb18406ad10 0x7fb18406d1d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb188003fc0 tx=0x7fb188009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.404+0000 7fb194ff9700 1 -- 172.21.15.6:0/62605622 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb190055a30 con 0x7fb19814fa60 2023-07-21T07:35:46.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.603+0000 7fb19e605700 1 -- 172.21.15.6:0/62605622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb19806e520 con 0x7fb19814fa60 2023-07-21T07:35:46.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.605+0000 7fb194ff9700 1 -- 172.21.15.6:0/62605622 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+21972 (secure 0 0 0) 0x7fb190059050 con 0x7fb19814fa60 2023-07-21T07:35:46.657 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:46.657 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":39,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:45.298701+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:35:29.385402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T07:35:29.920618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:35:43.052752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:35:44.270260+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.607+0000 7fb19e605700 1 -- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb18406ad10 msgr2=0x7fb18406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.607+0000 7fb19e605700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb18406ad10 0x7fb18406d1d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb188003fc0 tx=0x7fb188009040 comp rx=0 tx=0).stop 2023-07-21T07:35:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.607+0000 7fb19e605700 1 -- 172.21.15.6:0/62605622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19814fa60 msgr2=0x7fb198151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.607+0000 7fb19e605700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19814fa60 0x7fb198151100 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb190004000 tx=0x7fb190004ad0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.607+0000 7fb19e605700 1 -- 172.21.15.6:0/62605622 shutdown_connections 2023-07-21T07:35:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.607+0000 7fb19e605700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb18406ad10 0x7fb18406d1d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.607+0000 7fb19e605700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19814fa60 0x7fb198151100 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.607+0000 7fb19e605700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb19806b8b0 0x7fb1981ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.607+0000 7fb19e605700 1 --2- 172.21.15.6:0/62605622 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb19806bf00 0x7fb1980bddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.607+0000 7fb19e605700 1 -- 172.21.15.6:0/62605622 >> 172.21.15.6:0/62605622 conn(0x7fb1980a8c90 msgr2=0x7fb19814e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.607+0000 7fb19e605700 1 -- 172.21.15.6:0/62605622 shutdown_connections 2023-07-21T07:35:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.607+0000 7fb19e605700 1 -- 172.21.15.6:0/62605622 wait complete. 2023-07-21T07:35:46.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-07-21T07:35:46.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.748+0000 7fab71150700 1 Processor -- start 2023-07-21T07:35:46.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.748+0000 7fab71150700 1 -- start start 2023-07-21T07:35:46.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.749+0000 7fab71150700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab6c0ba140 0x7fab6c0c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.749+0000 7fab71150700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c155530 con 0x7fab6c06a300 2023-07-21T07:35:46.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.749+0000 7fab71150700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c0c5690 con 0x7fab6c06d8a0 2023-07-21T07:35:46.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.749+0000 7fab71150700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0c1a30 con 0x7fab6c0ba140 2023-07-21T07:35:46.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.749+0000 7fab6ad9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fab6c06a300 0x7fab6c1519b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42666/0 (socket says 172.21.15.6:42666) 2023-07-21T07:35:46.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.749+0000 7fab6ad9d700 1 -- 172.21.15.6:0/3674803709 learned_addr learned my addr 172.21.15.6:0/3674803709 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:46.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.749+0000 7fab6a59c700 1 --2- 172.21.15.6:0/3674803709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab6c0ba140 0x7fab6c0c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.749+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922771043 0 0) 0x7fab6c155530 con 0x7fab6c06a300 2023-07-21T07:35:46.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.749+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab540035b0 con 0x7fab6c06a300 2023-07-21T07:35:46.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.749+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2042798707 0 0) 0x7fab540035b0 con 0x7fab6c06a300 2023-07-21T07:35:46.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.749+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab6c0ba140 msgr2=0x7fab6c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:46.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.749+0000 7fab69d9b700 1 --2- 172.21.15.6:0/3674803709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab6c0ba140 0x7fab6c0c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.749+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 >> v1:172.21.15.86:6789/0 conn(0x7fab6c06d8a0 legacy=0x7fab6c0c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c154920 con 0x7fab6c06a300 2023-07-21T07:35:46.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7fab60001670 con 0x7fab6c06a300 2023-07-21T07:35:46.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 >> v1:172.21.15.6:6789/0 conn(0x7fab6c06a300 legacy=0x7fab6c1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab69d9b700 1 --2- 172.21.15.6:0/3674803709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab6c0ba140 0x7fab54003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab69d9b700 1 --2- 172.21.15.6:0/3674803709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab54003fb0 0x7fab54004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab69d9b700 1 --2- 172.21.15.6:0/3674803709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab54004d90 0x7fab54005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0c1a30 con 0x7fab54004d90 2023-07-21T07:35:46.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5400bba0 con 0x7fab54003fb0 2023-07-21T07:35:46.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5400bd60 con 0x7fab6c0ba140 2023-07-21T07:35:46.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab6ad9d700 1 --2- 172.21.15.6:0/3674803709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab6c0ba140 0x7fab54003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab6b59e700 1 --2- 172.21.15.6:0/3674803709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab54004d90 0x7fab54005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab6a59c700 1 --2- 172.21.15.6:0/3674803709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab54003fb0 0x7fab54004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab6b59e700 1 -- 172.21.15.6:0/3674803709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab6c0ba140 msgr2=0x7fab54003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:46.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab6b59e700 1 --2- 172.21.15.6:0/3674803709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab6c0ba140 0x7fab54003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab6b59e700 1 -- 172.21.15.6:0/3674803709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab54003fb0 msgr2=0x7fab54004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:46.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab6b59e700 1 --2- 172.21.15.6:0/3674803709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab54003fb0 0x7fab54004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab6b59e700 1 -- 172.21.15.6:0/3674803709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540035b0 con 0x7fab54004d90 2023-07-21T07:35:46.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab6b59e700 1 --2- 172.21.15.6:0/3674803709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab54004d90 0x7fab54005210 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fab6400c190 tx=0x7fab54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a988e9ba12af15 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:46.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64001db0 con 0x7fab54004d90 2023-07-21T07:35:46.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6400ccd0 con 0x7fab54004d90 2023-07-21T07:35:46.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.750+0000 7fab69d9b700 1 -- 172.21.15.6:0/3674803709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64003c40 con 0x7fab54004d90 2023-07-21T07:35:46.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.751+0000 7fab71150700 1 -- 172.21.15.6:0/3674803709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab54004d90 msgr2=0x7fab54005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.751+0000 7fab71150700 1 --2- 172.21.15.6:0/3674803709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab54004d90 0x7fab54005210 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fab6400c190 tx=0x7fab54005880 comp rx=0 tx=0).stop 2023-07-21T07:35:46.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.751+0000 7fab6b59e700 1 -- 172.21.15.6:0/3674803709 reap_dead start 2023-07-21T07:35:46.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.751+0000 7fab71150700 1 -- 172.21.15.6:0/3674803709 shutdown_connections 2023-07-21T07:35:46.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.751+0000 7fab71150700 1 -- 172.21.15.6:0/3674803709 >> 172.21.15.6:0/3674803709 conn(0x7fab6c0a8660 msgr2=0x7fab6c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:46.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.751+0000 7fab71150700 1 -- 172.21.15.6:0/3674803709 shutdown_connections 2023-07-21T07:35:46.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.751+0000 7fab71150700 1 -- 172.21.15.6:0/3674803709 wait complete. 2023-07-21T07:35:46.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.752+0000 7fab71150700 1 Processor -- start 2023-07-21T07:35:46.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.753+0000 7fab71150700 1 -- start start 2023-07-21T07:35:46.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.753+0000 7fab71150700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6c071c80 0x7fab6c0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.753+0000 7fab71150700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab6c0b90b0 0x7fab6c157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.753+0000 7fab71150700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab6c157ea0 0x7fab6c152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.753+0000 7fab71150700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c157540 con 0x7fab6c071c80 2023-07-21T07:35:46.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.753+0000 7fab71150700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c1ed820 con 0x7fab6c157ea0 2023-07-21T07:35:46.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.753+0000 7fab71150700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c154650 con 0x7fab6c0b90b0 2023-07-21T07:35:46.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.753+0000 7fab6ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6c071c80 0x7fab6c0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.753+0000 7fab6ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6c071c80 0x7fab6c0b8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34658/0 (socket says 172.21.15.6:34658) 2023-07-21T07:35:46.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.753+0000 7fab6ad9d700 1 -- 172.21.15.6:0/3216083438 learned_addr learned my addr 172.21.15.6:0/3216083438 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:46.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab6b59e700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab6c157ea0 0x7fab6c152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab6a59c700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab6c0b90b0 0x7fab6c157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab6ad9d700 1 -- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab6c0b90b0 msgr2=0x7fab6c157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab6ad9d700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab6c0b90b0 0x7fab6c157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab6ad9d700 1 -- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab6c157ea0 msgr2=0x7fab6c152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:46.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab6ad9d700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab6c157ea0 0x7fab6c152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:46.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab6ad9d700 1 -- 172.21.15.6:0/3216083438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c1eda70 con 0x7fab6c071c80 2023-07-21T07:35:46.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab6b59e700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab6c157ea0 0x7fab6c152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:46.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab6ad9d700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6c071c80 0x7fab6c0b8b70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fab60007290 tx=0x7fab60007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:46.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab537fe700 1 -- 172.21.15.6:0/3216083438 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6000f8d0 con 0x7fab6c071c80 2023-07-21T07:35:46.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab537fe700 1 -- 172.21.15.6:0/3216083438 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6000fa50 con 0x7fab6c071c80 2023-07-21T07:35:46.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab71150700 1 -- 172.21.15.6:0/3216083438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c156e80 con 0x7fab6c071c80 2023-07-21T07:35:46.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab537fe700 1 -- 172.21.15.6:0/3216083438 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6000fe00 con 0x7fab6c071c80 2023-07-21T07:35:46.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.754+0000 7fab71150700 1 -- 172.21.15.6:0/3216083438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c147440 con 0x7fab6c071c80 2023-07-21T07:35:46.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.755+0000 7fab71150700 1 -- 172.21.15.6:0/3216083438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c157680 con 0x7fab6c071c80 2023-07-21T07:35:46.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.755+0000 7fab537fe700 1 -- 172.21.15.6:0/3216083438 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab6001d460 con 0x7fab6c071c80 2023-07-21T07:35:46.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.756+0000 7fab537fe700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab5806ace0 0x7fab5806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:46.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.756+0000 7fab537fe700 1 -- 172.21.15.6:0/3216083438 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fab600898b0 con 0x7fab6c071c80 2023-07-21T07:35:46.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.756+0000 7fab6a59c700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab5806ace0 0x7fab5806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:46.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.757+0000 7fab6a59c700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab5806ace0 0x7fab5806d1a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0bdcc0 tx=0x7fab5c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:46.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:46.760+0000 7fab537fe700 1 -- 172.21.15.6:0/3216083438 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab6c157680 con 0x7fab6c071c80 2023-07-21T07:35:47.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.011+0000 7fab71150700 1 -- 172.21.15.6:0/3216083438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fab6c157680 con 0x7fab6c071c80 2023-07-21T07:35:47.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.892+0000 7fab537fe700 1 -- 172.21.15.6:0/3216083438 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 119+0+0 (secure 0 0 0) 0x7fab6c157680 con 0x7fab6c071c80 2023-07-21T07:35:47.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.894+0000 7fab71150700 1 -- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab5806ace0 msgr2=0x7fab5806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:47.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.894+0000 7fab71150700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab5806ace0 0x7fab5806d1a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0bdcc0 tx=0x7fab5c008040 comp rx=0 tx=0).stop 2023-07-21T07:35:47.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.894+0000 7fab71150700 1 -- 172.21.15.6:0/3216083438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6c071c80 msgr2=0x7fab6c0b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:47.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.894+0000 7fab71150700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6c071c80 0x7fab6c0b8b70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fab60007290 tx=0x7fab60007650 comp rx=0 tx=0).stop 2023-07-21T07:35:47.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.895+0000 7fab71150700 1 -- 172.21.15.6:0/3216083438 shutdown_connections 2023-07-21T07:35:47.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.895+0000 7fab71150700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab5806ace0 0x7fab5806d1a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:47.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.895+0000 7fab71150700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab6c157ea0 0x7fab6c152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:47.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.895+0000 7fab71150700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab6c071c80 0x7fab6c0b8b70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:47.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.895+0000 7fab71150700 1 --2- 172.21.15.6:0/3216083438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab6c0b90b0 0x7fab6c157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:47.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.895+0000 7fab71150700 1 -- 172.21.15.6:0/3216083438 >> 172.21.15.6:0/3216083438 conn(0x7fab6c0a8660 msgr2=0x7fab6c150c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:47.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.895+0000 7fab71150700 1 -- 172.21.15.6:0/3216083438 shutdown_connections 2023-07-21T07:35:47.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:47.895+0000 7fab71150700 1 -- 172.21.15.6:0/3216083438 wait complete. 2023-07-21T07:35:47.961 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T07:35:47.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-07-21T07:35:48.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.045+0000 7fac32271700 1 Processor -- start 2023-07-21T07:35:48.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.045+0000 7fac32271700 1 -- start start 2023-07-21T07:35:48.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.046+0000 7fac32271700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fac2c06ff90 0x7fac2c151e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:48.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.046+0000 7fac32271700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c0664e0 con 0x7fac2c0abc30 2023-07-21T07:35:48.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.046+0000 7fac32271700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c06b760 con 0x7fac2c14ed60 2023-07-21T07:35:48.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.046+0000 7fac32271700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c071ba0 con 0x7fac2c06ff90 2023-07-21T07:35:48.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.046+0000 7fac2bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fac2c0abc30 0x7fac2c14e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42686/0 (socket says 172.21.15.6:42686) 2023-07-21T07:35:48.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.046+0000 7fac2bfff700 1 -- 172.21.15.6:0/3085507415 learned_addr learned my addr 172.21.15.6:0/3085507415 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:48.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.046+0000 7fac3080e700 1 --2- 172.21.15.6:0/3085507415 >> v2:172.21.15.6:3300/0 conn(0x7fac2c06ff90 0x7fac2c151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:48.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac2affd700 1 -- 172.21.15.6:0/3085507415 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261891452 0 0) 0x7fac2c0664e0 con 0x7fac2c0abc30 2023-07-21T07:35:48.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac2affd700 1 -- 172.21.15.6:0/3085507415 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac180035b0 con 0x7fac2c0abc30 2023-07-21T07:35:48.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac3080e700 1 -- 172.21.15.6:0/3085507415 >> v1:172.21.15.86:6789/0 conn(0x7fac2c14ed60 legacy=0x7fac2c151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:48.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac3080e700 1 -- 172.21.15.6:0/3085507415 >> v1:172.21.15.6:6789/0 conn(0x7fac2c0abc30 legacy=0x7fac2c14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:48.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac3080e700 1 -- 172.21.15.6:0/3085507415 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c065f60 con 0x7fac2c06ff90 2023-07-21T07:35:48.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac3080e700 1 --2- 172.21.15.6:0/3085507415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac2c06ff90 0x7fac2c151e30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fac24009d90 tx=0x7fac2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db723352df6a93a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:48.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac2affd700 1 -- 172.21.15.6:0/3085507415 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400e070 con 0x7fac2c06ff90 2023-07-21T07:35:48.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac2affd700 1 -- 172.21.15.6:0/3085507415 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2400bb20 con 0x7fac2c06ff90 2023-07-21T07:35:48.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac2affd700 1 -- 172.21.15.6:0/3085507415 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400be90 con 0x7fac2c06ff90 2023-07-21T07:35:48.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac32271700 1 -- 172.21.15.6:0/3085507415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac2c06ff90 msgr2=0x7fac2c151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:48.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac32271700 1 --2- 172.21.15.6:0/3085507415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac2c06ff90 0x7fac2c151e30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fac24009d90 tx=0x7fac2400b330 comp rx=0 tx=0).stop 2023-07-21T07:35:48.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac32271700 1 -- 172.21.15.6:0/3085507415 shutdown_connections 2023-07-21T07:35:48.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac32271700 1 --2- 172.21.15.6:0/3085507415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac2c06ff90 0x7fac2c151e30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:48.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.047+0000 7fac32271700 1 -- 172.21.15.6:0/3085507415 >> 172.21.15.6:0/3085507415 conn(0x7fac2c0c2c20 msgr2=0x7fac2c0c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:48.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.048+0000 7fac32271700 1 -- 172.21.15.6:0/3085507415 shutdown_connections 2023-07-21T07:35:48.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.048+0000 7fac32271700 1 -- 172.21.15.6:0/3085507415 wait complete. 2023-07-21T07:35:48.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.049+0000 7fac32271700 1 Processor -- start 2023-07-21T07:35:48.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.049+0000 7fac32271700 1 -- start start 2023-07-21T07:35:48.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac32271700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac2c06ff90 0x7fac2c1ea820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:48.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac32271700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac2c0abc30 0x7fac2c1def60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:48.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac32271700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac2c14ed60 0x7fac2c0c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:48.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac32271700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c1ead60 con 0x7fac2c06ff90 2023-07-21T07:35:48.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac32271700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c14ca80 con 0x7fac2c0abc30 2023-07-21T07:35:48.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac32271700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c14c150 con 0x7fac2c14ed60 2023-07-21T07:35:48.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac2bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac2c06ff90 0x7fac2c1ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:48.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac2bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac2c06ff90 0x7fac2c1ea820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34672/0 (socket says 172.21.15.6:34672) 2023-07-21T07:35:48.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac2bfff700 1 -- 172.21.15.6:0/1863510268 learned_addr learned my addr 172.21.15.6:0/1863510268 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:48.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac2bfff700 1 -- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac2c14ed60 msgr2=0x7fac2c0c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:48.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac2b7fe700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac2c0abc30 0x7fac2c1def60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:48.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac3080e700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac2c14ed60 0x7fac2c0c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:48.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac2bfff700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac2c14ed60 0x7fac2c0c1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:48.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac2bfff700 1 -- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac2c0abc30 msgr2=0x7fac2c1def60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:48.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac2bfff700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac2c0abc30 0x7fac2c1def60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:48.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac2bfff700 1 -- 172.21.15.6:0/1863510268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24009a70 con 0x7fac2c06ff90 2023-07-21T07:35:48.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac2bfff700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac2c06ff90 0x7fac2c1ea820 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c700 tx=0x7fac1c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:48.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac28ff9700 1 -- 172.21.15.6:0/1863510268 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c005d70 con 0x7fac2c06ff90 2023-07-21T07:35:48.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac28ff9700 1 -- 172.21.15.6:0/1863510268 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c0070d0 con 0x7fac2c06ff90 2023-07-21T07:35:48.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac32271700 1 -- 172.21.15.6:0/1863510268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c150c60 con 0x7fac2c06ff90 2023-07-21T07:35:48.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.050+0000 7fac28ff9700 1 -- 172.21.15.6:0/1863510268 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c007460 con 0x7fac2c06ff90 2023-07-21T07:35:48.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.051+0000 7fac32271700 1 -- 172.21.15.6:0/1863510268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c14c710 con 0x7fac2c06ff90 2023-07-21T07:35:48.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.051+0000 7fac32271700 1 -- 172.21.15.6:0/1863510268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c151180 con 0x7fac2c06ff90 2023-07-21T07:35:48.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.052+0000 7fac28ff9700 1 -- 172.21.15.6:0/1863510268 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac1c0075c0 con 0x7fac2c06ff90 2023-07-21T07:35:48.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.052+0000 7fac28ff9700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac0c06ace0 0x7fac0c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:48.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.052+0000 7fac28ff9700 1 -- 172.21.15.6:0/1863510268 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fac1c088e90 con 0x7fac2c06ff90 2023-07-21T07:35:48.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.052+0000 7fac2b7fe700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac0c06ace0 0x7fac0c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:48.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.053+0000 7fac2b7fe700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac0c06ace0 0x7fac0c06d1a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac14007fd0 tx=0x7fac14009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:48.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.057+0000 7fac28ff9700 1 -- 172.21.15.6:0/1863510268 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fac1c053b50 con 0x7fac2c06ff90 2023-07-21T07:35:48.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.300+0000 7fac32271700 1 -- 172.21.15.6:0/1863510268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fac2c14c8a0 con 0x7fac2c06ff90 2023-07-21T07:35:48.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.897+0000 7fac28ff9700 1 -- 172.21.15.6:0/1863510268 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7fac1c057170 con 0x7fac2c06ff90 2023-07-21T07:35:48.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.900+0000 7fac32271700 1 -- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac0c06ace0 msgr2=0x7fac0c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:48.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.900+0000 7fac32271700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac0c06ace0 0x7fac0c06d1a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac14007fd0 tx=0x7fac14009040 comp rx=0 tx=0).stop 2023-07-21T07:35:48.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.900+0000 7fac32271700 1 -- 172.21.15.6:0/1863510268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac2c06ff90 msgr2=0x7fac2c1ea820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.900+0000 7fac32271700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac2c06ff90 0x7fac2c1ea820 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c700 tx=0x7fac1c00cac0 comp rx=0 tx=0).stop 2023-07-21T07:35:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.900+0000 7fac32271700 1 -- 172.21.15.6:0/1863510268 shutdown_connections 2023-07-21T07:35:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.900+0000 7fac32271700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fac0c06ace0 0x7fac0c06d1a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.900+0000 7fac32271700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac2c14ed60 0x7fac2c0c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.900+0000 7fac32271700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac2c06ff90 0x7fac2c1ea820 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.900+0000 7fac32271700 1 --2- 172.21.15.6:0/1863510268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac2c0abc30 0x7fac2c1def60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.900+0000 7fac32271700 1 -- 172.21.15.6:0/1863510268 >> 172.21.15.6:0/1863510268 conn(0x7fac2c0c2c20 msgr2=0x7fac2c0a99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.900+0000 7fac32271700 1 -- 172.21.15.6:0/1863510268 shutdown_connections 2023-07-21T07:35:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:48.900+0000 7fac32271700 1 -- 172.21.15.6:0/1863510268 wait complete. 2023-07-21T07:35:48.967 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-07-21T07:35:48.968 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:35:49.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.050+0000 7f60359a0700 1 Processor -- start 2023-07-21T07:35:49.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.050+0000 7f60359a0700 1 -- start start 2023-07-21T07:35:49.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.050+0000 7f60359a0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6030152da0 0x7f603006d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.050+0000 7f60359a0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60300c5790 0x7f60300c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.050+0000 7f60359a0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60300c5300 con 0x7f603014f880 2023-07-21T07:35:49.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.050+0000 7f60359a0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60300c16d0 con 0x7f60300c5790 2023-07-21T07:35:49.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.050+0000 7f60359a0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60301532a0 con 0x7f6030152da0 2023-07-21T07:35:49.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.051+0000 7f602f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60300c5790 0x7f60300c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.051+0000 7f602f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60300c5790 0x7f60300c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34684/0 (socket says 172.21.15.6:34684) 2023-07-21T07:35:49.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.051+0000 7f602f7fe700 1 -- 172.21.15.6:0/1255252832 learned_addr learned my addr 172.21.15.6:0/1255252832 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:49.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.051+0000 7f602e7fc700 1 --2- 172.21.15.6:0/1255252832 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6030152da0 0x7f603006d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.051+0000 7f602f7fe700 1 -- 172.21.15.6:0/1255252832 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6030152da0 msgr2=0x7f603006d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:49.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.051+0000 7f602f7fe700 1 --2- 172.21.15.6:0/1255252832 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6030152da0 0x7f603006d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.051+0000 7f602f7fe700 1 -- 172.21.15.6:0/1255252832 >> v1:172.21.15.86:6789/0 conn(0x7f603014f880 legacy=0x7f603006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.051+0000 7f602f7fe700 1 -- 172.21.15.6:0/1255252832 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60300c49d0 con 0x7f60300c5790 2023-07-21T07:35:49.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.051+0000 7f602e7fc700 1 --2- 172.21.15.6:0/1255252832 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6030152da0 0x7f603006d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:49.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.051+0000 7f602f7fe700 1 --2- 172.21.15.6:0/1255252832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60300c5790 0x7f60300c5c20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6028009e50 tx=0x7f602800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ff69b1f8ee6289 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:49.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.051+0000 7f602dffb700 1 -- 172.21.15.6:0/1255252832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800e070 con 0x7f60300c5790 2023-07-21T07:35:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.051+0000 7f602dffb700 1 -- 172.21.15.6:0/1255252832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602800b9c0 con 0x7f60300c5790 2023-07-21T07:35:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.051+0000 7f602dffb700 1 -- 172.21.15.6:0/1255252832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800bd70 con 0x7f60300c5790 2023-07-21T07:35:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.052+0000 7f60359a0700 1 -- 172.21.15.6:0/1255252832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60300c5790 msgr2=0x7f60300c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.052+0000 7f60359a0700 1 --2- 172.21.15.6:0/1255252832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60300c5790 0x7f60300c5c20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6028009e50 tx=0x7f602800b330 comp rx=0 tx=0).stop 2023-07-21T07:35:49.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.052+0000 7f60359a0700 1 -- 172.21.15.6:0/1255252832 shutdown_connections 2023-07-21T07:35:49.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.052+0000 7f60359a0700 1 --2- 172.21.15.6:0/1255252832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60300c5790 0x7f60300c5c20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.052+0000 7f60359a0700 1 --2- 172.21.15.6:0/1255252832 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6030152da0 0x7f603006d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.052+0000 7f60359a0700 1 -- 172.21.15.6:0/1255252832 >> 172.21.15.6:0/1255252832 conn(0x7f60300a8660 msgr2=0x7f60300a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:49.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.052+0000 7f60359a0700 1 -- 172.21.15.6:0/1255252832 shutdown_connections 2023-07-21T07:35:49.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.052+0000 7f60359a0700 1 -- 172.21.15.6:0/1255252832 wait complete. 2023-07-21T07:35:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.053+0000 7f60359a0700 1 Processor -- start 2023-07-21T07:35:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.053+0000 7f60359a0700 1 -- start start 2023-07-21T07:35:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.054+0000 7f60359a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60300c5790 0x7f603014b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.054+0000 7f60359a0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f603014f880 0x7f6030071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.054+0000 7f60359a0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6030152da0 0x7f60301e7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.054+0000 7f60359a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603014b7f0 con 0x7f60300c5790 2023-07-21T07:35:49.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.054+0000 7f60359a0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60300bfd20 con 0x7f6030152da0 2023-07-21T07:35:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.054+0000 7f60359a0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60300c0000 con 0x7f603014f880 2023-07-21T07:35:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.054+0000 7f602effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60300c5790 0x7f603014b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.054+0000 7f602effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60300c5790 0x7f603014b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34686/0 (socket says 172.21.15.6:34686) 2023-07-21T07:35:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.054+0000 7f602effd700 1 -- 172.21.15.6:0/7590705 learned_addr learned my addr 172.21.15.6:0/7590705 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.054+0000 7f602e7fc700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f603014f880 0x7f6030071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.055+0000 7f602f7fe700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6030152da0 0x7f60301e7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.055+0000 7f602effd700 1 -- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f603014f880 msgr2=0x7f6030071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.055+0000 7f602effd700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f603014f880 0x7f6030071ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.055+0000 7f602effd700 1 -- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6030152da0 msgr2=0x7f60301e7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.055+0000 7f602effd700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6030152da0 0x7f60301e7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.055+0000 7f602effd700 1 -- 172.21.15.6:0/7590705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6028009b30 con 0x7f60300c5790 2023-07-21T07:35:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.055+0000 7f602effd700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60300c5790 0x7f603014b2b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f602000c4e0 tx=0x7f602000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.055+0000 7f6017fff700 1 -- 172.21.15.6:0/7590705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60200052d0 con 0x7f60300c5790 2023-07-21T07:35:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.055+0000 7f6017fff700 1 -- 172.21.15.6:0/7590705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6020005430 con 0x7f60300c5790 2023-07-21T07:35:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.055+0000 7f60359a0700 1 -- 172.21.15.6:0/7590705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60300c02e0 con 0x7f60300c5790 2023-07-21T07:35:49.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.055+0000 7f6017fff700 1 -- 172.21.15.6:0/7590705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60200038c0 con 0x7f60300c5790 2023-07-21T07:35:49.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.055+0000 7f60359a0700 1 -- 172.21.15.6:0/7590705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60300c08a0 con 0x7f60300c5790 2023-07-21T07:35:49.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.056+0000 7f60359a0700 1 -- 172.21.15.6:0/7590705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60301e8930 con 0x7f60300c5790 2023-07-21T07:35:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.057+0000 7f6017fff700 1 -- 172.21.15.6:0/7590705 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6020003a20 con 0x7f60300c5790 2023-07-21T07:35:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.057+0000 7f6017fff700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f601c06ace0 0x7f601c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.057+0000 7f6017fff700 1 -- 172.21.15.6:0/7590705 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f6020088b80 con 0x7f60300c5790 2023-07-21T07:35:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.057+0000 7f602e7fc700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f601c06ace0 0x7f601c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.058+0000 7f602e7fc700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f601c06ace0 0x7f601c06d1a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f603014ddd0 tx=0x7f6024008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.061+0000 7f6017fff700 1 -- 172.21.15.6:0/7590705 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f60301e8930 con 0x7f60300c5790 2023-07-21T07:35:49.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.304+0000 7f60359a0700 1 -- 172.21.15.6:0/7590705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60301e8930 con 0x7f60300c5790 2023-07-21T07:35:49.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.305+0000 7f6017fff700 1 -- 172.21.15.6:0/7590705 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5804 (secure 0 0 0) 0x7f60301e8930 con 0x7f60300c5790 2023-07-21T07:35:49.357 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:49.357 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1808819585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1808819585},{"type":"v1","addr":"172.21.15.6:6834","nonce":1808819585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/422116109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":422116109},{"type":"v1","addr":"172.21.15.86:6836","nonce":422116109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:30.954456+0000","modified":"2023-07-21T07:35:34.571830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/459917011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":459917011},{"type":"v1","addr":"172.21.15.6:6835","nonce":459917011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:45.299013+0000","modified":"2023-07-21T07:35:48.891082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.86:6837/3328348149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3328348149},{"type":"v1","addr":"172.21.15.86:6837","nonce":3328348149}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T07:35:49.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.307+0000 7f60359a0700 1 -- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f601c06ace0 msgr2=0x7f601c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.307+0000 7f60359a0700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f601c06ace0 0x7f601c06d1a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f603014ddd0 tx=0x7f6024008040 comp rx=0 tx=0).stop 2023-07-21T07:35:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.307+0000 7f60359a0700 1 -- 172.21.15.6:0/7590705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60300c5790 msgr2=0x7f603014b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.307+0000 7f60359a0700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60300c5790 0x7f603014b2b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f602000c4e0 tx=0x7f602000c7f0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.307+0000 7f60359a0700 1 -- 172.21.15.6:0/7590705 shutdown_connections 2023-07-21T07:35:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.307+0000 7f60359a0700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f601c06ace0 0x7f601c06d1a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.307+0000 7f60359a0700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6030152da0 0x7f60301e7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.307+0000 7f60359a0700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60300c5790 0x7f603014b2b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.307+0000 7f60359a0700 1 --2- 172.21.15.6:0/7590705 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f603014f880 0x7f6030071ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.307+0000 7f60359a0700 1 -- 172.21.15.6:0/7590705 >> 172.21.15.6:0/7590705 conn(0x7f60300a8660 msgr2=0x7f603006a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:49.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.307+0000 7f60359a0700 1 -- 172.21.15.6:0/7590705 shutdown_connections 2023-07-21T07:35:49.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.307+0000 7f60359a0700 1 -- 172.21.15.6:0/7590705 wait complete. 2023-07-21T07:35:49.361 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 22 2023-07-21T07:35:49.371 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:49.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.443+0000 7f531c2fa700 1 Processor -- start 2023-07-21T07:35:49.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.444+0000 7f531c2fa700 1 -- start start 2023-07-21T07:35:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.444+0000 7f531c2fa700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f531414e870 0x7f531414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.444+0000 7f531c2fa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53140c4930 0x7f5314151330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.444+0000 7f531c2fa700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53140c4ef0 con 0x7f53140a5f00 2023-07-21T07:35:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.444+0000 7f531c2fa700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53140c1df0 con 0x7f53140c4930 2023-07-21T07:35:49.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.444+0000 7f531c2fa700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53140c1450 con 0x7f531414e870 2023-07-21T07:35:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.445+0000 7f531a897700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53140c4930 0x7f5314151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.445+0000 7f531a897700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53140c4930 0x7f5314151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34698/0 (socket says 172.21.15.6:34698) 2023-07-21T07:35:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.445+0000 7f531a897700 1 -- 172.21.15.6:0/430100991 learned_addr learned my addr 172.21.15.6:0/430100991 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.445+0000 7f531a096700 1 --2- 172.21.15.6:0/430100991 >> v2:172.21.15.86:3300/0 conn(0x7f531414e870 0x7f531414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.445+0000 7f531a897700 1 -- 172.21.15.6:0/430100991 >> v2:172.21.15.86:3300/0 conn(0x7f531414e870 msgr2=0x7f531414ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.445+0000 7f531a897700 1 --2- 172.21.15.6:0/430100991 >> v2:172.21.15.86:3300/0 conn(0x7f531414e870 0x7f531414ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.445+0000 7f531a897700 1 -- 172.21.15.6:0/430100991 >> v1:172.21.15.86:6789/0 conn(0x7f53140a5f00 legacy=0x7f53140c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.445+0000 7f531a897700 1 -- 172.21.15.6:0/430100991 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140c1730 con 0x7f53140c4930 2023-07-21T07:35:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.445+0000 7f531a897700 1 --2- 172.21.15.6:0/430100991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140c4930 0x7f5314151330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f53140c3410 tx=0x7f530c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69d291295750ef1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.445+0000 7f5319094700 1 -- 172.21.15.6:0/430100991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c011830 con 0x7f53140c4930 2023-07-21T07:35:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.445+0000 7f5319094700 1 -- 172.21.15.6:0/430100991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c011990 con 0x7f53140c4930 2023-07-21T07:35:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.445+0000 7f5319094700 1 -- 172.21.15.6:0/430100991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c011d20 con 0x7f53140c4930 2023-07-21T07:35:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.446+0000 7f531c2fa700 1 -- 172.21.15.6:0/430100991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140c4930 msgr2=0x7f5314151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.446+0000 7f531c2fa700 1 --2- 172.21.15.6:0/430100991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140c4930 0x7f5314151330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f53140c3410 tx=0x7f530c009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.446+0000 7f531c2fa700 1 -- 172.21.15.6:0/430100991 shutdown_connections 2023-07-21T07:35:49.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.446+0000 7f531c2fa700 1 --2- 172.21.15.6:0/430100991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140c4930 0x7f5314151330 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.446+0000 7f531c2fa700 1 --2- 172.21.15.6:0/430100991 >> v2:172.21.15.86:3300/0 conn(0x7f531414e870 0x7f531414ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.446+0000 7f531c2fa700 1 -- 172.21.15.6:0/430100991 >> 172.21.15.6:0/430100991 conn(0x7f53140a8660 msgr2=0x7f53140a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:49.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.446+0000 7f531c2fa700 1 -- 172.21.15.6:0/430100991 shutdown_connections 2023-07-21T07:35:49.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.446+0000 7f531c2fa700 1 -- 172.21.15.6:0/430100991 wait complete. 2023-07-21T07:35:49.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.447+0000 7f531c2fa700 1 Processor -- start 2023-07-21T07:35:49.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.447+0000 7f531c2fa700 1 -- start start 2023-07-21T07:35:49.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531c2fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140a5f00 0x7f53141d8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531c2fa700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53140c4930 0x7f531406d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531c2fa700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f531414e870 0x7f5314148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531c2fa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53140ab720 con 0x7f53140a5f00 2023-07-21T07:35:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531c2fa700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53140aba00 con 0x7f531414e870 2023-07-21T07:35:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531c2fa700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53140abce0 con 0x7f53140c4930 2023-07-21T07:35:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531a096700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140a5f00 0x7f53141d8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531a096700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140a5f00 0x7f53141d8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34700/0 (socket says 172.21.15.6:34700) 2023-07-21T07:35:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531a096700 1 -- 172.21.15.6:0/2416676669 learned_addr learned my addr 172.21.15.6:0/2416676669 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531a096700 1 -- 172.21.15.6:0/2416676669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53140c4930 msgr2=0x7f531406d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531a096700 1 --2- 172.21.15.6:0/2416676669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53140c4930 0x7f531406d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531a096700 1 -- 172.21.15.6:0/2416676669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f531414e870 msgr2=0x7f5314148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531a096700 1 --2- 172.21.15.6:0/2416676669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f531414e870 0x7f5314148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531a096700 1 -- 172.21.15.6:0/2416676669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c009550 con 0x7f53140a5f00 2023-07-21T07:35:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531a096700 1 --2- 172.21.15.6:0/2416676669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140a5f00 0x7f53141d8f50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f530400efc0 tx=0x7f530400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f5312ffd700 1 -- 172.21.15.6:0/2416676669 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530400cdc0 con 0x7f53140a5f00 2023-07-21T07:35:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f5312ffd700 1 -- 172.21.15.6:0/2416676669 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530400f040 con 0x7f53140a5f00 2023-07-21T07:35:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f531c2fa700 1 -- 172.21.15.6:0/2416676669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53140abfc0 con 0x7f53140a5f00 2023-07-21T07:35:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.448+0000 7f5312ffd700 1 -- 172.21.15.6:0/2416676669 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53040146a0 con 0x7f53140a5f00 2023-07-21T07:35:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.449+0000 7f531c2fa700 1 -- 172.21.15.6:0/2416676669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531406de30 con 0x7f53140a5f00 2023-07-21T07:35:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.449+0000 7f531c2fa700 1 -- 172.21.15.6:0/2416676669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5314074500 con 0x7f53140a5f00 2023-07-21T07:35:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.450+0000 7f5312ffd700 1 -- 172.21.15.6:0/2416676669 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5304014800 con 0x7f53140a5f00 2023-07-21T07:35:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.450+0000 7f5312ffd700 1 --2- 172.21.15.6:0/2416676669 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530006ace0 0x7f530006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.450+0000 7f5312ffd700 1 -- 172.21.15.6:0/2416676669 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f530408a4e0 con 0x7f53140a5f00 2023-07-21T07:35:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.451+0000 7f5319895700 1 --2- 172.21.15.6:0/2416676669 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530006ace0 0x7f530006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.451+0000 7f5319895700 1 --2- 172.21.15.6:0/2416676669 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530006ace0 0x7f530006d1a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5308000f60 tx=0x7f5308007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:49.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.455+0000 7f5312ffd700 1 -- 172.21.15.6:0/2416676669 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5304055230 con 0x7f53140a5f00 2023-07-21T07:35:49.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.655+0000 7f531c2fa700 1 -- 172.21.15.6:0/2416676669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53140a8ae0 con 0x7f53140a5f00 2023-07-21T07:35:49.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.657+0000 7f5312ffd700 1 -- 172.21.15.6:0/2416676669 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+21959 (secure 0 0 0) 0x7f5304058850 con 0x7f53140a5f00 2023-07-21T07:35:49.710 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:49.710 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:46.879421+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:35:29.385402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T07:35:29.920618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:35:43.052752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:35:44.270260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:49.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.659+0000 7f531c2fa700 1 -- 172.21.15.6:0/2416676669 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530006ace0 msgr2=0x7f530006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.659+0000 7f531c2fa700 1 --2- 172.21.15.6:0/2416676669 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530006ace0 0x7f530006d1a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5308000f60 tx=0x7f5308007a40 comp rx=0 tx=0).stop 2023-07-21T07:35:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.659+0000 7f531c2fa700 1 -- 172.21.15.6:0/2416676669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140a5f00 msgr2=0x7f53141d8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.659+0000 7f531c2fa700 1 --2- 172.21.15.6:0/2416676669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140a5f00 0x7f53141d8f50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f530400efc0 tx=0x7f530400c3a0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.659+0000 7f531c2fa700 1 -- 172.21.15.6:0/2416676669 shutdown_connections 2023-07-21T07:35:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.659+0000 7f531c2fa700 1 --2- 172.21.15.6:0/2416676669 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530006ace0 0x7f530006d1a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.659+0000 7f531c2fa700 1 --2- 172.21.15.6:0/2416676669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f531414e870 0x7f5314148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.659+0000 7f531c2fa700 1 --2- 172.21.15.6:0/2416676669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53140a5f00 0x7f53141d8f50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.659+0000 7f531c2fa700 1 --2- 172.21.15.6:0/2416676669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53140c4930 0x7f531406d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.659+0000 7f531c2fa700 1 -- 172.21.15.6:0/2416676669 >> 172.21.15.6:0/2416676669 conn(0x7f53140a8660 msgr2=0x7f53140c3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.659+0000 7f531c2fa700 1 -- 172.21.15.6:0/2416676669 shutdown_connections 2023-07-21T07:35:49.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.659+0000 7f531c2fa700 1 -- 172.21.15.6:0/2416676669 wait complete. 2023-07-21T07:35:49.723 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T07:35:49.724 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:35:49.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.797+0000 7f8a648d1700 1 Processor -- start 2023-07-21T07:35:49.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.797+0000 7f8a648d1700 1 -- start start 2023-07-21T07:35:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.798+0000 7f8a648d1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a600abdb0 0x7f8a600aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.798+0000 7f8a648d1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8a60066210 0x7f8a600aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.798+0000 7f8a648d1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a600c6cc0 con 0x7f8a6014fa10 2023-07-21T07:35:49.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.798+0000 7f8a648d1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a60152df0 con 0x7f8a600abdb0 2023-07-21T07:35:49.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.798+0000 7f8a648d1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a601530d0 con 0x7f8a60066210 2023-07-21T07:35:49.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.798+0000 7f8a5dd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a600abdb0 0x7f8a600aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.798+0000 7f8a5dd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a600abdb0 0x7f8a600aa9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34708/0 (socket says 172.21.15.6:34708) 2023-07-21T07:35:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.798+0000 7f8a5dd9b700 1 -- 172.21.15.6:0/2358448943 learned_addr learned my addr 172.21.15.6:0/2358448943 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.798+0000 7f8a5ed9d700 1 --2- 172.21.15.6:0/2358448943 >> v2:172.21.15.86:3300/0 conn(0x7f8a60066210 0x7f8a600aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.798+0000 7f8a5dd9b700 1 -- 172.21.15.6:0/2358448943 >> v2:172.21.15.86:3300/0 conn(0x7f8a60066210 msgr2=0x7f8a600aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.798+0000 7f8a5dd9b700 1 --2- 172.21.15.6:0/2358448943 >> v2:172.21.15.86:3300/0 conn(0x7f8a60066210 0x7f8a600aaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.799+0000 7f8a5dd9b700 1 -- 172.21.15.6:0/2358448943 >> v1:172.21.15.86:6789/0 conn(0x7f8a6014fa10 legacy=0x7f8a6006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.799+0000 7f8a5dd9b700 1 -- 172.21.15.6:0/2358448943 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a600c6f10 con 0x7f8a600abdb0 2023-07-21T07:35:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.799+0000 7f8a5dd9b700 1 --2- 172.21.15.6:0/2358448943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a600abdb0 0x7f8a600aa9d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8a6006fd90 tx=0x7f8a54009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e1a4385e43c293 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.799+0000 7f8a5d59a700 1 -- 172.21.15.6:0/2358448943 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54011830 con 0x7f8a600abdb0 2023-07-21T07:35:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.799+0000 7f8a5d59a700 1 -- 172.21.15.6:0/2358448943 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a54011990 con 0x7f8a600abdb0 2023-07-21T07:35:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.799+0000 7f8a5d59a700 1 -- 172.21.15.6:0/2358448943 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54011d20 con 0x7f8a600abdb0 2023-07-21T07:35:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.799+0000 7f8a648d1700 1 -- 172.21.15.6:0/2358448943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a600abdb0 msgr2=0x7f8a600aa9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.799+0000 7f8a648d1700 1 --2- 172.21.15.6:0/2358448943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a600abdb0 0x7f8a600aa9d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8a6006fd90 tx=0x7f8a54009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.799+0000 7f8a648d1700 1 -- 172.21.15.6:0/2358448943 shutdown_connections 2023-07-21T07:35:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.799+0000 7f8a648d1700 1 --2- 172.21.15.6:0/2358448943 >> v2:172.21.15.86:3300/0 conn(0x7f8a60066210 0x7f8a600aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.799+0000 7f8a648d1700 1 --2- 172.21.15.6:0/2358448943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a600abdb0 0x7f8a600aa9d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.799+0000 7f8a648d1700 1 -- 172.21.15.6:0/2358448943 >> 172.21.15.6:0/2358448943 conn(0x7f8a600c6140 msgr2=0x7f8a600c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.800+0000 7f8a648d1700 1 -- 172.21.15.6:0/2358448943 shutdown_connections 2023-07-21T07:35:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.800+0000 7f8a648d1700 1 -- 172.21.15.6:0/2358448943 wait complete. 2023-07-21T07:35:49.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.801+0000 7f8a648d1700 1 Processor -- start 2023-07-21T07:35:49.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.801+0000 7f8a648d1700 1 -- start start 2023-07-21T07:35:49.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.802+0000 7f8a648d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a60066210 0x7f8a601eb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.802+0000 7f8a648d1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a600abdb0 0x7f8a601e8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.802+0000 7f8a648d1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a6014fa10 0x7f8a6006a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.802+0000 7f8a648d1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a601ebea0 con 0x7f8a60066210 2023-07-21T07:35:49.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.802+0000 7f8a648d1700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6014e980 con 0x7f8a600abdb0 2023-07-21T07:35:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.802+0000 7f8a648d1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a601e7c70 con 0x7f8a6014fa10 2023-07-21T07:35:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.802+0000 7f8a5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a60066210 0x7f8a601eb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.802+0000 7f8a5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a60066210 0x7f8a601eb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34710/0 (socket says 172.21.15.6:34710) 2023-07-21T07:35:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.802+0000 7f8a5e59c700 1 -- 172.21.15.6:0/4080213204 learned_addr learned my addr 172.21.15.6:0/4080213204 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.802+0000 7f8a5dd9b700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a600abdb0 0x7f8a601e8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.802+0000 7f8a5ed9d700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a6014fa10 0x7f8a6006a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.803+0000 7f8a5e59c700 1 -- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a6014fa10 msgr2=0x7f8a6006a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.803+0000 7f8a5e59c700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a6014fa10 0x7f8a6006a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.803+0000 7f8a5e59c700 1 -- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a600abdb0 msgr2=0x7f8a601e8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.803+0000 7f8a5e59c700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a600abdb0 0x7f8a601e8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.803+0000 7f8a5e59c700 1 -- 172.21.15.6:0/4080213204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a54009550 con 0x7f8a60066210 2023-07-21T07:35:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.803+0000 7f8a5e59c700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a60066210 0x7f8a601eb960 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000c450 tx=0x7f8a5000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.803+0000 7f8a4effd700 1 -- 172.21.15.6:0/4080213204 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a500050d0 con 0x7f8a60066210 2023-07-21T07:35:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.803+0000 7f8a4effd700 1 -- 172.21.15.6:0/4080213204 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a50005230 con 0x7f8a60066210 2023-07-21T07:35:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.803+0000 7f8a648d1700 1 -- 172.21.15.6:0/4080213204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a601e7960 con 0x7f8a60066210 2023-07-21T07:35:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.803+0000 7f8a4effd700 1 -- 172.21.15.6:0/4080213204 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50003680 con 0x7f8a60066210 2023-07-21T07:35:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.803+0000 7f8a648d1700 1 -- 172.21.15.6:0/4080213204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a600c5a60 con 0x7f8a60066210 2023-07-21T07:35:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.804+0000 7f8a648d1700 1 -- 172.21.15.6:0/4080213204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a600c3d10 con 0x7f8a60066210 2023-07-21T07:35:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.805+0000 7f8a4effd700 1 -- 172.21.15.6:0/4080213204 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8a500037e0 con 0x7f8a60066210 2023-07-21T07:35:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.805+0000 7f8a4effd700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8a4006ace0 0x7f8a4006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.805+0000 7f8a4effd700 1 -- 172.21.15.6:0/4080213204 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f8a50088aa0 con 0x7f8a60066210 2023-07-21T07:35:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.805+0000 7f8a5dd9b700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8a4006ace0 0x7f8a4006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.806+0000 7f8a5dd9b700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8a4006ace0 0x7f8a4006d1a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8a600ac220 tx=0x7f8a54008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:49.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:49.809+0000 7f8a4effd700 1 -- 172.21.15.6:0/4080213204 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8a500537f0 con 0x7f8a60066210 2023-07-21T07:35:50.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.003+0000 7f8a648d1700 1 -- 172.21.15.6:0/4080213204 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a6006a7a0 con 0x7f8a4006ace0 2023-07-21T07:35:50.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.019+0000 7f8a4effd700 1 -- 172.21.15.6:0/4080213204 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+549637 (secure 0 0 0) 0x7f8a54011b80 con 0x7f8a4006ace0 2023-07-21T07:35:50.076 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.023+0000 7f8a648d1700 1 -- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8a4006ace0 msgr2=0x7f8a4006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.023+0000 7f8a648d1700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8a4006ace0 0x7f8a4006d1a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8a600ac220 tx=0x7f8a54008030 comp rx=0 tx=0).stop 2023-07-21T07:35:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.023+0000 7f8a648d1700 1 -- 172.21.15.6:0/4080213204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a60066210 msgr2=0x7f8a601eb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.023+0000 7f8a648d1700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a60066210 0x7f8a601eb960 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000c450 tx=0x7f8a5000c760 comp rx=0 tx=0).stop 2023-07-21T07:35:50.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.023+0000 7f8a648d1700 1 -- 172.21.15.6:0/4080213204 shutdown_connections 2023-07-21T07:35:50.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.023+0000 7f8a648d1700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8a4006ace0 0x7f8a4006d1a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.023+0000 7f8a648d1700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a6014fa10 0x7f8a6006a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.023+0000 7f8a648d1700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a60066210 0x7f8a601eb960 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.023+0000 7f8a648d1700 1 --2- 172.21.15.6:0/4080213204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a600abdb0 0x7f8a601e8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.023+0000 7f8a648d1700 1 -- 172.21.15.6:0/4080213204 >> 172.21.15.6:0/4080213204 conn(0x7f8a600c6140 msgr2=0x7f8a6014db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:50.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.023+0000 7f8a648d1700 1 -- 172.21.15.6:0/4080213204 shutdown_connections 2023-07-21T07:35:50.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.023+0000 7f8a648d1700 1 -- 172.21.15.6:0/4080213204 wait complete. 2023-07-21T07:35:50.081 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:35:50.087 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-07-21T07:35:48.708619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596599,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":353,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221020,"kb_used_data":4848,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753700,"statfs":{"total":773094113280,"available":772867788800,"internally_reserved":0,"allocated":4964352,"data_stored":2762066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.844894"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062275+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:35:47.062275+0000","last_peered":"2023-07-21T07:35:47.062275+0000","last_clean":"2023-07-21T07:35:47.062275+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:35:47.062275+0000","last_undegraded":"2023-07-21T07:35:47.062275+0000","last_fullsized":"2023-07-21T07:35:47.062275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:05:01.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887753+0000","last_change":"2023-07-21T07:35:30.551889+0000","last_active":"2023-07-21T07:35:46.887753+0000","last_peered":"2023-07-21T07:35:46.887753+0000","last_clean":"2023-07-21T07:35:46.887753+0000","last_became_active":"2023-07-21T07:35:30.551571+0000","last_became_peered":"2023-07-21T07:35:30.551571+0000","last_unstale":"2023-07-21T07:35:46.887753+0000","last_undegraded":"2023-07-21T07:35:46.887753+0000","last_fullsized":"2023-07-21T07:35:46.887753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:53:00.448841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062174+0000","last_change":"2023-07-21T07:35:31.576679+0000","last_active":"2023-07-21T07:35:47.062174+0000","last_peered":"2023-07-21T07:35:47.062174+0000","last_clean":"2023-07-21T07:35:47.062174+0000","last_became_active":"2023-07-21T07:35:31.576259+0000","last_became_peered":"2023-07-21T07:35:31.576259+0000","last_unstale":"2023-07-21T07:35:47.062174+0000","last_undegraded":"2023-07-21T07:35:47.062174+0000","last_fullsized":"2023-07-21T07:35:47.062174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:57.037209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887801+0000","last_change":"2023-07-21T07:35:44.894401+0000","last_active":"2023-07-21T07:35:46.887801+0000","last_peered":"2023-07-21T07:35:46.887801+0000","last_clean":"2023-07-21T07:35:46.887801+0000","last_became_active":"2023-07-21T07:35:44.894037+0000","last_became_peered":"2023-07-21T07:35:44.894037+0000","last_unstale":"2023-07-21T07:35:46.887801+0000","last_undegraded":"2023-07-21T07:35:46.887801+0000","last_fullsized":"2023-07-21T07:35:46.887801+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:22:39.013378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061948+0000","last_change":"2023-07-21T07:35:45.900270+0000","last_active":"2023-07-21T07:35:47.061948+0000","last_peered":"2023-07-21T07:35:47.061948+0000","last_clean":"2023-07-21T07:35:47.061948+0000","last_became_active":"2023-07-21T07:35:45.900019+0000","last_became_peered":"2023-07-21T07:35:45.900019+0000","last_unstale":"2023-07-21T07:35:47.061948+0000","last_undegraded":"2023-07-21T07:35:47.061948+0000","last_fullsized":"2023-07-21T07:35:47.061948+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:16:00.601675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888778+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:35:46.888778+0000","last_peered":"2023-07-21T07:35:46.888778+0000","last_clean":"2023-07-21T07:35:46.888778+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:35:46.888778+0000","last_undegraded":"2023-07-21T07:35:46.888778+0000","last_fullsized":"2023-07-21T07:35:46.888778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:04:51.973941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887524+0000","last_change":"2023-07-21T07:35:30.551446+0000","last_active":"2023-07-21T07:35:46.887524+0000","last_peered":"2023-07-21T07:35:46.887524+0000","last_clean":"2023-07-21T07:35:46.887524+0000","last_became_active":"2023-07-21T07:35:30.551160+0000","last_became_peered":"2023-07-21T07:35:30.551160+0000","last_unstale":"2023-07-21T07:35:46.887524+0000","last_undegraded":"2023-07-21T07:35:46.887524+0000","last_fullsized":"2023-07-21T07:35:46.887524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:55:22.308198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887758+0000","last_change":"2023-07-21T07:35:31.583748+0000","last_active":"2023-07-21T07:35:46.887758+0000","last_peered":"2023-07-21T07:35:46.887758+0000","last_clean":"2023-07-21T07:35:46.887758+0000","last_became_active":"2023-07-21T07:35:31.583463+0000","last_became_peered":"2023-07-21T07:35:31.583463+0000","last_unstale":"2023-07-21T07:35:46.887758+0000","last_undegraded":"2023-07-21T07:35:46.887758+0000","last_fullsized":"2023-07-21T07:35:46.887758+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:17:03.048087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888948+0000","last_change":"2023-07-21T07:35:44.895009+0000","last_active":"2023-07-21T07:35:46.888948+0000","last_peered":"2023-07-21T07:35:46.888948+0000","last_clean":"2023-07-21T07:35:46.888948+0000","last_became_active":"2023-07-21T07:35:44.894739+0000","last_became_peered":"2023-07-21T07:35:44.894739+0000","last_unstale":"2023-07-21T07:35:46.888948+0000","last_undegraded":"2023-07-21T07:35:46.888948+0000","last_fullsized":"2023-07-21T07:35:46.888948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:17:16.377122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974708+0000","last_change":"2023-07-21T07:35:45.904299+0000","last_active":"2023-07-21T07:35:46.974708+0000","last_peered":"2023-07-21T07:35:46.974708+0000","last_clean":"2023-07-21T07:35:46.974708+0000","last_became_active":"2023-07-21T07:35:45.903851+0000","last_became_peered":"2023-07-21T07:35:45.903851+0000","last_unstale":"2023-07-21T07:35:46.974708+0000","last_undegraded":"2023-07-21T07:35:46.974708+0000","last_fullsized":"2023-07-21T07:35:46.974708+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:26:40.433463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063445+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:35:47.063445+0000","last_peered":"2023-07-21T07:35:47.063445+0000","last_clean":"2023-07-21T07:35:47.063445+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:35:47.063445+0000","last_undegraded":"2023-07-21T07:35:47.063445+0000","last_fullsized":"2023-07-21T07:35:47.063445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:16:22.088494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060912+0000","last_change":"2023-07-21T07:35:30.546891+0000","last_active":"2023-07-21T07:35:47.060912+0000","last_peered":"2023-07-21T07:35:47.060912+0000","last_clean":"2023-07-21T07:35:47.060912+0000","last_became_active":"2023-07-21T07:35:30.546607+0000","last_became_peered":"2023-07-21T07:35:30.546607+0000","last_unstale":"2023-07-21T07:35:47.060912+0000","last_undegraded":"2023-07-21T07:35:47.060912+0000","last_fullsized":"2023-07-21T07:35:47.060912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:38:02.868880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886333+0000","last_change":"2023-07-21T07:35:31.576629+0000","last_active":"2023-07-21T07:35:46.886333+0000","last_peered":"2023-07-21T07:35:46.886333+0000","last_clean":"2023-07-21T07:35:46.886333+0000","last_became_active":"2023-07-21T07:35:31.575947+0000","last_became_peered":"2023-07-21T07:35:31.575947+0000","last_unstale":"2023-07-21T07:35:46.886333+0000","last_undegraded":"2023-07-21T07:35:46.886333+0000","last_fullsized":"2023-07-21T07:35:46.886333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:10:54.792526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060975+0000","last_change":"2023-07-21T07:35:44.886385+0000","last_active":"2023-07-21T07:35:47.060975+0000","last_peered":"2023-07-21T07:35:47.060975+0000","last_clean":"2023-07-21T07:35:47.060975+0000","last_became_active":"2023-07-21T07:35:44.886117+0000","last_became_peered":"2023-07-21T07:35:44.886117+0000","last_unstale":"2023-07-21T07:35:47.060975+0000","last_undegraded":"2023-07-21T07:35:47.060975+0000","last_fullsized":"2023-07-21T07:35:47.060975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:13:38.964946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889743+0000","last_change":"2023-07-21T07:35:45.894535+0000","last_active":"2023-07-21T07:35:46.889743+0000","last_peered":"2023-07-21T07:35:46.889743+0000","last_clean":"2023-07-21T07:35:46.889743+0000","last_became_active":"2023-07-21T07:35:45.894161+0000","last_became_peered":"2023-07-21T07:35:45.894161+0000","last_unstale":"2023-07-21T07:35:46.889743+0000","last_undegraded":"2023-07-21T07:35:46.889743+0000","last_fullsized":"2023-07-21T07:35:46.889743+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:18:59.929550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061320+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:35:47.061320+0000","last_peered":"2023-07-21T07:35:47.061320+0000","last_clean":"2023-07-21T07:35:47.061320+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:35:47.061320+0000","last_undegraded":"2023-07-21T07:35:47.061320+0000","last_fullsized":"2023-07-21T07:35:47.061320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:29:16.833300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062854+0000","last_change":"2023-07-21T07:35:30.552592+0000","last_active":"2023-07-21T07:35:47.062854+0000","last_peered":"2023-07-21T07:35:47.062854+0000","last_clean":"2023-07-21T07:35:47.062854+0000","last_became_active":"2023-07-21T07:35:30.552218+0000","last_became_peered":"2023-07-21T07:35:30.552218+0000","last_unstale":"2023-07-21T07:35:47.062854+0000","last_undegraded":"2023-07-21T07:35:47.062854+0000","last_fullsized":"2023-07-21T07:35:47.062854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:27:42.026971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886630+0000","last_change":"2023-07-21T07:35:31.572728+0000","last_active":"2023-07-21T07:35:46.886630+0000","last_peered":"2023-07-21T07:35:46.886630+0000","last_clean":"2023-07-21T07:35:46.886630+0000","last_became_active":"2023-07-21T07:35:31.572409+0000","last_became_peered":"2023-07-21T07:35:31.572409+0000","last_unstale":"2023-07-21T07:35:46.886630+0000","last_undegraded":"2023-07-21T07:35:46.886630+0000","last_fullsized":"2023-07-21T07:35:46.886630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:05:51.429848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063718+0000","last_change":"2023-07-21T07:35:44.887959+0000","last_active":"2023-07-21T07:35:47.063718+0000","last_peered":"2023-07-21T07:35:47.063718+0000","last_clean":"2023-07-21T07:35:47.063718+0000","last_became_active":"2023-07-21T07:35:44.887713+0000","last_became_peered":"2023-07-21T07:35:44.887713+0000","last_unstale":"2023-07-21T07:35:47.063718+0000","last_undegraded":"2023-07-21T07:35:47.063718+0000","last_fullsized":"2023-07-21T07:35:47.063718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:14:26.106085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886706+0000","last_change":"2023-07-21T07:35:45.880694+0000","last_active":"2023-07-21T07:35:46.886706+0000","last_peered":"2023-07-21T07:35:46.886706+0000","last_clean":"2023-07-21T07:35:46.886706+0000","last_became_active":"2023-07-21T07:35:45.880285+0000","last_became_peered":"2023-07-21T07:35:45.880285+0000","last_unstale":"2023-07-21T07:35:46.886706+0000","last_undegraded":"2023-07-21T07:35:46.886706+0000","last_fullsized":"2023-07-21T07:35:46.886706+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:31:32.294242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061458+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:35:47.061458+0000","last_peered":"2023-07-21T07:35:47.061458+0000","last_clean":"2023-07-21T07:35:47.061458+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:35:47.061458+0000","last_undegraded":"2023-07-21T07:35:47.061458+0000","last_fullsized":"2023-07-21T07:35:47.061458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:42:30.722039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061613+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:35:47.061613+0000","last_peered":"2023-07-21T07:35:47.061613+0000","last_clean":"2023-07-21T07:35:47.061613+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:35:47.061613+0000","last_undegraded":"2023-07-21T07:35:47.061613+0000","last_fullsized":"2023-07-21T07:35:47.061613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:14:29.787995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063125+0000","last_change":"2023-07-21T07:35:30.553624+0000","last_active":"2023-07-21T07:35:47.063125+0000","last_peered":"2023-07-21T07:35:47.063125+0000","last_clean":"2023-07-21T07:35:47.063125+0000","last_became_active":"2023-07-21T07:35:30.553307+0000","last_became_peered":"2023-07-21T07:35:30.553307+0000","last_unstale":"2023-07-21T07:35:47.063125+0000","last_undegraded":"2023-07-21T07:35:47.063125+0000","last_fullsized":"2023-07-21T07:35:47.063125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:59:50.497869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063163+0000","last_change":"2023-07-21T07:35:31.583146+0000","last_active":"2023-07-21T07:35:47.063163+0000","last_peered":"2023-07-21T07:35:47.063163+0000","last_clean":"2023-07-21T07:35:47.063163+0000","last_became_active":"2023-07-21T07:35:31.582823+0000","last_became_peered":"2023-07-21T07:35:31.582823+0000","last_unstale":"2023-07-21T07:35:47.063163+0000","last_undegraded":"2023-07-21T07:35:47.063163+0000","last_fullsized":"2023-07-21T07:35:47.063163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:36:54.377741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974940+0000","last_change":"2023-07-21T07:35:44.894719+0000","last_active":"2023-07-21T07:35:46.974940+0000","last_peered":"2023-07-21T07:35:46.974940+0000","last_clean":"2023-07-21T07:35:46.974940+0000","last_became_active":"2023-07-21T07:35:44.894382+0000","last_became_peered":"2023-07-21T07:35:44.894382+0000","last_unstale":"2023-07-21T07:35:46.974940+0000","last_undegraded":"2023-07-21T07:35:46.974940+0000","last_fullsized":"2023-07-21T07:35:46.974940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:35:21.303182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062713+0000","last_change":"2023-07-21T07:35:45.892460+0000","last_active":"2023-07-21T07:35:47.062713+0000","last_peered":"2023-07-21T07:35:47.062713+0000","last_clean":"2023-07-21T07:35:47.062713+0000","last_became_active":"2023-07-21T07:35:45.892167+0000","last_became_peered":"2023-07-21T07:35:45.892167+0000","last_unstale":"2023-07-21T07:35:47.062713+0000","last_undegraded":"2023-07-21T07:35:47.062713+0000","last_fullsized":"2023-07-21T07:35:47.062713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:43:07.218894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.059909+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:35:47.059909+0000","last_peered":"2023-07-21T07:35:47.059909+0000","last_clean":"2023-07-21T07:35:47.059909+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:35:47.059909+0000","last_undegraded":"2023-07-21T07:35:47.059909+0000","last_fullsized":"2023-07-21T07:35:47.059909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:53:49.621314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"36'1","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060528+0000","last_change":"2023-07-21T07:35:30.549185+0000","last_active":"2023-07-21T07:35:47.060528+0000","last_peered":"2023-07-21T07:35:47.060528+0000","last_clean":"2023-07-21T07:35:47.060528+0000","last_became_active":"2023-07-21T07:35:30.548890+0000","last_became_peered":"2023-07-21T07:35:30.548890+0000","last_unstale":"2023-07-21T07:35:47.060528+0000","last_undegraded":"2023-07-21T07:35:47.060528+0000","last_fullsized":"2023-07-21T07:35:47.060528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:38:02.868880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063556+0000","last_change":"2023-07-21T07:35:31.576484+0000","last_active":"2023-07-21T07:35:47.063556+0000","last_peered":"2023-07-21T07:35:47.063556+0000","last_clean":"2023-07-21T07:35:47.063556+0000","last_became_active":"2023-07-21T07:35:31.576171+0000","last_became_peered":"2023-07-21T07:35:31.576171+0000","last_unstale":"2023-07-21T07:35:47.063556+0000","last_undegraded":"2023-07-21T07:35:47.063556+0000","last_fullsized":"2023-07-21T07:35:47.063556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:11.583188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974764+0000","last_change":"2023-07-21T07:35:44.894482+0000","last_active":"2023-07-21T07:35:46.974764+0000","last_peered":"2023-07-21T07:35:46.974764+0000","last_clean":"2023-07-21T07:35:46.974764+0000","last_became_active":"2023-07-21T07:35:44.894136+0000","last_became_peered":"2023-07-21T07:35:44.894136+0000","last_unstale":"2023-07-21T07:35:46.974764+0000","last_undegraded":"2023-07-21T07:35:46.974764+0000","last_fullsized":"2023-07-21T07:35:46.974764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:53:14.782892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889064+0000","last_change":"2023-07-21T07:35:45.895309+0000","last_active":"2023-07-21T07:35:46.889064+0000","last_peered":"2023-07-21T07:35:46.889064+0000","last_clean":"2023-07-21T07:35:46.889064+0000","last_became_active":"2023-07-21T07:35:45.895021+0000","last_became_peered":"2023-07-21T07:35:45.895021+0000","last_unstale":"2023-07-21T07:35:46.889064+0000","last_undegraded":"2023-07-21T07:35:46.889064+0000","last_fullsized":"2023-07-21T07:35:46.889064+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:30:24.768875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062289+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:35:47.062289+0000","last_peered":"2023-07-21T07:35:47.062289+0000","last_clean":"2023-07-21T07:35:47.062289+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:35:47.062289+0000","last_undegraded":"2023-07-21T07:35:47.062289+0000","last_fullsized":"2023-07-21T07:35:47.062289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:13:16.088058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974837+0000","last_change":"2023-07-21T07:35:30.552526+0000","last_active":"2023-07-21T07:35:46.974837+0000","last_peered":"2023-07-21T07:35:46.974837+0000","last_clean":"2023-07-21T07:35:46.974837+0000","last_became_active":"2023-07-21T07:35:30.552173+0000","last_became_peered":"2023-07-21T07:35:30.552173+0000","last_unstale":"2023-07-21T07:35:46.974837+0000","last_undegraded":"2023-07-21T07:35:46.974837+0000","last_fullsized":"2023-07-21T07:35:46.974837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:06:08.427835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888101+0000","last_change":"2023-07-21T07:35:31.581657+0000","last_active":"2023-07-21T07:35:46.888101+0000","last_peered":"2023-07-21T07:35:46.888101+0000","last_clean":"2023-07-21T07:35:46.888101+0000","last_became_active":"2023-07-21T07:35:31.581117+0000","last_became_peered":"2023-07-21T07:35:31.581117+0000","last_unstale":"2023-07-21T07:35:46.888101+0000","last_undegraded":"2023-07-21T07:35:46.888101+0000","last_fullsized":"2023-07-21T07:35:46.888101+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:13:31.788489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061783+0000","last_change":"2023-07-21T07:35:44.890771+0000","last_active":"2023-07-21T07:35:47.061783+0000","last_peered":"2023-07-21T07:35:47.061783+0000","last_clean":"2023-07-21T07:35:47.061783+0000","last_became_active":"2023-07-21T07:35:44.890436+0000","last_became_peered":"2023-07-21T07:35:44.890436+0000","last_unstale":"2023-07-21T07:35:47.061783+0000","last_undegraded":"2023-07-21T07:35:47.061783+0000","last_fullsized":"2023-07-21T07:35:47.061783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:51:49.548799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061130+0000","last_change":"2023-07-21T07:35:45.899588+0000","last_active":"2023-07-21T07:35:47.061130+0000","last_peered":"2023-07-21T07:35:47.061130+0000","last_clean":"2023-07-21T07:35:47.061130+0000","last_became_active":"2023-07-21T07:35:45.898782+0000","last_became_peered":"2023-07-21T07:35:45.898782+0000","last_unstale":"2023-07-21T07:35:47.061130+0000","last_undegraded":"2023-07-21T07:35:47.061130+0000","last_fullsized":"2023-07-21T07:35:47.061130+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:53:52.856219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886959+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:35:46.886959+0000","last_peered":"2023-07-21T07:35:46.886959+0000","last_clean":"2023-07-21T07:35:46.886959+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:35:46.886959+0000","last_undegraded":"2023-07-21T07:35:46.886959+0000","last_fullsized":"2023-07-21T07:35:46.886959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:34:53.626147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974502+0000","last_change":"2023-07-21T07:35:30.548637+0000","last_active":"2023-07-21T07:35:46.974502+0000","last_peered":"2023-07-21T07:35:46.974502+0000","last_clean":"2023-07-21T07:35:46.974502+0000","last_became_active":"2023-07-21T07:35:30.548340+0000","last_became_peered":"2023-07-21T07:35:30.548340+0000","last_unstale":"2023-07-21T07:35:46.974502+0000","last_undegraded":"2023-07-21T07:35:46.974502+0000","last_fullsized":"2023-07-21T07:35:46.974502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:42:13.779276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974179+0000","last_change":"2023-07-21T07:35:31.582790+0000","last_active":"2023-07-21T07:35:46.974179+0000","last_peered":"2023-07-21T07:35:46.974179+0000","last_clean":"2023-07-21T07:35:46.974179+0000","last_became_active":"2023-07-21T07:35:31.582479+0000","last_became_peered":"2023-07-21T07:35:31.582479+0000","last_unstale":"2023-07-21T07:35:46.974179+0000","last_undegraded":"2023-07-21T07:35:46.974179+0000","last_fullsized":"2023-07-21T07:35:46.974179+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:54:17.793947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887365+0000","last_change":"2023-07-21T07:35:44.889963+0000","last_active":"2023-07-21T07:35:46.887365+0000","last_peered":"2023-07-21T07:35:46.887365+0000","last_clean":"2023-07-21T07:35:46.887365+0000","last_became_active":"2023-07-21T07:35:44.889745+0000","last_became_peered":"2023-07-21T07:35:44.889745+0000","last_unstale":"2023-07-21T07:35:46.887365+0000","last_undegraded":"2023-07-21T07:35:46.887365+0000","last_fullsized":"2023-07-21T07:35:46.887365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:38:25.168259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975117+0000","last_change":"2023-07-21T07:35:45.909498+0000","last_active":"2023-07-21T07:35:46.975117+0000","last_peered":"2023-07-21T07:35:46.975117+0000","last_clean":"2023-07-21T07:35:46.975117+0000","last_became_active":"2023-07-21T07:35:45.909192+0000","last_became_peered":"2023-07-21T07:35:45.909192+0000","last_unstale":"2023-07-21T07:35:46.975117+0000","last_undegraded":"2023-07-21T07:35:46.975117+0000","last_fullsized":"2023-07-21T07:35:46.975117+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:22:07.275516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.059880+0000","last_change":"2023-07-21T07:35:30.553301+0000","last_active":"2023-07-21T07:35:47.059880+0000","last_peered":"2023-07-21T07:35:47.059880+0000","last_clean":"2023-07-21T07:35:47.059880+0000","last_became_active":"2023-07-21T07:35:30.552995+0000","last_became_peered":"2023-07-21T07:35:30.552995+0000","last_unstale":"2023-07-21T07:35:47.059880+0000","last_undegraded":"2023-07-21T07:35:47.059880+0000","last_fullsized":"2023-07-21T07:35:47.059880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:36:28.316865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888373+0000","last_change":"2023-07-21T07:35:31.561900+0000","last_active":"2023-07-21T07:35:46.888373+0000","last_peered":"2023-07-21T07:35:46.888373+0000","last_clean":"2023-07-21T07:35:46.888373+0000","last_became_active":"2023-07-21T07:35:31.561610+0000","last_became_peered":"2023-07-21T07:35:31.561610+0000","last_unstale":"2023-07-21T07:35:46.888373+0000","last_undegraded":"2023-07-21T07:35:46.888373+0000","last_fullsized":"2023-07-21T07:35:46.888373+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:05:51.429848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887665+0000","last_change":"2023-07-21T07:35:44.893270+0000","last_active":"2023-07-21T07:35:46.887665+0000","last_peered":"2023-07-21T07:35:46.887665+0000","last_clean":"2023-07-21T07:35:46.887665+0000","last_became_active":"2023-07-21T07:35:44.892806+0000","last_became_peered":"2023-07-21T07:35:44.892806+0000","last_unstale":"2023-07-21T07:35:46.887665+0000","last_undegraded":"2023-07-21T07:35:46.887665+0000","last_fullsized":"2023-07-21T07:35:46.887665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:43:06.636965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061173+0000","last_change":"2023-07-21T07:35:45.897066+0000","last_active":"2023-07-21T07:35:47.061173+0000","last_peered":"2023-07-21T07:35:47.061173+0000","last_clean":"2023-07-21T07:35:47.061173+0000","last_became_active":"2023-07-21T07:35:45.896792+0000","last_became_peered":"2023-07-21T07:35:45.896792+0000","last_unstale":"2023-07-21T07:35:47.061173+0000","last_undegraded":"2023-07-21T07:35:47.061173+0000","last_fullsized":"2023-07-21T07:35:47.061173+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:16.909033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061715+0000","last_change":"2023-07-21T07:35:30.548129+0000","last_active":"2023-07-21T07:35:47.061715+0000","last_peered":"2023-07-21T07:35:47.061715+0000","last_clean":"2023-07-21T07:35:47.061715+0000","last_became_active":"2023-07-21T07:35:30.547850+0000","last_became_peered":"2023-07-21T07:35:30.547850+0000","last_unstale":"2023-07-21T07:35:47.061715+0000","last_undegraded":"2023-07-21T07:35:47.061715+0000","last_fullsized":"2023-07-21T07:35:47.061715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:34:27.015084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060777+0000","last_change":"2023-07-21T07:35:31.582343+0000","last_active":"2023-07-21T07:35:47.060777+0000","last_peered":"2023-07-21T07:35:47.060777+0000","last_clean":"2023-07-21T07:35:47.060777+0000","last_became_active":"2023-07-21T07:35:31.582111+0000","last_became_peered":"2023-07-21T07:35:31.582111+0000","last_unstale":"2023-07-21T07:35:47.060777+0000","last_undegraded":"2023-07-21T07:35:47.060777+0000","last_fullsized":"2023-07-21T07:35:47.060777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:43:08.187693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886688+0000","last_change":"2023-07-21T07:35:44.885465+0000","last_active":"2023-07-21T07:35:46.886688+0000","last_peered":"2023-07-21T07:35:46.886688+0000","last_clean":"2023-07-21T07:35:46.886688+0000","last_became_active":"2023-07-21T07:35:44.885187+0000","last_became_peered":"2023-07-21T07:35:44.885187+0000","last_unstale":"2023-07-21T07:35:46.886688+0000","last_undegraded":"2023-07-21T07:35:46.886688+0000","last_fullsized":"2023-07-21T07:35:46.886688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:55:36.642250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061652+0000","last_change":"2023-07-21T07:35:45.892840+0000","last_active":"2023-07-21T07:35:47.061652+0000","last_peered":"2023-07-21T07:35:47.061652+0000","last_clean":"2023-07-21T07:35:47.061652+0000","last_became_active":"2023-07-21T07:35:45.892567+0000","last_became_peered":"2023-07-21T07:35:45.892567+0000","last_unstale":"2023-07-21T07:35:47.061652+0000","last_undegraded":"2023-07-21T07:35:47.061652+0000","last_fullsized":"2023-07-21T07:35:47.061652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:17:33.113889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060132+0000","last_change":"2023-07-21T07:35:30.553310+0000","last_active":"2023-07-21T07:35:47.060132+0000","last_peered":"2023-07-21T07:35:47.060132+0000","last_clean":"2023-07-21T07:35:47.060132+0000","last_became_active":"2023-07-21T07:35:30.552922+0000","last_became_peered":"2023-07-21T07:35:30.552922+0000","last_unstale":"2023-07-21T07:35:47.060132+0000","last_undegraded":"2023-07-21T07:35:47.060132+0000","last_fullsized":"2023-07-21T07:35:47.060132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:44:39.839754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974403+0000","last_change":"2023-07-21T07:35:31.575363+0000","last_active":"2023-07-21T07:35:46.974403+0000","last_peered":"2023-07-21T07:35:46.974403+0000","last_clean":"2023-07-21T07:35:46.974403+0000","last_became_active":"2023-07-21T07:35:31.575044+0000","last_became_peered":"2023-07-21T07:35:31.575044+0000","last_unstale":"2023-07-21T07:35:46.974403+0000","last_undegraded":"2023-07-21T07:35:46.974403+0000","last_fullsized":"2023-07-21T07:35:46.974403+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:39:13.240293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060108+0000","last_change":"2023-07-21T07:35:44.883870+0000","last_active":"2023-07-21T07:35:47.060108+0000","last_peered":"2023-07-21T07:35:47.060108+0000","last_clean":"2023-07-21T07:35:47.060108+0000","last_became_active":"2023-07-21T07:35:44.883583+0000","last_became_peered":"2023-07-21T07:35:44.883583+0000","last_unstale":"2023-07-21T07:35:47.060108+0000","last_undegraded":"2023-07-21T07:35:47.060108+0000","last_fullsized":"2023-07-21T07:35:47.060108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:21:19.430365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888581+0000","last_change":"2023-07-21T07:35:45.895964+0000","last_active":"2023-07-21T07:35:46.888581+0000","last_peered":"2023-07-21T07:35:46.888581+0000","last_clean":"2023-07-21T07:35:46.888581+0000","last_became_active":"2023-07-21T07:35:45.895671+0000","last_became_peered":"2023-07-21T07:35:45.895671+0000","last_unstale":"2023-07-21T07:35:46.888581+0000","last_undegraded":"2023-07-21T07:35:46.888581+0000","last_fullsized":"2023-07-21T07:35:46.888581+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:18:59.929550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060203+0000","last_change":"2023-07-21T07:35:30.552311+0000","last_active":"2023-07-21T07:35:47.060203+0000","last_peered":"2023-07-21T07:35:47.060203+0000","last_clean":"2023-07-21T07:35:47.060203+0000","last_became_active":"2023-07-21T07:35:30.552023+0000","last_became_peered":"2023-07-21T07:35:30.552023+0000","last_unstale":"2023-07-21T07:35:47.060203+0000","last_undegraded":"2023-07-21T07:35:47.060203+0000","last_fullsized":"2023-07-21T07:35:47.060203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:01:18.593753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061738+0000","last_change":"2023-07-21T07:35:31.570982+0000","last_active":"2023-07-21T07:35:47.061738+0000","last_peered":"2023-07-21T07:35:47.061738+0000","last_clean":"2023-07-21T07:35:47.061738+0000","last_became_active":"2023-07-21T07:35:31.570685+0000","last_became_peered":"2023-07-21T07:35:31.570685+0000","last_unstale":"2023-07-21T07:35:47.061738+0000","last_undegraded":"2023-07-21T07:35:47.061738+0000","last_fullsized":"2023-07-21T07:35:47.061738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:23:19.589936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974310+0000","last_change":"2023-07-21T07:35:44.894912+0000","last_active":"2023-07-21T07:35:46.974310+0000","last_peered":"2023-07-21T07:35:46.974310+0000","last_clean":"2023-07-21T07:35:46.974310+0000","last_became_active":"2023-07-21T07:35:44.894064+0000","last_became_peered":"2023-07-21T07:35:44.894064+0000","last_unstale":"2023-07-21T07:35:46.974310+0000","last_undegraded":"2023-07-21T07:35:46.974310+0000","last_fullsized":"2023-07-21T07:35:46.974310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:01:05.144193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974959+0000","last_change":"2023-07-21T07:35:45.902158+0000","last_active":"2023-07-21T07:35:46.974959+0000","last_peered":"2023-07-21T07:35:46.974959+0000","last_clean":"2023-07-21T07:35:46.974959+0000","last_became_active":"2023-07-21T07:35:45.901872+0000","last_became_peered":"2023-07-21T07:35:45.901872+0000","last_unstale":"2023-07-21T07:35:46.974959+0000","last_undegraded":"2023-07-21T07:35:46.974959+0000","last_fullsized":"2023-07-21T07:35:46.974959+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:29:27.656646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886807+0000","last_change":"2023-07-21T07:35:30.552149+0000","last_active":"2023-07-21T07:35:46.886807+0000","last_peered":"2023-07-21T07:35:46.886807+0000","last_clean":"2023-07-21T07:35:46.886807+0000","last_became_active":"2023-07-21T07:35:30.551872+0000","last_became_peered":"2023-07-21T07:35:30.551872+0000","last_unstale":"2023-07-21T07:35:46.886807+0000","last_undegraded":"2023-07-21T07:35:46.886807+0000","last_fullsized":"2023-07-21T07:35:46.886807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:30:09.427456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060588+0000","last_change":"2023-07-21T07:35:31.571997+0000","last_active":"2023-07-21T07:35:47.060588+0000","last_peered":"2023-07-21T07:35:47.060588+0000","last_clean":"2023-07-21T07:35:47.060588+0000","last_became_active":"2023-07-21T07:35:31.571042+0000","last_became_peered":"2023-07-21T07:35:31.571042+0000","last_unstale":"2023-07-21T07:35:47.060588+0000","last_undegraded":"2023-07-21T07:35:47.060588+0000","last_fullsized":"2023-07-21T07:35:47.060588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:02.572630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060534+0000","last_change":"2023-07-21T07:35:44.884732+0000","last_active":"2023-07-21T07:35:47.060534+0000","last_peered":"2023-07-21T07:35:47.060534+0000","last_clean":"2023-07-21T07:35:47.060534+0000","last_became_active":"2023-07-21T07:35:44.884473+0000","last_became_peered":"2023-07-21T07:35:44.884473+0000","last_unstale":"2023-07-21T07:35:47.060534+0000","last_undegraded":"2023-07-21T07:35:47.060534+0000","last_fullsized":"2023-07-21T07:35:47.060534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:32:51.388129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886217+0000","last_change":"2023-07-21T07:35:45.897470+0000","last_active":"2023-07-21T07:35:46.886217+0000","last_peered":"2023-07-21T07:35:46.886217+0000","last_clean":"2023-07-21T07:35:46.886217+0000","last_became_active":"2023-07-21T07:35:45.897196+0000","last_became_peered":"2023-07-21T07:35:45.897196+0000","last_unstale":"2023-07-21T07:35:46.886217+0000","last_undegraded":"2023-07-21T07:35:46.886217+0000","last_fullsized":"2023-07-21T07:35:46.886217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:13:46.124892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060398+0000","last_change":"2023-07-21T07:35:30.554225+0000","last_active":"2023-07-21T07:35:47.060398+0000","last_peered":"2023-07-21T07:35:47.060398+0000","last_clean":"2023-07-21T07:35:47.060398+0000","last_became_active":"2023-07-21T07:35:30.553952+0000","last_became_peered":"2023-07-21T07:35:30.553952+0000","last_unstale":"2023-07-21T07:35:47.060398+0000","last_undegraded":"2023-07-21T07:35:47.060398+0000","last_fullsized":"2023-07-21T07:35:47.060398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:37:52.003972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888335+0000","last_change":"2023-07-21T07:35:31.578142+0000","last_active":"2023-07-21T07:35:46.888335+0000","last_peered":"2023-07-21T07:35:46.888335+0000","last_clean":"2023-07-21T07:35:46.888335+0000","last_became_active":"2023-07-21T07:35:31.577865+0000","last_became_peered":"2023-07-21T07:35:31.577865+0000","last_unstale":"2023-07-21T07:35:46.888335+0000","last_undegraded":"2023-07-21T07:35:46.888335+0000","last_fullsized":"2023-07-21T07:35:46.888335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:48.192496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975333+0000","last_change":"2023-07-21T07:35:44.899265+0000","last_active":"2023-07-21T07:35:46.975333+0000","last_peered":"2023-07-21T07:35:46.975333+0000","last_clean":"2023-07-21T07:35:46.975333+0000","last_became_active":"2023-07-21T07:35:44.899054+0000","last_became_peered":"2023-07-21T07:35:44.899054+0000","last_unstale":"2023-07-21T07:35:46.975333+0000","last_undegraded":"2023-07-21T07:35:46.975333+0000","last_fullsized":"2023-07-21T07:35:46.975333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:35:24.030633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888890+0000","last_change":"2023-07-21T07:35:45.895937+0000","last_active":"2023-07-21T07:35:46.888890+0000","last_peered":"2023-07-21T07:35:46.888890+0000","last_clean":"2023-07-21T07:35:46.888890+0000","last_became_active":"2023-07-21T07:35:45.895519+0000","last_became_peered":"2023-07-21T07:35:45.895519+0000","last_unstale":"2023-07-21T07:35:46.888890+0000","last_undegraded":"2023-07-21T07:35:46.888890+0000","last_fullsized":"2023-07-21T07:35:46.888890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:26:13.461979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888131+0000","last_change":"2023-07-21T07:35:30.550575+0000","last_active":"2023-07-21T07:35:46.888131+0000","last_peered":"2023-07-21T07:35:46.888131+0000","last_clean":"2023-07-21T07:35:46.888131+0000","last_became_active":"2023-07-21T07:35:30.550269+0000","last_became_peered":"2023-07-21T07:35:30.550269+0000","last_unstale":"2023-07-21T07:35:46.888131+0000","last_undegraded":"2023-07-21T07:35:46.888131+0000","last_fullsized":"2023-07-21T07:35:46.888131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:55:30.715720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062167+0000","last_change":"2023-07-21T07:35:31.572905+0000","last_active":"2023-07-21T07:35:47.062167+0000","last_peered":"2023-07-21T07:35:47.062167+0000","last_clean":"2023-07-21T07:35:47.062167+0000","last_became_active":"2023-07-21T07:35:31.571995+0000","last_became_peered":"2023-07-21T07:35:31.571995+0000","last_unstale":"2023-07-21T07:35:47.062167+0000","last_undegraded":"2023-07-21T07:35:47.062167+0000","last_fullsized":"2023-07-21T07:35:47.062167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:14:27.722253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061853+0000","last_change":"2023-07-21T07:35:44.895275+0000","last_active":"2023-07-21T07:35:47.061853+0000","last_peered":"2023-07-21T07:35:47.061853+0000","last_clean":"2023-07-21T07:35:47.061853+0000","last_became_active":"2023-07-21T07:35:44.895004+0000","last_became_peered":"2023-07-21T07:35:44.895004+0000","last_unstale":"2023-07-21T07:35:47.061853+0000","last_undegraded":"2023-07-21T07:35:47.061853+0000","last_fullsized":"2023-07-21T07:35:47.061853+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:19:04.212276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886637+0000","last_change":"2023-07-21T07:35:45.893318+0000","last_active":"2023-07-21T07:35:46.886637+0000","last_peered":"2023-07-21T07:35:46.886637+0000","last_clean":"2023-07-21T07:35:46.886637+0000","last_became_active":"2023-07-21T07:35:45.892993+0000","last_became_peered":"2023-07-21T07:35:45.892993+0000","last_unstale":"2023-07-21T07:35:46.886637+0000","last_undegraded":"2023-07-21T07:35:46.886637+0000","last_fullsized":"2023-07-21T07:35:46.886637+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:38:26.175627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062965+0000","last_change":"2023-07-21T07:35:30.552874+0000","last_active":"2023-07-21T07:35:47.062965+0000","last_peered":"2023-07-21T07:35:47.062965+0000","last_clean":"2023-07-21T07:35:47.062965+0000","last_became_active":"2023-07-21T07:35:30.552612+0000","last_became_peered":"2023-07-21T07:35:30.552612+0000","last_unstale":"2023-07-21T07:35:47.062965+0000","last_undegraded":"2023-07-21T07:35:47.062965+0000","last_fullsized":"2023-07-21T07:35:47.062965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:37:14.136364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889129+0000","last_change":"2023-07-21T07:35:31.581417+0000","last_active":"2023-07-21T07:35:46.889129+0000","last_peered":"2023-07-21T07:35:46.889129+0000","last_clean":"2023-07-21T07:35:46.889129+0000","last_became_active":"2023-07-21T07:35:31.581026+0000","last_became_peered":"2023-07-21T07:35:31.581026+0000","last_unstale":"2023-07-21T07:35:46.889129+0000","last_undegraded":"2023-07-21T07:35:46.889129+0000","last_fullsized":"2023-07-21T07:35:46.889129+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:55:31.720737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062964+0000","last_change":"2023-07-21T07:35:44.887179+0000","last_active":"2023-07-21T07:35:47.062964+0000","last_peered":"2023-07-21T07:35:47.062964+0000","last_clean":"2023-07-21T07:35:47.062964+0000","last_became_active":"2023-07-21T07:35:44.886859+0000","last_became_peered":"2023-07-21T07:35:44.886859+0000","last_unstale":"2023-07-21T07:35:47.062964+0000","last_undegraded":"2023-07-21T07:35:47.062964+0000","last_fullsized":"2023-07-21T07:35:47.062964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:44:05.006534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888013+0000","last_change":"2023-07-21T07:35:45.903484+0000","last_active":"2023-07-21T07:35:46.888013+0000","last_peered":"2023-07-21T07:35:46.888013+0000","last_clean":"2023-07-21T07:35:46.888013+0000","last_became_active":"2023-07-21T07:35:45.903206+0000","last_became_peered":"2023-07-21T07:35:45.903206+0000","last_unstale":"2023-07-21T07:35:46.888013+0000","last_undegraded":"2023-07-21T07:35:46.888013+0000","last_fullsized":"2023-07-21T07:35:46.888013+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:32:53.808044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974995+0000","last_change":"2023-07-21T07:35:45.912077+0000","last_active":"2023-07-21T07:35:46.974995+0000","last_peered":"2023-07-21T07:35:46.974995+0000","last_clean":"2023-07-21T07:35:46.974995+0000","last_became_active":"2023-07-21T07:35:45.911734+0000","last_became_peered":"2023-07-21T07:35:45.911734+0000","last_unstale":"2023-07-21T07:35:46.974995+0000","last_undegraded":"2023-07-21T07:35:46.974995+0000","last_fullsized":"2023-07-21T07:35:46.974995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:13:46.124892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061606+0000","last_change":"2023-07-21T07:35:30.550883+0000","last_active":"2023-07-21T07:35:47.061606+0000","last_peered":"2023-07-21T07:35:47.061606+0000","last_clean":"2023-07-21T07:35:47.061606+0000","last_became_active":"2023-07-21T07:35:30.550604+0000","last_became_peered":"2023-07-21T07:35:30.550604+0000","last_unstale":"2023-07-21T07:35:47.061606+0000","last_undegraded":"2023-07-21T07:35:47.061606+0000","last_fullsized":"2023-07-21T07:35:47.061606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:37:35.298311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888483+0000","last_change":"2023-07-21T07:35:31.569072+0000","last_active":"2023-07-21T07:35:46.888483+0000","last_peered":"2023-07-21T07:35:46.888483+0000","last_clean":"2023-07-21T07:35:46.888483+0000","last_became_active":"2023-07-21T07:35:31.568900+0000","last_became_peered":"2023-07-21T07:35:31.568900+0000","last_unstale":"2023-07-21T07:35:46.888483+0000","last_undegraded":"2023-07-21T07:35:46.888483+0000","last_fullsized":"2023-07-21T07:35:46.888483+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:31:17.957839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062762+0000","last_change":"2023-07-21T07:35:44.902901+0000","last_active":"2023-07-21T07:35:47.062762+0000","last_peered":"2023-07-21T07:35:47.062762+0000","last_clean":"2023-07-21T07:35:47.062762+0000","last_became_active":"2023-07-21T07:35:44.902582+0000","last_became_peered":"2023-07-21T07:35:44.902582+0000","last_unstale":"2023-07-21T07:35:47.062762+0000","last_undegraded":"2023-07-21T07:35:47.062762+0000","last_fullsized":"2023-07-21T07:35:47.062762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:15:16.232322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060964+0000","last_change":"2023-07-21T07:35:30.550924+0000","last_active":"2023-07-21T07:35:47.060964+0000","last_peered":"2023-07-21T07:35:47.060964+0000","last_clean":"2023-07-21T07:35:47.060964+0000","last_became_active":"2023-07-21T07:35:30.550606+0000","last_became_peered":"2023-07-21T07:35:30.550606+0000","last_unstale":"2023-07-21T07:35:47.060964+0000","last_undegraded":"2023-07-21T07:35:47.060964+0000","last_fullsized":"2023-07-21T07:35:47.060964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:05:51.079287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062528+0000","last_change":"2023-07-21T07:35:31.566406+0000","last_active":"2023-07-21T07:35:47.062528+0000","last_peered":"2023-07-21T07:35:47.062528+0000","last_clean":"2023-07-21T07:35:47.062528+0000","last_became_active":"2023-07-21T07:35:31.566108+0000","last_became_peered":"2023-07-21T07:35:31.566108+0000","last_unstale":"2023-07-21T07:35:47.062528+0000","last_undegraded":"2023-07-21T07:35:47.062528+0000","last_fullsized":"2023-07-21T07:35:47.062528+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:14:01.169474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974557+0000","last_change":"2023-07-21T07:35:44.894630+0000","last_active":"2023-07-21T07:35:46.974557+0000","last_peered":"2023-07-21T07:35:46.974557+0000","last_clean":"2023-07-21T07:35:46.974557+0000","last_became_active":"2023-07-21T07:35:44.894299+0000","last_became_peered":"2023-07-21T07:35:44.894299+0000","last_unstale":"2023-07-21T07:35:46.974557+0000","last_undegraded":"2023-07-21T07:35:46.974557+0000","last_fullsized":"2023-07-21T07:35:46.974557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:46.925715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061206+0000","last_change":"2023-07-21T07:35:45.898972+0000","last_active":"2023-07-21T07:35:47.061206+0000","last_peered":"2023-07-21T07:35:47.061206+0000","last_clean":"2023-07-21T07:35:47.061206+0000","last_became_active":"2023-07-21T07:35:45.898683+0000","last_became_peered":"2023-07-21T07:35:45.898683+0000","last_unstale":"2023-07-21T07:35:47.061206+0000","last_undegraded":"2023-07-21T07:35:47.061206+0000","last_fullsized":"2023-07-21T07:35:47.061206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:29:44.936315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975519+0000","last_change":"2023-07-21T07:35:45.902345+0000","last_active":"2023-07-21T07:35:46.975519+0000","last_peered":"2023-07-21T07:35:46.975519+0000","last_clean":"2023-07-21T07:35:46.975519+0000","last_became_active":"2023-07-21T07:35:45.901904+0000","last_became_peered":"2023-07-21T07:35:45.901904+0000","last_unstale":"2023-07-21T07:35:46.975519+0000","last_undegraded":"2023-07-21T07:35:46.975519+0000","last_fullsized":"2023-07-21T07:35:46.975519+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:00:56.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886516+0000","last_change":"2023-07-21T07:35:30.542937+0000","last_active":"2023-07-21T07:35:46.886516+0000","last_peered":"2023-07-21T07:35:46.886516+0000","last_clean":"2023-07-21T07:35:46.886516+0000","last_became_active":"2023-07-21T07:35:30.542650+0000","last_became_peered":"2023-07-21T07:35:30.542650+0000","last_unstale":"2023-07-21T07:35:46.886516+0000","last_undegraded":"2023-07-21T07:35:46.886516+0000","last_fullsized":"2023-07-21T07:35:46.886516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:05.055421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887855+0000","last_change":"2023-07-21T07:35:31.569427+0000","last_active":"2023-07-21T07:35:46.887855+0000","last_peered":"2023-07-21T07:35:46.887855+0000","last_clean":"2023-07-21T07:35:46.887855+0000","last_became_active":"2023-07-21T07:35:31.569152+0000","last_became_peered":"2023-07-21T07:35:31.569152+0000","last_unstale":"2023-07-21T07:35:46.887855+0000","last_undegraded":"2023-07-21T07:35:46.887855+0000","last_fullsized":"2023-07-21T07:35:46.887855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:06:09.432852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"39'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888067+0000","last_change":"2023-07-21T07:35:44.904909+0000","last_active":"2023-07-21T07:35:46.888067+0000","last_peered":"2023-07-21T07:35:46.888067+0000","last_clean":"2023-07-21T07:35:46.888067+0000","last_became_active":"2023-07-21T07:35:44.904583+0000","last_became_peered":"2023-07-21T07:35:44.904583+0000","last_unstale":"2023-07-21T07:35:46.888067+0000","last_undegraded":"2023-07-21T07:35:46.888067+0000","last_fullsized":"2023-07-21T07:35:46.888067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:35:21.303182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889012+0000","last_change":"2023-07-21T07:35:45.901425+0000","last_active":"2023-07-21T07:35:46.889012+0000","last_peered":"2023-07-21T07:35:46.889012+0000","last_clean":"2023-07-21T07:35:46.889012+0000","last_became_active":"2023-07-21T07:35:45.901053+0000","last_became_peered":"2023-07-21T07:35:45.901053+0000","last_unstale":"2023-07-21T07:35:46.889012+0000","last_undegraded":"2023-07-21T07:35:46.889012+0000","last_fullsized":"2023-07-21T07:35:46.889012+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:00:56.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888113+0000","last_change":"2023-07-21T07:35:30.548569+0000","last_active":"2023-07-21T07:35:46.888113+0000","last_peered":"2023-07-21T07:35:46.888113+0000","last_clean":"2023-07-21T07:35:46.888113+0000","last_became_active":"2023-07-21T07:35:30.548258+0000","last_became_peered":"2023-07-21T07:35:30.548258+0000","last_unstale":"2023-07-21T07:35:46.888113+0000","last_undegraded":"2023-07-21T07:35:46.888113+0000","last_fullsized":"2023-07-21T07:35:46.888113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:10:53.787509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974102+0000","last_change":"2023-07-21T07:35:31.567871+0000","last_active":"2023-07-21T07:35:46.974102+0000","last_peered":"2023-07-21T07:35:46.974102+0000","last_clean":"2023-07-21T07:35:46.974102+0000","last_became_active":"2023-07-21T07:35:31.567550+0000","last_became_peered":"2023-07-21T07:35:31.567550+0000","last_unstale":"2023-07-21T07:35:46.974102+0000","last_undegraded":"2023-07-21T07:35:46.974102+0000","last_fullsized":"2023-07-21T07:35:46.974102+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:30:30.257729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063104+0000","last_change":"2023-07-21T07:35:44.892878+0000","last_active":"2023-07-21T07:35:47.063104+0000","last_peered":"2023-07-21T07:35:47.063104+0000","last_clean":"2023-07-21T07:35:47.063104+0000","last_became_active":"2023-07-21T07:35:44.892603+0000","last_became_peered":"2023-07-21T07:35:44.892603+0000","last_unstale":"2023-07-21T07:35:47.063104+0000","last_undegraded":"2023-07-21T07:35:47.063104+0000","last_fullsized":"2023-07-21T07:35:47.063104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:56:33.161202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.14","version":"36'8","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889056+0000","last_change":"2023-07-21T07:35:30.550443+0000","last_active":"2023-07-21T07:35:46.889056+0000","last_peered":"2023-07-21T07:35:46.889056+0000","last_clean":"2023-07-21T07:35:46.889056+0000","last_became_active":"2023-07-21T07:35:30.550126+0000","last_became_peered":"2023-07-21T07:35:30.550126+0000","last_unstale":"2023-07-21T07:35:46.889056+0000","last_undegraded":"2023-07-21T07:35:46.889056+0000","last_fullsized":"2023-07-21T07:35:46.889056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:32:38.466624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888649+0000","last_change":"2023-07-21T07:35:31.577585+0000","last_active":"2023-07-21T07:35:46.888649+0000","last_peered":"2023-07-21T07:35:46.888649+0000","last_clean":"2023-07-21T07:35:46.888649+0000","last_became_active":"2023-07-21T07:35:31.577145+0000","last_became_peered":"2023-07-21T07:35:31.577145+0000","last_unstale":"2023-07-21T07:35:46.888649+0000","last_undegraded":"2023-07-21T07:35:46.888649+0000","last_fullsized":"2023-07-21T07:35:46.888649+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:43:32.449934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888514+0000","last_change":"2023-07-21T07:35:44.903130+0000","last_active":"2023-07-21T07:35:46.888514+0000","last_peered":"2023-07-21T07:35:46.888514+0000","last_clean":"2023-07-21T07:35:46.888514+0000","last_became_active":"2023-07-21T07:35:44.902788+0000","last_became_peered":"2023-07-21T07:35:44.902788+0000","last_unstale":"2023-07-21T07:35:46.888514+0000","last_undegraded":"2023-07-21T07:35:46.888514+0000","last_fullsized":"2023-07-21T07:35:46.888514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:30:26.851327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063503+0000","last_change":"2023-07-21T07:35:45.890647+0000","last_active":"2023-07-21T07:35:47.063503+0000","last_peered":"2023-07-21T07:35:47.063503+0000","last_clean":"2023-07-21T07:35:47.063503+0000","last_became_active":"2023-07-21T07:35:45.890371+0000","last_became_peered":"2023-07-21T07:35:45.890371+0000","last_unstale":"2023-07-21T07:35:47.063503+0000","last_undegraded":"2023-07-21T07:35:47.063503+0000","last_fullsized":"2023-07-21T07:35:47.063503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:39:14.490597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":24,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062436+0000","last_change":"2023-07-21T07:35:30.552297+0000","last_active":"2023-07-21T07:35:47.062436+0000","last_peered":"2023-07-21T07:35:47.062436+0000","last_clean":"2023-07-21T07:35:47.062436+0000","last_became_active":"2023-07-21T07:35:30.552039+0000","last_became_peered":"2023-07-21T07:35:30.552039+0000","last_unstale":"2023-07-21T07:35:47.062436+0000","last_undegraded":"2023-07-21T07:35:47.062436+0000","last_fullsized":"2023-07-21T07:35:47.062436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:53:59.070091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975029+0000","last_change":"2023-07-21T07:35:31.574640+0000","last_active":"2023-07-21T07:35:46.975029+0000","last_peered":"2023-07-21T07:35:46.975029+0000","last_clean":"2023-07-21T07:35:46.975029+0000","last_became_active":"2023-07-21T07:35:31.574338+0000","last_became_peered":"2023-07-21T07:35:31.574338+0000","last_unstale":"2023-07-21T07:35:46.975029+0000","last_undegraded":"2023-07-21T07:35:46.975029+0000","last_fullsized":"2023-07-21T07:35:46.975029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:10:54.792526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062631+0000","last_change":"2023-07-21T07:35:44.889328+0000","last_active":"2023-07-21T07:35:47.062631+0000","last_peered":"2023-07-21T07:35:47.062631+0000","last_clean":"2023-07-21T07:35:47.062631+0000","last_became_active":"2023-07-21T07:35:44.889059+0000","last_became_peered":"2023-07-21T07:35:44.889059+0000","last_unstale":"2023-07-21T07:35:47.062631+0000","last_undegraded":"2023-07-21T07:35:47.062631+0000","last_fullsized":"2023-07-21T07:35:47.062631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:29:43.928947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887297+0000","last_change":"2023-07-21T07:35:45.896902+0000","last_active":"2023-07-21T07:35:46.887297+0000","last_peered":"2023-07-21T07:35:46.887297+0000","last_clean":"2023-07-21T07:35:46.887297+0000","last_became_active":"2023-07-21T07:35:45.896632+0000","last_became_peered":"2023-07-21T07:35:45.896632+0000","last_unstale":"2023-07-21T07:35:46.887297+0000","last_undegraded":"2023-07-21T07:35:46.887297+0000","last_fullsized":"2023-07-21T07:35:46.887297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:20.396840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061394+0000","last_change":"2023-07-21T07:35:30.547725+0000","last_active":"2023-07-21T07:35:47.061394+0000","last_peered":"2023-07-21T07:35:47.061394+0000","last_clean":"2023-07-21T07:35:47.061394+0000","last_became_active":"2023-07-21T07:35:30.547400+0000","last_became_peered":"2023-07-21T07:35:30.547400+0000","last_unstale":"2023-07-21T07:35:47.061394+0000","last_undegraded":"2023-07-21T07:35:47.061394+0000","last_fullsized":"2023-07-21T07:35:47.061394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:59:50.497869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063693+0000","last_change":"2023-07-21T07:35:31.581622+0000","last_active":"2023-07-21T07:35:47.063693+0000","last_peered":"2023-07-21T07:35:47.063693+0000","last_clean":"2023-07-21T07:35:47.063693+0000","last_became_active":"2023-07-21T07:35:31.581309+0000","last_became_peered":"2023-07-21T07:35:31.581309+0000","last_unstale":"2023-07-21T07:35:47.063693+0000","last_undegraded":"2023-07-21T07:35:47.063693+0000","last_fullsized":"2023-07-21T07:35:47.063693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:26:25.366366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"39'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889293+0000","last_change":"2023-07-21T07:35:44.889706+0000","last_active":"2023-07-21T07:35:46.889293+0000","last_peered":"2023-07-21T07:35:46.889293+0000","last_clean":"2023-07-21T07:35:46.889293+0000","last_became_active":"2023-07-21T07:35:44.889309+0000","last_became_peered":"2023-07-21T07:35:44.889309+0000","last_unstale":"2023-07-21T07:35:46.889293+0000","last_undegraded":"2023-07-21T07:35:46.889293+0000","last_fullsized":"2023-07-21T07:35:46.889293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:15:16.208764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887922+0000","last_change":"2023-07-21T07:35:45.889409+0000","last_active":"2023-07-21T07:35:46.887922+0000","last_peered":"2023-07-21T07:35:46.887922+0000","last_clean":"2023-07-21T07:35:46.887922+0000","last_became_active":"2023-07-21T07:35:45.889174+0000","last_became_peered":"2023-07-21T07:35:45.889174+0000","last_unstale":"2023-07-21T07:35:46.887922+0000","last_undegraded":"2023-07-21T07:35:46.887922+0000","last_fullsized":"2023-07-21T07:35:46.887922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:04.651542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889292+0000","last_change":"2023-07-21T07:35:30.551290+0000","last_active":"2023-07-21T07:35:46.889292+0000","last_peered":"2023-07-21T07:35:46.889292+0000","last_clean":"2023-07-21T07:35:46.889292+0000","last_became_active":"2023-07-21T07:35:30.550872+0000","last_became_peered":"2023-07-21T07:35:30.550872+0000","last_unstale":"2023-07-21T07:35:46.889292+0000","last_undegraded":"2023-07-21T07:35:46.889292+0000","last_fullsized":"2023-07-21T07:35:46.889292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:03:28.127150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060683+0000","last_change":"2023-07-21T07:35:31.576245+0000","last_active":"2023-07-21T07:35:47.060683+0000","last_peered":"2023-07-21T07:35:47.060683+0000","last_clean":"2023-07-21T07:35:47.060683+0000","last_became_active":"2023-07-21T07:35:31.575586+0000","last_became_peered":"2023-07-21T07:35:31.575586+0000","last_unstale":"2023-07-21T07:35:47.060683+0000","last_undegraded":"2023-07-21T07:35:47.060683+0000","last_fullsized":"2023-07-21T07:35:47.060683+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:45:56.504529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"39'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063800+0000","last_change":"2023-07-21T07:35:44.894507+0000","last_active":"2023-07-21T07:35:47.063800+0000","last_peered":"2023-07-21T07:35:47.063800+0000","last_clean":"2023-07-21T07:35:47.063800+0000","last_became_active":"2023-07-21T07:35:44.894254+0000","last_became_peered":"2023-07-21T07:35:44.894254+0000","last_unstale":"2023-07-21T07:35:47.063800+0000","last_undegraded":"2023-07-21T07:35:47.063800+0000","last_fullsized":"2023-07-21T07:35:47.063800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:54:13.404143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974573+0000","last_change":"2023-07-21T07:35:45.912066+0000","last_active":"2023-07-21T07:35:46.974573+0000","last_peered":"2023-07-21T07:35:46.974573+0000","last_clean":"2023-07-21T07:35:46.974573+0000","last_became_active":"2023-07-21T07:35:45.911723+0000","last_became_peered":"2023-07-21T07:35:45.911723+0000","last_unstale":"2023-07-21T07:35:46.974573+0000","last_undegraded":"2023-07-21T07:35:46.974573+0000","last_fullsized":"2023-07-21T07:35:46.974573+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:43:07.644333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887400+0000","last_change":"2023-07-21T07:35:30.550858+0000","last_active":"2023-07-21T07:35:46.887400+0000","last_peered":"2023-07-21T07:35:46.887400+0000","last_clean":"2023-07-21T07:35:46.887400+0000","last_became_active":"2023-07-21T07:35:30.550540+0000","last_became_peered":"2023-07-21T07:35:30.550540+0000","last_unstale":"2023-07-21T07:35:46.887400+0000","last_undegraded":"2023-07-21T07:35:46.887400+0000","last_fullsized":"2023-07-21T07:35:46.887400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:05:50.424831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888340+0000","last_change":"2023-07-21T07:35:31.561749+0000","last_active":"2023-07-21T07:35:46.888340+0000","last_peered":"2023-07-21T07:35:46.888340+0000","last_clean":"2023-07-21T07:35:46.888340+0000","last_became_active":"2023-07-21T07:35:31.561255+0000","last_became_peered":"2023-07-21T07:35:31.561255+0000","last_unstale":"2023-07-21T07:35:46.888340+0000","last_undegraded":"2023-07-21T07:35:46.888340+0000","last_fullsized":"2023-07-21T07:35:46.888340+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:06.060437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887655+0000","last_change":"2023-07-21T07:35:44.892878+0000","last_active":"2023-07-21T07:35:46.887655+0000","last_peered":"2023-07-21T07:35:46.887655+0000","last_clean":"2023-07-21T07:35:46.887655+0000","last_became_active":"2023-07-21T07:35:44.892488+0000","last_became_peered":"2023-07-21T07:35:44.892488+0000","last_unstale":"2023-07-21T07:35:46.887655+0000","last_undegraded":"2023-07-21T07:35:46.887655+0000","last_fullsized":"2023-07-21T07:35:46.887655+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:31:31.286874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063460+0000","last_change":"2023-07-21T07:35:45.902658+0000","last_active":"2023-07-21T07:35:47.063460+0000","last_peered":"2023-07-21T07:35:47.063460+0000","last_clean":"2023-07-21T07:35:47.063460+0000","last_became_active":"2023-07-21T07:35:45.902375+0000","last_became_peered":"2023-07-21T07:35:45.902375+0000","last_unstale":"2023-07-21T07:35:47.063460+0000","last_undegraded":"2023-07-21T07:35:47.063460+0000","last_fullsized":"2023-07-21T07:35:47.063460+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:52:21.599534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886365+0000","last_change":"2023-07-21T07:35:30.542823+0000","last_active":"2023-07-21T07:35:46.886365+0000","last_peered":"2023-07-21T07:35:46.886365+0000","last_clean":"2023-07-21T07:35:46.886365+0000","last_became_active":"2023-07-21T07:35:30.542612+0000","last_became_peered":"2023-07-21T07:35:30.542612+0000","last_unstale":"2023-07-21T07:35:46.886365+0000","last_undegraded":"2023-07-21T07:35:46.886365+0000","last_fullsized":"2023-07-21T07:35:46.886365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:21:51.934097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887848+0000","last_change":"2023-07-21T07:35:31.577159+0000","last_active":"2023-07-21T07:35:46.887848+0000","last_peered":"2023-07-21T07:35:46.887848+0000","last_clean":"2023-07-21T07:35:46.887848+0000","last_became_active":"2023-07-21T07:35:31.576870+0000","last_became_peered":"2023-07-21T07:35:31.576870+0000","last_unstale":"2023-07-21T07:35:46.887848+0000","last_undegraded":"2023-07-21T07:35:46.887848+0000","last_fullsized":"2023-07-21T07:35:46.887848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:30:10.432473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974394+0000","last_change":"2023-07-21T07:35:44.890964+0000","last_active":"2023-07-21T07:35:46.974394+0000","last_peered":"2023-07-21T07:35:46.974394+0000","last_clean":"2023-07-21T07:35:46.974394+0000","last_became_active":"2023-07-21T07:35:44.890503+0000","last_became_peered":"2023-07-21T07:35:44.890503+0000","last_unstale":"2023-07-21T07:35:46.974394+0000","last_undegraded":"2023-07-21T07:35:46.974394+0000","last_fullsized":"2023-07-21T07:35:46.974394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:43:41.267360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888214+0000","last_change":"2023-07-21T07:35:45.902656+0000","last_active":"2023-07-21T07:35:46.888214+0000","last_peered":"2023-07-21T07:35:46.888214+0000","last_clean":"2023-07-21T07:35:46.888214+0000","last_became_active":"2023-07-21T07:35:45.902336+0000","last_became_peered":"2023-07-21T07:35:45.902336+0000","last_unstale":"2023-07-21T07:35:46.888214+0000","last_undegraded":"2023-07-21T07:35:46.888214+0000","last_fullsized":"2023-07-21T07:35:46.888214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:46:23.964370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062402+0000","last_change":"2023-07-21T07:35:30.550820+0000","last_active":"2023-07-21T07:35:47.062402+0000","last_peered":"2023-07-21T07:35:47.062402+0000","last_clean":"2023-07-21T07:35:47.062402+0000","last_became_active":"2023-07-21T07:35:30.550525+0000","last_became_peered":"2023-07-21T07:35:30.550525+0000","last_unstale":"2023-07-21T07:35:47.062402+0000","last_undegraded":"2023-07-21T07:35:47.062402+0000","last_fullsized":"2023-07-21T07:35:47.062402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:53:37.514800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062828+0000","last_change":"2023-07-21T07:35:31.578102+0000","last_active":"2023-07-21T07:35:47.062828+0000","last_peered":"2023-07-21T07:35:47.062828+0000","last_clean":"2023-07-21T07:35:47.062828+0000","last_became_active":"2023-07-21T07:35:31.577824+0000","last_became_peered":"2023-07-21T07:35:31.577824+0000","last_unstale":"2023-07-21T07:35:47.062828+0000","last_undegraded":"2023-07-21T07:35:47.062828+0000","last_fullsized":"2023-07-21T07:35:47.062828+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:42:11.382323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974509+0000","last_change":"2023-07-21T07:35:44.892233+0000","last_active":"2023-07-21T07:35:46.974509+0000","last_peered":"2023-07-21T07:35:46.974509+0000","last_clean":"2023-07-21T07:35:46.974509+0000","last_became_active":"2023-07-21T07:35:44.891945+0000","last_became_peered":"2023-07-21T07:35:44.891945+0000","last_unstale":"2023-07-21T07:35:46.974509+0000","last_undegraded":"2023-07-21T07:35:46.974509+0000","last_fullsized":"2023-07-21T07:35:46.974509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:02:28.246014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062282+0000","last_change":"2023-07-21T07:35:45.912378+0000","last_active":"2023-07-21T07:35:47.062282+0000","last_peered":"2023-07-21T07:35:47.062282+0000","last_clean":"2023-07-21T07:35:47.062282+0000","last_became_active":"2023-07-21T07:35:45.912142+0000","last_became_peered":"2023-07-21T07:35:45.912142+0000","last_unstale":"2023-07-21T07:35:47.062282+0000","last_undegraded":"2023-07-21T07:35:47.062282+0000","last_fullsized":"2023-07-21T07:35:47.062282+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:43:22.524095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061746+0000","last_change":"2023-07-21T07:35:30.546712+0000","last_active":"2023-07-21T07:35:47.061746+0000","last_peered":"2023-07-21T07:35:47.061746+0000","last_clean":"2023-07-21T07:35:47.061746+0000","last_became_active":"2023-07-21T07:35:30.546408+0000","last_became_peered":"2023-07-21T07:35:30.546408+0000","last_unstale":"2023-07-21T07:35:47.061746+0000","last_undegraded":"2023-07-21T07:35:47.061746+0000","last_fullsized":"2023-07-21T07:35:47.061746+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:10.578171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974306+0000","last_change":"2023-07-21T07:35:31.568304+0000","last_active":"2023-07-21T07:35:46.974306+0000","last_peered":"2023-07-21T07:35:46.974306+0000","last_clean":"2023-07-21T07:35:46.974306+0000","last_became_active":"2023-07-21T07:35:31.567923+0000","last_became_peered":"2023-07-21T07:35:31.567923+0000","last_unstale":"2023-07-21T07:35:46.974306+0000","last_undegraded":"2023-07-21T07:35:46.974306+0000","last_fullsized":"2023-07-21T07:35:46.974306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:45:49.839683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062569+0000","last_change":"2023-07-21T07:35:44.891451+0000","last_active":"2023-07-21T07:35:47.062569+0000","last_peered":"2023-07-21T07:35:47.062569+0000","last_clean":"2023-07-21T07:35:47.062569+0000","last_became_active":"2023-07-21T07:35:44.891172+0000","last_became_peered":"2023-07-21T07:35:44.891172+0000","last_unstale":"2023-07-21T07:35:47.062569+0000","last_undegraded":"2023-07-21T07:35:47.062569+0000","last_fullsized":"2023-07-21T07:35:47.062569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:17:50.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888417+0000","last_change":"2023-07-21T07:35:45.899896+0000","last_active":"2023-07-21T07:35:46.888417+0000","last_peered":"2023-07-21T07:35:46.888417+0000","last_clean":"2023-07-21T07:35:46.888417+0000","last_became_active":"2023-07-21T07:35:45.899604+0000","last_became_peered":"2023-07-21T07:35:45.899604+0000","last_unstale":"2023-07-21T07:35:46.888417+0000","last_undegraded":"2023-07-21T07:35:46.888417+0000","last_fullsized":"2023-07-21T07:35:46.888417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:38:26.175627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888389+0000","last_change":"2023-07-21T07:35:30.551432+0000","last_active":"2023-07-21T07:35:46.888389+0000","last_peered":"2023-07-21T07:35:46.888389+0000","last_clean":"2023-07-21T07:35:46.888389+0000","last_became_active":"2023-07-21T07:35:30.551141+0000","last_became_peered":"2023-07-21T07:35:30.551141+0000","last_unstale":"2023-07-21T07:35:46.888389+0000","last_undegraded":"2023-07-21T07:35:46.888389+0000","last_fullsized":"2023-07-21T07:35:46.888389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:18:44.588131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889545+0000","last_change":"2023-07-21T07:35:31.584271+0000","last_active":"2023-07-21T07:35:46.889545+0000","last_peered":"2023-07-21T07:35:46.889545+0000","last_clean":"2023-07-21T07:35:46.889545+0000","last_became_active":"2023-07-21T07:35:31.583788+0000","last_became_peered":"2023-07-21T07:35:31.583788+0000","last_unstale":"2023-07-21T07:35:46.889545+0000","last_undegraded":"2023-07-21T07:35:46.889545+0000","last_fullsized":"2023-07-21T07:35:46.889545+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:48.192496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888696+0000","last_change":"2023-07-21T07:35:44.897357+0000","last_active":"2023-07-21T07:35:46.888696+0000","last_peered":"2023-07-21T07:35:46.888696+0000","last_clean":"2023-07-21T07:35:46.888696+0000","last_became_active":"2023-07-21T07:35:44.897082+0000","last_became_peered":"2023-07-21T07:35:44.897082+0000","last_unstale":"2023-07-21T07:35:46.888696+0000","last_undegraded":"2023-07-21T07:35:46.888696+0000","last_fullsized":"2023-07-21T07:35:46.888696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:30:26.851327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063568+0000","last_change":"2023-07-21T07:35:45.895560+0000","last_active":"2023-07-21T07:35:47.063568+0000","last_peered":"2023-07-21T07:35:47.063568+0000","last_clean":"2023-07-21T07:35:47.063568+0000","last_became_active":"2023-07-21T07:35:45.895266+0000","last_became_peered":"2023-07-21T07:35:45.895266+0000","last_unstale":"2023-07-21T07:35:47.063568+0000","last_undegraded":"2023-07-21T07:35:47.063568+0000","last_fullsized":"2023-07-21T07:35:47.063568+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:34:56.784677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887260+0000","last_change":"2023-07-21T07:35:30.550649+0000","last_active":"2023-07-21T07:35:46.887260+0000","last_peered":"2023-07-21T07:35:46.887260+0000","last_clean":"2023-07-21T07:35:46.887260+0000","last_became_active":"2023-07-21T07:35:30.550349+0000","last_became_peered":"2023-07-21T07:35:30.550349+0000","last_unstale":"2023-07-21T07:35:46.887260+0000","last_undegraded":"2023-07-21T07:35:46.887260+0000","last_fullsized":"2023-07-21T07:35:46.887260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:55:30.715720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888306+0000","last_change":"2023-07-21T07:35:31.579255+0000","last_active":"2023-07-21T07:35:46.888306+0000","last_peered":"2023-07-21T07:35:46.888306+0000","last_clean":"2023-07-21T07:35:46.888306+0000","last_became_active":"2023-07-21T07:35:31.578910+0000","last_became_peered":"2023-07-21T07:35:31.578910+0000","last_unstale":"2023-07-21T07:35:46.888306+0000","last_undegraded":"2023-07-21T07:35:46.888306+0000","last_fullsized":"2023-07-21T07:35:46.888306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:03:29.132167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"39'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061628+0000","last_change":"2023-07-21T07:35:44.891970+0000","last_active":"2023-07-21T07:35:47.061628+0000","last_peered":"2023-07-21T07:35:47.061628+0000","last_clean":"2023-07-21T07:35:47.061628+0000","last_became_active":"2023-07-21T07:35:44.891737+0000","last_became_peered":"2023-07-21T07:35:44.891737+0000","last_unstale":"2023-07-21T07:35:47.061628+0000","last_undegraded":"2023-07-21T07:35:47.061628+0000","last_fullsized":"2023-07-21T07:35:47.061628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:57:03.161260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060540+0000","last_change":"2023-07-21T07:35:45.894069+0000","last_active":"2023-07-21T07:35:47.060540+0000","last_peered":"2023-07-21T07:35:47.060540+0000","last_clean":"2023-07-21T07:35:47.060540+0000","last_became_active":"2023-07-21T07:35:45.893542+0000","last_became_peered":"2023-07-21T07:35:45.893542+0000","last_unstale":"2023-07-21T07:35:47.060540+0000","last_undegraded":"2023-07-21T07:35:47.060540+0000","last_fullsized":"2023-07-21T07:35:47.060540+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:18:59.929550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975133+0000","last_change":"2023-07-21T07:35:30.549262+0000","last_active":"2023-07-21T07:35:46.975133+0000","last_peered":"2023-07-21T07:35:46.975133+0000","last_clean":"2023-07-21T07:35:46.975133+0000","last_became_active":"2023-07-21T07:35:30.548946+0000","last_became_peered":"2023-07-21T07:35:30.548946+0000","last_unstale":"2023-07-21T07:35:46.975133+0000","last_undegraded":"2023-07-21T07:35:46.975133+0000","last_fullsized":"2023-07-21T07:35:46.975133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:38:10.834208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887462+0000","last_change":"2023-07-21T07:35:31.572810+0000","last_active":"2023-07-21T07:35:46.887462+0000","last_peered":"2023-07-21T07:35:46.887462+0000","last_clean":"2023-07-21T07:35:46.887462+0000","last_became_active":"2023-07-21T07:35:31.572369+0000","last_became_peered":"2023-07-21T07:35:31.572369+0000","last_unstale":"2023-07-21T07:35:46.887462+0000","last_undegraded":"2023-07-21T07:35:46.887462+0000","last_fullsized":"2023-07-21T07:35:46.887462+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:46:09.627968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061358+0000","last_change":"2023-07-21T07:35:44.890780+0000","last_active":"2023-07-21T07:35:47.061358+0000","last_peered":"2023-07-21T07:35:47.061358+0000","last_clean":"2023-07-21T07:35:47.061358+0000","last_became_active":"2023-07-21T07:35:44.890547+0000","last_became_peered":"2023-07-21T07:35:44.890547+0000","last_unstale":"2023-07-21T07:35:47.061358+0000","last_undegraded":"2023-07-21T07:35:47.061358+0000","last_fullsized":"2023-07-21T07:35:47.061358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:14:14.498509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888275+0000","last_change":"2023-07-21T07:35:45.897282+0000","last_active":"2023-07-21T07:35:46.888275+0000","last_peered":"2023-07-21T07:35:46.888275+0000","last_clean":"2023-07-21T07:35:46.888275+0000","last_became_active":"2023-07-21T07:35:45.896993+0000","last_became_peered":"2023-07-21T07:35:45.896993+0000","last_unstale":"2023-07-21T07:35:46.888275+0000","last_undegraded":"2023-07-21T07:35:46.888275+0000","last_fullsized":"2023-07-21T07:35:46.888275+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:22:07.275516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062158+0000","last_change":"2023-07-21T07:35:30.552422+0000","last_active":"2023-07-21T07:35:47.062158+0000","last_peered":"2023-07-21T07:35:47.062158+0000","last_clean":"2023-07-21T07:35:47.062158+0000","last_became_active":"2023-07-21T07:35:30.552153+0000","last_became_peered":"2023-07-21T07:35:30.552153+0000","last_unstale":"2023-07-21T07:35:47.062158+0000","last_undegraded":"2023-07-21T07:35:47.062158+0000","last_fullsized":"2023-07-21T07:35:47.062158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:19:40.834625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062396+0000","last_change":"2023-07-21T07:35:31.572362+0000","last_active":"2023-07-21T07:35:47.062396+0000","last_peered":"2023-07-21T07:35:47.062396+0000","last_clean":"2023-07-21T07:35:47.062396+0000","last_became_active":"2023-07-21T07:35:31.572080+0000","last_became_peered":"2023-07-21T07:35:31.572080+0000","last_unstale":"2023-07-21T07:35:47.062396+0000","last_undegraded":"2023-07-21T07:35:47.062396+0000","last_fullsized":"2023-07-21T07:35:47.062396+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:13:25.635911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888841+0000","last_change":"2023-07-21T07:35:44.892311+0000","last_active":"2023-07-21T07:35:46.888841+0000","last_peered":"2023-07-21T07:35:46.888841+0000","last_clean":"2023-07-21T07:35:46.888841+0000","last_became_active":"2023-07-21T07:35:44.892011+0000","last_became_peered":"2023-07-21T07:35:44.892011+0000","last_unstale":"2023-07-21T07:35:46.888841+0000","last_undegraded":"2023-07-21T07:35:46.888841+0000","last_fullsized":"2023-07-21T07:35:46.888841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:15:16.208764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060965+0000","last_change":"2023-07-21T07:35:45.901417+0000","last_active":"2023-07-21T07:35:47.060965+0000","last_peered":"2023-07-21T07:35:47.060965+0000","last_clean":"2023-07-21T07:35:47.060965+0000","last_became_active":"2023-07-21T07:35:45.901116+0000","last_became_peered":"2023-07-21T07:35:45.901116+0000","last_unstale":"2023-07-21T07:35:47.060965+0000","last_undegraded":"2023-07-21T07:35:47.060965+0000","last_fullsized":"2023-07-21T07:35:47.060965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:32:52.395497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063463+0000","last_change":"2023-07-21T07:35:45.896120+0000","last_active":"2023-07-21T07:35:47.063463+0000","last_peered":"2023-07-21T07:35:47.063463+0000","last_clean":"2023-07-21T07:35:47.063463+0000","last_became_active":"2023-07-21T07:35:45.893735+0000","last_became_peered":"2023-07-21T07:35:45.893735+0000","last_unstale":"2023-07-21T07:35:47.063463+0000","last_undegraded":"2023-07-21T07:35:47.063463+0000","last_fullsized":"2023-07-21T07:35:47.063463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:15:40.813390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886251+0000","last_change":"2023-07-21T07:35:31.568296+0000","last_active":"2023-07-21T07:35:46.886251+0000","last_peered":"2023-07-21T07:35:46.886251+0000","last_clean":"2023-07-21T07:35:46.886251+0000","last_became_active":"2023-07-21T07:35:31.567956+0000","last_became_peered":"2023-07-21T07:35:31.567956+0000","last_unstale":"2023-07-21T07:35:46.886251+0000","last_undegraded":"2023-07-21T07:35:46.886251+0000","last_fullsized":"2023-07-21T07:35:46.886251+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:25:59.125576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975231+0000","last_change":"2023-07-21T07:35:45.902531+0000","last_active":"2023-07-21T07:35:46.975231+0000","last_peered":"2023-07-21T07:35:46.975231+0000","last_clean":"2023-07-21T07:35:46.975231+0000","last_became_active":"2023-07-21T07:35:45.902241+0000","last_became_peered":"2023-07-21T07:35:45.902241+0000","last_unstale":"2023-07-21T07:35:46.975231+0000","last_undegraded":"2023-07-21T07:35:46.975231+0000","last_fullsized":"2023-07-21T07:35:46.975231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:55:37.649618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062645+0000","last_change":"2023-07-21T07:35:31.566417+0000","last_active":"2023-07-21T07:35:47.062645+0000","last_peered":"2023-07-21T07:35:47.062645+0000","last_clean":"2023-07-21T07:35:47.062645+0000","last_became_active":"2023-07-21T07:35:31.565614+0000","last_became_peered":"2023-07-21T07:35:31.565614+0000","last_unstale":"2023-07-21T07:35:47.062645+0000","last_undegraded":"2023-07-21T07:35:47.062645+0000","last_fullsized":"2023-07-21T07:35:47.062645+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:33:53.955794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061198+0000","last_change":"2023-07-21T07:35:45.896935+0000","last_active":"2023-07-21T07:35:47.061198+0000","last_peered":"2023-07-21T07:35:47.061198+0000","last_clean":"2023-07-21T07:35:47.061198+0000","last_became_active":"2023-07-21T07:35:45.896660+0000","last_became_peered":"2023-07-21T07:35:45.896660+0000","last_unstale":"2023-07-21T07:35:47.061198+0000","last_undegraded":"2023-07-21T07:35:47.061198+0000","last_fullsized":"2023-07-21T07:35:47.061198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:46:10.840932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062582+0000","last_change":"2023-07-21T07:35:31.586191+0000","last_active":"2023-07-21T07:35:47.062582+0000","last_peered":"2023-07-21T07:35:47.062582+0000","last_clean":"2023-07-21T07:35:47.062582+0000","last_became_active":"2023-07-21T07:35:31.585881+0000","last_became_peered":"2023-07-21T07:35:31.585881+0000","last_unstale":"2023-07-21T07:35:47.062582+0000","last_undegraded":"2023-07-21T07:35:47.062582+0000","last_fullsized":"2023-07-21T07:35:47.062582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:42:18.162795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975145+0000","last_change":"2023-07-21T07:35:45.905154+0000","last_active":"2023-07-21T07:35:46.975145+0000","last_peered":"2023-07-21T07:35:46.975145+0000","last_clean":"2023-07-21T07:35:46.975145+0000","last_became_active":"2023-07-21T07:35:45.904809+0000","last_became_peered":"2023-07-21T07:35:45.904809+0000","last_unstale":"2023-07-21T07:35:46.975145+0000","last_undegraded":"2023-07-21T07:35:46.975145+0000","last_fullsized":"2023-07-21T07:35:46.975145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:20.396840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061284+0000","last_change":"2023-07-21T07:35:31.582080+0000","last_active":"2023-07-21T07:35:47.061284+0000","last_peered":"2023-07-21T07:35:47.061284+0000","last_clean":"2023-07-21T07:35:47.061284+0000","last_became_active":"2023-07-21T07:35:31.581824+0000","last_became_peered":"2023-07-21T07:35:31.581824+0000","last_unstale":"2023-07-21T07:35:47.061284+0000","last_undegraded":"2023-07-21T07:35:47.061284+0000","last_fullsized":"2023-07-21T07:35:47.061284+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:18:06.650041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887525+0000","last_change":"2023-07-21T07:35:45.903931+0000","last_active":"2023-07-21T07:35:46.887525+0000","last_peered":"2023-07-21T07:35:46.887525+0000","last_clean":"2023-07-21T07:35:46.887525+0000","last_became_active":"2023-07-21T07:35:45.903668+0000","last_became_peered":"2023-07-21T07:35:45.903668+0000","last_unstale":"2023-07-21T07:35:46.887525+0000","last_undegraded":"2023-07-21T07:35:46.887525+0000","last_fullsized":"2023-07-21T07:35:46.887525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:47.933083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061466+0000","last_change":"2023-07-21T07:35:31.583360+0000","last_active":"2023-07-21T07:35:47.061466+0000","last_peered":"2023-07-21T07:35:47.061466+0000","last_clean":"2023-07-21T07:35:47.061466+0000","last_became_active":"2023-07-21T07:35:31.582534+0000","last_became_peered":"2023-07-21T07:35:31.582534+0000","last_unstale":"2023-07-21T07:35:47.061466+0000","last_undegraded":"2023-07-21T07:35:47.061466+0000","last_fullsized":"2023-07-21T07:35:47.061466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:33:53.955794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062436+0000","last_change":"2023-07-21T07:35:45.901026+0000","last_active":"2023-07-21T07:35:47.062436+0000","last_peered":"2023-07-21T07:35:47.062436+0000","last_clean":"2023-07-21T07:35:47.062436+0000","last_became_active":"2023-07-21T07:35:45.900704+0000","last_became_peered":"2023-07-21T07:35:45.900704+0000","last_unstale":"2023-07-21T07:35:47.062436+0000","last_undegraded":"2023-07-21T07:35:47.062436+0000","last_fullsized":"2023-07-21T07:35:47.062436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:15:28.199088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062856+0000","last_change":"2023-07-21T07:35:31.580409+0000","last_active":"2023-07-21T07:35:47.062856+0000","last_peered":"2023-07-21T07:35:47.062856+0000","last_clean":"2023-07-21T07:35:47.062856+0000","last_became_active":"2023-07-21T07:35:31.580078+0000","last_became_peered":"2023-07-21T07:35:31.580078+0000","last_unstale":"2023-07-21T07:35:47.062856+0000","last_undegraded":"2023-07-21T07:35:47.062856+0000","last_fullsized":"2023-07-21T07:35:47.062856+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:17:11.999157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974093+0000","last_change":"2023-07-21T07:35:45.909064+0000","last_active":"2023-07-21T07:35:46.974093+0000","last_peered":"2023-07-21T07:35:46.974093+0000","last_clean":"2023-07-21T07:35:46.974093+0000","last_became_active":"2023-07-21T07:35:45.908784+0000","last_became_peered":"2023-07-21T07:35:45.908784+0000","last_unstale":"2023-07-21T07:35:46.974093+0000","last_undegraded":"2023-07-21T07:35:46.974093+0000","last_fullsized":"2023-07-21T07:35:46.974093+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:57:24.598149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888763+0000","last_change":"2023-07-21T07:35:31.575204+0000","last_active":"2023-07-21T07:35:46.888763+0000","last_peered":"2023-07-21T07:35:46.888763+0000","last_clean":"2023-07-21T07:35:46.888763+0000","last_became_active":"2023-07-21T07:35:31.574935+0000","last_became_peered":"2023-07-21T07:35:31.574935+0000","last_unstale":"2023-07-21T07:35:46.888763+0000","last_undegraded":"2023-07-21T07:35:46.888763+0000","last_fullsized":"2023-07-21T07:35:46.888763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:43:32.449934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060143+0000","last_change":"2023-07-21T07:35:45.897147+0000","last_active":"2023-07-21T07:35:47.060143+0000","last_peered":"2023-07-21T07:35:47.060143+0000","last_clean":"2023-07-21T07:35:47.060143+0000","last_became_active":"2023-07-21T07:35:45.896853+0000","last_became_peered":"2023-07-21T07:35:45.896853+0000","last_unstale":"2023-07-21T07:35:47.060143+0000","last_undegraded":"2023-07-21T07:35:47.060143+0000","last_fullsized":"2023-07-21T07:35:47.060143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:11:22.203386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061947+0000","last_change":"2023-07-21T07:35:31.575695+0000","last_active":"2023-07-21T07:35:47.061947+0000","last_peered":"2023-07-21T07:35:47.061947+0000","last_clean":"2023-07-21T07:35:47.061947+0000","last_became_active":"2023-07-21T07:35:31.574995+0000","last_became_peered":"2023-07-21T07:35:31.574995+0000","last_unstale":"2023-07-21T07:35:47.061947+0000","last_undegraded":"2023-07-21T07:35:47.061947+0000","last_fullsized":"2023-07-21T07:35:47.061947+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:26:21.678324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888124+0000","last_change":"2023-07-21T07:35:45.897229+0000","last_active":"2023-07-21T07:35:46.888124+0000","last_peered":"2023-07-21T07:35:46.888124+0000","last_clean":"2023-07-21T07:35:46.888124+0000","last_became_active":"2023-07-21T07:35:45.896948+0000","last_became_peered":"2023-07-21T07:35:45.896948+0000","last_unstale":"2023-07-21T07:35:46.888124+0000","last_undegraded":"2023-07-21T07:35:46.888124+0000","last_fullsized":"2023-07-21T07:35:46.888124+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:29:27.656646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.059771+0000","last_change":"2023-07-21T07:35:31.560958+0000","last_active":"2023-07-21T07:35:47.059771+0000","last_peered":"2023-07-21T07:35:47.059771+0000","last_clean":"2023-07-21T07:35:47.059771+0000","last_became_active":"2023-07-21T07:35:31.560610+0000","last_became_peered":"2023-07-21T07:35:31.560610+0000","last_unstale":"2023-07-21T07:35:47.059771+0000","last_undegraded":"2023-07-21T07:35:47.059771+0000","last_fullsized":"2023-07-21T07:35:47.059771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:10:24.363237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975245+0000","last_change":"2023-07-21T07:35:45.908609+0000","last_active":"2023-07-21T07:35:46.975245+0000","last_peered":"2023-07-21T07:35:46.975245+0000","last_clean":"2023-07-21T07:35:46.975245+0000","last_became_active":"2023-07-21T07:35:45.908308+0000","last_became_peered":"2023-07-21T07:35:45.908308+0000","last_unstale":"2023-07-21T07:35:46.975245+0000","last_undegraded":"2023-07-21T07:35:46.975245+0000","last_fullsized":"2023-07-21T07:35:46.975245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:31:32.294242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063618+0000","last_change":"2023-07-21T07:35:31.571165+0000","last_active":"2023-07-21T07:35:47.063618+0000","last_peered":"2023-07-21T07:35:47.063618+0000","last_clean":"2023-07-21T07:35:47.063618+0000","last_became_active":"2023-07-21T07:35:31.570834+0000","last_became_peered":"2023-07-21T07:35:31.570834+0000","last_unstale":"2023-07-21T07:35:47.063618+0000","last_undegraded":"2023-07-21T07:35:47.063618+0000","last_fullsized":"2023-07-21T07:35:47.063618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:14:27.722253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061629+0000","last_change":"2023-07-21T07:35:45.900018+0000","last_active":"2023-07-21T07:35:47.061629+0000","last_peered":"2023-07-21T07:35:47.061629+0000","last_clean":"2023-07-21T07:35:47.061629+0000","last_became_active":"2023-07-21T07:35:45.899772+0000","last_became_peered":"2023-07-21T07:35:45.899772+0000","last_unstale":"2023-07-21T07:35:47.061629+0000","last_undegraded":"2023-07-21T07:35:47.061629+0000","last_fullsized":"2023-07-21T07:35:47.061629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:54:31.841951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888227+0000","last_change":"2023-07-21T07:35:31.570945+0000","last_active":"2023-07-21T07:35:46.888227+0000","last_peered":"2023-07-21T07:35:46.888227+0000","last_clean":"2023-07-21T07:35:46.888227+0000","last_became_active":"2023-07-21T07:35:31.570678+0000","last_became_peered":"2023-07-21T07:35:31.570678+0000","last_unstale":"2023-07-21T07:35:46.888227+0000","last_undegraded":"2023-07-21T07:35:46.888227+0000","last_fullsized":"2023-07-21T07:35:46.888227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:15:02.879729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887913+0000","last_change":"2023-07-21T07:35:45.903523+0000","last_active":"2023-07-21T07:35:46.887913+0000","last_peered":"2023-07-21T07:35:46.887913+0000","last_clean":"2023-07-21T07:35:46.887913+0000","last_became_active":"2023-07-21T07:35:45.902799+0000","last_became_peered":"2023-07-21T07:35:45.902799+0000","last_unstale":"2023-07-21T07:35:46.887913+0000","last_undegraded":"2023-07-21T07:35:46.887913+0000","last_fullsized":"2023-07-21T07:35:46.887913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:03:43.468570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061485+0000","last_change":"2023-07-21T07:35:31.572474+0000","last_active":"2023-07-21T07:35:47.061485+0000","last_peered":"2023-07-21T07:35:47.061485+0000","last_clean":"2023-07-21T07:35:47.061485+0000","last_became_active":"2023-07-21T07:35:31.572214+0000","last_became_peered":"2023-07-21T07:35:31.572214+0000","last_unstale":"2023-07-21T07:35:47.061485+0000","last_undegraded":"2023-07-21T07:35:47.061485+0000","last_fullsized":"2023-07-21T07:35:47.061485+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:52:07.263132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062307+0000","last_change":"2023-07-21T07:35:45.900065+0000","last_active":"2023-07-21T07:35:47.062307+0000","last_peered":"2023-07-21T07:35:47.062307+0000","last_clean":"2023-07-21T07:35:47.062307+0000","last_became_active":"2023-07-21T07:35:45.899778+0000","last_became_peered":"2023-07-21T07:35:45.899778+0000","last_unstale":"2023-07-21T07:35:47.062307+0000","last_undegraded":"2023-07-21T07:35:47.062307+0000","last_fullsized":"2023-07-21T07:35:47.062307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:18:28.590568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061947+0000","last_change":"2023-07-21T07:35:31.575679+0000","last_active":"2023-07-21T07:35:47.061947+0000","last_peered":"2023-07-21T07:35:47.061947+0000","last_clean":"2023-07-21T07:35:47.061947+0000","last_became_active":"2023-07-21T07:35:31.575365+0000","last_became_peered":"2023-07-21T07:35:31.575365+0000","last_unstale":"2023-07-21T07:35:47.061947+0000","last_undegraded":"2023-07-21T07:35:47.061947+0000","last_fullsized":"2023-07-21T07:35:47.061947+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:16:08.917825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974384+0000","last_change":"2023-07-21T07:35:45.895108+0000","last_active":"2023-07-21T07:35:46.974384+0000","last_peered":"2023-07-21T07:35:46.974384+0000","last_clean":"2023-07-21T07:35:46.974384+0000","last_became_active":"2023-07-21T07:35:45.894807+0000","last_became_peered":"2023-07-21T07:35:45.894807+0000","last_unstale":"2023-07-21T07:35:46.974384+0000","last_undegraded":"2023-07-21T07:35:46.974384+0000","last_fullsized":"2023-07-21T07:35:46.974384+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:18:08.271364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060454+0000","last_change":"2023-07-21T07:35:31.564789+0000","last_active":"2023-07-21T07:35:47.060454+0000","last_peered":"2023-07-21T07:35:47.060454+0000","last_clean":"2023-07-21T07:35:47.060454+0000","last_became_active":"2023-07-21T07:35:31.564503+0000","last_became_peered":"2023-07-21T07:35:31.564503+0000","last_unstale":"2023-07-21T07:35:47.060454+0000","last_undegraded":"2023-07-21T07:35:47.060454+0000","last_fullsized":"2023-07-21T07:35:47.060454+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:01:10.985979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060754+0000","last_change":"2023-07-21T07:35:45.899100+0000","last_active":"2023-07-21T07:35:47.060754+0000","last_peered":"2023-07-21T07:35:47.060754+0000","last_clean":"2023-07-21T07:35:47.060754+0000","last_became_active":"2023-07-21T07:35:45.898518+0000","last_became_peered":"2023-07-21T07:35:45.898518+0000","last_unstale":"2023-07-21T07:35:47.060754+0000","last_undegraded":"2023-07-21T07:35:47.060754+0000","last_fullsized":"2023-07-21T07:35:47.060754+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:18:28.590568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061357+0000","last_change":"2023-07-21T07:35:31.583163+0000","last_active":"2023-07-21T07:35:47.061357+0000","last_peered":"2023-07-21T07:35:47.061357+0000","last_clean":"2023-07-21T07:35:47.061357+0000","last_became_active":"2023-07-21T07:35:31.582878+0000","last_became_peered":"2023-07-21T07:35:31.582878+0000","last_unstale":"2023-07-21T07:35:47.061357+0000","last_undegraded":"2023-07-21T07:35:47.061357+0000","last_fullsized":"2023-07-21T07:35:47.061357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:15:49.778614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974114+0000","last_change":"2023-07-21T07:35:45.907377+0000","last_active":"2023-07-21T07:35:46.974114+0000","last_peered":"2023-07-21T07:35:46.974114+0000","last_clean":"2023-07-21T07:35:46.974114+0000","last_became_active":"2023-07-21T07:35:45.907078+0000","last_became_peered":"2023-07-21T07:35:45.907078+0000","last_unstale":"2023-07-21T07:35:46.974114+0000","last_undegraded":"2023-07-21T07:35:46.974114+0000","last_fullsized":"2023-07-21T07:35:46.974114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:05:08.946687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063375+0000","last_change":"2023-07-21T07:35:31.565879+0000","last_active":"2023-07-21T07:35:47.063375+0000","last_peered":"2023-07-21T07:35:47.063375+0000","last_clean":"2023-07-21T07:35:47.063375+0000","last_became_active":"2023-07-21T07:35:31.565592+0000","last_became_peered":"2023-07-21T07:35:31.565592+0000","last_unstale":"2023-07-21T07:35:47.063375+0000","last_undegraded":"2023-07-21T07:35:47.063375+0000","last_fullsized":"2023-07-21T07:35:47.063375+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:59:31.677609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063634+0000","last_change":"2023-07-21T07:35:45.904078+0000","last_active":"2023-07-21T07:35:47.063634+0000","last_peered":"2023-07-21T07:35:47.063634+0000","last_clean":"2023-07-21T07:35:47.063634+0000","last_became_active":"2023-07-21T07:35:45.903818+0000","last_became_peered":"2023-07-21T07:35:45.903818+0000","last_unstale":"2023-07-21T07:35:47.063634+0000","last_undegraded":"2023-07-21T07:35:47.063634+0000","last_fullsized":"2023-07-21T07:35:47.063634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:16:00.601675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061888+0000","last_change":"2023-07-21T07:35:31.565812+0000","last_active":"2023-07-21T07:35:47.061888+0000","last_peered":"2023-07-21T07:35:47.061888+0000","last_clean":"2023-07-21T07:35:47.061888+0000","last_became_active":"2023-07-21T07:35:31.565496+0000","last_became_peered":"2023-07-21T07:35:31.565496+0000","last_unstale":"2023-07-21T07:35:47.061888+0000","last_undegraded":"2023-07-21T07:35:47.061888+0000","last_fullsized":"2023-07-21T07:35:47.061888+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:24:31.460797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888422+0000","last_change":"2023-07-21T07:35:45.893151+0000","last_active":"2023-07-21T07:35:46.888422+0000","last_peered":"2023-07-21T07:35:46.888422+0000","last_clean":"2023-07-21T07:35:46.888422+0000","last_became_active":"2023-07-21T07:35:45.892851+0000","last_became_peered":"2023-07-21T07:35:45.892851+0000","last_unstale":"2023-07-21T07:35:46.888422+0000","last_undegraded":"2023-07-21T07:35:46.888422+0000","last_fullsized":"2023-07-21T07:35:46.888422+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:37:02.528899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063367+0000","last_change":"2023-07-21T07:35:31.580543+0000","last_active":"2023-07-21T07:35:47.063367+0000","last_peered":"2023-07-21T07:35:47.063367+0000","last_clean":"2023-07-21T07:35:47.063367+0000","last_became_active":"2023-07-21T07:35:31.580216+0000","last_became_peered":"2023-07-21T07:35:31.580216+0000","last_unstale":"2023-07-21T07:35:47.063367+0000","last_undegraded":"2023-07-21T07:35:47.063367+0000","last_fullsized":"2023-07-21T07:35:47.063367+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:07:33.277440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062178+0000","last_change":"2023-07-21T07:35:45.904288+0000","last_active":"2023-07-21T07:35:47.062178+0000","last_peered":"2023-07-21T07:35:47.062178+0000","last_clean":"2023-07-21T07:35:47.062178+0000","last_became_active":"2023-07-21T07:35:45.903967+0000","last_became_peered":"2023-07-21T07:35:45.903967+0000","last_unstale":"2023-07-21T07:35:47.062178+0000","last_undegraded":"2023-07-21T07:35:47.062178+0000","last_fullsized":"2023-07-21T07:35:47.062178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:05:21.262500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887695+0000","last_change":"2023-07-21T07:35:31.579241+0000","last_active":"2023-07-21T07:35:46.887695+0000","last_peered":"2023-07-21T07:35:46.887695+0000","last_clean":"2023-07-21T07:35:46.887695+0000","last_became_active":"2023-07-21T07:35:31.578961+0000","last_became_peered":"2023-07-21T07:35:31.578961+0000","last_unstale":"2023-07-21T07:35:46.887695+0000","last_undegraded":"2023-07-21T07:35:46.887695+0000","last_fullsized":"2023-07-21T07:35:46.887695+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:35:10.701598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975183+0000","last_change":"2023-07-21T07:35:45.905372+0000","last_active":"2023-07-21T07:35:46.975183+0000","last_peered":"2023-07-21T07:35:46.975183+0000","last_clean":"2023-07-21T07:35:46.975183+0000","last_became_active":"2023-07-21T07:35:45.902950+0000","last_became_peered":"2023-07-21T07:35:45.902950+0000","last_unstale":"2023-07-21T07:35:46.975183+0000","last_undegraded":"2023-07-21T07:35:46.975183+0000","last_fullsized":"2023-07-21T07:35:46.975183+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:06:05.766251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061342+0000","last_change":"2023-07-21T07:35:31.574882+0000","last_active":"2023-07-21T07:35:47.061342+0000","last_peered":"2023-07-21T07:35:47.061342+0000","last_clean":"2023-07-21T07:35:47.061342+0000","last_became_active":"2023-07-21T07:35:31.574354+0000","last_became_peered":"2023-07-21T07:35:31.574354+0000","last_unstale":"2023-07-21T07:35:47.061342+0000","last_undegraded":"2023-07-21T07:35:47.061342+0000","last_fullsized":"2023-07-21T07:35:47.061342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:56:19.832167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886852+0000","last_change":"2023-07-21T07:35:45.902655+0000","last_active":"2023-07-21T07:35:46.886852+0000","last_peered":"2023-07-21T07:35:46.886852+0000","last_clean":"2023-07-21T07:35:46.886852+0000","last_became_active":"2023-07-21T07:35:45.902174+0000","last_became_peered":"2023-07-21T07:35:45.902174+0000","last_unstale":"2023-07-21T07:35:46.886852+0000","last_undegraded":"2023-07-21T07:35:46.886852+0000","last_fullsized":"2023-07-21T07:35:46.886852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:00:56.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974826+0000","last_change":"2023-07-21T07:35:31.574434+0000","last_active":"2023-07-21T07:35:46.974826+0000","last_peered":"2023-07-21T07:35:46.974826+0000","last_clean":"2023-07-21T07:35:46.974826+0000","last_became_active":"2023-07-21T07:35:31.574069+0000","last_became_peered":"2023-07-21T07:35:31.574069+0000","last_unstale":"2023-07-21T07:35:46.974826+0000","last_undegraded":"2023-07-21T07:35:46.974826+0000","last_fullsized":"2023-07-21T07:35:46.974826+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:22:25.684343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888025+0000","last_change":"2023-07-21T07:35:45.901451+0000","last_active":"2023-07-21T07:35:46.888025+0000","last_peered":"2023-07-21T07:35:46.888025+0000","last_clean":"2023-07-21T07:35:46.888025+0000","last_became_active":"2023-07-21T07:35:45.900777+0000","last_became_peered":"2023-07-21T07:35:45.900777+0000","last_unstale":"2023-07-21T07:35:46.888025+0000","last_undegraded":"2023-07-21T07:35:46.888025+0000","last_fullsized":"2023-07-21T07:35:46.888025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:00:56.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062298+0000","last_change":"2023-07-21T07:35:31.569009+0000","last_active":"2023-07-21T07:35:47.062298+0000","last_peered":"2023-07-21T07:35:47.062298+0000","last_clean":"2023-07-21T07:35:47.062298+0000","last_became_active":"2023-07-21T07:35:31.568723+0000","last_became_peered":"2023-07-21T07:35:31.568723+0000","last_unstale":"2023-07-21T07:35:47.062298+0000","last_undegraded":"2023-07-21T07:35:47.062298+0000","last_fullsized":"2023-07-21T07:35:47.062298+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:26:25.366366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889768+0000","last_change":"2023-07-21T07:35:45.905694+0000","last_active":"2023-07-21T07:35:46.889768+0000","last_peered":"2023-07-21T07:35:46.889768+0000","last_clean":"2023-07-21T07:35:46.889768+0000","last_became_active":"2023-07-21T07:35:45.899336+0000","last_became_peered":"2023-07-21T07:35:45.899336+0000","last_unstale":"2023-07-21T07:35:46.889768+0000","last_undegraded":"2023-07-21T07:35:46.889768+0000","last_fullsized":"2023-07-21T07:35:46.889768+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:26:40.433463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061549+0000","last_change":"2023-07-21T07:35:31.574487+0000","last_active":"2023-07-21T07:35:47.061549+0000","last_peered":"2023-07-21T07:35:47.061549+0000","last_clean":"2023-07-21T07:35:47.061549+0000","last_became_active":"2023-07-21T07:35:31.574154+0000","last_became_peered":"2023-07-21T07:35:31.574154+0000","last_unstale":"2023-07-21T07:35:47.061549+0000","last_undegraded":"2023-07-21T07:35:47.061549+0000","last_fullsized":"2023-07-21T07:35:47.061549+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:59:31.677609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974295+0000","last_change":"2023-07-21T07:35:45.904015+0000","last_active":"2023-07-21T07:35:46.974295+0000","last_peered":"2023-07-21T07:35:46.974295+0000","last_clean":"2023-07-21T07:35:46.974295+0000","last_became_active":"2023-07-21T07:35:45.903746+0000","last_became_peered":"2023-07-21T07:35:45.903746+0000","last_unstale":"2023-07-21T07:35:46.974295+0000","last_undegraded":"2023-07-21T07:35:46.974295+0000","last_fullsized":"2023-07-21T07:35:46.974295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:07:42.293709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975324+0000","last_change":"2023-07-21T07:35:31.568180+0000","last_active":"2023-07-21T07:35:46.975324+0000","last_peered":"2023-07-21T07:35:46.975324+0000","last_clean":"2023-07-21T07:35:46.975324+0000","last_became_active":"2023-07-21T07:35:31.567871+0000","last_became_peered":"2023-07-21T07:35:31.567871+0000","last_unstale":"2023-07-21T07:35:46.975324+0000","last_undegraded":"2023-07-21T07:35:46.975324+0000","last_fullsized":"2023-07-21T07:35:46.975324+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:17:03.048087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887104+0000","last_change":"2023-07-21T07:35:45.896103+0000","last_active":"2023-07-21T07:35:46.887104+0000","last_peered":"2023-07-21T07:35:46.887104+0000","last_clean":"2023-07-21T07:35:46.887104+0000","last_became_active":"2023-07-21T07:35:45.895674+0000","last_became_peered":"2023-07-21T07:35:45.895674+0000","last_unstale":"2023-07-21T07:35:46.887104+0000","last_undegraded":"2023-07-21T07:35:46.887104+0000","last_fullsized":"2023-07-21T07:35:46.887104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:32:53.808044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887471+0000","last_change":"2023-07-21T07:35:31.566207+0000","last_active":"2023-07-21T07:35:46.887471+0000","last_peered":"2023-07-21T07:35:46.887471+0000","last_clean":"2023-07-21T07:35:46.887471+0000","last_became_active":"2023-07-21T07:35:31.565950+0000","last_became_peered":"2023-07-21T07:35:31.565950+0000","last_unstale":"2023-07-21T07:35:46.887471+0000","last_undegraded":"2023-07-21T07:35:46.887471+0000","last_fullsized":"2023-07-21T07:35:46.887471+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:42:14.784293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889101+0000","last_change":"2023-07-21T07:35:45.907598+0000","last_active":"2023-07-21T07:35:46.889101+0000","last_peered":"2023-07-21T07:35:46.889101+0000","last_clean":"2023-07-21T07:35:46.889101+0000","last_became_active":"2023-07-21T07:35:45.905863+0000","last_became_peered":"2023-07-21T07:35:45.905863+0000","last_unstale":"2023-07-21T07:35:46.889101+0000","last_undegraded":"2023-07-21T07:35:46.889101+0000","last_fullsized":"2023-07-21T07:35:46.889101+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:04.651542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063236+0000","last_change":"2023-07-21T07:35:31.585808+0000","last_active":"2023-07-21T07:35:47.063236+0000","last_peered":"2023-07-21T07:35:47.063236+0000","last_clean":"2023-07-21T07:35:47.063236+0000","last_became_active":"2023-07-21T07:35:31.585492+0000","last_became_peered":"2023-07-21T07:35:31.585492+0000","last_unstale":"2023-07-21T07:35:47.063236+0000","last_undegraded":"2023-07-21T07:35:47.063236+0000","last_fullsized":"2023-07-21T07:35:47.063236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:35:44.955028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888951+0000","last_change":"2023-07-21T07:35:45.900650+0000","last_active":"2023-07-21T07:35:46.888951+0000","last_peered":"2023-07-21T07:35:46.888951+0000","last_clean":"2023-07-21T07:35:46.888951+0000","last_became_active":"2023-07-21T07:35:45.900372+0000","last_became_peered":"2023-07-21T07:35:45.900372+0000","last_unstale":"2023-07-21T07:35:46.888951+0000","last_undegraded":"2023-07-21T07:35:46.888951+0000","last_fullsized":"2023-07-21T07:35:46.888951+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:35:25.038001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886644+0000","last_change":"2023-07-21T07:35:31.564194+0000","last_active":"2023-07-21T07:35:46.886644+0000","last_peered":"2023-07-21T07:35:46.886644+0000","last_clean":"2023-07-21T07:35:46.886644+0000","last_became_active":"2023-07-21T07:35:31.563915+0000","last_became_peered":"2023-07-21T07:35:31.563915+0000","last_unstale":"2023-07-21T07:35:46.886644+0000","last_undegraded":"2023-07-21T07:35:46.886644+0000","last_fullsized":"2023-07-21T07:35:46.886644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:35:10.701598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060348+0000","last_change":"2023-07-21T07:35:45.900999+0000","last_active":"2023-07-21T07:35:47.060348+0000","last_peered":"2023-07-21T07:35:47.060348+0000","last_clean":"2023-07-21T07:35:47.060348+0000","last_became_active":"2023-07-21T07:35:45.900694+0000","last_became_peered":"2023-07-21T07:35:45.900694+0000","last_unstale":"2023-07-21T07:35:47.060348+0000","last_undegraded":"2023-07-21T07:35:47.060348+0000","last_fullsized":"2023-07-21T07:35:47.060348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:21:05.644293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060401+0000","last_change":"2023-07-21T07:35:31.570813+0000","last_active":"2023-07-21T07:35:47.060401+0000","last_peered":"2023-07-21T07:35:47.060401+0000","last_clean":"2023-07-21T07:35:47.060401+0000","last_became_active":"2023-07-21T07:35:31.570509+0000","last_became_peered":"2023-07-21T07:35:31.570509+0000","last_unstale":"2023-07-21T07:35:47.060401+0000","last_undegraded":"2023-07-21T07:35:47.060401+0000","last_fullsized":"2023-07-21T07:35:47.060401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:11:48.491690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974403+0000","last_change":"2023-07-21T07:35:45.908198+0000","last_active":"2023-07-21T07:35:46.974403+0000","last_peered":"2023-07-21T07:35:46.974403+0000","last_clean":"2023-07-21T07:35:46.974403+0000","last_became_active":"2023-07-21T07:35:45.907901+0000","last_became_peered":"2023-07-21T07:35:45.907901+0000","last_unstale":"2023-07-21T07:35:46.974403+0000","last_undegraded":"2023-07-21T07:35:46.974403+0000","last_fullsized":"2023-07-21T07:35:46.974403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:26:23.427825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060555+0000","last_change":"2023-07-21T07:35:31.576630+0000","last_active":"2023-07-21T07:35:47.060555+0000","last_peered":"2023-07-21T07:35:47.060555+0000","last_clean":"2023-07-21T07:35:47.060555+0000","last_became_active":"2023-07-21T07:35:31.576116+0000","last_became_peered":"2023-07-21T07:35:31.576116+0000","last_unstale":"2023-07-21T07:35:47.060555+0000","last_undegraded":"2023-07-21T07:35:47.060555+0000","last_fullsized":"2023-07-21T07:35:47.060555+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:05:52.084304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886782+0000","last_change":"2023-07-21T07:35:45.890880+0000","last_active":"2023-07-21T07:35:46.886782+0000","last_peered":"2023-07-21T07:35:46.886782+0000","last_clean":"2023-07-21T07:35:46.886782+0000","last_became_active":"2023-07-21T07:35:45.890544+0000","last_became_peered":"2023-07-21T07:35:45.890544+0000","last_unstale":"2023-07-21T07:35:46.886782+0000","last_undegraded":"2023-07-21T07:35:46.886782+0000","last_fullsized":"2023-07-21T07:35:46.886782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:17:17.384490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974978+0000","last_change":"2023-07-21T07:35:31.572534+0000","last_active":"2023-07-21T07:35:46.974978+0000","last_peered":"2023-07-21T07:35:46.974978+0000","last_clean":"2023-07-21T07:35:46.974978+0000","last_became_active":"2023-07-21T07:35:31.572252+0000","last_became_peered":"2023-07-21T07:35:31.572252+0000","last_unstale":"2023-07-21T07:35:46.974978+0000","last_undegraded":"2023-07-21T07:35:46.974978+0000","last_fullsized":"2023-07-21T07:35:46.974978+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:25:59.125576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886194+0000","last_change":"2023-07-21T07:35:45.891383+0000","last_active":"2023-07-21T07:35:46.886194+0000","last_peered":"2023-07-21T07:35:46.886194+0000","last_clean":"2023-07-21T07:35:46.886194+0000","last_became_active":"2023-07-21T07:35:45.891075+0000","last_became_peered":"2023-07-21T07:35:45.891075+0000","last_unstale":"2023-07-21T07:35:46.886194+0000","last_undegraded":"2023-07-21T07:35:46.886194+0000","last_fullsized":"2023-07-21T07:35:46.886194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:29:27.656646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888441+0000","last_change":"2023-07-21T07:35:31.567420+0000","last_active":"2023-07-21T07:35:46.888441+0000","last_peered":"2023-07-21T07:35:46.888441+0000","last_clean":"2023-07-21T07:35:46.888441+0000","last_became_active":"2023-07-21T07:35:31.567119+0000","last_became_peered":"2023-07-21T07:35:31.567119+0000","last_unstale":"2023-07-21T07:35:46.888441+0000","last_undegraded":"2023-07-21T07:35:46.888441+0000","last_fullsized":"2023-07-21T07:35:46.888441+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:55:23.313215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061617+0000","last_change":"2023-07-21T07:35:45.898128+0000","last_active":"2023-07-21T07:35:47.061617+0000","last_peered":"2023-07-21T07:35:47.061617+0000","last_clean":"2023-07-21T07:35:47.061617+0000","last_became_active":"2023-07-21T07:35:45.897804+0000","last_became_peered":"2023-07-21T07:35:45.897804+0000","last_unstale":"2023-07-21T07:35:47.061617+0000","last_undegraded":"2023-07-21T07:35:47.061617+0000","last_fullsized":"2023-07-21T07:35:47.061617+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:06:02.999336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889181+0000","last_change":"2023-07-21T07:35:31.572060+0000","last_active":"2023-07-21T07:35:46.889181+0000","last_peered":"2023-07-21T07:35:46.889181+0000","last_clean":"2023-07-21T07:35:46.889181+0000","last_became_active":"2023-07-21T07:35:31.571747+0000","last_became_peered":"2023-07-21T07:35:31.571747+0000","last_unstale":"2023-07-21T07:35:46.889181+0000","last_undegraded":"2023-07-21T07:35:46.889181+0000","last_fullsized":"2023-07-21T07:35:46.889181+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:46:09.627968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3869,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1077248,"data_stored":791619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.498}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.38900000000000001}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.40600000000000003}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.34699999999999998}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":191710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.4990000000000006,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.4039999999999999,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.505},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.625}]},{"osd":4,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40799999999999997}]},{"osd":5,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.437},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.48099999999999998}]},{"osd":7,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.51700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":198236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.245},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1052672,"data_stored":780934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.497}]},{"osd":2,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":199620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.313}]},{"osd":1,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.375}]},{"osd":3,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.505},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63100000000000001}]},{"osd":7,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.53600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":202677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.29999999999999999}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.373}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.752},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":199172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":10.18,"5min":10.18,"15min":10.18},"last":0.624},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":10.207000000000001,"5min":10.207000000000001,"15min":10.207000000000001},"last":0.53200000000000003}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.378},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.504}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":198098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.622},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.74199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:35:50.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:35:50.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.201+0000 7f46016b7700 1 Processor -- start 2023-07-21T07:35:50.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.201+0000 7f46016b7700 1 -- start start 2023-07-21T07:35:50.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.201+0000 7f46016b7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45fc151ac0 0x7f45fc0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:50.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f46016b7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc155390 con 0x7f45fc0c47d0 2023-07-21T07:35:50.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f46016b7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc0c83e0 con 0x7f45fc0c4c50 2023-07-21T07:35:50.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f46016b7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0bd7b0 con 0x7f45fc151ac0 2023-07-21T07:35:50.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45fa7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f45fc0c47d0 0x7f45fc0c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42740/0 (socket says 172.21.15.6:42740) 2023-07-21T07:35:50.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45fa7fc700 1 -- 172.21.15.6:0/1600881746 learned_addr learned my addr 172.21.15.6:0/1600881746 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:50.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45faffd700 1 --2- 172.21.15.6:0/1600881746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45fc151ac0 0x7f45fc0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:50.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719402058 0 0) 0x7f45fc155390 con 0x7f45fc0c47d0 2023-07-21T07:35:50.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45e40035b0 con 0x7f45fc0c47d0 2023-07-21T07:35:50.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 799317317 0 0) 0x7f45e40035b0 con 0x7f45fc0c47d0 2023-07-21T07:35:50.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45fc151ac0 msgr2=0x7f45fc0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:50.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 --2- 172.21.15.6:0/1600881746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45fc151ac0 0x7f45fc0c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 >> v1:172.21.15.86:6789/0 conn(0x7f45fc0c4c50 legacy=0x7f45fc0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc154780 con 0x7f45fc0c47d0 2023-07-21T07:35:50.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f45f0001670 con 0x7f45fc0c47d0 2023-07-21T07:35:50.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 >> v1:172.21.15.6:6789/0 conn(0x7f45fc0c47d0 legacy=0x7f45fc0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 --2- 172.21.15.6:0/1600881746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45e4003a30 0x7f45e4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 --2- 172.21.15.6:0/1600881746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e4004850 0x7f45e4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 --2- 172.21.15.6:0/1600881746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45fc151ac0 0x7f45e40052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e400bba0 con 0x7f45e4004850 2023-07-21T07:35:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e400bd10 con 0x7f45e4003a30 2023-07-21T07:35:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e400bed0 con 0x7f45fc151ac0 2023-07-21T07:35:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.202+0000 7f45fa7fc700 1 --2- 172.21.15.6:0/1600881746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e4004850 0x7f45e4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:50.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.203+0000 7f45faffd700 1 --2- 172.21.15.6:0/1600881746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45e4003a30 0x7f45e4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:50.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.203+0000 7f45fb7fe700 1 --2- 172.21.15.6:0/1600881746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45fc151ac0 0x7f45e40052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:50.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.203+0000 7f45fa7fc700 1 -- 172.21.15.6:0/1600881746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45fc151ac0 msgr2=0x7f45e40052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:50.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.203+0000 7f45fa7fc700 1 --2- 172.21.15.6:0/1600881746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45fc151ac0 0x7f45e40052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.203+0000 7f45fa7fc700 1 -- 172.21.15.6:0/1600881746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45e4003a30 msgr2=0x7f45e4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:50.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.203+0000 7f45fa7fc700 1 --2- 172.21.15.6:0/1600881746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45e4003a30 0x7f45e4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.203+0000 7f45fa7fc700 1 -- 172.21.15.6:0/1600881746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e40035b0 con 0x7f45e4004850 2023-07-21T07:35:50.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.203+0000 7f45fa7fc700 1 --2- 172.21.15.6:0/1600881746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e4004850 0x7f45e4004cd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f45f000c2a0 tx=0x7f45e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86b6e8ec8a3ecb2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:50.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.203+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0007c10 con 0x7f45e4004850 2023-07-21T07:35:50.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.203+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f000cdc0 con 0x7f45e4004850 2023-07-21T07:35:50.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.203+0000 7f45f9ffb700 1 -- 172.21.15.6:0/1600881746 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0005ba0 con 0x7f45e4004850 2023-07-21T07:35:50.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.204+0000 7f46016b7700 1 -- 172.21.15.6:0/1600881746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e4004850 msgr2=0x7f45e4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.204+0000 7f46016b7700 1 --2- 172.21.15.6:0/1600881746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45e4004850 0x7f45e4004cd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f45f000c2a0 tx=0x7f45e4005880 comp rx=0 tx=0).stop 2023-07-21T07:35:50.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.204+0000 7f45fb7fe700 1 -- 172.21.15.6:0/1600881746 reap_dead start 2023-07-21T07:35:50.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.204+0000 7f46016b7700 1 -- 172.21.15.6:0/1600881746 shutdown_connections 2023-07-21T07:35:50.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.204+0000 7f46016b7700 1 -- 172.21.15.6:0/1600881746 >> 172.21.15.6:0/1600881746 conn(0x7f45fc0717c0 msgr2=0x7f45fc071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:50.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.204+0000 7f46016b7700 1 -- 172.21.15.6:0/1600881746 shutdown_connections 2023-07-21T07:35:50.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.204+0000 7f46016b7700 1 -- 172.21.15.6:0/1600881746 wait complete. 2023-07-21T07:35:50.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.205+0000 7f46016b7700 1 Processor -- start 2023-07-21T07:35:50.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.205+0000 7f46016b7700 1 -- start start 2023-07-21T07:35:50.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.206+0000 7f46016b7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45e4004850 0x7f45fc1edc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:50.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.206+0000 7f46016b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45fc1ea500 0x7f45fc150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:50.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.206+0000 7f46016b7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45fc156cd0 0x7f45fc157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:50.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.206+0000 7f46016b7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0c15e0 con 0x7f45fc1ea500 2023-07-21T07:35:50.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.206+0000 7f46016b7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0c1300 con 0x7f45e4004850 2023-07-21T07:35:50.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.206+0000 7f46016b7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc1ed160 con 0x7f45fc156cd0 2023-07-21T07:35:50.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.206+0000 7f45fa7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45fc1ea500 0x7f45fc150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:50.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.206+0000 7f45fa7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45fc1ea500 0x7f45fc150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34732/0 (socket says 172.21.15.6:34732) 2023-07-21T07:35:50.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.206+0000 7f45fa7fc700 1 -- 172.21.15.6:0/414979939 learned_addr learned my addr 172.21.15.6:0/414979939 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:50.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f45faffd700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45e4004850 0x7f45fc1edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:50.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f45fb7fe700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45fc156cd0 0x7f45fc157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:50.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f45fa7fc700 1 -- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45fc156cd0 msgr2=0x7f45fc157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f45fa7fc700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45fc156cd0 0x7f45fc157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f45fa7fc700 1 -- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45e4004850 msgr2=0x7f45fc1edc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f45fa7fc700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45e4004850 0x7f45fc1edc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f45fa7fc700 1 -- 172.21.15.6:0/414979939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc1ed440 con 0x7f45fc1ea500 2023-07-21T07:35:50.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f45faffd700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45e4004850 0x7f45fc1edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:50.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f45fa7fc700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45fc1ea500 0x7f45fc150c70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f45e400bce0 tx=0x7f45fc155300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:50.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f45e37fe700 1 -- 172.21.15.6:0/414979939 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0001630 con 0x7f45fc1ea500 2023-07-21T07:35:50.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f45e37fe700 1 -- 172.21.15.6:0/414979939 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f00070d0 con 0x7f45fc1ea500 2023-07-21T07:35:50.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f45e37fe700 1 -- 172.21.15.6:0/414979939 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0007480 con 0x7f45fc1ea500 2023-07-21T07:35:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f46016b7700 1 -- 172.21.15.6:0/414979939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc1ed720 con 0x7f45fc1ea500 2023-07-21T07:35:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.207+0000 7f46016b7700 1 -- 172.21.15.6:0/414979939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc1511b0 con 0x7f45fc1ea500 2023-07-21T07:35:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.208+0000 7f46016b7700 1 -- 172.21.15.6:0/414979939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc0c5170 con 0x7f45fc1ea500 2023-07-21T07:35:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.209+0000 7f45e37fe700 1 -- 172.21.15.6:0/414979939 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45f0019030 con 0x7f45fc1ea500 2023-07-21T07:35:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.209+0000 7f45e37fe700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f45e806ace0 0x7f45e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.209+0000 7f45e37fe700 1 -- 172.21.15.6:0/414979939 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f45f008a5a0 con 0x7f45fc1ea500 2023-07-21T07:35:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.209+0000 7f45faffd700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f45e806ace0 0x7f45e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.210+0000 7f45faffd700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f45e806ace0 0x7f45e806d1a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009c60 tx=0x7f45ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.214+0000 7f45e37fe700 1 -- 172.21.15.6:0/414979939 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f45f0055380 con 0x7f45fc1ea500 2023-07-21T07:35:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.408+0000 7f46016b7700 1 -- 172.21.15.6:0/414979939 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45fc154d40 con 0x7f45e806ace0 2023-07-21T07:35:50.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.423+0000 7f45e37fe700 1 -- 172.21.15.6:0/414979939 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+549637 (secure 0 0 0) 0x7f45ec009da0 con 0x7f45e806ace0 2023-07-21T07:35:50.480 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:50.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.427+0000 7f46016b7700 1 -- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f45e806ace0 msgr2=0x7f45e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.427+0000 7f46016b7700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f45e806ace0 0x7f45e806d1a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009c60 tx=0x7f45ec008040 comp rx=0 tx=0).stop 2023-07-21T07:35:50.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.427+0000 7f46016b7700 1 -- 172.21.15.6:0/414979939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45fc1ea500 msgr2=0x7f45fc150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.427+0000 7f46016b7700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45fc1ea500 0x7f45fc150c70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f45e400bce0 tx=0x7f45fc155300 comp rx=0 tx=0).stop 2023-07-21T07:35:50.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.427+0000 7f46016b7700 1 -- 172.21.15.6:0/414979939 shutdown_connections 2023-07-21T07:35:50.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.427+0000 7f46016b7700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f45e806ace0 0x7f45e806d1a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.427+0000 7f46016b7700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45fc156cd0 0x7f45fc157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.427+0000 7f46016b7700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45e4004850 0x7f45fc1edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.427+0000 7f46016b7700 1 --2- 172.21.15.6:0/414979939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45fc1ea500 0x7f45fc150c70 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.427+0000 7f46016b7700 1 -- 172.21.15.6:0/414979939 >> 172.21.15.6:0/414979939 conn(0x7f45fc0717c0 msgr2=0x7f45fc14e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:50.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.428+0000 7f46016b7700 1 -- 172.21.15.6:0/414979939 shutdown_connections 2023-07-21T07:35:50.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.428+0000 7f46016b7700 1 -- 172.21.15.6:0/414979939 wait complete. 2023-07-21T07:35:50.485 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:35:50.492 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-07-21T07:35:48.708619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596599,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":353,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221020,"kb_used_data":4848,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753700,"statfs":{"total":773094113280,"available":772867788800,"internally_reserved":0,"allocated":4964352,"data_stored":2762066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.844894"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062275+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:35:47.062275+0000","last_peered":"2023-07-21T07:35:47.062275+0000","last_clean":"2023-07-21T07:35:47.062275+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:35:47.062275+0000","last_undegraded":"2023-07-21T07:35:47.062275+0000","last_fullsized":"2023-07-21T07:35:47.062275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:05:01.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887753+0000","last_change":"2023-07-21T07:35:30.551889+0000","last_active":"2023-07-21T07:35:46.887753+0000","last_peered":"2023-07-21T07:35:46.887753+0000","last_clean":"2023-07-21T07:35:46.887753+0000","last_became_active":"2023-07-21T07:35:30.551571+0000","last_became_peered":"2023-07-21T07:35:30.551571+0000","last_unstale":"2023-07-21T07:35:46.887753+0000","last_undegraded":"2023-07-21T07:35:46.887753+0000","last_fullsized":"2023-07-21T07:35:46.887753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:53:00.448841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062174+0000","last_change":"2023-07-21T07:35:31.576679+0000","last_active":"2023-07-21T07:35:47.062174+0000","last_peered":"2023-07-21T07:35:47.062174+0000","last_clean":"2023-07-21T07:35:47.062174+0000","last_became_active":"2023-07-21T07:35:31.576259+0000","last_became_peered":"2023-07-21T07:35:31.576259+0000","last_unstale":"2023-07-21T07:35:47.062174+0000","last_undegraded":"2023-07-21T07:35:47.062174+0000","last_fullsized":"2023-07-21T07:35:47.062174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:57.037209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887801+0000","last_change":"2023-07-21T07:35:44.894401+0000","last_active":"2023-07-21T07:35:46.887801+0000","last_peered":"2023-07-21T07:35:46.887801+0000","last_clean":"2023-07-21T07:35:46.887801+0000","last_became_active":"2023-07-21T07:35:44.894037+0000","last_became_peered":"2023-07-21T07:35:44.894037+0000","last_unstale":"2023-07-21T07:35:46.887801+0000","last_undegraded":"2023-07-21T07:35:46.887801+0000","last_fullsized":"2023-07-21T07:35:46.887801+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:22:39.013378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061948+0000","last_change":"2023-07-21T07:35:45.900270+0000","last_active":"2023-07-21T07:35:47.061948+0000","last_peered":"2023-07-21T07:35:47.061948+0000","last_clean":"2023-07-21T07:35:47.061948+0000","last_became_active":"2023-07-21T07:35:45.900019+0000","last_became_peered":"2023-07-21T07:35:45.900019+0000","last_unstale":"2023-07-21T07:35:47.061948+0000","last_undegraded":"2023-07-21T07:35:47.061948+0000","last_fullsized":"2023-07-21T07:35:47.061948+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:16:00.601675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888778+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:35:46.888778+0000","last_peered":"2023-07-21T07:35:46.888778+0000","last_clean":"2023-07-21T07:35:46.888778+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:35:46.888778+0000","last_undegraded":"2023-07-21T07:35:46.888778+0000","last_fullsized":"2023-07-21T07:35:46.888778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:04:51.973941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887524+0000","last_change":"2023-07-21T07:35:30.551446+0000","last_active":"2023-07-21T07:35:46.887524+0000","last_peered":"2023-07-21T07:35:46.887524+0000","last_clean":"2023-07-21T07:35:46.887524+0000","last_became_active":"2023-07-21T07:35:30.551160+0000","last_became_peered":"2023-07-21T07:35:30.551160+0000","last_unstale":"2023-07-21T07:35:46.887524+0000","last_undegraded":"2023-07-21T07:35:46.887524+0000","last_fullsized":"2023-07-21T07:35:46.887524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:55:22.308198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887758+0000","last_change":"2023-07-21T07:35:31.583748+0000","last_active":"2023-07-21T07:35:46.887758+0000","last_peered":"2023-07-21T07:35:46.887758+0000","last_clean":"2023-07-21T07:35:46.887758+0000","last_became_active":"2023-07-21T07:35:31.583463+0000","last_became_peered":"2023-07-21T07:35:31.583463+0000","last_unstale":"2023-07-21T07:35:46.887758+0000","last_undegraded":"2023-07-21T07:35:46.887758+0000","last_fullsized":"2023-07-21T07:35:46.887758+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:17:03.048087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888948+0000","last_change":"2023-07-21T07:35:44.895009+0000","last_active":"2023-07-21T07:35:46.888948+0000","last_peered":"2023-07-21T07:35:46.888948+0000","last_clean":"2023-07-21T07:35:46.888948+0000","last_became_active":"2023-07-21T07:35:44.894739+0000","last_became_peered":"2023-07-21T07:35:44.894739+0000","last_unstale":"2023-07-21T07:35:46.888948+0000","last_undegraded":"2023-07-21T07:35:46.888948+0000","last_fullsized":"2023-07-21T07:35:46.888948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:17:16.377122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974708+0000","last_change":"2023-07-21T07:35:45.904299+0000","last_active":"2023-07-21T07:35:46.974708+0000","last_peered":"2023-07-21T07:35:46.974708+0000","last_clean":"2023-07-21T07:35:46.974708+0000","last_became_active":"2023-07-21T07:35:45.903851+0000","last_became_peered":"2023-07-21T07:35:45.903851+0000","last_unstale":"2023-07-21T07:35:46.974708+0000","last_undegraded":"2023-07-21T07:35:46.974708+0000","last_fullsized":"2023-07-21T07:35:46.974708+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:26:40.433463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063445+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:35:47.063445+0000","last_peered":"2023-07-21T07:35:47.063445+0000","last_clean":"2023-07-21T07:35:47.063445+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:35:47.063445+0000","last_undegraded":"2023-07-21T07:35:47.063445+0000","last_fullsized":"2023-07-21T07:35:47.063445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:16:22.088494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060912+0000","last_change":"2023-07-21T07:35:30.546891+0000","last_active":"2023-07-21T07:35:47.060912+0000","last_peered":"2023-07-21T07:35:47.060912+0000","last_clean":"2023-07-21T07:35:47.060912+0000","last_became_active":"2023-07-21T07:35:30.546607+0000","last_became_peered":"2023-07-21T07:35:30.546607+0000","last_unstale":"2023-07-21T07:35:47.060912+0000","last_undegraded":"2023-07-21T07:35:47.060912+0000","last_fullsized":"2023-07-21T07:35:47.060912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:38:02.868880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886333+0000","last_change":"2023-07-21T07:35:31.576629+0000","last_active":"2023-07-21T07:35:46.886333+0000","last_peered":"2023-07-21T07:35:46.886333+0000","last_clean":"2023-07-21T07:35:46.886333+0000","last_became_active":"2023-07-21T07:35:31.575947+0000","last_became_peered":"2023-07-21T07:35:31.575947+0000","last_unstale":"2023-07-21T07:35:46.886333+0000","last_undegraded":"2023-07-21T07:35:46.886333+0000","last_fullsized":"2023-07-21T07:35:46.886333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:10:54.792526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060975+0000","last_change":"2023-07-21T07:35:44.886385+0000","last_active":"2023-07-21T07:35:47.060975+0000","last_peered":"2023-07-21T07:35:47.060975+0000","last_clean":"2023-07-21T07:35:47.060975+0000","last_became_active":"2023-07-21T07:35:44.886117+0000","last_became_peered":"2023-07-21T07:35:44.886117+0000","last_unstale":"2023-07-21T07:35:47.060975+0000","last_undegraded":"2023-07-21T07:35:47.060975+0000","last_fullsized":"2023-07-21T07:35:47.060975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:13:38.964946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889743+0000","last_change":"2023-07-21T07:35:45.894535+0000","last_active":"2023-07-21T07:35:46.889743+0000","last_peered":"2023-07-21T07:35:46.889743+0000","last_clean":"2023-07-21T07:35:46.889743+0000","last_became_active":"2023-07-21T07:35:45.894161+0000","last_became_peered":"2023-07-21T07:35:45.894161+0000","last_unstale":"2023-07-21T07:35:46.889743+0000","last_undegraded":"2023-07-21T07:35:46.889743+0000","last_fullsized":"2023-07-21T07:35:46.889743+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:18:59.929550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061320+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:35:47.061320+0000","last_peered":"2023-07-21T07:35:47.061320+0000","last_clean":"2023-07-21T07:35:47.061320+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:35:47.061320+0000","last_undegraded":"2023-07-21T07:35:47.061320+0000","last_fullsized":"2023-07-21T07:35:47.061320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:29:16.833300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062854+0000","last_change":"2023-07-21T07:35:30.552592+0000","last_active":"2023-07-21T07:35:47.062854+0000","last_peered":"2023-07-21T07:35:47.062854+0000","last_clean":"2023-07-21T07:35:47.062854+0000","last_became_active":"2023-07-21T07:35:30.552218+0000","last_became_peered":"2023-07-21T07:35:30.552218+0000","last_unstale":"2023-07-21T07:35:47.062854+0000","last_undegraded":"2023-07-21T07:35:47.062854+0000","last_fullsized":"2023-07-21T07:35:47.062854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:27:42.026971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886630+0000","last_change":"2023-07-21T07:35:31.572728+0000","last_active":"2023-07-21T07:35:46.886630+0000","last_peered":"2023-07-21T07:35:46.886630+0000","last_clean":"2023-07-21T07:35:46.886630+0000","last_became_active":"2023-07-21T07:35:31.572409+0000","last_became_peered":"2023-07-21T07:35:31.572409+0000","last_unstale":"2023-07-21T07:35:46.886630+0000","last_undegraded":"2023-07-21T07:35:46.886630+0000","last_fullsized":"2023-07-21T07:35:46.886630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:05:51.429848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063718+0000","last_change":"2023-07-21T07:35:44.887959+0000","last_active":"2023-07-21T07:35:47.063718+0000","last_peered":"2023-07-21T07:35:47.063718+0000","last_clean":"2023-07-21T07:35:47.063718+0000","last_became_active":"2023-07-21T07:35:44.887713+0000","last_became_peered":"2023-07-21T07:35:44.887713+0000","last_unstale":"2023-07-21T07:35:47.063718+0000","last_undegraded":"2023-07-21T07:35:47.063718+0000","last_fullsized":"2023-07-21T07:35:47.063718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:14:26.106085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886706+0000","last_change":"2023-07-21T07:35:45.880694+0000","last_active":"2023-07-21T07:35:46.886706+0000","last_peered":"2023-07-21T07:35:46.886706+0000","last_clean":"2023-07-21T07:35:46.886706+0000","last_became_active":"2023-07-21T07:35:45.880285+0000","last_became_peered":"2023-07-21T07:35:45.880285+0000","last_unstale":"2023-07-21T07:35:46.886706+0000","last_undegraded":"2023-07-21T07:35:46.886706+0000","last_fullsized":"2023-07-21T07:35:46.886706+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:31:32.294242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061458+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:35:47.061458+0000","last_peered":"2023-07-21T07:35:47.061458+0000","last_clean":"2023-07-21T07:35:47.061458+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:35:47.061458+0000","last_undegraded":"2023-07-21T07:35:47.061458+0000","last_fullsized":"2023-07-21T07:35:47.061458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:42:30.722039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061613+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:35:47.061613+0000","last_peered":"2023-07-21T07:35:47.061613+0000","last_clean":"2023-07-21T07:35:47.061613+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:35:47.061613+0000","last_undegraded":"2023-07-21T07:35:47.061613+0000","last_fullsized":"2023-07-21T07:35:47.061613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:14:29.787995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063125+0000","last_change":"2023-07-21T07:35:30.553624+0000","last_active":"2023-07-21T07:35:47.063125+0000","last_peered":"2023-07-21T07:35:47.063125+0000","last_clean":"2023-07-21T07:35:47.063125+0000","last_became_active":"2023-07-21T07:35:30.553307+0000","last_became_peered":"2023-07-21T07:35:30.553307+0000","last_unstale":"2023-07-21T07:35:47.063125+0000","last_undegraded":"2023-07-21T07:35:47.063125+0000","last_fullsized":"2023-07-21T07:35:47.063125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:59:50.497869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063163+0000","last_change":"2023-07-21T07:35:31.583146+0000","last_active":"2023-07-21T07:35:47.063163+0000","last_peered":"2023-07-21T07:35:47.063163+0000","last_clean":"2023-07-21T07:35:47.063163+0000","last_became_active":"2023-07-21T07:35:31.582823+0000","last_became_peered":"2023-07-21T07:35:31.582823+0000","last_unstale":"2023-07-21T07:35:47.063163+0000","last_undegraded":"2023-07-21T07:35:47.063163+0000","last_fullsized":"2023-07-21T07:35:47.063163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:36:54.377741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974940+0000","last_change":"2023-07-21T07:35:44.894719+0000","last_active":"2023-07-21T07:35:46.974940+0000","last_peered":"2023-07-21T07:35:46.974940+0000","last_clean":"2023-07-21T07:35:46.974940+0000","last_became_active":"2023-07-21T07:35:44.894382+0000","last_became_peered":"2023-07-21T07:35:44.894382+0000","last_unstale":"2023-07-21T07:35:46.974940+0000","last_undegraded":"2023-07-21T07:35:46.974940+0000","last_fullsized":"2023-07-21T07:35:46.974940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:35:21.303182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062713+0000","last_change":"2023-07-21T07:35:45.892460+0000","last_active":"2023-07-21T07:35:47.062713+0000","last_peered":"2023-07-21T07:35:47.062713+0000","last_clean":"2023-07-21T07:35:47.062713+0000","last_became_active":"2023-07-21T07:35:45.892167+0000","last_became_peered":"2023-07-21T07:35:45.892167+0000","last_unstale":"2023-07-21T07:35:47.062713+0000","last_undegraded":"2023-07-21T07:35:47.062713+0000","last_fullsized":"2023-07-21T07:35:47.062713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:43:07.218894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.059909+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:35:47.059909+0000","last_peered":"2023-07-21T07:35:47.059909+0000","last_clean":"2023-07-21T07:35:47.059909+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:35:47.059909+0000","last_undegraded":"2023-07-21T07:35:47.059909+0000","last_fullsized":"2023-07-21T07:35:47.059909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:53:49.621314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"36'1","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060528+0000","last_change":"2023-07-21T07:35:30.549185+0000","last_active":"2023-07-21T07:35:47.060528+0000","last_peered":"2023-07-21T07:35:47.060528+0000","last_clean":"2023-07-21T07:35:47.060528+0000","last_became_active":"2023-07-21T07:35:30.548890+0000","last_became_peered":"2023-07-21T07:35:30.548890+0000","last_unstale":"2023-07-21T07:35:47.060528+0000","last_undegraded":"2023-07-21T07:35:47.060528+0000","last_fullsized":"2023-07-21T07:35:47.060528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:38:02.868880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063556+0000","last_change":"2023-07-21T07:35:31.576484+0000","last_active":"2023-07-21T07:35:47.063556+0000","last_peered":"2023-07-21T07:35:47.063556+0000","last_clean":"2023-07-21T07:35:47.063556+0000","last_became_active":"2023-07-21T07:35:31.576171+0000","last_became_peered":"2023-07-21T07:35:31.576171+0000","last_unstale":"2023-07-21T07:35:47.063556+0000","last_undegraded":"2023-07-21T07:35:47.063556+0000","last_fullsized":"2023-07-21T07:35:47.063556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:11.583188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974764+0000","last_change":"2023-07-21T07:35:44.894482+0000","last_active":"2023-07-21T07:35:46.974764+0000","last_peered":"2023-07-21T07:35:46.974764+0000","last_clean":"2023-07-21T07:35:46.974764+0000","last_became_active":"2023-07-21T07:35:44.894136+0000","last_became_peered":"2023-07-21T07:35:44.894136+0000","last_unstale":"2023-07-21T07:35:46.974764+0000","last_undegraded":"2023-07-21T07:35:46.974764+0000","last_fullsized":"2023-07-21T07:35:46.974764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:53:14.782892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889064+0000","last_change":"2023-07-21T07:35:45.895309+0000","last_active":"2023-07-21T07:35:46.889064+0000","last_peered":"2023-07-21T07:35:46.889064+0000","last_clean":"2023-07-21T07:35:46.889064+0000","last_became_active":"2023-07-21T07:35:45.895021+0000","last_became_peered":"2023-07-21T07:35:45.895021+0000","last_unstale":"2023-07-21T07:35:46.889064+0000","last_undegraded":"2023-07-21T07:35:46.889064+0000","last_fullsized":"2023-07-21T07:35:46.889064+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:30:24.768875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062289+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:35:47.062289+0000","last_peered":"2023-07-21T07:35:47.062289+0000","last_clean":"2023-07-21T07:35:47.062289+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:35:47.062289+0000","last_undegraded":"2023-07-21T07:35:47.062289+0000","last_fullsized":"2023-07-21T07:35:47.062289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:13:16.088058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974837+0000","last_change":"2023-07-21T07:35:30.552526+0000","last_active":"2023-07-21T07:35:46.974837+0000","last_peered":"2023-07-21T07:35:46.974837+0000","last_clean":"2023-07-21T07:35:46.974837+0000","last_became_active":"2023-07-21T07:35:30.552173+0000","last_became_peered":"2023-07-21T07:35:30.552173+0000","last_unstale":"2023-07-21T07:35:46.974837+0000","last_undegraded":"2023-07-21T07:35:46.974837+0000","last_fullsized":"2023-07-21T07:35:46.974837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:06:08.427835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888101+0000","last_change":"2023-07-21T07:35:31.581657+0000","last_active":"2023-07-21T07:35:46.888101+0000","last_peered":"2023-07-21T07:35:46.888101+0000","last_clean":"2023-07-21T07:35:46.888101+0000","last_became_active":"2023-07-21T07:35:31.581117+0000","last_became_peered":"2023-07-21T07:35:31.581117+0000","last_unstale":"2023-07-21T07:35:46.888101+0000","last_undegraded":"2023-07-21T07:35:46.888101+0000","last_fullsized":"2023-07-21T07:35:46.888101+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:13:31.788489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061783+0000","last_change":"2023-07-21T07:35:44.890771+0000","last_active":"2023-07-21T07:35:47.061783+0000","last_peered":"2023-07-21T07:35:47.061783+0000","last_clean":"2023-07-21T07:35:47.061783+0000","last_became_active":"2023-07-21T07:35:44.890436+0000","last_became_peered":"2023-07-21T07:35:44.890436+0000","last_unstale":"2023-07-21T07:35:47.061783+0000","last_undegraded":"2023-07-21T07:35:47.061783+0000","last_fullsized":"2023-07-21T07:35:47.061783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:51:49.548799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061130+0000","last_change":"2023-07-21T07:35:45.899588+0000","last_active":"2023-07-21T07:35:47.061130+0000","last_peered":"2023-07-21T07:35:47.061130+0000","last_clean":"2023-07-21T07:35:47.061130+0000","last_became_active":"2023-07-21T07:35:45.898782+0000","last_became_peered":"2023-07-21T07:35:45.898782+0000","last_unstale":"2023-07-21T07:35:47.061130+0000","last_undegraded":"2023-07-21T07:35:47.061130+0000","last_fullsized":"2023-07-21T07:35:47.061130+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:53:52.856219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886959+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:35:46.886959+0000","last_peered":"2023-07-21T07:35:46.886959+0000","last_clean":"2023-07-21T07:35:46.886959+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:35:46.886959+0000","last_undegraded":"2023-07-21T07:35:46.886959+0000","last_fullsized":"2023-07-21T07:35:46.886959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:34:53.626147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974502+0000","last_change":"2023-07-21T07:35:30.548637+0000","last_active":"2023-07-21T07:35:46.974502+0000","last_peered":"2023-07-21T07:35:46.974502+0000","last_clean":"2023-07-21T07:35:46.974502+0000","last_became_active":"2023-07-21T07:35:30.548340+0000","last_became_peered":"2023-07-21T07:35:30.548340+0000","last_unstale":"2023-07-21T07:35:46.974502+0000","last_undegraded":"2023-07-21T07:35:46.974502+0000","last_fullsized":"2023-07-21T07:35:46.974502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:42:13.779276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974179+0000","last_change":"2023-07-21T07:35:31.582790+0000","last_active":"2023-07-21T07:35:46.974179+0000","last_peered":"2023-07-21T07:35:46.974179+0000","last_clean":"2023-07-21T07:35:46.974179+0000","last_became_active":"2023-07-21T07:35:31.582479+0000","last_became_peered":"2023-07-21T07:35:31.582479+0000","last_unstale":"2023-07-21T07:35:46.974179+0000","last_undegraded":"2023-07-21T07:35:46.974179+0000","last_fullsized":"2023-07-21T07:35:46.974179+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:54:17.793947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887365+0000","last_change":"2023-07-21T07:35:44.889963+0000","last_active":"2023-07-21T07:35:46.887365+0000","last_peered":"2023-07-21T07:35:46.887365+0000","last_clean":"2023-07-21T07:35:46.887365+0000","last_became_active":"2023-07-21T07:35:44.889745+0000","last_became_peered":"2023-07-21T07:35:44.889745+0000","last_unstale":"2023-07-21T07:35:46.887365+0000","last_undegraded":"2023-07-21T07:35:46.887365+0000","last_fullsized":"2023-07-21T07:35:46.887365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:38:25.168259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975117+0000","last_change":"2023-07-21T07:35:45.909498+0000","last_active":"2023-07-21T07:35:46.975117+0000","last_peered":"2023-07-21T07:35:46.975117+0000","last_clean":"2023-07-21T07:35:46.975117+0000","last_became_active":"2023-07-21T07:35:45.909192+0000","last_became_peered":"2023-07-21T07:35:45.909192+0000","last_unstale":"2023-07-21T07:35:46.975117+0000","last_undegraded":"2023-07-21T07:35:46.975117+0000","last_fullsized":"2023-07-21T07:35:46.975117+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:22:07.275516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.059880+0000","last_change":"2023-07-21T07:35:30.553301+0000","last_active":"2023-07-21T07:35:47.059880+0000","last_peered":"2023-07-21T07:35:47.059880+0000","last_clean":"2023-07-21T07:35:47.059880+0000","last_became_active":"2023-07-21T07:35:30.552995+0000","last_became_peered":"2023-07-21T07:35:30.552995+0000","last_unstale":"2023-07-21T07:35:47.059880+0000","last_undegraded":"2023-07-21T07:35:47.059880+0000","last_fullsized":"2023-07-21T07:35:47.059880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:36:28.316865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888373+0000","last_change":"2023-07-21T07:35:31.561900+0000","last_active":"2023-07-21T07:35:46.888373+0000","last_peered":"2023-07-21T07:35:46.888373+0000","last_clean":"2023-07-21T07:35:46.888373+0000","last_became_active":"2023-07-21T07:35:31.561610+0000","last_became_peered":"2023-07-21T07:35:31.561610+0000","last_unstale":"2023-07-21T07:35:46.888373+0000","last_undegraded":"2023-07-21T07:35:46.888373+0000","last_fullsized":"2023-07-21T07:35:46.888373+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:05:51.429848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887665+0000","last_change":"2023-07-21T07:35:44.893270+0000","last_active":"2023-07-21T07:35:46.887665+0000","last_peered":"2023-07-21T07:35:46.887665+0000","last_clean":"2023-07-21T07:35:46.887665+0000","last_became_active":"2023-07-21T07:35:44.892806+0000","last_became_peered":"2023-07-21T07:35:44.892806+0000","last_unstale":"2023-07-21T07:35:46.887665+0000","last_undegraded":"2023-07-21T07:35:46.887665+0000","last_fullsized":"2023-07-21T07:35:46.887665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:43:06.636965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061173+0000","last_change":"2023-07-21T07:35:45.897066+0000","last_active":"2023-07-21T07:35:47.061173+0000","last_peered":"2023-07-21T07:35:47.061173+0000","last_clean":"2023-07-21T07:35:47.061173+0000","last_became_active":"2023-07-21T07:35:45.896792+0000","last_became_peered":"2023-07-21T07:35:45.896792+0000","last_unstale":"2023-07-21T07:35:47.061173+0000","last_undegraded":"2023-07-21T07:35:47.061173+0000","last_fullsized":"2023-07-21T07:35:47.061173+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:16.909033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061715+0000","last_change":"2023-07-21T07:35:30.548129+0000","last_active":"2023-07-21T07:35:47.061715+0000","last_peered":"2023-07-21T07:35:47.061715+0000","last_clean":"2023-07-21T07:35:47.061715+0000","last_became_active":"2023-07-21T07:35:30.547850+0000","last_became_peered":"2023-07-21T07:35:30.547850+0000","last_unstale":"2023-07-21T07:35:47.061715+0000","last_undegraded":"2023-07-21T07:35:47.061715+0000","last_fullsized":"2023-07-21T07:35:47.061715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:34:27.015084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060777+0000","last_change":"2023-07-21T07:35:31.582343+0000","last_active":"2023-07-21T07:35:47.060777+0000","last_peered":"2023-07-21T07:35:47.060777+0000","last_clean":"2023-07-21T07:35:47.060777+0000","last_became_active":"2023-07-21T07:35:31.582111+0000","last_became_peered":"2023-07-21T07:35:31.582111+0000","last_unstale":"2023-07-21T07:35:47.060777+0000","last_undegraded":"2023-07-21T07:35:47.060777+0000","last_fullsized":"2023-07-21T07:35:47.060777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:43:08.187693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886688+0000","last_change":"2023-07-21T07:35:44.885465+0000","last_active":"2023-07-21T07:35:46.886688+0000","last_peered":"2023-07-21T07:35:46.886688+0000","last_clean":"2023-07-21T07:35:46.886688+0000","last_became_active":"2023-07-21T07:35:44.885187+0000","last_became_peered":"2023-07-21T07:35:44.885187+0000","last_unstale":"2023-07-21T07:35:46.886688+0000","last_undegraded":"2023-07-21T07:35:46.886688+0000","last_fullsized":"2023-07-21T07:35:46.886688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:55:36.642250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061652+0000","last_change":"2023-07-21T07:35:45.892840+0000","last_active":"2023-07-21T07:35:47.061652+0000","last_peered":"2023-07-21T07:35:47.061652+0000","last_clean":"2023-07-21T07:35:47.061652+0000","last_became_active":"2023-07-21T07:35:45.892567+0000","last_became_peered":"2023-07-21T07:35:45.892567+0000","last_unstale":"2023-07-21T07:35:47.061652+0000","last_undegraded":"2023-07-21T07:35:47.061652+0000","last_fullsized":"2023-07-21T07:35:47.061652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:17:33.113889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060132+0000","last_change":"2023-07-21T07:35:30.553310+0000","last_active":"2023-07-21T07:35:47.060132+0000","last_peered":"2023-07-21T07:35:47.060132+0000","last_clean":"2023-07-21T07:35:47.060132+0000","last_became_active":"2023-07-21T07:35:30.552922+0000","last_became_peered":"2023-07-21T07:35:30.552922+0000","last_unstale":"2023-07-21T07:35:47.060132+0000","last_undegraded":"2023-07-21T07:35:47.060132+0000","last_fullsized":"2023-07-21T07:35:47.060132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:44:39.839754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974403+0000","last_change":"2023-07-21T07:35:31.575363+0000","last_active":"2023-07-21T07:35:46.974403+0000","last_peered":"2023-07-21T07:35:46.974403+0000","last_clean":"2023-07-21T07:35:46.974403+0000","last_became_active":"2023-07-21T07:35:31.575044+0000","last_became_peered":"2023-07-21T07:35:31.575044+0000","last_unstale":"2023-07-21T07:35:46.974403+0000","last_undegraded":"2023-07-21T07:35:46.974403+0000","last_fullsized":"2023-07-21T07:35:46.974403+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:39:13.240293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060108+0000","last_change":"2023-07-21T07:35:44.883870+0000","last_active":"2023-07-21T07:35:47.060108+0000","last_peered":"2023-07-21T07:35:47.060108+0000","last_clean":"2023-07-21T07:35:47.060108+0000","last_became_active":"2023-07-21T07:35:44.883583+0000","last_became_peered":"2023-07-21T07:35:44.883583+0000","last_unstale":"2023-07-21T07:35:47.060108+0000","last_undegraded":"2023-07-21T07:35:47.060108+0000","last_fullsized":"2023-07-21T07:35:47.060108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:21:19.430365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888581+0000","last_change":"2023-07-21T07:35:45.895964+0000","last_active":"2023-07-21T07:35:46.888581+0000","last_peered":"2023-07-21T07:35:46.888581+0000","last_clean":"2023-07-21T07:35:46.888581+0000","last_became_active":"2023-07-21T07:35:45.895671+0000","last_became_peered":"2023-07-21T07:35:45.895671+0000","last_unstale":"2023-07-21T07:35:46.888581+0000","last_undegraded":"2023-07-21T07:35:46.888581+0000","last_fullsized":"2023-07-21T07:35:46.888581+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:18:59.929550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060203+0000","last_change":"2023-07-21T07:35:30.552311+0000","last_active":"2023-07-21T07:35:47.060203+0000","last_peered":"2023-07-21T07:35:47.060203+0000","last_clean":"2023-07-21T07:35:47.060203+0000","last_became_active":"2023-07-21T07:35:30.552023+0000","last_became_peered":"2023-07-21T07:35:30.552023+0000","last_unstale":"2023-07-21T07:35:47.060203+0000","last_undegraded":"2023-07-21T07:35:47.060203+0000","last_fullsized":"2023-07-21T07:35:47.060203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:01:18.593753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061738+0000","last_change":"2023-07-21T07:35:31.570982+0000","last_active":"2023-07-21T07:35:47.061738+0000","last_peered":"2023-07-21T07:35:47.061738+0000","last_clean":"2023-07-21T07:35:47.061738+0000","last_became_active":"2023-07-21T07:35:31.570685+0000","last_became_peered":"2023-07-21T07:35:31.570685+0000","last_unstale":"2023-07-21T07:35:47.061738+0000","last_undegraded":"2023-07-21T07:35:47.061738+0000","last_fullsized":"2023-07-21T07:35:47.061738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:23:19.589936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974310+0000","last_change":"2023-07-21T07:35:44.894912+0000","last_active":"2023-07-21T07:35:46.974310+0000","last_peered":"2023-07-21T07:35:46.974310+0000","last_clean":"2023-07-21T07:35:46.974310+0000","last_became_active":"2023-07-21T07:35:44.894064+0000","last_became_peered":"2023-07-21T07:35:44.894064+0000","last_unstale":"2023-07-21T07:35:46.974310+0000","last_undegraded":"2023-07-21T07:35:46.974310+0000","last_fullsized":"2023-07-21T07:35:46.974310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:01:05.144193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974959+0000","last_change":"2023-07-21T07:35:45.902158+0000","last_active":"2023-07-21T07:35:46.974959+0000","last_peered":"2023-07-21T07:35:46.974959+0000","last_clean":"2023-07-21T07:35:46.974959+0000","last_became_active":"2023-07-21T07:35:45.901872+0000","last_became_peered":"2023-07-21T07:35:45.901872+0000","last_unstale":"2023-07-21T07:35:46.974959+0000","last_undegraded":"2023-07-21T07:35:46.974959+0000","last_fullsized":"2023-07-21T07:35:46.974959+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:29:27.656646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886807+0000","last_change":"2023-07-21T07:35:30.552149+0000","last_active":"2023-07-21T07:35:46.886807+0000","last_peered":"2023-07-21T07:35:46.886807+0000","last_clean":"2023-07-21T07:35:46.886807+0000","last_became_active":"2023-07-21T07:35:30.551872+0000","last_became_peered":"2023-07-21T07:35:30.551872+0000","last_unstale":"2023-07-21T07:35:46.886807+0000","last_undegraded":"2023-07-21T07:35:46.886807+0000","last_fullsized":"2023-07-21T07:35:46.886807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:30:09.427456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060588+0000","last_change":"2023-07-21T07:35:31.571997+0000","last_active":"2023-07-21T07:35:47.060588+0000","last_peered":"2023-07-21T07:35:47.060588+0000","last_clean":"2023-07-21T07:35:47.060588+0000","last_became_active":"2023-07-21T07:35:31.571042+0000","last_became_peered":"2023-07-21T07:35:31.571042+0000","last_unstale":"2023-07-21T07:35:47.060588+0000","last_undegraded":"2023-07-21T07:35:47.060588+0000","last_fullsized":"2023-07-21T07:35:47.060588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:02.572630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060534+0000","last_change":"2023-07-21T07:35:44.884732+0000","last_active":"2023-07-21T07:35:47.060534+0000","last_peered":"2023-07-21T07:35:47.060534+0000","last_clean":"2023-07-21T07:35:47.060534+0000","last_became_active":"2023-07-21T07:35:44.884473+0000","last_became_peered":"2023-07-21T07:35:44.884473+0000","last_unstale":"2023-07-21T07:35:47.060534+0000","last_undegraded":"2023-07-21T07:35:47.060534+0000","last_fullsized":"2023-07-21T07:35:47.060534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:32:51.388129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886217+0000","last_change":"2023-07-21T07:35:45.897470+0000","last_active":"2023-07-21T07:35:46.886217+0000","last_peered":"2023-07-21T07:35:46.886217+0000","last_clean":"2023-07-21T07:35:46.886217+0000","last_became_active":"2023-07-21T07:35:45.897196+0000","last_became_peered":"2023-07-21T07:35:45.897196+0000","last_unstale":"2023-07-21T07:35:46.886217+0000","last_undegraded":"2023-07-21T07:35:46.886217+0000","last_fullsized":"2023-07-21T07:35:46.886217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:13:46.124892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060398+0000","last_change":"2023-07-21T07:35:30.554225+0000","last_active":"2023-07-21T07:35:47.060398+0000","last_peered":"2023-07-21T07:35:47.060398+0000","last_clean":"2023-07-21T07:35:47.060398+0000","last_became_active":"2023-07-21T07:35:30.553952+0000","last_became_peered":"2023-07-21T07:35:30.553952+0000","last_unstale":"2023-07-21T07:35:47.060398+0000","last_undegraded":"2023-07-21T07:35:47.060398+0000","last_fullsized":"2023-07-21T07:35:47.060398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:37:52.003972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888335+0000","last_change":"2023-07-21T07:35:31.578142+0000","last_active":"2023-07-21T07:35:46.888335+0000","last_peered":"2023-07-21T07:35:46.888335+0000","last_clean":"2023-07-21T07:35:46.888335+0000","last_became_active":"2023-07-21T07:35:31.577865+0000","last_became_peered":"2023-07-21T07:35:31.577865+0000","last_unstale":"2023-07-21T07:35:46.888335+0000","last_undegraded":"2023-07-21T07:35:46.888335+0000","last_fullsized":"2023-07-21T07:35:46.888335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:48.192496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975333+0000","last_change":"2023-07-21T07:35:44.899265+0000","last_active":"2023-07-21T07:35:46.975333+0000","last_peered":"2023-07-21T07:35:46.975333+0000","last_clean":"2023-07-21T07:35:46.975333+0000","last_became_active":"2023-07-21T07:35:44.899054+0000","last_became_peered":"2023-07-21T07:35:44.899054+0000","last_unstale":"2023-07-21T07:35:46.975333+0000","last_undegraded":"2023-07-21T07:35:46.975333+0000","last_fullsized":"2023-07-21T07:35:46.975333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:35:24.030633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888890+0000","last_change":"2023-07-21T07:35:45.895937+0000","last_active":"2023-07-21T07:35:46.888890+0000","last_peered":"2023-07-21T07:35:46.888890+0000","last_clean":"2023-07-21T07:35:46.888890+0000","last_became_active":"2023-07-21T07:35:45.895519+0000","last_became_peered":"2023-07-21T07:35:45.895519+0000","last_unstale":"2023-07-21T07:35:46.888890+0000","last_undegraded":"2023-07-21T07:35:46.888890+0000","last_fullsized":"2023-07-21T07:35:46.888890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:26:13.461979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888131+0000","last_change":"2023-07-21T07:35:30.550575+0000","last_active":"2023-07-21T07:35:46.888131+0000","last_peered":"2023-07-21T07:35:46.888131+0000","last_clean":"2023-07-21T07:35:46.888131+0000","last_became_active":"2023-07-21T07:35:30.550269+0000","last_became_peered":"2023-07-21T07:35:30.550269+0000","last_unstale":"2023-07-21T07:35:46.888131+0000","last_undegraded":"2023-07-21T07:35:46.888131+0000","last_fullsized":"2023-07-21T07:35:46.888131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:55:30.715720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062167+0000","last_change":"2023-07-21T07:35:31.572905+0000","last_active":"2023-07-21T07:35:47.062167+0000","last_peered":"2023-07-21T07:35:47.062167+0000","last_clean":"2023-07-21T07:35:47.062167+0000","last_became_active":"2023-07-21T07:35:31.571995+0000","last_became_peered":"2023-07-21T07:35:31.571995+0000","last_unstale":"2023-07-21T07:35:47.062167+0000","last_undegraded":"2023-07-21T07:35:47.062167+0000","last_fullsized":"2023-07-21T07:35:47.062167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:14:27.722253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061853+0000","last_change":"2023-07-21T07:35:44.895275+0000","last_active":"2023-07-21T07:35:47.061853+0000","last_peered":"2023-07-21T07:35:47.061853+0000","last_clean":"2023-07-21T07:35:47.061853+0000","last_became_active":"2023-07-21T07:35:44.895004+0000","last_became_peered":"2023-07-21T07:35:44.895004+0000","last_unstale":"2023-07-21T07:35:47.061853+0000","last_undegraded":"2023-07-21T07:35:47.061853+0000","last_fullsized":"2023-07-21T07:35:47.061853+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:19:04.212276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886637+0000","last_change":"2023-07-21T07:35:45.893318+0000","last_active":"2023-07-21T07:35:46.886637+0000","last_peered":"2023-07-21T07:35:46.886637+0000","last_clean":"2023-07-21T07:35:46.886637+0000","last_became_active":"2023-07-21T07:35:45.892993+0000","last_became_peered":"2023-07-21T07:35:45.892993+0000","last_unstale":"2023-07-21T07:35:46.886637+0000","last_undegraded":"2023-07-21T07:35:46.886637+0000","last_fullsized":"2023-07-21T07:35:46.886637+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:38:26.175627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062965+0000","last_change":"2023-07-21T07:35:30.552874+0000","last_active":"2023-07-21T07:35:47.062965+0000","last_peered":"2023-07-21T07:35:47.062965+0000","last_clean":"2023-07-21T07:35:47.062965+0000","last_became_active":"2023-07-21T07:35:30.552612+0000","last_became_peered":"2023-07-21T07:35:30.552612+0000","last_unstale":"2023-07-21T07:35:47.062965+0000","last_undegraded":"2023-07-21T07:35:47.062965+0000","last_fullsized":"2023-07-21T07:35:47.062965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:37:14.136364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889129+0000","last_change":"2023-07-21T07:35:31.581417+0000","last_active":"2023-07-21T07:35:46.889129+0000","last_peered":"2023-07-21T07:35:46.889129+0000","last_clean":"2023-07-21T07:35:46.889129+0000","last_became_active":"2023-07-21T07:35:31.581026+0000","last_became_peered":"2023-07-21T07:35:31.581026+0000","last_unstale":"2023-07-21T07:35:46.889129+0000","last_undegraded":"2023-07-21T07:35:46.889129+0000","last_fullsized":"2023-07-21T07:35:46.889129+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:55:31.720737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062964+0000","last_change":"2023-07-21T07:35:44.887179+0000","last_active":"2023-07-21T07:35:47.062964+0000","last_peered":"2023-07-21T07:35:47.062964+0000","last_clean":"2023-07-21T07:35:47.062964+0000","last_became_active":"2023-07-21T07:35:44.886859+0000","last_became_peered":"2023-07-21T07:35:44.886859+0000","last_unstale":"2023-07-21T07:35:47.062964+0000","last_undegraded":"2023-07-21T07:35:47.062964+0000","last_fullsized":"2023-07-21T07:35:47.062964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:44:05.006534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888013+0000","last_change":"2023-07-21T07:35:45.903484+0000","last_active":"2023-07-21T07:35:46.888013+0000","last_peered":"2023-07-21T07:35:46.888013+0000","last_clean":"2023-07-21T07:35:46.888013+0000","last_became_active":"2023-07-21T07:35:45.903206+0000","last_became_peered":"2023-07-21T07:35:45.903206+0000","last_unstale":"2023-07-21T07:35:46.888013+0000","last_undegraded":"2023-07-21T07:35:46.888013+0000","last_fullsized":"2023-07-21T07:35:46.888013+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:32:53.808044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974995+0000","last_change":"2023-07-21T07:35:45.912077+0000","last_active":"2023-07-21T07:35:46.974995+0000","last_peered":"2023-07-21T07:35:46.974995+0000","last_clean":"2023-07-21T07:35:46.974995+0000","last_became_active":"2023-07-21T07:35:45.911734+0000","last_became_peered":"2023-07-21T07:35:45.911734+0000","last_unstale":"2023-07-21T07:35:46.974995+0000","last_undegraded":"2023-07-21T07:35:46.974995+0000","last_fullsized":"2023-07-21T07:35:46.974995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:13:46.124892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061606+0000","last_change":"2023-07-21T07:35:30.550883+0000","last_active":"2023-07-21T07:35:47.061606+0000","last_peered":"2023-07-21T07:35:47.061606+0000","last_clean":"2023-07-21T07:35:47.061606+0000","last_became_active":"2023-07-21T07:35:30.550604+0000","last_became_peered":"2023-07-21T07:35:30.550604+0000","last_unstale":"2023-07-21T07:35:47.061606+0000","last_undegraded":"2023-07-21T07:35:47.061606+0000","last_fullsized":"2023-07-21T07:35:47.061606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:37:35.298311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888483+0000","last_change":"2023-07-21T07:35:31.569072+0000","last_active":"2023-07-21T07:35:46.888483+0000","last_peered":"2023-07-21T07:35:46.888483+0000","last_clean":"2023-07-21T07:35:46.888483+0000","last_became_active":"2023-07-21T07:35:31.568900+0000","last_became_peered":"2023-07-21T07:35:31.568900+0000","last_unstale":"2023-07-21T07:35:46.888483+0000","last_undegraded":"2023-07-21T07:35:46.888483+0000","last_fullsized":"2023-07-21T07:35:46.888483+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:31:17.957839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062762+0000","last_change":"2023-07-21T07:35:44.902901+0000","last_active":"2023-07-21T07:35:47.062762+0000","last_peered":"2023-07-21T07:35:47.062762+0000","last_clean":"2023-07-21T07:35:47.062762+0000","last_became_active":"2023-07-21T07:35:44.902582+0000","last_became_peered":"2023-07-21T07:35:44.902582+0000","last_unstale":"2023-07-21T07:35:47.062762+0000","last_undegraded":"2023-07-21T07:35:47.062762+0000","last_fullsized":"2023-07-21T07:35:47.062762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:15:16.232322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060964+0000","last_change":"2023-07-21T07:35:30.550924+0000","last_active":"2023-07-21T07:35:47.060964+0000","last_peered":"2023-07-21T07:35:47.060964+0000","last_clean":"2023-07-21T07:35:47.060964+0000","last_became_active":"2023-07-21T07:35:30.550606+0000","last_became_peered":"2023-07-21T07:35:30.550606+0000","last_unstale":"2023-07-21T07:35:47.060964+0000","last_undegraded":"2023-07-21T07:35:47.060964+0000","last_fullsized":"2023-07-21T07:35:47.060964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:05:51.079287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062528+0000","last_change":"2023-07-21T07:35:31.566406+0000","last_active":"2023-07-21T07:35:47.062528+0000","last_peered":"2023-07-21T07:35:47.062528+0000","last_clean":"2023-07-21T07:35:47.062528+0000","last_became_active":"2023-07-21T07:35:31.566108+0000","last_became_peered":"2023-07-21T07:35:31.566108+0000","last_unstale":"2023-07-21T07:35:47.062528+0000","last_undegraded":"2023-07-21T07:35:47.062528+0000","last_fullsized":"2023-07-21T07:35:47.062528+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:14:01.169474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974557+0000","last_change":"2023-07-21T07:35:44.894630+0000","last_active":"2023-07-21T07:35:46.974557+0000","last_peered":"2023-07-21T07:35:46.974557+0000","last_clean":"2023-07-21T07:35:46.974557+0000","last_became_active":"2023-07-21T07:35:44.894299+0000","last_became_peered":"2023-07-21T07:35:44.894299+0000","last_unstale":"2023-07-21T07:35:46.974557+0000","last_undegraded":"2023-07-21T07:35:46.974557+0000","last_fullsized":"2023-07-21T07:35:46.974557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:46.925715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061206+0000","last_change":"2023-07-21T07:35:45.898972+0000","last_active":"2023-07-21T07:35:47.061206+0000","last_peered":"2023-07-21T07:35:47.061206+0000","last_clean":"2023-07-21T07:35:47.061206+0000","last_became_active":"2023-07-21T07:35:45.898683+0000","last_became_peered":"2023-07-21T07:35:45.898683+0000","last_unstale":"2023-07-21T07:35:47.061206+0000","last_undegraded":"2023-07-21T07:35:47.061206+0000","last_fullsized":"2023-07-21T07:35:47.061206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:29:44.936315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975519+0000","last_change":"2023-07-21T07:35:45.902345+0000","last_active":"2023-07-21T07:35:46.975519+0000","last_peered":"2023-07-21T07:35:46.975519+0000","last_clean":"2023-07-21T07:35:46.975519+0000","last_became_active":"2023-07-21T07:35:45.901904+0000","last_became_peered":"2023-07-21T07:35:45.901904+0000","last_unstale":"2023-07-21T07:35:46.975519+0000","last_undegraded":"2023-07-21T07:35:46.975519+0000","last_fullsized":"2023-07-21T07:35:46.975519+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:00:56.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886516+0000","last_change":"2023-07-21T07:35:30.542937+0000","last_active":"2023-07-21T07:35:46.886516+0000","last_peered":"2023-07-21T07:35:46.886516+0000","last_clean":"2023-07-21T07:35:46.886516+0000","last_became_active":"2023-07-21T07:35:30.542650+0000","last_became_peered":"2023-07-21T07:35:30.542650+0000","last_unstale":"2023-07-21T07:35:46.886516+0000","last_undegraded":"2023-07-21T07:35:46.886516+0000","last_fullsized":"2023-07-21T07:35:46.886516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:05.055421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887855+0000","last_change":"2023-07-21T07:35:31.569427+0000","last_active":"2023-07-21T07:35:46.887855+0000","last_peered":"2023-07-21T07:35:46.887855+0000","last_clean":"2023-07-21T07:35:46.887855+0000","last_became_active":"2023-07-21T07:35:31.569152+0000","last_became_peered":"2023-07-21T07:35:31.569152+0000","last_unstale":"2023-07-21T07:35:46.887855+0000","last_undegraded":"2023-07-21T07:35:46.887855+0000","last_fullsized":"2023-07-21T07:35:46.887855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:06:09.432852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"39'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888067+0000","last_change":"2023-07-21T07:35:44.904909+0000","last_active":"2023-07-21T07:35:46.888067+0000","last_peered":"2023-07-21T07:35:46.888067+0000","last_clean":"2023-07-21T07:35:46.888067+0000","last_became_active":"2023-07-21T07:35:44.904583+0000","last_became_peered":"2023-07-21T07:35:44.904583+0000","last_unstale":"2023-07-21T07:35:46.888067+0000","last_undegraded":"2023-07-21T07:35:46.888067+0000","last_fullsized":"2023-07-21T07:35:46.888067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:35:21.303182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889012+0000","last_change":"2023-07-21T07:35:45.901425+0000","last_active":"2023-07-21T07:35:46.889012+0000","last_peered":"2023-07-21T07:35:46.889012+0000","last_clean":"2023-07-21T07:35:46.889012+0000","last_became_active":"2023-07-21T07:35:45.901053+0000","last_became_peered":"2023-07-21T07:35:45.901053+0000","last_unstale":"2023-07-21T07:35:46.889012+0000","last_undegraded":"2023-07-21T07:35:46.889012+0000","last_fullsized":"2023-07-21T07:35:46.889012+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:00:56.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888113+0000","last_change":"2023-07-21T07:35:30.548569+0000","last_active":"2023-07-21T07:35:46.888113+0000","last_peered":"2023-07-21T07:35:46.888113+0000","last_clean":"2023-07-21T07:35:46.888113+0000","last_became_active":"2023-07-21T07:35:30.548258+0000","last_became_peered":"2023-07-21T07:35:30.548258+0000","last_unstale":"2023-07-21T07:35:46.888113+0000","last_undegraded":"2023-07-21T07:35:46.888113+0000","last_fullsized":"2023-07-21T07:35:46.888113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:10:53.787509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974102+0000","last_change":"2023-07-21T07:35:31.567871+0000","last_active":"2023-07-21T07:35:46.974102+0000","last_peered":"2023-07-21T07:35:46.974102+0000","last_clean":"2023-07-21T07:35:46.974102+0000","last_became_active":"2023-07-21T07:35:31.567550+0000","last_became_peered":"2023-07-21T07:35:31.567550+0000","last_unstale":"2023-07-21T07:35:46.974102+0000","last_undegraded":"2023-07-21T07:35:46.974102+0000","last_fullsized":"2023-07-21T07:35:46.974102+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:30:30.257729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063104+0000","last_change":"2023-07-21T07:35:44.892878+0000","last_active":"2023-07-21T07:35:47.063104+0000","last_peered":"2023-07-21T07:35:47.063104+0000","last_clean":"2023-07-21T07:35:47.063104+0000","last_became_active":"2023-07-21T07:35:44.892603+0000","last_became_peered":"2023-07-21T07:35:44.892603+0000","last_unstale":"2023-07-21T07:35:47.063104+0000","last_undegraded":"2023-07-21T07:35:47.063104+0000","last_fullsized":"2023-07-21T07:35:47.063104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:56:33.161202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.14","version":"36'8","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889056+0000","last_change":"2023-07-21T07:35:30.550443+0000","last_active":"2023-07-21T07:35:46.889056+0000","last_peered":"2023-07-21T07:35:46.889056+0000","last_clean":"2023-07-21T07:35:46.889056+0000","last_became_active":"2023-07-21T07:35:30.550126+0000","last_became_peered":"2023-07-21T07:35:30.550126+0000","last_unstale":"2023-07-21T07:35:46.889056+0000","last_undegraded":"2023-07-21T07:35:46.889056+0000","last_fullsized":"2023-07-21T07:35:46.889056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:32:38.466624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888649+0000","last_change":"2023-07-21T07:35:31.577585+0000","last_active":"2023-07-21T07:35:46.888649+0000","last_peered":"2023-07-21T07:35:46.888649+0000","last_clean":"2023-07-21T07:35:46.888649+0000","last_became_active":"2023-07-21T07:35:31.577145+0000","last_became_peered":"2023-07-21T07:35:31.577145+0000","last_unstale":"2023-07-21T07:35:46.888649+0000","last_undegraded":"2023-07-21T07:35:46.888649+0000","last_fullsized":"2023-07-21T07:35:46.888649+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:43:32.449934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888514+0000","last_change":"2023-07-21T07:35:44.903130+0000","last_active":"2023-07-21T07:35:46.888514+0000","last_peered":"2023-07-21T07:35:46.888514+0000","last_clean":"2023-07-21T07:35:46.888514+0000","last_became_active":"2023-07-21T07:35:44.902788+0000","last_became_peered":"2023-07-21T07:35:44.902788+0000","last_unstale":"2023-07-21T07:35:46.888514+0000","last_undegraded":"2023-07-21T07:35:46.888514+0000","last_fullsized":"2023-07-21T07:35:46.888514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:30:26.851327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063503+0000","last_change":"2023-07-21T07:35:45.890647+0000","last_active":"2023-07-21T07:35:47.063503+0000","last_peered":"2023-07-21T07:35:47.063503+0000","last_clean":"2023-07-21T07:35:47.063503+0000","last_became_active":"2023-07-21T07:35:45.890371+0000","last_became_peered":"2023-07-21T07:35:45.890371+0000","last_unstale":"2023-07-21T07:35:47.063503+0000","last_undegraded":"2023-07-21T07:35:47.063503+0000","last_fullsized":"2023-07-21T07:35:47.063503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:39:14.490597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":24,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062436+0000","last_change":"2023-07-21T07:35:30.552297+0000","last_active":"2023-07-21T07:35:47.062436+0000","last_peered":"2023-07-21T07:35:47.062436+0000","last_clean":"2023-07-21T07:35:47.062436+0000","last_became_active":"2023-07-21T07:35:30.552039+0000","last_became_peered":"2023-07-21T07:35:30.552039+0000","last_unstale":"2023-07-21T07:35:47.062436+0000","last_undegraded":"2023-07-21T07:35:47.062436+0000","last_fullsized":"2023-07-21T07:35:47.062436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:53:59.070091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975029+0000","last_change":"2023-07-21T07:35:31.574640+0000","last_active":"2023-07-21T07:35:46.975029+0000","last_peered":"2023-07-21T07:35:46.975029+0000","last_clean":"2023-07-21T07:35:46.975029+0000","last_became_active":"2023-07-21T07:35:31.574338+0000","last_became_peered":"2023-07-21T07:35:31.574338+0000","last_unstale":"2023-07-21T07:35:46.975029+0000","last_undegraded":"2023-07-21T07:35:46.975029+0000","last_fullsized":"2023-07-21T07:35:46.975029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:10:54.792526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062631+0000","last_change":"2023-07-21T07:35:44.889328+0000","last_active":"2023-07-21T07:35:47.062631+0000","last_peered":"2023-07-21T07:35:47.062631+0000","last_clean":"2023-07-21T07:35:47.062631+0000","last_became_active":"2023-07-21T07:35:44.889059+0000","last_became_peered":"2023-07-21T07:35:44.889059+0000","last_unstale":"2023-07-21T07:35:47.062631+0000","last_undegraded":"2023-07-21T07:35:47.062631+0000","last_fullsized":"2023-07-21T07:35:47.062631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:29:43.928947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887297+0000","last_change":"2023-07-21T07:35:45.896902+0000","last_active":"2023-07-21T07:35:46.887297+0000","last_peered":"2023-07-21T07:35:46.887297+0000","last_clean":"2023-07-21T07:35:46.887297+0000","last_became_active":"2023-07-21T07:35:45.896632+0000","last_became_peered":"2023-07-21T07:35:45.896632+0000","last_unstale":"2023-07-21T07:35:46.887297+0000","last_undegraded":"2023-07-21T07:35:46.887297+0000","last_fullsized":"2023-07-21T07:35:46.887297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:20.396840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061394+0000","last_change":"2023-07-21T07:35:30.547725+0000","last_active":"2023-07-21T07:35:47.061394+0000","last_peered":"2023-07-21T07:35:47.061394+0000","last_clean":"2023-07-21T07:35:47.061394+0000","last_became_active":"2023-07-21T07:35:30.547400+0000","last_became_peered":"2023-07-21T07:35:30.547400+0000","last_unstale":"2023-07-21T07:35:47.061394+0000","last_undegraded":"2023-07-21T07:35:47.061394+0000","last_fullsized":"2023-07-21T07:35:47.061394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:59:50.497869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063693+0000","last_change":"2023-07-21T07:35:31.581622+0000","last_active":"2023-07-21T07:35:47.063693+0000","last_peered":"2023-07-21T07:35:47.063693+0000","last_clean":"2023-07-21T07:35:47.063693+0000","last_became_active":"2023-07-21T07:35:31.581309+0000","last_became_peered":"2023-07-21T07:35:31.581309+0000","last_unstale":"2023-07-21T07:35:47.063693+0000","last_undegraded":"2023-07-21T07:35:47.063693+0000","last_fullsized":"2023-07-21T07:35:47.063693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:26:25.366366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"39'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889293+0000","last_change":"2023-07-21T07:35:44.889706+0000","last_active":"2023-07-21T07:35:46.889293+0000","last_peered":"2023-07-21T07:35:46.889293+0000","last_clean":"2023-07-21T07:35:46.889293+0000","last_became_active":"2023-07-21T07:35:44.889309+0000","last_became_peered":"2023-07-21T07:35:44.889309+0000","last_unstale":"2023-07-21T07:35:46.889293+0000","last_undegraded":"2023-07-21T07:35:46.889293+0000","last_fullsized":"2023-07-21T07:35:46.889293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:15:16.208764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887922+0000","last_change":"2023-07-21T07:35:45.889409+0000","last_active":"2023-07-21T07:35:46.887922+0000","last_peered":"2023-07-21T07:35:46.887922+0000","last_clean":"2023-07-21T07:35:46.887922+0000","last_became_active":"2023-07-21T07:35:45.889174+0000","last_became_peered":"2023-07-21T07:35:45.889174+0000","last_unstale":"2023-07-21T07:35:46.887922+0000","last_undegraded":"2023-07-21T07:35:46.887922+0000","last_fullsized":"2023-07-21T07:35:46.887922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:04.651542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889292+0000","last_change":"2023-07-21T07:35:30.551290+0000","last_active":"2023-07-21T07:35:46.889292+0000","last_peered":"2023-07-21T07:35:46.889292+0000","last_clean":"2023-07-21T07:35:46.889292+0000","last_became_active":"2023-07-21T07:35:30.550872+0000","last_became_peered":"2023-07-21T07:35:30.550872+0000","last_unstale":"2023-07-21T07:35:46.889292+0000","last_undegraded":"2023-07-21T07:35:46.889292+0000","last_fullsized":"2023-07-21T07:35:46.889292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:03:28.127150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060683+0000","last_change":"2023-07-21T07:35:31.576245+0000","last_active":"2023-07-21T07:35:47.060683+0000","last_peered":"2023-07-21T07:35:47.060683+0000","last_clean":"2023-07-21T07:35:47.060683+0000","last_became_active":"2023-07-21T07:35:31.575586+0000","last_became_peered":"2023-07-21T07:35:31.575586+0000","last_unstale":"2023-07-21T07:35:47.060683+0000","last_undegraded":"2023-07-21T07:35:47.060683+0000","last_fullsized":"2023-07-21T07:35:47.060683+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:45:56.504529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"39'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063800+0000","last_change":"2023-07-21T07:35:44.894507+0000","last_active":"2023-07-21T07:35:47.063800+0000","last_peered":"2023-07-21T07:35:47.063800+0000","last_clean":"2023-07-21T07:35:47.063800+0000","last_became_active":"2023-07-21T07:35:44.894254+0000","last_became_peered":"2023-07-21T07:35:44.894254+0000","last_unstale":"2023-07-21T07:35:47.063800+0000","last_undegraded":"2023-07-21T07:35:47.063800+0000","last_fullsized":"2023-07-21T07:35:47.063800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:54:13.404143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974573+0000","last_change":"2023-07-21T07:35:45.912066+0000","last_active":"2023-07-21T07:35:46.974573+0000","last_peered":"2023-07-21T07:35:46.974573+0000","last_clean":"2023-07-21T07:35:46.974573+0000","last_became_active":"2023-07-21T07:35:45.911723+0000","last_became_peered":"2023-07-21T07:35:45.911723+0000","last_unstale":"2023-07-21T07:35:46.974573+0000","last_undegraded":"2023-07-21T07:35:46.974573+0000","last_fullsized":"2023-07-21T07:35:46.974573+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:43:07.644333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887400+0000","last_change":"2023-07-21T07:35:30.550858+0000","last_active":"2023-07-21T07:35:46.887400+0000","last_peered":"2023-07-21T07:35:46.887400+0000","last_clean":"2023-07-21T07:35:46.887400+0000","last_became_active":"2023-07-21T07:35:30.550540+0000","last_became_peered":"2023-07-21T07:35:30.550540+0000","last_unstale":"2023-07-21T07:35:46.887400+0000","last_undegraded":"2023-07-21T07:35:46.887400+0000","last_fullsized":"2023-07-21T07:35:46.887400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:05:50.424831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888340+0000","last_change":"2023-07-21T07:35:31.561749+0000","last_active":"2023-07-21T07:35:46.888340+0000","last_peered":"2023-07-21T07:35:46.888340+0000","last_clean":"2023-07-21T07:35:46.888340+0000","last_became_active":"2023-07-21T07:35:31.561255+0000","last_became_peered":"2023-07-21T07:35:31.561255+0000","last_unstale":"2023-07-21T07:35:46.888340+0000","last_undegraded":"2023-07-21T07:35:46.888340+0000","last_fullsized":"2023-07-21T07:35:46.888340+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:06.060437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887655+0000","last_change":"2023-07-21T07:35:44.892878+0000","last_active":"2023-07-21T07:35:46.887655+0000","last_peered":"2023-07-21T07:35:46.887655+0000","last_clean":"2023-07-21T07:35:46.887655+0000","last_became_active":"2023-07-21T07:35:44.892488+0000","last_became_peered":"2023-07-21T07:35:44.892488+0000","last_unstale":"2023-07-21T07:35:46.887655+0000","last_undegraded":"2023-07-21T07:35:46.887655+0000","last_fullsized":"2023-07-21T07:35:46.887655+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:31:31.286874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063460+0000","last_change":"2023-07-21T07:35:45.902658+0000","last_active":"2023-07-21T07:35:47.063460+0000","last_peered":"2023-07-21T07:35:47.063460+0000","last_clean":"2023-07-21T07:35:47.063460+0000","last_became_active":"2023-07-21T07:35:45.902375+0000","last_became_peered":"2023-07-21T07:35:45.902375+0000","last_unstale":"2023-07-21T07:35:47.063460+0000","last_undegraded":"2023-07-21T07:35:47.063460+0000","last_fullsized":"2023-07-21T07:35:47.063460+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:52:21.599534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886365+0000","last_change":"2023-07-21T07:35:30.542823+0000","last_active":"2023-07-21T07:35:46.886365+0000","last_peered":"2023-07-21T07:35:46.886365+0000","last_clean":"2023-07-21T07:35:46.886365+0000","last_became_active":"2023-07-21T07:35:30.542612+0000","last_became_peered":"2023-07-21T07:35:30.542612+0000","last_unstale":"2023-07-21T07:35:46.886365+0000","last_undegraded":"2023-07-21T07:35:46.886365+0000","last_fullsized":"2023-07-21T07:35:46.886365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:21:51.934097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887848+0000","last_change":"2023-07-21T07:35:31.577159+0000","last_active":"2023-07-21T07:35:46.887848+0000","last_peered":"2023-07-21T07:35:46.887848+0000","last_clean":"2023-07-21T07:35:46.887848+0000","last_became_active":"2023-07-21T07:35:31.576870+0000","last_became_peered":"2023-07-21T07:35:31.576870+0000","last_unstale":"2023-07-21T07:35:46.887848+0000","last_undegraded":"2023-07-21T07:35:46.887848+0000","last_fullsized":"2023-07-21T07:35:46.887848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:30:10.432473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974394+0000","last_change":"2023-07-21T07:35:44.890964+0000","last_active":"2023-07-21T07:35:46.974394+0000","last_peered":"2023-07-21T07:35:46.974394+0000","last_clean":"2023-07-21T07:35:46.974394+0000","last_became_active":"2023-07-21T07:35:44.890503+0000","last_became_peered":"2023-07-21T07:35:44.890503+0000","last_unstale":"2023-07-21T07:35:46.974394+0000","last_undegraded":"2023-07-21T07:35:46.974394+0000","last_fullsized":"2023-07-21T07:35:46.974394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:43:41.267360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888214+0000","last_change":"2023-07-21T07:35:45.902656+0000","last_active":"2023-07-21T07:35:46.888214+0000","last_peered":"2023-07-21T07:35:46.888214+0000","last_clean":"2023-07-21T07:35:46.888214+0000","last_became_active":"2023-07-21T07:35:45.902336+0000","last_became_peered":"2023-07-21T07:35:45.902336+0000","last_unstale":"2023-07-21T07:35:46.888214+0000","last_undegraded":"2023-07-21T07:35:46.888214+0000","last_fullsized":"2023-07-21T07:35:46.888214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:46:23.964370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062402+0000","last_change":"2023-07-21T07:35:30.550820+0000","last_active":"2023-07-21T07:35:47.062402+0000","last_peered":"2023-07-21T07:35:47.062402+0000","last_clean":"2023-07-21T07:35:47.062402+0000","last_became_active":"2023-07-21T07:35:30.550525+0000","last_became_peered":"2023-07-21T07:35:30.550525+0000","last_unstale":"2023-07-21T07:35:47.062402+0000","last_undegraded":"2023-07-21T07:35:47.062402+0000","last_fullsized":"2023-07-21T07:35:47.062402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:53:37.514800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062828+0000","last_change":"2023-07-21T07:35:31.578102+0000","last_active":"2023-07-21T07:35:47.062828+0000","last_peered":"2023-07-21T07:35:47.062828+0000","last_clean":"2023-07-21T07:35:47.062828+0000","last_became_active":"2023-07-21T07:35:31.577824+0000","last_became_peered":"2023-07-21T07:35:31.577824+0000","last_unstale":"2023-07-21T07:35:47.062828+0000","last_undegraded":"2023-07-21T07:35:47.062828+0000","last_fullsized":"2023-07-21T07:35:47.062828+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:42:11.382323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974509+0000","last_change":"2023-07-21T07:35:44.892233+0000","last_active":"2023-07-21T07:35:46.974509+0000","last_peered":"2023-07-21T07:35:46.974509+0000","last_clean":"2023-07-21T07:35:46.974509+0000","last_became_active":"2023-07-21T07:35:44.891945+0000","last_became_peered":"2023-07-21T07:35:44.891945+0000","last_unstale":"2023-07-21T07:35:46.974509+0000","last_undegraded":"2023-07-21T07:35:46.974509+0000","last_fullsized":"2023-07-21T07:35:46.974509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:02:28.246014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062282+0000","last_change":"2023-07-21T07:35:45.912378+0000","last_active":"2023-07-21T07:35:47.062282+0000","last_peered":"2023-07-21T07:35:47.062282+0000","last_clean":"2023-07-21T07:35:47.062282+0000","last_became_active":"2023-07-21T07:35:45.912142+0000","last_became_peered":"2023-07-21T07:35:45.912142+0000","last_unstale":"2023-07-21T07:35:47.062282+0000","last_undegraded":"2023-07-21T07:35:47.062282+0000","last_fullsized":"2023-07-21T07:35:47.062282+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:43:22.524095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061746+0000","last_change":"2023-07-21T07:35:30.546712+0000","last_active":"2023-07-21T07:35:47.061746+0000","last_peered":"2023-07-21T07:35:47.061746+0000","last_clean":"2023-07-21T07:35:47.061746+0000","last_became_active":"2023-07-21T07:35:30.546408+0000","last_became_peered":"2023-07-21T07:35:30.546408+0000","last_unstale":"2023-07-21T07:35:47.061746+0000","last_undegraded":"2023-07-21T07:35:47.061746+0000","last_fullsized":"2023-07-21T07:35:47.061746+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:10.578171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974306+0000","last_change":"2023-07-21T07:35:31.568304+0000","last_active":"2023-07-21T07:35:46.974306+0000","last_peered":"2023-07-21T07:35:46.974306+0000","last_clean":"2023-07-21T07:35:46.974306+0000","last_became_active":"2023-07-21T07:35:31.567923+0000","last_became_peered":"2023-07-21T07:35:31.567923+0000","last_unstale":"2023-07-21T07:35:46.974306+0000","last_undegraded":"2023-07-21T07:35:46.974306+0000","last_fullsized":"2023-07-21T07:35:46.974306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:45:49.839683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062569+0000","last_change":"2023-07-21T07:35:44.891451+0000","last_active":"2023-07-21T07:35:47.062569+0000","last_peered":"2023-07-21T07:35:47.062569+0000","last_clean":"2023-07-21T07:35:47.062569+0000","last_became_active":"2023-07-21T07:35:44.891172+0000","last_became_peered":"2023-07-21T07:35:44.891172+0000","last_unstale":"2023-07-21T07:35:47.062569+0000","last_undegraded":"2023-07-21T07:35:47.062569+0000","last_fullsized":"2023-07-21T07:35:47.062569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:17:50.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888417+0000","last_change":"2023-07-21T07:35:45.899896+0000","last_active":"2023-07-21T07:35:46.888417+0000","last_peered":"2023-07-21T07:35:46.888417+0000","last_clean":"2023-07-21T07:35:46.888417+0000","last_became_active":"2023-07-21T07:35:45.899604+0000","last_became_peered":"2023-07-21T07:35:45.899604+0000","last_unstale":"2023-07-21T07:35:46.888417+0000","last_undegraded":"2023-07-21T07:35:46.888417+0000","last_fullsized":"2023-07-21T07:35:46.888417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:38:26.175627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888389+0000","last_change":"2023-07-21T07:35:30.551432+0000","last_active":"2023-07-21T07:35:46.888389+0000","last_peered":"2023-07-21T07:35:46.888389+0000","last_clean":"2023-07-21T07:35:46.888389+0000","last_became_active":"2023-07-21T07:35:30.551141+0000","last_became_peered":"2023-07-21T07:35:30.551141+0000","last_unstale":"2023-07-21T07:35:46.888389+0000","last_undegraded":"2023-07-21T07:35:46.888389+0000","last_fullsized":"2023-07-21T07:35:46.888389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:18:44.588131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889545+0000","last_change":"2023-07-21T07:35:31.584271+0000","last_active":"2023-07-21T07:35:46.889545+0000","last_peered":"2023-07-21T07:35:46.889545+0000","last_clean":"2023-07-21T07:35:46.889545+0000","last_became_active":"2023-07-21T07:35:31.583788+0000","last_became_peered":"2023-07-21T07:35:31.583788+0000","last_unstale":"2023-07-21T07:35:46.889545+0000","last_undegraded":"2023-07-21T07:35:46.889545+0000","last_fullsized":"2023-07-21T07:35:46.889545+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:48.192496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888696+0000","last_change":"2023-07-21T07:35:44.897357+0000","last_active":"2023-07-21T07:35:46.888696+0000","last_peered":"2023-07-21T07:35:46.888696+0000","last_clean":"2023-07-21T07:35:46.888696+0000","last_became_active":"2023-07-21T07:35:44.897082+0000","last_became_peered":"2023-07-21T07:35:44.897082+0000","last_unstale":"2023-07-21T07:35:46.888696+0000","last_undegraded":"2023-07-21T07:35:46.888696+0000","last_fullsized":"2023-07-21T07:35:46.888696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:30:26.851327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063568+0000","last_change":"2023-07-21T07:35:45.895560+0000","last_active":"2023-07-21T07:35:47.063568+0000","last_peered":"2023-07-21T07:35:47.063568+0000","last_clean":"2023-07-21T07:35:47.063568+0000","last_became_active":"2023-07-21T07:35:45.895266+0000","last_became_peered":"2023-07-21T07:35:45.895266+0000","last_unstale":"2023-07-21T07:35:47.063568+0000","last_undegraded":"2023-07-21T07:35:47.063568+0000","last_fullsized":"2023-07-21T07:35:47.063568+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:34:56.784677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887260+0000","last_change":"2023-07-21T07:35:30.550649+0000","last_active":"2023-07-21T07:35:46.887260+0000","last_peered":"2023-07-21T07:35:46.887260+0000","last_clean":"2023-07-21T07:35:46.887260+0000","last_became_active":"2023-07-21T07:35:30.550349+0000","last_became_peered":"2023-07-21T07:35:30.550349+0000","last_unstale":"2023-07-21T07:35:46.887260+0000","last_undegraded":"2023-07-21T07:35:46.887260+0000","last_fullsized":"2023-07-21T07:35:46.887260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:55:30.715720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888306+0000","last_change":"2023-07-21T07:35:31.579255+0000","last_active":"2023-07-21T07:35:46.888306+0000","last_peered":"2023-07-21T07:35:46.888306+0000","last_clean":"2023-07-21T07:35:46.888306+0000","last_became_active":"2023-07-21T07:35:31.578910+0000","last_became_peered":"2023-07-21T07:35:31.578910+0000","last_unstale":"2023-07-21T07:35:46.888306+0000","last_undegraded":"2023-07-21T07:35:46.888306+0000","last_fullsized":"2023-07-21T07:35:46.888306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:03:29.132167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"39'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061628+0000","last_change":"2023-07-21T07:35:44.891970+0000","last_active":"2023-07-21T07:35:47.061628+0000","last_peered":"2023-07-21T07:35:47.061628+0000","last_clean":"2023-07-21T07:35:47.061628+0000","last_became_active":"2023-07-21T07:35:44.891737+0000","last_became_peered":"2023-07-21T07:35:44.891737+0000","last_unstale":"2023-07-21T07:35:47.061628+0000","last_undegraded":"2023-07-21T07:35:47.061628+0000","last_fullsized":"2023-07-21T07:35:47.061628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:57:03.161260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060540+0000","last_change":"2023-07-21T07:35:45.894069+0000","last_active":"2023-07-21T07:35:47.060540+0000","last_peered":"2023-07-21T07:35:47.060540+0000","last_clean":"2023-07-21T07:35:47.060540+0000","last_became_active":"2023-07-21T07:35:45.893542+0000","last_became_peered":"2023-07-21T07:35:45.893542+0000","last_unstale":"2023-07-21T07:35:47.060540+0000","last_undegraded":"2023-07-21T07:35:47.060540+0000","last_fullsized":"2023-07-21T07:35:47.060540+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:18:59.929550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975133+0000","last_change":"2023-07-21T07:35:30.549262+0000","last_active":"2023-07-21T07:35:46.975133+0000","last_peered":"2023-07-21T07:35:46.975133+0000","last_clean":"2023-07-21T07:35:46.975133+0000","last_became_active":"2023-07-21T07:35:30.548946+0000","last_became_peered":"2023-07-21T07:35:30.548946+0000","last_unstale":"2023-07-21T07:35:46.975133+0000","last_undegraded":"2023-07-21T07:35:46.975133+0000","last_fullsized":"2023-07-21T07:35:46.975133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:38:10.834208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887462+0000","last_change":"2023-07-21T07:35:31.572810+0000","last_active":"2023-07-21T07:35:46.887462+0000","last_peered":"2023-07-21T07:35:46.887462+0000","last_clean":"2023-07-21T07:35:46.887462+0000","last_became_active":"2023-07-21T07:35:31.572369+0000","last_became_peered":"2023-07-21T07:35:31.572369+0000","last_unstale":"2023-07-21T07:35:46.887462+0000","last_undegraded":"2023-07-21T07:35:46.887462+0000","last_fullsized":"2023-07-21T07:35:46.887462+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:46:09.627968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061358+0000","last_change":"2023-07-21T07:35:44.890780+0000","last_active":"2023-07-21T07:35:47.061358+0000","last_peered":"2023-07-21T07:35:47.061358+0000","last_clean":"2023-07-21T07:35:47.061358+0000","last_became_active":"2023-07-21T07:35:44.890547+0000","last_became_peered":"2023-07-21T07:35:44.890547+0000","last_unstale":"2023-07-21T07:35:47.061358+0000","last_undegraded":"2023-07-21T07:35:47.061358+0000","last_fullsized":"2023-07-21T07:35:47.061358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:14:14.498509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888275+0000","last_change":"2023-07-21T07:35:45.897282+0000","last_active":"2023-07-21T07:35:46.888275+0000","last_peered":"2023-07-21T07:35:46.888275+0000","last_clean":"2023-07-21T07:35:46.888275+0000","last_became_active":"2023-07-21T07:35:45.896993+0000","last_became_peered":"2023-07-21T07:35:45.896993+0000","last_unstale":"2023-07-21T07:35:46.888275+0000","last_undegraded":"2023-07-21T07:35:46.888275+0000","last_fullsized":"2023-07-21T07:35:46.888275+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:22:07.275516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062158+0000","last_change":"2023-07-21T07:35:30.552422+0000","last_active":"2023-07-21T07:35:47.062158+0000","last_peered":"2023-07-21T07:35:47.062158+0000","last_clean":"2023-07-21T07:35:47.062158+0000","last_became_active":"2023-07-21T07:35:30.552153+0000","last_became_peered":"2023-07-21T07:35:30.552153+0000","last_unstale":"2023-07-21T07:35:47.062158+0000","last_undegraded":"2023-07-21T07:35:47.062158+0000","last_fullsized":"2023-07-21T07:35:47.062158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:29.521857+0000","last_clean_scrub_stamp":"2023-07-21T07:35:29.521857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:19:40.834625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062396+0000","last_change":"2023-07-21T07:35:31.572362+0000","last_active":"2023-07-21T07:35:47.062396+0000","last_peered":"2023-07-21T07:35:47.062396+0000","last_clean":"2023-07-21T07:35:47.062396+0000","last_became_active":"2023-07-21T07:35:31.572080+0000","last_became_peered":"2023-07-21T07:35:31.572080+0000","last_unstale":"2023-07-21T07:35:47.062396+0000","last_undegraded":"2023-07-21T07:35:47.062396+0000","last_fullsized":"2023-07-21T07:35:47.062396+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:13:25.635911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888841+0000","last_change":"2023-07-21T07:35:44.892311+0000","last_active":"2023-07-21T07:35:46.888841+0000","last_peered":"2023-07-21T07:35:46.888841+0000","last_clean":"2023-07-21T07:35:46.888841+0000","last_became_active":"2023-07-21T07:35:44.892011+0000","last_became_peered":"2023-07-21T07:35:44.892011+0000","last_unstale":"2023-07-21T07:35:46.888841+0000","last_undegraded":"2023-07-21T07:35:46.888841+0000","last_fullsized":"2023-07-21T07:35:46.888841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:43.855909+0000","last_clean_scrub_stamp":"2023-07-21T07:35:43.855909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:15:16.208764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060965+0000","last_change":"2023-07-21T07:35:45.901417+0000","last_active":"2023-07-21T07:35:47.060965+0000","last_peered":"2023-07-21T07:35:47.060965+0000","last_clean":"2023-07-21T07:35:47.060965+0000","last_became_active":"2023-07-21T07:35:45.901116+0000","last_became_peered":"2023-07-21T07:35:45.901116+0000","last_unstale":"2023-07-21T07:35:47.060965+0000","last_undegraded":"2023-07-21T07:35:47.060965+0000","last_fullsized":"2023-07-21T07:35:47.060965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:32:52.395497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063463+0000","last_change":"2023-07-21T07:35:45.896120+0000","last_active":"2023-07-21T07:35:47.063463+0000","last_peered":"2023-07-21T07:35:47.063463+0000","last_clean":"2023-07-21T07:35:47.063463+0000","last_became_active":"2023-07-21T07:35:45.893735+0000","last_became_peered":"2023-07-21T07:35:45.893735+0000","last_unstale":"2023-07-21T07:35:47.063463+0000","last_undegraded":"2023-07-21T07:35:47.063463+0000","last_fullsized":"2023-07-21T07:35:47.063463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:15:40.813390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886251+0000","last_change":"2023-07-21T07:35:31.568296+0000","last_active":"2023-07-21T07:35:46.886251+0000","last_peered":"2023-07-21T07:35:46.886251+0000","last_clean":"2023-07-21T07:35:46.886251+0000","last_became_active":"2023-07-21T07:35:31.567956+0000","last_became_peered":"2023-07-21T07:35:31.567956+0000","last_unstale":"2023-07-21T07:35:46.886251+0000","last_undegraded":"2023-07-21T07:35:46.886251+0000","last_fullsized":"2023-07-21T07:35:46.886251+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:25:59.125576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975231+0000","last_change":"2023-07-21T07:35:45.902531+0000","last_active":"2023-07-21T07:35:46.975231+0000","last_peered":"2023-07-21T07:35:46.975231+0000","last_clean":"2023-07-21T07:35:46.975231+0000","last_became_active":"2023-07-21T07:35:45.902241+0000","last_became_peered":"2023-07-21T07:35:45.902241+0000","last_unstale":"2023-07-21T07:35:46.975231+0000","last_undegraded":"2023-07-21T07:35:46.975231+0000","last_fullsized":"2023-07-21T07:35:46.975231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:55:37.649618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062645+0000","last_change":"2023-07-21T07:35:31.566417+0000","last_active":"2023-07-21T07:35:47.062645+0000","last_peered":"2023-07-21T07:35:47.062645+0000","last_clean":"2023-07-21T07:35:47.062645+0000","last_became_active":"2023-07-21T07:35:31.565614+0000","last_became_peered":"2023-07-21T07:35:31.565614+0000","last_unstale":"2023-07-21T07:35:47.062645+0000","last_undegraded":"2023-07-21T07:35:47.062645+0000","last_fullsized":"2023-07-21T07:35:47.062645+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:33:53.955794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061198+0000","last_change":"2023-07-21T07:35:45.896935+0000","last_active":"2023-07-21T07:35:47.061198+0000","last_peered":"2023-07-21T07:35:47.061198+0000","last_clean":"2023-07-21T07:35:47.061198+0000","last_became_active":"2023-07-21T07:35:45.896660+0000","last_became_peered":"2023-07-21T07:35:45.896660+0000","last_unstale":"2023-07-21T07:35:47.061198+0000","last_undegraded":"2023-07-21T07:35:47.061198+0000","last_fullsized":"2023-07-21T07:35:47.061198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:46:10.840932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062582+0000","last_change":"2023-07-21T07:35:31.586191+0000","last_active":"2023-07-21T07:35:47.062582+0000","last_peered":"2023-07-21T07:35:47.062582+0000","last_clean":"2023-07-21T07:35:47.062582+0000","last_became_active":"2023-07-21T07:35:31.585881+0000","last_became_peered":"2023-07-21T07:35:31.585881+0000","last_unstale":"2023-07-21T07:35:47.062582+0000","last_undegraded":"2023-07-21T07:35:47.062582+0000","last_fullsized":"2023-07-21T07:35:47.062582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:42:18.162795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975145+0000","last_change":"2023-07-21T07:35:45.905154+0000","last_active":"2023-07-21T07:35:46.975145+0000","last_peered":"2023-07-21T07:35:46.975145+0000","last_clean":"2023-07-21T07:35:46.975145+0000","last_became_active":"2023-07-21T07:35:45.904809+0000","last_became_peered":"2023-07-21T07:35:45.904809+0000","last_unstale":"2023-07-21T07:35:46.975145+0000","last_undegraded":"2023-07-21T07:35:46.975145+0000","last_fullsized":"2023-07-21T07:35:46.975145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:20.396840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061284+0000","last_change":"2023-07-21T07:35:31.582080+0000","last_active":"2023-07-21T07:35:47.061284+0000","last_peered":"2023-07-21T07:35:47.061284+0000","last_clean":"2023-07-21T07:35:47.061284+0000","last_became_active":"2023-07-21T07:35:31.581824+0000","last_became_peered":"2023-07-21T07:35:31.581824+0000","last_unstale":"2023-07-21T07:35:47.061284+0000","last_undegraded":"2023-07-21T07:35:47.061284+0000","last_fullsized":"2023-07-21T07:35:47.061284+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:18:06.650041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887525+0000","last_change":"2023-07-21T07:35:45.903931+0000","last_active":"2023-07-21T07:35:46.887525+0000","last_peered":"2023-07-21T07:35:46.887525+0000","last_clean":"2023-07-21T07:35:46.887525+0000","last_became_active":"2023-07-21T07:35:45.903668+0000","last_became_peered":"2023-07-21T07:35:45.903668+0000","last_unstale":"2023-07-21T07:35:46.887525+0000","last_undegraded":"2023-07-21T07:35:46.887525+0000","last_fullsized":"2023-07-21T07:35:46.887525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:47.933083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061466+0000","last_change":"2023-07-21T07:35:31.583360+0000","last_active":"2023-07-21T07:35:47.061466+0000","last_peered":"2023-07-21T07:35:47.061466+0000","last_clean":"2023-07-21T07:35:47.061466+0000","last_became_active":"2023-07-21T07:35:31.582534+0000","last_became_peered":"2023-07-21T07:35:31.582534+0000","last_unstale":"2023-07-21T07:35:47.061466+0000","last_undegraded":"2023-07-21T07:35:47.061466+0000","last_fullsized":"2023-07-21T07:35:47.061466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:33:53.955794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062436+0000","last_change":"2023-07-21T07:35:45.901026+0000","last_active":"2023-07-21T07:35:47.062436+0000","last_peered":"2023-07-21T07:35:47.062436+0000","last_clean":"2023-07-21T07:35:47.062436+0000","last_became_active":"2023-07-21T07:35:45.900704+0000","last_became_peered":"2023-07-21T07:35:45.900704+0000","last_unstale":"2023-07-21T07:35:47.062436+0000","last_undegraded":"2023-07-21T07:35:47.062436+0000","last_fullsized":"2023-07-21T07:35:47.062436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:15:28.199088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062856+0000","last_change":"2023-07-21T07:35:31.580409+0000","last_active":"2023-07-21T07:35:47.062856+0000","last_peered":"2023-07-21T07:35:47.062856+0000","last_clean":"2023-07-21T07:35:47.062856+0000","last_became_active":"2023-07-21T07:35:31.580078+0000","last_became_peered":"2023-07-21T07:35:31.580078+0000","last_unstale":"2023-07-21T07:35:47.062856+0000","last_undegraded":"2023-07-21T07:35:47.062856+0000","last_fullsized":"2023-07-21T07:35:47.062856+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:17:11.999157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974093+0000","last_change":"2023-07-21T07:35:45.909064+0000","last_active":"2023-07-21T07:35:46.974093+0000","last_peered":"2023-07-21T07:35:46.974093+0000","last_clean":"2023-07-21T07:35:46.974093+0000","last_became_active":"2023-07-21T07:35:45.908784+0000","last_became_peered":"2023-07-21T07:35:45.908784+0000","last_unstale":"2023-07-21T07:35:46.974093+0000","last_undegraded":"2023-07-21T07:35:46.974093+0000","last_fullsized":"2023-07-21T07:35:46.974093+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:57:24.598149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888763+0000","last_change":"2023-07-21T07:35:31.575204+0000","last_active":"2023-07-21T07:35:46.888763+0000","last_peered":"2023-07-21T07:35:46.888763+0000","last_clean":"2023-07-21T07:35:46.888763+0000","last_became_active":"2023-07-21T07:35:31.574935+0000","last_became_peered":"2023-07-21T07:35:31.574935+0000","last_unstale":"2023-07-21T07:35:46.888763+0000","last_undegraded":"2023-07-21T07:35:46.888763+0000","last_fullsized":"2023-07-21T07:35:46.888763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:43:32.449934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060143+0000","last_change":"2023-07-21T07:35:45.897147+0000","last_active":"2023-07-21T07:35:47.060143+0000","last_peered":"2023-07-21T07:35:47.060143+0000","last_clean":"2023-07-21T07:35:47.060143+0000","last_became_active":"2023-07-21T07:35:45.896853+0000","last_became_peered":"2023-07-21T07:35:45.896853+0000","last_unstale":"2023-07-21T07:35:47.060143+0000","last_undegraded":"2023-07-21T07:35:47.060143+0000","last_fullsized":"2023-07-21T07:35:47.060143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:11:22.203386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061947+0000","last_change":"2023-07-21T07:35:31.575695+0000","last_active":"2023-07-21T07:35:47.061947+0000","last_peered":"2023-07-21T07:35:47.061947+0000","last_clean":"2023-07-21T07:35:47.061947+0000","last_became_active":"2023-07-21T07:35:31.574995+0000","last_became_peered":"2023-07-21T07:35:31.574995+0000","last_unstale":"2023-07-21T07:35:47.061947+0000","last_undegraded":"2023-07-21T07:35:47.061947+0000","last_fullsized":"2023-07-21T07:35:47.061947+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:26:21.678324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888124+0000","last_change":"2023-07-21T07:35:45.897229+0000","last_active":"2023-07-21T07:35:46.888124+0000","last_peered":"2023-07-21T07:35:46.888124+0000","last_clean":"2023-07-21T07:35:46.888124+0000","last_became_active":"2023-07-21T07:35:45.896948+0000","last_became_peered":"2023-07-21T07:35:45.896948+0000","last_unstale":"2023-07-21T07:35:46.888124+0000","last_undegraded":"2023-07-21T07:35:46.888124+0000","last_fullsized":"2023-07-21T07:35:46.888124+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:29:27.656646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.059771+0000","last_change":"2023-07-21T07:35:31.560958+0000","last_active":"2023-07-21T07:35:47.059771+0000","last_peered":"2023-07-21T07:35:47.059771+0000","last_clean":"2023-07-21T07:35:47.059771+0000","last_became_active":"2023-07-21T07:35:31.560610+0000","last_became_peered":"2023-07-21T07:35:31.560610+0000","last_unstale":"2023-07-21T07:35:47.059771+0000","last_undegraded":"2023-07-21T07:35:47.059771+0000","last_fullsized":"2023-07-21T07:35:47.059771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:10:24.363237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975245+0000","last_change":"2023-07-21T07:35:45.908609+0000","last_active":"2023-07-21T07:35:46.975245+0000","last_peered":"2023-07-21T07:35:46.975245+0000","last_clean":"2023-07-21T07:35:46.975245+0000","last_became_active":"2023-07-21T07:35:45.908308+0000","last_became_peered":"2023-07-21T07:35:45.908308+0000","last_unstale":"2023-07-21T07:35:46.975245+0000","last_undegraded":"2023-07-21T07:35:46.975245+0000","last_fullsized":"2023-07-21T07:35:46.975245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:31:32.294242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063618+0000","last_change":"2023-07-21T07:35:31.571165+0000","last_active":"2023-07-21T07:35:47.063618+0000","last_peered":"2023-07-21T07:35:47.063618+0000","last_clean":"2023-07-21T07:35:47.063618+0000","last_became_active":"2023-07-21T07:35:31.570834+0000","last_became_peered":"2023-07-21T07:35:31.570834+0000","last_unstale":"2023-07-21T07:35:47.063618+0000","last_undegraded":"2023-07-21T07:35:47.063618+0000","last_fullsized":"2023-07-21T07:35:47.063618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:14:27.722253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061629+0000","last_change":"2023-07-21T07:35:45.900018+0000","last_active":"2023-07-21T07:35:47.061629+0000","last_peered":"2023-07-21T07:35:47.061629+0000","last_clean":"2023-07-21T07:35:47.061629+0000","last_became_active":"2023-07-21T07:35:45.899772+0000","last_became_peered":"2023-07-21T07:35:45.899772+0000","last_unstale":"2023-07-21T07:35:47.061629+0000","last_undegraded":"2023-07-21T07:35:47.061629+0000","last_fullsized":"2023-07-21T07:35:47.061629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:54:31.841951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888227+0000","last_change":"2023-07-21T07:35:31.570945+0000","last_active":"2023-07-21T07:35:46.888227+0000","last_peered":"2023-07-21T07:35:46.888227+0000","last_clean":"2023-07-21T07:35:46.888227+0000","last_became_active":"2023-07-21T07:35:31.570678+0000","last_became_peered":"2023-07-21T07:35:31.570678+0000","last_unstale":"2023-07-21T07:35:46.888227+0000","last_undegraded":"2023-07-21T07:35:46.888227+0000","last_fullsized":"2023-07-21T07:35:46.888227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:15:02.879729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887913+0000","last_change":"2023-07-21T07:35:45.903523+0000","last_active":"2023-07-21T07:35:46.887913+0000","last_peered":"2023-07-21T07:35:46.887913+0000","last_clean":"2023-07-21T07:35:46.887913+0000","last_became_active":"2023-07-21T07:35:45.902799+0000","last_became_peered":"2023-07-21T07:35:45.902799+0000","last_unstale":"2023-07-21T07:35:46.887913+0000","last_undegraded":"2023-07-21T07:35:46.887913+0000","last_fullsized":"2023-07-21T07:35:46.887913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:03:43.468570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061485+0000","last_change":"2023-07-21T07:35:31.572474+0000","last_active":"2023-07-21T07:35:47.061485+0000","last_peered":"2023-07-21T07:35:47.061485+0000","last_clean":"2023-07-21T07:35:47.061485+0000","last_became_active":"2023-07-21T07:35:31.572214+0000","last_became_peered":"2023-07-21T07:35:31.572214+0000","last_unstale":"2023-07-21T07:35:47.061485+0000","last_undegraded":"2023-07-21T07:35:47.061485+0000","last_fullsized":"2023-07-21T07:35:47.061485+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:52:07.263132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062307+0000","last_change":"2023-07-21T07:35:45.900065+0000","last_active":"2023-07-21T07:35:47.062307+0000","last_peered":"2023-07-21T07:35:47.062307+0000","last_clean":"2023-07-21T07:35:47.062307+0000","last_became_active":"2023-07-21T07:35:45.899778+0000","last_became_peered":"2023-07-21T07:35:45.899778+0000","last_unstale":"2023-07-21T07:35:47.062307+0000","last_undegraded":"2023-07-21T07:35:47.062307+0000","last_fullsized":"2023-07-21T07:35:47.062307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:18:28.590568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061947+0000","last_change":"2023-07-21T07:35:31.575679+0000","last_active":"2023-07-21T07:35:47.061947+0000","last_peered":"2023-07-21T07:35:47.061947+0000","last_clean":"2023-07-21T07:35:47.061947+0000","last_became_active":"2023-07-21T07:35:31.575365+0000","last_became_peered":"2023-07-21T07:35:31.575365+0000","last_unstale":"2023-07-21T07:35:47.061947+0000","last_undegraded":"2023-07-21T07:35:47.061947+0000","last_fullsized":"2023-07-21T07:35:47.061947+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:16:08.917825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974384+0000","last_change":"2023-07-21T07:35:45.895108+0000","last_active":"2023-07-21T07:35:46.974384+0000","last_peered":"2023-07-21T07:35:46.974384+0000","last_clean":"2023-07-21T07:35:46.974384+0000","last_became_active":"2023-07-21T07:35:45.894807+0000","last_became_peered":"2023-07-21T07:35:45.894807+0000","last_unstale":"2023-07-21T07:35:46.974384+0000","last_undegraded":"2023-07-21T07:35:46.974384+0000","last_fullsized":"2023-07-21T07:35:46.974384+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:18:08.271364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060454+0000","last_change":"2023-07-21T07:35:31.564789+0000","last_active":"2023-07-21T07:35:47.060454+0000","last_peered":"2023-07-21T07:35:47.060454+0000","last_clean":"2023-07-21T07:35:47.060454+0000","last_became_active":"2023-07-21T07:35:31.564503+0000","last_became_peered":"2023-07-21T07:35:31.564503+0000","last_unstale":"2023-07-21T07:35:47.060454+0000","last_undegraded":"2023-07-21T07:35:47.060454+0000","last_fullsized":"2023-07-21T07:35:47.060454+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:01:10.985979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060754+0000","last_change":"2023-07-21T07:35:45.899100+0000","last_active":"2023-07-21T07:35:47.060754+0000","last_peered":"2023-07-21T07:35:47.060754+0000","last_clean":"2023-07-21T07:35:47.060754+0000","last_became_active":"2023-07-21T07:35:45.898518+0000","last_became_peered":"2023-07-21T07:35:45.898518+0000","last_unstale":"2023-07-21T07:35:47.060754+0000","last_undegraded":"2023-07-21T07:35:47.060754+0000","last_fullsized":"2023-07-21T07:35:47.060754+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:18:28.590568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061357+0000","last_change":"2023-07-21T07:35:31.583163+0000","last_active":"2023-07-21T07:35:47.061357+0000","last_peered":"2023-07-21T07:35:47.061357+0000","last_clean":"2023-07-21T07:35:47.061357+0000","last_became_active":"2023-07-21T07:35:31.582878+0000","last_became_peered":"2023-07-21T07:35:31.582878+0000","last_unstale":"2023-07-21T07:35:47.061357+0000","last_undegraded":"2023-07-21T07:35:47.061357+0000","last_fullsized":"2023-07-21T07:35:47.061357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:15:49.778614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974114+0000","last_change":"2023-07-21T07:35:45.907377+0000","last_active":"2023-07-21T07:35:46.974114+0000","last_peered":"2023-07-21T07:35:46.974114+0000","last_clean":"2023-07-21T07:35:46.974114+0000","last_became_active":"2023-07-21T07:35:45.907078+0000","last_became_peered":"2023-07-21T07:35:45.907078+0000","last_unstale":"2023-07-21T07:35:46.974114+0000","last_undegraded":"2023-07-21T07:35:46.974114+0000","last_fullsized":"2023-07-21T07:35:46.974114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:05:08.946687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063375+0000","last_change":"2023-07-21T07:35:31.565879+0000","last_active":"2023-07-21T07:35:47.063375+0000","last_peered":"2023-07-21T07:35:47.063375+0000","last_clean":"2023-07-21T07:35:47.063375+0000","last_became_active":"2023-07-21T07:35:31.565592+0000","last_became_peered":"2023-07-21T07:35:31.565592+0000","last_unstale":"2023-07-21T07:35:47.063375+0000","last_undegraded":"2023-07-21T07:35:47.063375+0000","last_fullsized":"2023-07-21T07:35:47.063375+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:59:31.677609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063634+0000","last_change":"2023-07-21T07:35:45.904078+0000","last_active":"2023-07-21T07:35:47.063634+0000","last_peered":"2023-07-21T07:35:47.063634+0000","last_clean":"2023-07-21T07:35:47.063634+0000","last_became_active":"2023-07-21T07:35:45.903818+0000","last_became_peered":"2023-07-21T07:35:45.903818+0000","last_unstale":"2023-07-21T07:35:47.063634+0000","last_undegraded":"2023-07-21T07:35:47.063634+0000","last_fullsized":"2023-07-21T07:35:47.063634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:16:00.601675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061888+0000","last_change":"2023-07-21T07:35:31.565812+0000","last_active":"2023-07-21T07:35:47.061888+0000","last_peered":"2023-07-21T07:35:47.061888+0000","last_clean":"2023-07-21T07:35:47.061888+0000","last_became_active":"2023-07-21T07:35:31.565496+0000","last_became_peered":"2023-07-21T07:35:31.565496+0000","last_unstale":"2023-07-21T07:35:47.061888+0000","last_undegraded":"2023-07-21T07:35:47.061888+0000","last_fullsized":"2023-07-21T07:35:47.061888+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:24:31.460797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888422+0000","last_change":"2023-07-21T07:35:45.893151+0000","last_active":"2023-07-21T07:35:46.888422+0000","last_peered":"2023-07-21T07:35:46.888422+0000","last_clean":"2023-07-21T07:35:46.888422+0000","last_became_active":"2023-07-21T07:35:45.892851+0000","last_became_peered":"2023-07-21T07:35:45.892851+0000","last_unstale":"2023-07-21T07:35:46.888422+0000","last_undegraded":"2023-07-21T07:35:46.888422+0000","last_fullsized":"2023-07-21T07:35:46.888422+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:37:02.528899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063367+0000","last_change":"2023-07-21T07:35:31.580543+0000","last_active":"2023-07-21T07:35:47.063367+0000","last_peered":"2023-07-21T07:35:47.063367+0000","last_clean":"2023-07-21T07:35:47.063367+0000","last_became_active":"2023-07-21T07:35:31.580216+0000","last_became_peered":"2023-07-21T07:35:31.580216+0000","last_unstale":"2023-07-21T07:35:47.063367+0000","last_undegraded":"2023-07-21T07:35:47.063367+0000","last_fullsized":"2023-07-21T07:35:47.063367+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:07:33.277440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062178+0000","last_change":"2023-07-21T07:35:45.904288+0000","last_active":"2023-07-21T07:35:47.062178+0000","last_peered":"2023-07-21T07:35:47.062178+0000","last_clean":"2023-07-21T07:35:47.062178+0000","last_became_active":"2023-07-21T07:35:45.903967+0000","last_became_peered":"2023-07-21T07:35:45.903967+0000","last_unstale":"2023-07-21T07:35:47.062178+0000","last_undegraded":"2023-07-21T07:35:47.062178+0000","last_fullsized":"2023-07-21T07:35:47.062178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:05:21.262500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887695+0000","last_change":"2023-07-21T07:35:31.579241+0000","last_active":"2023-07-21T07:35:46.887695+0000","last_peered":"2023-07-21T07:35:46.887695+0000","last_clean":"2023-07-21T07:35:46.887695+0000","last_became_active":"2023-07-21T07:35:31.578961+0000","last_became_peered":"2023-07-21T07:35:31.578961+0000","last_unstale":"2023-07-21T07:35:46.887695+0000","last_undegraded":"2023-07-21T07:35:46.887695+0000","last_fullsized":"2023-07-21T07:35:46.887695+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:35:10.701598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975183+0000","last_change":"2023-07-21T07:35:45.905372+0000","last_active":"2023-07-21T07:35:46.975183+0000","last_peered":"2023-07-21T07:35:46.975183+0000","last_clean":"2023-07-21T07:35:46.975183+0000","last_became_active":"2023-07-21T07:35:45.902950+0000","last_became_peered":"2023-07-21T07:35:45.902950+0000","last_unstale":"2023-07-21T07:35:46.975183+0000","last_undegraded":"2023-07-21T07:35:46.975183+0000","last_fullsized":"2023-07-21T07:35:46.975183+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:06:05.766251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061342+0000","last_change":"2023-07-21T07:35:31.574882+0000","last_active":"2023-07-21T07:35:47.061342+0000","last_peered":"2023-07-21T07:35:47.061342+0000","last_clean":"2023-07-21T07:35:47.061342+0000","last_became_active":"2023-07-21T07:35:31.574354+0000","last_became_peered":"2023-07-21T07:35:31.574354+0000","last_unstale":"2023-07-21T07:35:47.061342+0000","last_undegraded":"2023-07-21T07:35:47.061342+0000","last_fullsized":"2023-07-21T07:35:47.061342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:56:19.832167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886852+0000","last_change":"2023-07-21T07:35:45.902655+0000","last_active":"2023-07-21T07:35:46.886852+0000","last_peered":"2023-07-21T07:35:46.886852+0000","last_clean":"2023-07-21T07:35:46.886852+0000","last_became_active":"2023-07-21T07:35:45.902174+0000","last_became_peered":"2023-07-21T07:35:45.902174+0000","last_unstale":"2023-07-21T07:35:46.886852+0000","last_undegraded":"2023-07-21T07:35:46.886852+0000","last_fullsized":"2023-07-21T07:35:46.886852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:00:56.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974826+0000","last_change":"2023-07-21T07:35:31.574434+0000","last_active":"2023-07-21T07:35:46.974826+0000","last_peered":"2023-07-21T07:35:46.974826+0000","last_clean":"2023-07-21T07:35:46.974826+0000","last_became_active":"2023-07-21T07:35:31.574069+0000","last_became_peered":"2023-07-21T07:35:31.574069+0000","last_unstale":"2023-07-21T07:35:46.974826+0000","last_undegraded":"2023-07-21T07:35:46.974826+0000","last_fullsized":"2023-07-21T07:35:46.974826+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:22:25.684343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888025+0000","last_change":"2023-07-21T07:35:45.901451+0000","last_active":"2023-07-21T07:35:46.888025+0000","last_peered":"2023-07-21T07:35:46.888025+0000","last_clean":"2023-07-21T07:35:46.888025+0000","last_became_active":"2023-07-21T07:35:45.900777+0000","last_became_peered":"2023-07-21T07:35:45.900777+0000","last_unstale":"2023-07-21T07:35:46.888025+0000","last_undegraded":"2023-07-21T07:35:46.888025+0000","last_fullsized":"2023-07-21T07:35:46.888025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:00:56.377632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.062298+0000","last_change":"2023-07-21T07:35:31.569009+0000","last_active":"2023-07-21T07:35:47.062298+0000","last_peered":"2023-07-21T07:35:47.062298+0000","last_clean":"2023-07-21T07:35:47.062298+0000","last_became_active":"2023-07-21T07:35:31.568723+0000","last_became_peered":"2023-07-21T07:35:31.568723+0000","last_unstale":"2023-07-21T07:35:47.062298+0000","last_undegraded":"2023-07-21T07:35:47.062298+0000","last_fullsized":"2023-07-21T07:35:47.062298+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:26:25.366366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889768+0000","last_change":"2023-07-21T07:35:45.905694+0000","last_active":"2023-07-21T07:35:46.889768+0000","last_peered":"2023-07-21T07:35:46.889768+0000","last_clean":"2023-07-21T07:35:46.889768+0000","last_became_active":"2023-07-21T07:35:45.899336+0000","last_became_peered":"2023-07-21T07:35:45.899336+0000","last_unstale":"2023-07-21T07:35:46.889768+0000","last_undegraded":"2023-07-21T07:35:46.889768+0000","last_fullsized":"2023-07-21T07:35:46.889768+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:26:40.433463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061549+0000","last_change":"2023-07-21T07:35:31.574487+0000","last_active":"2023-07-21T07:35:47.061549+0000","last_peered":"2023-07-21T07:35:47.061549+0000","last_clean":"2023-07-21T07:35:47.061549+0000","last_became_active":"2023-07-21T07:35:31.574154+0000","last_became_peered":"2023-07-21T07:35:31.574154+0000","last_unstale":"2023-07-21T07:35:47.061549+0000","last_undegraded":"2023-07-21T07:35:47.061549+0000","last_fullsized":"2023-07-21T07:35:47.061549+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:59:31.677609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974295+0000","last_change":"2023-07-21T07:35:45.904015+0000","last_active":"2023-07-21T07:35:46.974295+0000","last_peered":"2023-07-21T07:35:46.974295+0000","last_clean":"2023-07-21T07:35:46.974295+0000","last_became_active":"2023-07-21T07:35:45.903746+0000","last_became_peered":"2023-07-21T07:35:45.903746+0000","last_unstale":"2023-07-21T07:35:46.974295+0000","last_undegraded":"2023-07-21T07:35:46.974295+0000","last_fullsized":"2023-07-21T07:35:46.974295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:07:42.293709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.975324+0000","last_change":"2023-07-21T07:35:31.568180+0000","last_active":"2023-07-21T07:35:46.975324+0000","last_peered":"2023-07-21T07:35:46.975324+0000","last_clean":"2023-07-21T07:35:46.975324+0000","last_became_active":"2023-07-21T07:35:31.567871+0000","last_became_peered":"2023-07-21T07:35:31.567871+0000","last_unstale":"2023-07-21T07:35:46.975324+0000","last_undegraded":"2023-07-21T07:35:46.975324+0000","last_fullsized":"2023-07-21T07:35:46.975324+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:17:03.048087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887104+0000","last_change":"2023-07-21T07:35:45.896103+0000","last_active":"2023-07-21T07:35:46.887104+0000","last_peered":"2023-07-21T07:35:46.887104+0000","last_clean":"2023-07-21T07:35:46.887104+0000","last_became_active":"2023-07-21T07:35:45.895674+0000","last_became_peered":"2023-07-21T07:35:45.895674+0000","last_unstale":"2023-07-21T07:35:46.887104+0000","last_undegraded":"2023-07-21T07:35:46.887104+0000","last_fullsized":"2023-07-21T07:35:46.887104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:32:53.808044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.887471+0000","last_change":"2023-07-21T07:35:31.566207+0000","last_active":"2023-07-21T07:35:46.887471+0000","last_peered":"2023-07-21T07:35:46.887471+0000","last_clean":"2023-07-21T07:35:46.887471+0000","last_became_active":"2023-07-21T07:35:31.565950+0000","last_became_peered":"2023-07-21T07:35:31.565950+0000","last_unstale":"2023-07-21T07:35:46.887471+0000","last_undegraded":"2023-07-21T07:35:46.887471+0000","last_fullsized":"2023-07-21T07:35:46.887471+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:42:14.784293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889101+0000","last_change":"2023-07-21T07:35:45.907598+0000","last_active":"2023-07-21T07:35:46.889101+0000","last_peered":"2023-07-21T07:35:46.889101+0000","last_clean":"2023-07-21T07:35:46.889101+0000","last_became_active":"2023-07-21T07:35:45.905863+0000","last_became_peered":"2023-07-21T07:35:45.905863+0000","last_unstale":"2023-07-21T07:35:46.889101+0000","last_undegraded":"2023-07-21T07:35:46.889101+0000","last_fullsized":"2023-07-21T07:35:46.889101+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:36:04.651542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.063236+0000","last_change":"2023-07-21T07:35:31.585808+0000","last_active":"2023-07-21T07:35:47.063236+0000","last_peered":"2023-07-21T07:35:47.063236+0000","last_clean":"2023-07-21T07:35:47.063236+0000","last_became_active":"2023-07-21T07:35:31.585492+0000","last_became_peered":"2023-07-21T07:35:31.585492+0000","last_unstale":"2023-07-21T07:35:47.063236+0000","last_undegraded":"2023-07-21T07:35:47.063236+0000","last_fullsized":"2023-07-21T07:35:47.063236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:35:44.955028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888951+0000","last_change":"2023-07-21T07:35:45.900650+0000","last_active":"2023-07-21T07:35:46.888951+0000","last_peered":"2023-07-21T07:35:46.888951+0000","last_clean":"2023-07-21T07:35:46.888951+0000","last_became_active":"2023-07-21T07:35:45.900372+0000","last_became_peered":"2023-07-21T07:35:45.900372+0000","last_unstale":"2023-07-21T07:35:46.888951+0000","last_undegraded":"2023-07-21T07:35:46.888951+0000","last_fullsized":"2023-07-21T07:35:46.888951+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:35:25.038001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886644+0000","last_change":"2023-07-21T07:35:31.564194+0000","last_active":"2023-07-21T07:35:46.886644+0000","last_peered":"2023-07-21T07:35:46.886644+0000","last_clean":"2023-07-21T07:35:46.886644+0000","last_became_active":"2023-07-21T07:35:31.563915+0000","last_became_peered":"2023-07-21T07:35:31.563915+0000","last_unstale":"2023-07-21T07:35:46.886644+0000","last_undegraded":"2023-07-21T07:35:46.886644+0000","last_fullsized":"2023-07-21T07:35:46.886644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:35:10.701598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060348+0000","last_change":"2023-07-21T07:35:45.900999+0000","last_active":"2023-07-21T07:35:47.060348+0000","last_peered":"2023-07-21T07:35:47.060348+0000","last_clean":"2023-07-21T07:35:47.060348+0000","last_became_active":"2023-07-21T07:35:45.900694+0000","last_became_peered":"2023-07-21T07:35:45.900694+0000","last_unstale":"2023-07-21T07:35:47.060348+0000","last_undegraded":"2023-07-21T07:35:47.060348+0000","last_fullsized":"2023-07-21T07:35:47.060348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:21:05.644293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060401+0000","last_change":"2023-07-21T07:35:31.570813+0000","last_active":"2023-07-21T07:35:47.060401+0000","last_peered":"2023-07-21T07:35:47.060401+0000","last_clean":"2023-07-21T07:35:47.060401+0000","last_became_active":"2023-07-21T07:35:31.570509+0000","last_became_peered":"2023-07-21T07:35:31.570509+0000","last_unstale":"2023-07-21T07:35:47.060401+0000","last_undegraded":"2023-07-21T07:35:47.060401+0000","last_fullsized":"2023-07-21T07:35:47.060401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:11:48.491690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974403+0000","last_change":"2023-07-21T07:35:45.908198+0000","last_active":"2023-07-21T07:35:46.974403+0000","last_peered":"2023-07-21T07:35:46.974403+0000","last_clean":"2023-07-21T07:35:46.974403+0000","last_became_active":"2023-07-21T07:35:45.907901+0000","last_became_peered":"2023-07-21T07:35:45.907901+0000","last_unstale":"2023-07-21T07:35:46.974403+0000","last_undegraded":"2023-07-21T07:35:46.974403+0000","last_fullsized":"2023-07-21T07:35:46.974403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:26:23.427825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.060555+0000","last_change":"2023-07-21T07:35:31.576630+0000","last_active":"2023-07-21T07:35:47.060555+0000","last_peered":"2023-07-21T07:35:47.060555+0000","last_clean":"2023-07-21T07:35:47.060555+0000","last_became_active":"2023-07-21T07:35:31.576116+0000","last_became_peered":"2023-07-21T07:35:31.576116+0000","last_unstale":"2023-07-21T07:35:47.060555+0000","last_undegraded":"2023-07-21T07:35:47.060555+0000","last_fullsized":"2023-07-21T07:35:47.060555+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:05:52.084304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886782+0000","last_change":"2023-07-21T07:35:45.890880+0000","last_active":"2023-07-21T07:35:46.886782+0000","last_peered":"2023-07-21T07:35:46.886782+0000","last_clean":"2023-07-21T07:35:46.886782+0000","last_became_active":"2023-07-21T07:35:45.890544+0000","last_became_peered":"2023-07-21T07:35:45.890544+0000","last_unstale":"2023-07-21T07:35:46.886782+0000","last_undegraded":"2023-07-21T07:35:46.886782+0000","last_fullsized":"2023-07-21T07:35:46.886782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:17:17.384490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.974978+0000","last_change":"2023-07-21T07:35:31.572534+0000","last_active":"2023-07-21T07:35:46.974978+0000","last_peered":"2023-07-21T07:35:46.974978+0000","last_clean":"2023-07-21T07:35:46.974978+0000","last_became_active":"2023-07-21T07:35:31.572252+0000","last_became_peered":"2023-07-21T07:35:31.572252+0000","last_unstale":"2023-07-21T07:35:46.974978+0000","last_undegraded":"2023-07-21T07:35:46.974978+0000","last_fullsized":"2023-07-21T07:35:46.974978+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:25:59.125576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.886194+0000","last_change":"2023-07-21T07:35:45.891383+0000","last_active":"2023-07-21T07:35:46.886194+0000","last_peered":"2023-07-21T07:35:46.886194+0000","last_clean":"2023-07-21T07:35:46.886194+0000","last_became_active":"2023-07-21T07:35:45.891075+0000","last_became_peered":"2023-07-21T07:35:45.891075+0000","last_unstale":"2023-07-21T07:35:46.886194+0000","last_undegraded":"2023-07-21T07:35:46.886194+0000","last_fullsized":"2023-07-21T07:35:46.886194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:29:27.656646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.888441+0000","last_change":"2023-07-21T07:35:31.567420+0000","last_active":"2023-07-21T07:35:46.888441+0000","last_peered":"2023-07-21T07:35:46.888441+0000","last_clean":"2023-07-21T07:35:46.888441+0000","last_became_active":"2023-07-21T07:35:31.567119+0000","last_became_peered":"2023-07-21T07:35:31.567119+0000","last_unstale":"2023-07-21T07:35:46.888441+0000","last_undegraded":"2023-07-21T07:35:46.888441+0000","last_fullsized":"2023-07-21T07:35:46.888441+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:55:23.313215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:47.061617+0000","last_change":"2023-07-21T07:35:45.898128+0000","last_active":"2023-07-21T07:35:47.061617+0000","last_peered":"2023-07-21T07:35:47.061617+0000","last_clean":"2023-07-21T07:35:47.061617+0000","last_became_active":"2023-07-21T07:35:45.897804+0000","last_became_peered":"2023-07-21T07:35:45.897804+0000","last_unstale":"2023-07-21T07:35:47.061617+0000","last_undegraded":"2023-07-21T07:35:47.061617+0000","last_fullsized":"2023-07-21T07:35:47.061617+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:44.863277+0000","last_clean_scrub_stamp":"2023-07-21T07:35:44.863277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:06:02.999336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-21T07:35:46.889181+0000","last_change":"2023-07-21T07:35:31.572060+0000","last_active":"2023-07-21T07:35:46.889181+0000","last_peered":"2023-07-21T07:35:46.889181+0000","last_clean":"2023-07-21T07:35:46.889181+0000","last_became_active":"2023-07-21T07:35:31.571747+0000","last_became_peered":"2023-07-21T07:35:31.571747+0000","last_unstale":"2023-07-21T07:35:46.889181+0000","last_undegraded":"2023-07-21T07:35:46.889181+0000","last_fullsized":"2023-07-21T07:35:46.889181+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:35:30.526874+0000","last_clean_scrub_stamp":"2023-07-21T07:35:30.526874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:46:09.627968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3869,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1077248,"data_stored":791619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.498}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.38900000000000001}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.40600000000000003}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.34699999999999998}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":191710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.4990000000000006,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.4039999999999999,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.505},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.625}]},{"osd":4,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40799999999999997}]},{"osd":5,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.437},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.48099999999999998}]},{"osd":7,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.51700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":198236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.245},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1052672,"data_stored":780934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.497}]},{"osd":2,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":199620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.313}]},{"osd":1,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.375}]},{"osd":3,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.505},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63100000000000001}]},{"osd":7,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.53600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":202677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.29999999999999999}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.373}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.752},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":199172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":10.18,"5min":10.18,"15min":10.18},"last":0.624},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":10.207000000000001,"5min":10.207000000000001,"15min":10.207000000000001},"last":0.53200000000000003}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.378},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.504}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":198098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.622},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.74199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:35:50.507 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T07:35:50.509 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-07-21T07:35:50.567 INFO:tasks.ceph.mds.b.smithi086.stderr:2023-07-21T07:35:50.515+0000 7f3415ad5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T07:35:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.612+0000 7f18e949c700 1 Processor -- start 2023-07-21T07:35:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.612+0000 7f18e949c700 1 -- start start 2023-07-21T07:35:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.612+0000 7f18e949c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18e40c1570 0x7f18e4158280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.612+0000 7f18e949c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e40c5a50 con 0x7f18e4151c20 2023-07-21T07:35:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.612+0000 7f18e949c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e4152000 con 0x7f18e4155000 2023-07-21T07:35:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.612+0000 7f18e949c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e40c8800 con 0x7f18e40c1570 2023-07-21T07:35:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.613+0000 7f18e37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18e40c1570 0x7f18e4158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.613+0000 7f18e37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18e40c1570 0x7f18e4158280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34742/0 (socket says 172.21.15.6:34742) 2023-07-21T07:35:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.613+0000 7f18e2ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f18e4151c20 0x7f18e40c0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42758/0 (socket says 172.21.15.6:42758) 2023-07-21T07:35:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.613+0000 7f18e37fe700 1 -- 172.21.15.6:0/1924720831 learned_addr learned my addr 172.21.15.6:0/1924720831 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:50.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.613+0000 7f18e37fe700 1 -- 172.21.15.6:0/1924720831 >> v1:172.21.15.86:6789/0 conn(0x7f18e4155000 legacy=0x7f18e4157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:50.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.613+0000 7f18e37fe700 1 -- 172.21.15.6:0/1924720831 >> v1:172.21.15.6:6789/0 conn(0x7f18e4151c20 legacy=0x7f18e40c0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.613+0000 7f18e37fe700 1 -- 172.21.15.6:0/1924720831 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e4155500 con 0x7f18e40c1570 2023-07-21T07:35:50.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.613+0000 7f18e37fe700 1 --2- 172.21.15.6:0/1924720831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e40c1570 0x7f18e4158280 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009e50 tx=0x7f18dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ca6edeab40d7b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:50.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.613+0000 7f18e1ffb700 1 -- 172.21.15.6:0/1924720831 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc00e070 con 0x7f18e40c1570 2023-07-21T07:35:50.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.613+0000 7f18e1ffb700 1 -- 172.21.15.6:0/1924720831 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc003a20 con 0x7f18e40c1570 2023-07-21T07:35:50.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.613+0000 7f18e1ffb700 1 -- 172.21.15.6:0/1924720831 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc003dd0 con 0x7f18e40c1570 2023-07-21T07:35:50.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.614+0000 7f18e949c700 1 -- 172.21.15.6:0/1924720831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e40c1570 msgr2=0x7f18e4158280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.614+0000 7f18e949c700 1 --2- 172.21.15.6:0/1924720831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e40c1570 0x7f18e4158280 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009e50 tx=0x7f18dc00b330 comp rx=0 tx=0).stop 2023-07-21T07:35:50.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.614+0000 7f18e949c700 1 -- 172.21.15.6:0/1924720831 shutdown_connections 2023-07-21T07:35:50.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.614+0000 7f18e949c700 1 --2- 172.21.15.6:0/1924720831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e40c1570 0x7f18e4158280 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.614+0000 7f18e949c700 1 -- 172.21.15.6:0/1924720831 >> 172.21.15.6:0/1924720831 conn(0x7f18e40c7b50 msgr2=0x7f18e40c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:50.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.614+0000 7f18e949c700 1 -- 172.21.15.6:0/1924720831 shutdown_connections 2023-07-21T07:35:50.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.614+0000 7f18e949c700 1 -- 172.21.15.6:0/1924720831 wait complete. 2023-07-21T07:35:50.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.615+0000 7f18e949c700 1 Processor -- start 2023-07-21T07:35:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.615+0000 7f18e949c700 1 -- start start 2023-07-21T07:35:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e949c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18e40c1570 0x7f18e4153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e949c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e4151c20 0x7f18e4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e949c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4155000 0x7f18e414fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e949c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4158b00 con 0x7f18e4155000 2023-07-21T07:35:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e949c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e41ecfc0 con 0x7f18e40c1570 2023-07-21T07:35:50.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e949c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e41edd40 con 0x7f18e4151c20 2023-07-21T07:35:50.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4155000 0x7f18e414fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:50.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4155000 0x7f18e414fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34748/0 (socket says 172.21.15.6:34748) 2023-07-21T07:35:50.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e37fe700 1 -- 172.21.15.6:0/2286581732 learned_addr learned my addr 172.21.15.6:0/2286581732 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:50.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e2ffd700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18e40c1570 0x7f18e4153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:50.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e27fc700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e4151c20 0x7f18e4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:50.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e37fe700 1 -- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e4151c20 msgr2=0x7f18e4158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e37fe700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e4151c20 0x7f18e4158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e37fe700 1 -- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18e40c1570 msgr2=0x7f18e4153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e37fe700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18e40c1570 0x7f18e4153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e37fe700 1 -- 172.21.15.6:0/2286581732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc009b30 con 0x7f18e4155000 2023-07-21T07:35:50.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e2ffd700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18e40c1570 0x7f18e4153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:50.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e27fc700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e4151c20 0x7f18e4158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:50.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18e37fe700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4155000 0x7f18e414fee0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f18e40685a0 tx=0x7f18dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:50.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.616+0000 7f18cb7fe700 1 -- 172.21.15.6:0/2286581732 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc004440 con 0x7f18e4155000 2023-07-21T07:35:50.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.617+0000 7f18cb7fe700 1 -- 172.21.15.6:0/2286581732 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc0045a0 con 0x7f18e4155000 2023-07-21T07:35:50.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.617+0000 7f18e949c700 1 -- 172.21.15.6:0/2286581732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e41ed260 con 0x7f18e4155000 2023-07-21T07:35:50.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.617+0000 7f18cb7fe700 1 -- 172.21.15.6:0/2286581732 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc004950 con 0x7f18e4155000 2023-07-21T07:35:50.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.617+0000 7f18e949c700 1 -- 172.21.15.6:0/2286581732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e41ed820 con 0x7f18e4155000 2023-07-21T07:35:50.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.618+0000 7f18e949c700 1 -- 172.21.15.6:0/2286581732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e4074500 con 0x7f18e4155000 2023-07-21T07:35:50.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.618+0000 7f18cb7fe700 1 -- 172.21.15.6:0/2286581732 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f18dc012430 con 0x7f18e4155000 2023-07-21T07:35:50.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.618+0000 7f18cb7fe700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f18d006ace0 0x7f18d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:50.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.618+0000 7f18cb7fe700 1 -- 172.21.15.6:0/2286581732 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f18dc08ad90 con 0x7f18e4155000 2023-07-21T07:35:50.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.619+0000 7f18e2ffd700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f18d006ace0 0x7f18d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:50.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.619+0000 7f18e2ffd700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f18d006ace0 0x7f18d006d1a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f18d4000f60 tx=0x7f18d4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:50.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.623+0000 7f18cb7fe700 1 -- 172.21.15.6:0/2286581732 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f18dc055af0 con 0x7f18e4155000 2023-07-21T07:35:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.903+0000 7f18e949c700 1 -- 172.21.15.6:0/2286581732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f18e40c4cc0 con 0x7f18e4155000 2023-07-21T07:35:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.906+0000 7f18cb7fe700 1 -- 172.21.15.6:0/2286581732 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v10) v1 ==== 185+0+142 (secure 0 0 0) 0x7f18dc059110 con 0x7f18e4155000 2023-07-21T07:35:50.958 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2023-07-21T07:35:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDVNLpkvOxjOhAA2c1WuwU8rO+o7NzkpQOe0w== 2023-07-21T07:35:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T07:35:50.958 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T07:35:50.959 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-07-21T07:35:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.908+0000 7f18e949c700 1 -- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f18d006ace0 msgr2=0x7f18d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.908+0000 7f18e949c700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f18d006ace0 0x7f18d006d1a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f18d4000f60 tx=0x7f18d4009040 comp rx=0 tx=0).stop 2023-07-21T07:35:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.908+0000 7f18e949c700 1 -- 172.21.15.6:0/2286581732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4155000 msgr2=0x7f18e414fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.908+0000 7f18e949c700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4155000 0x7f18e414fee0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f18e40685a0 tx=0x7f18dc004ad0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.908+0000 7f18e949c700 1 -- 172.21.15.6:0/2286581732 shutdown_connections 2023-07-21T07:35:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.908+0000 7f18e949c700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f18d006ace0 0x7f18d006d1a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.908+0000 7f18e949c700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4155000 0x7f18e414fee0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.908+0000 7f18e949c700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18e40c1570 0x7f18e4153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.908+0000 7f18e949c700 1 --2- 172.21.15.6:0/2286581732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e4151c20 0x7f18e4158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:50.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.908+0000 7f18e949c700 1 -- 172.21.15.6:0/2286581732 >> 172.21.15.6:0/2286581732 conn(0x7f18e40c7b50 msgr2=0x7f18e406fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:50.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.908+0000 7f18e949c700 1 -- 172.21.15.6:0/2286581732 shutdown_connections 2023-07-21T07:35:50.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:50.908+0000 7f18e949c700 1 -- 172.21.15.6:0/2286581732 wait complete. 2023-07-21T07:35:50.962 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.1 2023-07-21T07:35:50.972 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:35:50.973 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:50.993 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:35:50.993 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:51.052 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.125+0000 7fb064107700 1 Processor -- start 2023-07-21T07:35:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.125+0000 7fb064107700 1 -- start start 2023-07-21T07:35:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.126+0000 7fb064107700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb05c06a300 0x7fb05c0c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.126+0000 7fb064107700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb05c0c2bf0 0x7fb05c1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.126+0000 7fb064107700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05c0c3120 con 0x7fb05c151be0 2023-07-21T07:35:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.126+0000 7fb064107700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05c0c1e60 con 0x7fb05c06a300 2023-07-21T07:35:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.126+0000 7fb064107700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05c154860 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.126+0000 7fb061ea3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb05c06a300 0x7fb05c0c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.126+0000 7fb061ea3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb05c06a300 0x7fb05c0c26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34752/0 (socket says 172.21.15.6:34752) 2023-07-21T07:35:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.126+0000 7fb061ea3700 1 -- 172.21.15.6:0/611562862 learned_addr learned my addr 172.21.15.6:0/611562862 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.126+0000 7fb0616a2700 1 --2- 172.21.15.6:0/611562862 >> v2:172.21.15.86:3300/0 conn(0x7fb05c0c2bf0 0x7fb05c1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.126+0000 7fb061ea3700 1 -- 172.21.15.6:0/611562862 >> v2:172.21.15.86:3300/0 conn(0x7fb05c0c2bf0 msgr2=0x7fb05c1516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.126+0000 7fb061ea3700 1 --2- 172.21.15.6:0/611562862 >> v2:172.21.15.86:3300/0 conn(0x7fb05c0c2bf0 0x7fb05c1516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.126+0000 7fb061ea3700 1 -- 172.21.15.6:0/611562862 >> v1:172.21.15.86:6789/0 conn(0x7fb05c151be0 legacy=0x7fb05c157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.126+0000 7fb061ea3700 1 -- 172.21.15.6:0/611562862 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c154b40 con 0x7fb05c06a300 2023-07-21T07:35:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.127+0000 7fb061ea3700 1 --2- 172.21.15.6:0/611562862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05c06a300 0x7fb05c0c26b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0bd970 tx=0x7fb050009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68912d99844e6e60 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.127+0000 7fb060ea1700 1 -- 172.21.15.6:0/611562862 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000b870 con 0x7fb05c06a300 2023-07-21T07:35:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.127+0000 7fb060ea1700 1 -- 172.21.15.6:0/611562862 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05000b9d0 con 0x7fb05c06a300 2023-07-21T07:35:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.127+0000 7fb060ea1700 1 -- 172.21.15.6:0/611562862 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000bd60 con 0x7fb05c06a300 2023-07-21T07:35:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.127+0000 7fb064107700 1 -- 172.21.15.6:0/611562862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05c06a300 msgr2=0x7fb05c0c26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.127+0000 7fb064107700 1 --2- 172.21.15.6:0/611562862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05c06a300 0x7fb05c0c26b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0bd970 tx=0x7fb050009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.127+0000 7fb064107700 1 -- 172.21.15.6:0/611562862 shutdown_connections 2023-07-21T07:35:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.127+0000 7fb064107700 1 --2- 172.21.15.6:0/611562862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05c06a300 0x7fb05c0c26b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.127+0000 7fb064107700 1 --2- 172.21.15.6:0/611562862 >> v2:172.21.15.86:3300/0 conn(0x7fb05c0c2bf0 0x7fb05c1516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.127+0000 7fb064107700 1 -- 172.21.15.6:0/611562862 >> 172.21.15.6:0/611562862 conn(0x7fb05c0a8c90 msgr2=0x7fb05c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.127+0000 7fb064107700 1 -- 172.21.15.6:0/611562862 shutdown_connections 2023-07-21T07:35:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.128+0000 7fb064107700 1 -- 172.21.15.6:0/611562862 wait complete. 2023-07-21T07:35:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.129+0000 7fb064107700 1 Processor -- start 2023-07-21T07:35:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.129+0000 7fb064107700 1 -- start start 2023-07-21T07:35:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.129+0000 7fb064107700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb05c06a300 0x7fb05c0c0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.129+0000 7fb064107700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05c0c2bf0 0x7fb05c14bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.129+0000 7fb064107700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05c151be0 0x7fb05c14c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.129+0000 7fb064107700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c072510 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.129+0000 7fb064107700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c14f9b0 con 0x7fb05c06a300 2023-07-21T07:35:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.129+0000 7fb064107700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c14f6d0 con 0x7fb05c151be0 2023-07-21T07:35:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.129+0000 7fb0616a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05c0c2bf0 0x7fb05c14bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.129+0000 7fb0616a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05c0c2bf0 0x7fb05c14bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34760/0 (socket says 172.21.15.6:34760) 2023-07-21T07:35:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.129+0000 7fb0616a2700 1 -- 172.21.15.6:0/3352560106 learned_addr learned my addr 172.21.15.6:0/3352560106 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.130+0000 7fb061ea3700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb05c06a300 0x7fb05c0c0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.130+0000 7fb0626a4700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05c151be0 0x7fb05c14c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.130+0000 7fb0616a2700 1 -- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05c151be0 msgr2=0x7fb05c14c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.130+0000 7fb0616a2700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05c151be0 0x7fb05c14c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.130+0000 7fb0616a2700 1 -- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb05c06a300 msgr2=0x7fb05c0c0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.130+0000 7fb0616a2700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb05c06a300 0x7fb05c0c0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.130+0000 7fb0616a2700 1 -- 172.21.15.6:0/3352560106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050009550 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.130+0000 7fb0616a2700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05c0c2bf0 0x7fb05c14bb60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb05800e810 tx=0x7fb05800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.130+0000 7fb04e7fc700 1 -- 172.21.15.6:0/3352560106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058013610 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.130+0000 7fb04e7fc700 1 -- 172.21.15.6:0/3352560106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058013770 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.130+0000 7fb04e7fc700 1 -- 172.21.15.6:0/3352560106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058013b00 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.130+0000 7fb064107700 1 -- 172.21.15.6:0/3352560106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05c0b9090 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.130+0000 7fb064107700 1 -- 172.21.15.6:0/3352560106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05c0c0590 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.131+0000 7fb064107700 1 -- 172.21.15.6:0/3352560106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05c072000 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.132+0000 7fb04e7fc700 1 -- 172.21.15.6:0/3352560106 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb058013c60 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.132+0000 7fb04e7fc700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb04006ace0 0x7fb04006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.132+0000 7fb04e7fc700 1 -- 172.21.15.6:0/3352560106 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fb058089430 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.132+0000 7fb061ea3700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb04006ace0 0x7fb04006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.133+0000 7fb061ea3700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb04006ace0 0x7fb04006d1a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb050014040 tx=0x7fb050008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:51.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.136+0000 7fb04e7fc700 1 -- 172.21.15.6:0/3352560106 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb05c072000 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.336+0000 7fb064107700 1 -- 172.21.15.6:0/3352560106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb05c14b880 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.337+0000 7fb04e7fc700 1 -- 172.21.15.6:0/3352560106 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+21959 (secure 0 0 0) 0x7fb05c14b880 con 0x7fb05c0c2bf0 2023-07-21T07:35:51.389 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:51.390 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:46.879421+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:35:29.385402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T07:35:29.920618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:35:43.052752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:35:44.270260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:51.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.339+0000 7fb064107700 1 -- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb04006ace0 msgr2=0x7fb04006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.339+0000 7fb064107700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb04006ace0 0x7fb04006d1a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb050014040 tx=0x7fb050008030 comp rx=0 tx=0).stop 2023-07-21T07:35:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.339+0000 7fb064107700 1 -- 172.21.15.6:0/3352560106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05c0c2bf0 msgr2=0x7fb05c14bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.339+0000 7fb064107700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05c0c2bf0 0x7fb05c14bb60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb05800e810 tx=0x7fb05800ebd0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.339+0000 7fb064107700 1 -- 172.21.15.6:0/3352560106 shutdown_connections 2023-07-21T07:35:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.339+0000 7fb064107700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb04006ace0 0x7fb04006d1a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.339+0000 7fb064107700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05c151be0 0x7fb05c14c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.339+0000 7fb064107700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb05c06a300 0x7fb05c0c0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.339+0000 7fb064107700 1 --2- 172.21.15.6:0/3352560106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05c0c2bf0 0x7fb05c14bb60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.339+0000 7fb064107700 1 -- 172.21.15.6:0/3352560106 >> 172.21.15.6:0/3352560106 conn(0x7fb05c0a8c90 msgr2=0x7fb05c0c34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.340+0000 7fb064107700 1 -- 172.21.15.6:0/3352560106 shutdown_connections 2023-07-21T07:35:51.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.340+0000 7fb064107700 1 -- 172.21.15.6:0/3352560106 wait complete. 2023-07-21T07:35:51.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:35:29.385402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:35:29.920618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-21T07:35:43.052752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-21T07:35:44.270260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:35:51.405 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:35:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.480+0000 7f0fd0472700 1 Processor -- start 2023-07-21T07:35:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.480+0000 7f0fd0472700 1 -- start start 2023-07-21T07:35:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.481+0000 7f0fd0472700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0fc80c7bd0 0x7f0fc806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.481+0000 7f0fd0472700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc8154dc0 con 0x7f0fc8151d80 2023-07-21T07:35:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.481+0000 7f0fd0472700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc806ad50 con 0x7f0fc80bd360 2023-07-21T07:35:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.481+0000 7f0fd0472700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc81552f0 con 0x7f0fc80c7bd0 2023-07-21T07:35:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.481+0000 7f0fcda0d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0fc80c7bd0 0x7f0fc806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.481+0000 7f0fce20e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0fc8151d80 0x7f0fc80c4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42786/0 (socket says 172.21.15.6:42786) 2023-07-21T07:35:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.481+0000 7f0fcda0d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0fc80c7bd0 0x7f0fc806b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34768/0 (socket says 172.21.15.6:34768) 2023-07-21T07:35:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.481+0000 7f0fce20e700 1 -- 172.21.15.6:0/4147201422 learned_addr learned my addr 172.21.15.6:0/4147201422 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.482+0000 7f0fcda0d700 1 -- 172.21.15.6:0/4147201422 >> v1:172.21.15.86:6789/0 conn(0x7f0fc80bd360 legacy=0x7f0fc806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.482+0000 7f0fcda0d700 1 -- 172.21.15.6:0/4147201422 >> v1:172.21.15.6:6789/0 conn(0x7f0fc8151d80 legacy=0x7f0fc80c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.482+0000 7f0fcda0d700 1 -- 172.21.15.6:0/4147201422 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc8155010 con 0x7f0fc80c7bd0 2023-07-21T07:35:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.482+0000 7f0fcd20c700 1 -- 172.21.15.6:0/4147201422 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752667148 0 0) 0x7f0fc8154dc0 con 0x7f0fc8151d80 2023-07-21T07:35:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.482+0000 7f0fcda0d700 1 --2- 172.21.15.6:0/4147201422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fc80c7bd0 0x7f0fc806b1e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009840 tx=0x7f0fc4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c905e0c71dbc2d36 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:51.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.482+0000 7f0fcd20c700 1 -- 172.21.15.6:0/4147201422 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4004230 con 0x7f0fc80c7bd0 2023-07-21T07:35:51.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.482+0000 7f0fcd20c700 1 -- 172.21.15.6:0/4147201422 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc4004390 con 0x7f0fc80c7bd0 2023-07-21T07:35:51.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.482+0000 7f0fcd20c700 1 -- 172.21.15.6:0/4147201422 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40036a0 con 0x7f0fc80c7bd0 2023-07-21T07:35:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.483+0000 7f0fd0472700 1 -- 172.21.15.6:0/4147201422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fc80c7bd0 msgr2=0x7f0fc806b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.483+0000 7f0fd0472700 1 --2- 172.21.15.6:0/4147201422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fc80c7bd0 0x7f0fc806b1e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009840 tx=0x7f0fc4009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.483+0000 7f0fd0472700 1 -- 172.21.15.6:0/4147201422 shutdown_connections 2023-07-21T07:35:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.483+0000 7f0fd0472700 1 --2- 172.21.15.6:0/4147201422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fc80c7bd0 0x7f0fc806b1e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.483+0000 7f0fd0472700 1 -- 172.21.15.6:0/4147201422 >> 172.21.15.6:0/4147201422 conn(0x7f0fc80c9cd0 msgr2=0x7f0fc80ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.483+0000 7f0fd0472700 1 -- 172.21.15.6:0/4147201422 shutdown_connections 2023-07-21T07:35:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.483+0000 7f0fd0472700 1 -- 172.21.15.6:0/4147201422 wait complete. 2023-07-21T07:35:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.484+0000 7f0fd0472700 1 Processor -- start 2023-07-21T07:35:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.484+0000 7f0fd0472700 1 -- start start 2023-07-21T07:35:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.485+0000 7f0fd0472700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fc80bd360 0x7f0fc80c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.485+0000 7f0fd0472700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fc80c7bd0 0x7f0fc80c3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.485+0000 7f0fd0472700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fc8151d80 0x7f0fc8155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.485+0000 7f0fd0472700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81e9c40 con 0x7f0fc80bd360 2023-07-21T07:35:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.485+0000 7f0fd0472700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc81ea1c0 con 0x7f0fc8151d80 2023-07-21T07:35:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.485+0000 7f0fd0472700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80c3960 con 0x7f0fc80c7bd0 2023-07-21T07:35:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.485+0000 7f0fce20e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fc80bd360 0x7f0fc80c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.485+0000 7f0fce20e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fc80bd360 0x7f0fc80c1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34772/0 (socket says 172.21.15.6:34772) 2023-07-21T07:35:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.485+0000 7f0fce20e700 1 -- 172.21.15.6:0/1311567266 learned_addr learned my addr 172.21.15.6:0/1311567266 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.486+0000 7f0fcda0d700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fc80c7bd0 0x7f0fc80c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.486+0000 7f0fcea0f700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fc8151d80 0x7f0fc8155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.486+0000 7f0fce20e700 1 -- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fc80c7bd0 msgr2=0x7f0fc80c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.486+0000 7f0fce20e700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fc80c7bd0 0x7f0fc80c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.486+0000 7f0fce20e700 1 -- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fc8151d80 msgr2=0x7f0fc8155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.486+0000 7f0fce20e700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fc8151d80 0x7f0fc8155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.486+0000 7f0fce20e700 1 -- 172.21.15.6:0/1311567266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40094a0 con 0x7f0fc80bd360 2023-07-21T07:35:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.486+0000 7f0fce20e700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fc80bd360 0x7f0fc80c1ae0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00c750 tx=0x7f0fbc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.486+0000 7f0fbaffd700 1 -- 172.21.15.6:0/1311567266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc004c80 con 0x7f0fc80bd360 2023-07-21T07:35:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.486+0000 7f0fbaffd700 1 -- 172.21.15.6:0/1311567266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc004e00 con 0x7f0fc80bd360 2023-07-21T07:35:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.486+0000 7f0fd0472700 1 -- 172.21.15.6:0/1311567266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc80ae090 con 0x7f0fc80bd360 2023-07-21T07:35:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.486+0000 7f0fbaffd700 1 -- 172.21.15.6:0/1311567266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc007310 con 0x7f0fc80bd360 2023-07-21T07:35:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.486+0000 7f0fd0472700 1 -- 172.21.15.6:0/1311567266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc80c3e90 con 0x7f0fc80bd360 2023-07-21T07:35:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.487+0000 7f0fd0472700 1 -- 172.21.15.6:0/1311567266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc8074500 con 0x7f0fc80bd360 2023-07-21T07:35:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.487+0000 7f0fbaffd700 1 -- 172.21.15.6:0/1311567266 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0fbc007470 con 0x7f0fc80bd360 2023-07-21T07:35:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.488+0000 7f0fbaffd700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0fac06ace0 0x7f0fac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.488+0000 7f0fbaffd700 1 -- 172.21.15.6:0/1311567266 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f0fbc0895b0 con 0x7f0fc80bd360 2023-07-21T07:35:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.488+0000 7f0fcda0d700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0fac06ace0 0x7f0fac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.488+0000 7f0fcda0d700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0fac06ace0 0x7f0fac06d1a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4000c00 tx=0x7f0fc401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:51.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.492+0000 7f0fbaffd700 1 -- 172.21.15.6:0/1311567266 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0fbc054300 con 0x7f0fc80bd360 2023-07-21T07:35:51.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.691+0000 7f0fd0472700 1 -- 172.21.15.6:0/1311567266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0fc806cc60 con 0x7f0fc80bd360 2023-07-21T07:35:51.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.691+0000 7f0fbaffd700 1 -- 172.21.15.6:0/1311567266 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0fbc057920 con 0x7f0fc80bd360 2023-07-21T07:35:51.743 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:35:51.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.693+0000 7f0fd0472700 1 -- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0fac06ace0 msgr2=0x7f0fac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.693+0000 7f0fd0472700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0fac06ace0 0x7f0fac06d1a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4000c00 tx=0x7f0fc401c040 comp rx=0 tx=0).stop 2023-07-21T07:35:51.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.693+0000 7f0fd0472700 1 -- 172.21.15.6:0/1311567266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fc80bd360 msgr2=0x7f0fc80c1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.693+0000 7f0fd0472700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fc80bd360 0x7f0fc80c1ae0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00c750 tx=0x7f0fbc00cb10 comp rx=0 tx=0).stop 2023-07-21T07:35:51.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.693+0000 7f0fd0472700 1 -- 172.21.15.6:0/1311567266 shutdown_connections 2023-07-21T07:35:51.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.693+0000 7f0fd0472700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f0fac06ace0 0x7f0fac06d1a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.693+0000 7f0fd0472700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fc8151d80 0x7f0fc8155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.693+0000 7f0fd0472700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fc80bd360 0x7f0fc80c1ae0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.693+0000 7f0fd0472700 1 --2- 172.21.15.6:0/1311567266 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fc80c7bd0 0x7f0fc80c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.693+0000 7f0fd0472700 1 -- 172.21.15.6:0/1311567266 >> 172.21.15.6:0/1311567266 conn(0x7f0fc80c9cd0 msgr2=0x7f0fc80c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.693+0000 7f0fd0472700 1 -- 172.21.15.6:0/1311567266 shutdown_connections 2023-07-21T07:35:51.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.693+0000 7f0fd0472700 1 -- 172.21.15.6:0/1311567266 wait complete. 2023-07-21T07:35:51.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:35:51.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.833+0000 7f71952fb700 1 Processor -- start 2023-07-21T07:35:51.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.833+0000 7f71952fb700 1 -- start start 2023-07-21T07:35:51.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.834+0000 7f71952fb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7190151d80 0x7f71900c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.834+0000 7f71952fb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f71900bd360 0x7f719006b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.834+0000 7f71952fb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7190154dc0 con 0x7f71900c7bd0 2023-07-21T07:35:51.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.834+0000 7f71952fb700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719006ad50 con 0x7f71900bd360 2023-07-21T07:35:51.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.834+0000 7f71952fb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71901552f0 con 0x7f7190151d80 2023-07-21T07:35:51.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.834+0000 7f718e7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f71900c7bd0 0x7f719006b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42800/0 (socket says 172.21.15.6:42800) 2023-07-21T07:35:51.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.834+0000 7f718e7fc700 1 -- 172.21.15.6:0/229272368 learned_addr learned my addr 172.21.15.6:0/229272368 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:51.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.834+0000 7f718effd700 1 --2- 172.21.15.6:0/229272368 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7190151d80 0x7f71900c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.834+0000 7f718f7fe700 1 --2- 172.21.15.6:0/229272368 >> v2:172.21.15.86:3300/0 conn(0x7f71900bd360 0x7f719006b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.834+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406509773 0 0) 0x7f7190154dc0 con 0x7f71900c7bd0 2023-07-21T07:35:51.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.834+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71780035b0 con 0x7f71900c7bd0 2023-07-21T07:35:51.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1268153791 0 0) 0x7f71780035b0 con 0x7f71900c7bd0 2023-07-21T07:35:51.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7190151d80 msgr2=0x7f71900c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 --2- 172.21.15.6:0/229272368 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7190151d80 0x7f71900c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 >> v2:172.21.15.86:3300/0 conn(0x7f71900bd360 msgr2=0x7f719006b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 --2- 172.21.15.6:0/229272368 >> v2:172.21.15.86:3300/0 conn(0x7f71900bd360 0x7f719006b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7190155010 con 0x7f71900c7bd0 2023-07-21T07:35:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f7180001670 con 0x7f71900c7bd0 2023-07-21T07:35:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 >> v1:172.21.15.6:6789/0 conn(0x7f71900c7bd0 legacy=0x7f719006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 --2- 172.21.15.6:0/229272368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7178003a00 0x7f7178003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 --2- 172.21.15.6:0/229272368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7178004850 0x7f7178004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 --2- 172.21.15.6:0/229272368 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7190151d80 0x7f7178005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719006ad50 con 0x7f7178004850 2023-07-21T07:35:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71901552f0 con 0x7f7178003a00 2023-07-21T07:35:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717800ba90 con 0x7f7190151d80 2023-07-21T07:35:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718f7fe700 1 --2- 172.21.15.6:0/229272368 >> v2:172.21.15.86:3300/0 conn(0x7f71900bd360 0x7f719006b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718e7fc700 1 --2- 172.21.15.6:0/229272368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7178004850 0x7f7178004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718effd700 1 --2- 172.21.15.6:0/229272368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7178003a00 0x7f7178003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718f7fe700 1 --2- 172.21.15.6:0/229272368 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7190151d80 0x7f7178005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718e7fc700 1 -- 172.21.15.6:0/229272368 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7190151d80 msgr2=0x7f7178005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718e7fc700 1 --2- 172.21.15.6:0/229272368 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7190151d80 0x7f7178005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718e7fc700 1 -- 172.21.15.6:0/229272368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7178003a00 msgr2=0x7f7178003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718e7fc700 1 --2- 172.21.15.6:0/229272368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7178003a00 0x7f7178003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718e7fc700 1 -- 172.21.15.6:0/229272368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71780035b0 con 0x7f7178004850 2023-07-21T07:35:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718f7fe700 1 --2- 172.21.15.6:0/229272368 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7190151d80 0x7f7178005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718e7fc700 1 --2- 172.21.15.6:0/229272368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7178004850 0x7f7178004cd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f718000c2f0 tx=0x7f7178005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc958fe94be388c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.835+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718000ce30 con 0x7f7178004850 2023-07-21T07:35:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.836+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7180005960 con 0x7f7178004850 2023-07-21T07:35:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.836+0000 7f718dffb700 1 -- 172.21.15.6:0/229272368 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180005d10 con 0x7f7178004850 2023-07-21T07:35:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.836+0000 7f71952fb700 1 -- 172.21.15.6:0/229272368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7178004850 msgr2=0x7f7178004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.836+0000 7f71952fb700 1 --2- 172.21.15.6:0/229272368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7178004850 0x7f7178004cd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f718000c2f0 tx=0x7f7178005880 comp rx=0 tx=0).stop 2023-07-21T07:35:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.836+0000 7f718f7fe700 1 -- 172.21.15.6:0/229272368 reap_dead start 2023-07-21T07:35:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.836+0000 7f71952fb700 1 -- 172.21.15.6:0/229272368 shutdown_connections 2023-07-21T07:35:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.836+0000 7f71952fb700 1 -- 172.21.15.6:0/229272368 >> 172.21.15.6:0/229272368 conn(0x7f71900c9cd0 msgr2=0x7f71900ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.836+0000 7f71952fb700 1 -- 172.21.15.6:0/229272368 shutdown_connections 2023-07-21T07:35:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.836+0000 7f71952fb700 1 -- 172.21.15.6:0/229272368 wait complete. 2023-07-21T07:35:51.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.837+0000 7f71952fb700 1 Processor -- start 2023-07-21T07:35:51.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.837+0000 7f71952fb700 1 -- start start 2023-07-21T07:35:51.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.838+0000 7f71952fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7178004850 0x7f71901ed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.838+0000 7f71952fb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71900c0110 0x7f71900c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.838+0000 7f71952fb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f719014e150 0x7f719014e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.838+0000 7f71952fb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7190157cc0 con 0x7f7178004850 2023-07-21T07:35:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.838+0000 7f71952fb700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71900bea60 con 0x7f71900c0110 2023-07-21T07:35:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.838+0000 7f71952fb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71901edb10 con 0x7f719014e150 2023-07-21T07:35:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.838+0000 7f718effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7178004850 0x7f71901ed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.838+0000 7f718effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7178004850 0x7f71901ed5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34792/0 (socket says 172.21.15.6:34792) 2023-07-21T07:35:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.838+0000 7f718effd700 1 -- 172.21.15.6:0/1964053587 learned_addr learned my addr 172.21.15.6:0/1964053587 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.838+0000 7f718f7fe700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f719014e150 0x7f719014e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.838+0000 7f718e7fc700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71900c0110 0x7f71900c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.839+0000 7f718effd700 1 -- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f719014e150 msgr2=0x7f719014e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.839+0000 7f718effd700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f719014e150 0x7f719014e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.839+0000 7f718effd700 1 -- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71900c0110 msgr2=0x7f71900c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.839+0000 7f718effd700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71900c0110 0x7f71900c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.839+0000 7f718effd700 1 -- 172.21.15.6:0/1964053587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71900bf620 con 0x7f7178004850 2023-07-21T07:35:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.839+0000 7f718e7fc700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71900c0110 0x7f71900c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:51.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.839+0000 7f718effd700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7178004850 0x7f71901ed5d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f71840119d0 tx=0x7f7184011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:51.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.839+0000 7f71777fe700 1 -- 172.21.15.6:0/1964053587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718400f8e0 con 0x7f7178004850 2023-07-21T07:35:51.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.839+0000 7f71777fe700 1 -- 172.21.15.6:0/1964053587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718400fa40 con 0x7f7178004850 2023-07-21T07:35:51.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.839+0000 7f71952fb700 1 -- 172.21.15.6:0/1964053587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71900bf900 con 0x7f7178004850 2023-07-21T07:35:51.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.839+0000 7f71777fe700 1 -- 172.21.15.6:0/1964053587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718400fdd0 con 0x7f7178004850 2023-07-21T07:35:51.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.839+0000 7f71952fb700 1 -- 172.21.15.6:0/1964053587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71900c4d00 con 0x7f7178004850 2023-07-21T07:35:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.840+0000 7f71952fb700 1 -- 172.21.15.6:0/1964053587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7190074500 con 0x7f7178004850 2023-07-21T07:35:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.840+0000 7f71777fe700 1 -- 172.21.15.6:0/1964053587 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7184014440 con 0x7f7178004850 2023-07-21T07:35:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.841+0000 7f71777fe700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f717c06ace0 0x7f717c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.841+0000 7f71777fe700 1 -- 172.21.15.6:0/1964053587 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f7184089ee0 con 0x7f7178004850 2023-07-21T07:35:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.841+0000 7f718e7fc700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f717c06ace0 0x7f717c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.842+0000 7f718e7fc700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f717c06ace0 0x7f717c06d1a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7180015040 tx=0x7f718000a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:51.845+0000 7f71777fe700 1 -- 172.21.15.6:0/1964053587 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7184054b90 con 0x7f7178004850 2023-07-21T07:35:52.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.043+0000 7f71952fb700 1 -- 172.21.15.6:0/1964053587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f719006cc60 con 0x7f7178004850 2023-07-21T07:35:52.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.044+0000 7f71777fe700 1 -- 172.21.15.6:0/1964053587 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f71840581b0 con 0x7f7178004850 2023-07-21T07:35:52.096 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:35:52.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.046+0000 7f71952fb700 1 -- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f717c06ace0 msgr2=0x7f717c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.046+0000 7f71952fb700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f717c06ace0 0x7f717c06d1a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7180015040 tx=0x7f718000a000 comp rx=0 tx=0).stop 2023-07-21T07:35:52.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.046+0000 7f71952fb700 1 -- 172.21.15.6:0/1964053587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7178004850 msgr2=0x7f71901ed5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.046+0000 7f71952fb700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7178004850 0x7f71901ed5d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f71840119d0 tx=0x7f7184011d90 comp rx=0 tx=0).stop 2023-07-21T07:35:52.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.046+0000 7f71952fb700 1 -- 172.21.15.6:0/1964053587 shutdown_connections 2023-07-21T07:35:52.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.046+0000 7f71952fb700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f717c06ace0 0x7f717c06d1a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.046+0000 7f71952fb700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f719014e150 0x7f719014e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.046+0000 7f71952fb700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7178004850 0x7f71901ed5d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.046+0000 7f71952fb700 1 --2- 172.21.15.6:0/1964053587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71900c0110 0x7f71900c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.046+0000 7f71952fb700 1 -- 172.21.15.6:0/1964053587 >> 172.21.15.6:0/1964053587 conn(0x7f71900c9cd0 msgr2=0x7f71900ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:52.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.046+0000 7f71952fb700 1 -- 172.21.15.6:0/1964053587 shutdown_connections 2023-07-21T07:35:52.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.046+0000 7f71952fb700 1 -- 172.21.15.6:0/1964053587 wait complete. 2023-07-21T07:35:52.110 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:35:52.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.186+0000 7f9ccb995700 1 Processor -- start 2023-07-21T07:35:52.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.186+0000 7f9ccb995700 1 -- start start 2023-07-21T07:35:52.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.187+0000 7f9ccb995700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9cc40c3f80 0x7f9cc4151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.187+0000 7f9ccb995700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc41517c0 con 0x7f9cc40c1860 2023-07-21T07:35:52.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.187+0000 7f9ccb995700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc40c4e50 con 0x7f9cc40c5260 2023-07-21T07:35:52.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.187+0000 7f9ccb995700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc41519f0 con 0x7f9cc40c3f80 2023-07-21T07:35:52.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.187+0000 7f9cc9f32700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9cc40c3f80 0x7f9cc4151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.187+0000 7f9cc9f32700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9cc40c3f80 0x7f9cc4151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34804/0 (socket says 172.21.15.6:34804) 2023-07-21T07:35:52.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.187+0000 7f9cc9f32700 1 -- 172.21.15.6:0/642839735 learned_addr learned my addr 172.21.15.6:0/642839735 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.187+0000 7f9cc9f32700 1 -- 172.21.15.6:0/642839735 >> v1:172.21.15.86:6789/0 conn(0x7f9cc40c5260 legacy=0x7f9cc40c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.187+0000 7f9cc9f32700 1 -- 172.21.15.6:0/642839735 >> v1:172.21.15.6:6789/0 conn(0x7f9cc40c1860 legacy=0x7f9cc406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.187+0000 7f9cc9f32700 1 -- 172.21.15.6:0/642839735 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4151cd0 con 0x7f9cc40c3f80 2023-07-21T07:35:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.187+0000 7f9cc9f32700 1 --2- 172.21.15.6:0/642839735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cc40c3f80 0x7f9cc4151280 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009e50 tx=0x7f9cbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f774486408c1b50 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.188+0000 7f9cbbfff700 1 -- 172.21.15.6:0/642839735 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc00e070 con 0x7f9cc40c3f80 2023-07-21T07:35:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.188+0000 7f9cbbfff700 1 -- 172.21.15.6:0/642839735 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc003a20 con 0x7f9cc40c3f80 2023-07-21T07:35:52.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.188+0000 7f9cbbfff700 1 -- 172.21.15.6:0/642839735 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc003dd0 con 0x7f9cc40c3f80 2023-07-21T07:35:52.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.188+0000 7f9ccb995700 1 -- 172.21.15.6:0/642839735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cc40c3f80 msgr2=0x7f9cc4151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.188+0000 7f9ccb995700 1 --2- 172.21.15.6:0/642839735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cc40c3f80 0x7f9cc4151280 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009e50 tx=0x7f9cbc00b330 comp rx=0 tx=0).stop 2023-07-21T07:35:52.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.188+0000 7f9ccb995700 1 -- 172.21.15.6:0/642839735 shutdown_connections 2023-07-21T07:35:52.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.188+0000 7f9ccb995700 1 --2- 172.21.15.6:0/642839735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cc40c3f80 0x7f9cc4151280 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.188+0000 7f9ccb995700 1 -- 172.21.15.6:0/642839735 >> 172.21.15.6:0/642839735 conn(0x7f9cc40a8660 msgr2=0x7f9cc40a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:52.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.188+0000 7f9ccb995700 1 -- 172.21.15.6:0/642839735 shutdown_connections 2023-07-21T07:35:52.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.188+0000 7f9ccb995700 1 -- 172.21.15.6:0/642839735 wait complete. 2023-07-21T07:35:52.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.189+0000 7f9ccb995700 1 Processor -- start 2023-07-21T07:35:52.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.189+0000 7f9ccb995700 1 -- start start 2023-07-21T07:35:52.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9ccb995700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cc40c1860 0x7f9cc414b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9ccb995700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cc40c3f80 0x7f9cc4150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9ccb995700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cc40c5260 0x7f9cc4144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9ccb995700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40b8010 con 0x7f9cc40c1860 2023-07-21T07:35:52.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9ccb995700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc414bdf0 con 0x7f9cc40c3f80 2023-07-21T07:35:52.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9ccb995700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc41501b0 con 0x7f9cc40c5260 2023-07-21T07:35:52.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9cc9731700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cc40c1860 0x7f9cc414b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9cc9731700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cc40c1860 0x7f9cc414b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34806/0 (socket says 172.21.15.6:34806) 2023-07-21T07:35:52.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9cc9731700 1 -- 172.21.15.6:0/3234046537 learned_addr learned my addr 172.21.15.6:0/3234046537 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9cc8f30700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cc40c3f80 0x7f9cc4150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9cc9f32700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cc40c5260 0x7f9cc4144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9cc9731700 1 -- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cc40c5260 msgr2=0x7f9cc4144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9cc9731700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cc40c5260 0x7f9cc4144c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9cc9731700 1 -- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cc40c3f80 msgr2=0x7f9cc4150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9cc9731700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cc40c3f80 0x7f9cc4150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.190+0000 7f9cc9731700 1 -- 172.21.15.6:0/3234046537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc009b30 con 0x7f9cc40c1860 2023-07-21T07:35:52.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.191+0000 7f9cc9731700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cc40c1860 0x7f9cc414b8b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c450 tx=0x7f9cb400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:52.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.191+0000 7f9cb9ffb700 1 -- 172.21.15.6:0/3234046537 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40052d0 con 0x7f9cc40c1860 2023-07-21T07:35:52.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.191+0000 7f9cb9ffb700 1 -- 172.21.15.6:0/3234046537 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb4005430 con 0x7f9cc40c1860 2023-07-21T07:35:52.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.191+0000 7f9ccb995700 1 -- 172.21.15.6:0/3234046537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc4150490 con 0x7f9cc40c1860 2023-07-21T07:35:52.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.191+0000 7f9cb9ffb700 1 -- 172.21.15.6:0/3234046537 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40038c0 con 0x7f9cc40c1860 2023-07-21T07:35:52.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.191+0000 7f9ccb995700 1 -- 172.21.15.6:0/3234046537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc4150a50 con 0x7f9cc40c1860 2023-07-21T07:35:52.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.192+0000 7f9ccb995700 1 -- 172.21.15.6:0/3234046537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc4074500 con 0x7f9cc40c1860 2023-07-21T07:35:52.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.192+0000 7f9cb9ffb700 1 -- 172.21.15.6:0/3234046537 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9cb4003a20 con 0x7f9cc40c1860 2023-07-21T07:35:52.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.193+0000 7f9cb9ffb700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9ca806ace0 0x7f9ca806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.193+0000 7f9cb9ffb700 1 -- 172.21.15.6:0/3234046537 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f9cb4088a50 con 0x7f9cc40c1860 2023-07-21T07:35:52.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.193+0000 7f9cc8f30700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9ca806ace0 0x7f9ca806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.194+0000 7f9cc8f30700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9ca806ace0 0x7f9ca806d1a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40a6b40 tx=0x7f9cc0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:52.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.197+0000 7f9cb9ffb700 1 -- 172.21.15.6:0/3234046537 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9cb4053830 con 0x7f9cc40c1860 2023-07-21T07:35:52.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.395+0000 7f9ccb995700 1 -- 172.21.15.6:0/3234046537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9cc40c49b0 con 0x7f9cc40c1860 2023-07-21T07:35:52.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.396+0000 7f9cb9ffb700 1 -- 172.21.15.6:0/3234046537 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9cb4056e50 con 0x7f9cc40c1860 2023-07-21T07:35:52.448 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:35:52.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.398+0000 7f9ccb995700 1 -- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9ca806ace0 msgr2=0x7f9ca806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.398+0000 7f9ccb995700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9ca806ace0 0x7f9ca806d1a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40a6b40 tx=0x7f9cc0009040 comp rx=0 tx=0).stop 2023-07-21T07:35:52.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.398+0000 7f9ccb995700 1 -- 172.21.15.6:0/3234046537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cc40c1860 msgr2=0x7f9cc414b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.398+0000 7f9ccb995700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cc40c1860 0x7f9cc414b8b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c450 tx=0x7f9cb400c810 comp rx=0 tx=0).stop 2023-07-21T07:35:52.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.398+0000 7f9ccb995700 1 -- 172.21.15.6:0/3234046537 shutdown_connections 2023-07-21T07:35:52.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.398+0000 7f9ccb995700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9ca806ace0 0x7f9ca806d1a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.398+0000 7f9ccb995700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cc40c5260 0x7f9cc4144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.398+0000 7f9ccb995700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cc40c1860 0x7f9cc414b8b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.398+0000 7f9ccb995700 1 --2- 172.21.15.6:0/3234046537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cc40c3f80 0x7f9cc4150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.398+0000 7f9ccb995700 1 -- 172.21.15.6:0/3234046537 >> 172.21.15.6:0/3234046537 conn(0x7f9cc40a8660 msgr2=0x7f9cc40a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:52.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.398+0000 7f9ccb995700 1 -- 172.21.15.6:0/3234046537 shutdown_connections 2023-07-21T07:35:52.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.398+0000 7f9ccb995700 1 -- 172.21.15.6:0/3234046537 wait complete. 2023-07-21T07:35:52.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:35:52.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.537+0000 7f8b22996700 1 Processor -- start 2023-07-21T07:35:52.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.537+0000 7f8b22996700 1 -- start start 2023-07-21T07:35:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.538+0000 7f8b22996700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8b1c0a6f80 0x7f8b1c152380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.538+0000 7f8b22996700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b1c072160 0x7f8b1c14f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.538+0000 7f8b22996700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b1c0c4120 0x7f8b1c14f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.538+0000 7f8b22996700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1c0c26e0 con 0x7f8b1c0c4120 2023-07-21T07:35:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.538+0000 7f8b22996700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1c0c3c90 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.538+0000 7f8b22996700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c0c3680 con 0x7f8b1c072160 2023-07-21T07:35:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.538+0000 7f8b20f33700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b1c0c4120 0x7f8b1c14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.538+0000 7f8b20f33700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b1c0c4120 0x7f8b1c14f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34818/0 (socket says 172.21.15.6:34818) 2023-07-21T07:35:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.538+0000 7f8b20f33700 1 -- 172.21.15.6:0/857053824 learned_addr learned my addr 172.21.15.6:0/857053824 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.539+0000 7f8b1bfff700 1 --2- 172.21.15.6:0/857053824 >> v2:172.21.15.86:3300/0 conn(0x7f8b1c0a6f80 0x7f8b1c152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.539+0000 7f8b1b7fe700 1 --2- 172.21.15.6:0/857053824 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b1c072160 0x7f8b1c14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.539+0000 7f8b20f33700 1 -- 172.21.15.6:0/857053824 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b1c072160 msgr2=0x7f8b1c14f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.539+0000 7f8b20f33700 1 --2- 172.21.15.6:0/857053824 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b1c072160 0x7f8b1c14f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.539+0000 7f8b20f33700 1 -- 172.21.15.6:0/857053824 >> v2:172.21.15.86:3300/0 conn(0x7f8b1c0a6f80 msgr2=0x7f8b1c152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.539+0000 7f8b20f33700 1 --2- 172.21.15.6:0/857053824 >> v2:172.21.15.86:3300/0 conn(0x7f8b1c0a6f80 0x7f8b1c152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.539+0000 7f8b20f33700 1 -- 172.21.15.6:0/857053824 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c0c6fe0 con 0x7f8b1c0c4120 2023-07-21T07:35:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.539+0000 7f8b1bfff700 1 --2- 172.21.15.6:0/857053824 >> v2:172.21.15.86:3300/0 conn(0x7f8b1c0a6f80 0x7f8b1c152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.539+0000 7f8b20f33700 1 --2- 172.21.15.6:0/857053824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0c4120 0x7f8b1c14f960 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c067440 tx=0x7f8b1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf849fb19a423e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.539+0000 7f8b1affd700 1 -- 172.21.15.6:0/857053824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400e070 con 0x7f8b1c0c4120 2023-07-21T07:35:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.539+0000 7f8b1affd700 1 -- 172.21.15.6:0/857053824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1400b9c0 con 0x7f8b1c0c4120 2023-07-21T07:35:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.539+0000 7f8b1affd700 1 -- 172.21.15.6:0/857053824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400bd70 con 0x7f8b1c0c4120 2023-07-21T07:35:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.540+0000 7f8b22996700 1 -- 172.21.15.6:0/857053824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0c4120 msgr2=0x7f8b1c14f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.540+0000 7f8b22996700 1 --2- 172.21.15.6:0/857053824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0c4120 0x7f8b1c14f960 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c067440 tx=0x7f8b1400b330 comp rx=0 tx=0).stop 2023-07-21T07:35:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.540+0000 7f8b22996700 1 -- 172.21.15.6:0/857053824 shutdown_connections 2023-07-21T07:35:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.540+0000 7f8b22996700 1 --2- 172.21.15.6:0/857053824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0c4120 0x7f8b1c14f960 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.540+0000 7f8b22996700 1 --2- 172.21.15.6:0/857053824 >> v2:172.21.15.86:3300/0 conn(0x7f8b1c0a6f80 0x7f8b1c152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.540+0000 7f8b22996700 1 --2- 172.21.15.6:0/857053824 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b1c072160 0x7f8b1c14f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.540+0000 7f8b22996700 1 -- 172.21.15.6:0/857053824 >> 172.21.15.6:0/857053824 conn(0x7f8b1c0c7b50 msgr2=0x7f8b1c0c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:52.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.540+0000 7f8b22996700 1 -- 172.21.15.6:0/857053824 shutdown_connections 2023-07-21T07:35:52.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.540+0000 7f8b22996700 1 -- 172.21.15.6:0/857053824 wait complete. 2023-07-21T07:35:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.541+0000 7f8b22996700 1 Processor -- start 2023-07-21T07:35:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.541+0000 7f8b22996700 1 -- start start 2023-07-21T07:35:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b22996700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b1c072160 0x7f8b1c14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b22996700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0a6f80 0x7f8b1c1441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b22996700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b1c0c4120 0x7f8b1c146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b22996700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c06bea0 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b22996700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c06c2c0 con 0x7f8b1c0c4120 2023-07-21T07:35:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b22996700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c144700 con 0x7f8b1c072160 2023-07-21T07:35:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0a6f80 0x7f8b1c1441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0a6f80 0x7f8b1c1441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34822/0 (socket says 172.21.15.6:34822) 2023-07-21T07:35:52.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b1b7fe700 1 -- 172.21.15.6:0/4293112122 learned_addr learned my addr 172.21.15.6:0/4293112122 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:52.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b1bfff700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b1c072160 0x7f8b1c14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b20f33700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b1c0c4120 0x7f8b1c146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b1b7fe700 1 -- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b1c072160 msgr2=0x7f8b1c14a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b1b7fe700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b1c072160 0x7f8b1c14a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b1b7fe700 1 -- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b1c0c4120 msgr2=0x7f8b1c146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b1b7fe700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b1c0c4120 0x7f8b1c146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b1b7fe700 1 -- 172.21.15.6:0/4293112122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b14009b30 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b1bfff700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b1c072160 0x7f8b1c14a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:52.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.542+0000 7f8b20f33700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b1c0c4120 0x7f8b1c146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:52.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.543+0000 7f8b1b7fe700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0a6f80 0x7f8b1c1441c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400e810 tx=0x7f8b0400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:52.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.543+0000 7f8b18ff9700 1 -- 172.21.15.6:0/4293112122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04013610 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.543+0000 7f8b18ff9700 1 -- 172.21.15.6:0/4293112122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b04013770 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.543+0000 7f8b22996700 1 -- 172.21.15.6:0/4293112122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c14a770 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.543+0000 7f8b18ff9700 1 -- 172.21.15.6:0/4293112122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04013b20 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.543+0000 7f8b22996700 1 -- 172.21.15.6:0/4293112122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c06b7e0 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.544+0000 7f8b22996700 1 -- 172.21.15.6:0/4293112122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1c074500 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.544+0000 7f8b18ff9700 1 -- 172.21.15.6:0/4293112122 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b04013c80 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.545+0000 7f8b18ff9700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8afc06ace0 0x7f8afc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.545+0000 7f8b18ff9700 1 -- 172.21.15.6:0/4293112122 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f8b04089520 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.545+0000 7f8b1bfff700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8afc06ace0 0x7f8afc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.545+0000 7f8b1bfff700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8afc06ace0 0x7f8afc06d1a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0099f0 tx=0x7f8b0c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.549+0000 7f8b18ff9700 1 -- 172.21.15.6:0/4293112122 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b04057c60 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.749+0000 7f8b22996700 1 -- 172.21.15.6:0/4293112122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b1c14c560 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.749+0000 7f8b18ff9700 1 -- 172.21.15.6:0/4293112122 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b040577f0 con 0x7f8b1c0a6f80 2023-07-21T07:35:52.801 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:35:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.751+0000 7f8b22996700 1 -- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8afc06ace0 msgr2=0x7f8afc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.751+0000 7f8b22996700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8afc06ace0 0x7f8afc06d1a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0099f0 tx=0x7f8b0c008040 comp rx=0 tx=0).stop 2023-07-21T07:35:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.751+0000 7f8b22996700 1 -- 172.21.15.6:0/4293112122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0a6f80 msgr2=0x7f8b1c1441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.751+0000 7f8b22996700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0a6f80 0x7f8b1c1441c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400e810 tx=0x7f8b0400ebd0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.751+0000 7f8b22996700 1 -- 172.21.15.6:0/4293112122 shutdown_connections 2023-07-21T07:35:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.751+0000 7f8b22996700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8afc06ace0 0x7f8afc06d1a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.751+0000 7f8b22996700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b1c0c4120 0x7f8b1c146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.751+0000 7f8b22996700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b1c072160 0x7f8b1c14a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.751+0000 7f8b22996700 1 --2- 172.21.15.6:0/4293112122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0a6f80 0x7f8b1c1441c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.751+0000 7f8b22996700 1 -- 172.21.15.6:0/4293112122 >> 172.21.15.6:0/4293112122 conn(0x7f8b1c0c7b50 msgr2=0x7f8b1c1db790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:52.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.751+0000 7f8b22996700 1 -- 172.21.15.6:0/4293112122 shutdown_connections 2023-07-21T07:35:52.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.751+0000 7f8b22996700 1 -- 172.21.15.6:0/4293112122 wait complete. 2023-07-21T07:35:52.815 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-21T07:35:52.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.893+0000 7fedc5257700 1 Processor -- start 2023-07-21T07:35:52.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.893+0000 7fedc5257700 1 -- start start 2023-07-21T07:35:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedc5257700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedc00ba140 0x7fedc00c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedc5257700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fedc006d8a0 0x7fedc00c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedc5257700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc0155530 con 0x7fedc006a300 2023-07-21T07:35:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedc5257700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc00c1a30 con 0x7fedc00ba140 2023-07-21T07:35:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedc5257700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc0154920 con 0x7fedc006d8a0 2023-07-21T07:35:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedbe59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedc00ba140 0x7fedc00c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedbe59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedc00ba140 0x7fedc00c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34830/0 (socket says 172.21.15.6:34830) 2023-07-21T07:35:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedbe59c700 1 -- 172.21.15.6:0/2601525736 learned_addr learned my addr 172.21.15.6:0/2601525736 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedbf59e700 1 --2- 172.21.15.6:0/2601525736 >> v2:172.21.15.86:3300/0 conn(0x7fedc006d8a0 0x7fedc00c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedbe59c700 1 -- 172.21.15.6:0/2601525736 >> v2:172.21.15.86:3300/0 conn(0x7fedc006d8a0 msgr2=0x7fedc00c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedbe59c700 1 --2- 172.21.15.6:0/2601525736 >> v2:172.21.15.86:3300/0 conn(0x7fedc006d8a0 0x7fedc00c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedbe59c700 1 -- 172.21.15.6:0/2601525736 >> v1:172.21.15.6:6789/0 conn(0x7fedc006a300 legacy=0x7fedc01519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedbdd9b700 1 -- 172.21.15.6:0/2601525736 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475142665 0 0) 0x7fedc0155530 con 0x7fedc006a300 2023-07-21T07:35:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.894+0000 7fedbe59c700 1 -- 172.21.15.6:0/2601525736 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc0154c00 con 0x7fedc00ba140 2023-07-21T07:35:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.895+0000 7fedbe59c700 1 --2- 172.21.15.6:0/2601525736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc00ba140 0x7fedc00c4a40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fedc00685f0 tx=0x7fedb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17d51144eb9a05 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.895+0000 7fedbdd9b700 1 -- 172.21.15.6:0/2601525736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4011830 con 0x7fedc00ba140 2023-07-21T07:35:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.895+0000 7fedbdd9b700 1 -- 172.21.15.6:0/2601525736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb4011990 con 0x7fedc00ba140 2023-07-21T07:35:52.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.895+0000 7fedbdd9b700 1 -- 172.21.15.6:0/2601525736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4011d20 con 0x7fedc00ba140 2023-07-21T07:35:52.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.895+0000 7fedc5257700 1 -- 172.21.15.6:0/2601525736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc00ba140 msgr2=0x7fedc00c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.895+0000 7fedc5257700 1 --2- 172.21.15.6:0/2601525736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc00ba140 0x7fedc00c4a40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fedc00685f0 tx=0x7fedb4009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.895+0000 7fedc5257700 1 -- 172.21.15.6:0/2601525736 shutdown_connections 2023-07-21T07:35:52.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.895+0000 7fedc5257700 1 --2- 172.21.15.6:0/2601525736 >> v2:172.21.15.86:3300/0 conn(0x7fedc006d8a0 0x7fedc00c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.895+0000 7fedc5257700 1 --2- 172.21.15.6:0/2601525736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc00ba140 0x7fedc00c4a40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.895+0000 7fedc5257700 1 -- 172.21.15.6:0/2601525736 >> 172.21.15.6:0/2601525736 conn(0x7fedc00a8660 msgr2=0x7fedc00a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:52.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.895+0000 7fedc5257700 1 -- 172.21.15.6:0/2601525736 shutdown_connections 2023-07-21T07:35:52.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.895+0000 7fedc5257700 1 -- 172.21.15.6:0/2601525736 wait complete. 2023-07-21T07:35:52.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.897+0000 7fedc5257700 1 Processor -- start 2023-07-21T07:35:52.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.897+0000 7fedc5257700 1 -- start start 2023-07-21T07:35:52.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedc5257700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc006a300 0x7fedc00b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedc5257700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc006d8a0 0x7fedc00b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedc5257700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedc00ba140 0x7fedc0070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedc5257700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc00b7080 con 0x7fedc006a300 2023-07-21T07:35:52.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedc5257700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc00b6da0 con 0x7fedc00ba140 2023-07-21T07:35:52.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedc5257700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc01e99b0 con 0x7fedc006d8a0 2023-07-21T07:35:52.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedbed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc006a300 0x7fedc00b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedbed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc006a300 0x7fedc00b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34834/0 (socket says 172.21.15.6:34834) 2023-07-21T07:35:52.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedbed9d700 1 -- 172.21.15.6:0/755446940 learned_addr learned my addr 172.21.15.6:0/755446940 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:52.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedbf59e700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedc00ba140 0x7fedc0070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedbe59c700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc006d8a0 0x7fedc00b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedbed9d700 1 -- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc006d8a0 msgr2=0x7fedc00b8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedbed9d700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc006d8a0 0x7fedc00b8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedbed9d700 1 -- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedc00ba140 msgr2=0x7fedc0070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:52.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedbed9d700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedc00ba140 0x7fedc0070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:52.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedbed9d700 1 -- 172.21.15.6:0/755446940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb4009550 con 0x7fedc006a300 2023-07-21T07:35:52.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedbf59e700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedc00ba140 0x7fedc0070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:52.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7fedbed9d700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc006a300 0x7fedc00b67a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fedb000c550 tx=0x7fedb000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:52.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7feda77fe700 1 -- 172.21.15.6:0/755446940 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb00054e0 con 0x7fedc006a300 2023-07-21T07:35:52.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.898+0000 7feda77fe700 1 -- 172.21.15.6:0/755446940 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb0003680 con 0x7fedc006a300 2023-07-21T07:35:52.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.899+0000 7fedc5257700 1 -- 172.21.15.6:0/755446940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc01e9c90 con 0x7fedc006a300 2023-07-21T07:35:52.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.899+0000 7feda77fe700 1 -- 172.21.15.6:0/755446940 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0003a30 con 0x7fedc006a300 2023-07-21T07:35:52.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.899+0000 7fedc5257700 1 -- 172.21.15.6:0/755446940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc00b9360 con 0x7fedc006a300 2023-07-21T07:35:52.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.900+0000 7fedc5257700 1 -- 172.21.15.6:0/755446940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc01e9810 con 0x7fedc006a300 2023-07-21T07:35:52.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.900+0000 7feda77fe700 1 -- 172.21.15.6:0/755446940 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fedb0003b90 con 0x7fedc006a300 2023-07-21T07:35:52.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.900+0000 7feda77fe700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fedac06ad10 0x7fedac06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:52.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.900+0000 7feda77fe700 1 -- 172.21.15.6:0/755446940 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fedb0088cf0 con 0x7fedc006a300 2023-07-21T07:35:52.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.901+0000 7fedbe59c700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fedac06ad10 0x7fedac06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:52.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.901+0000 7fedbe59c700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fedac06ad10 0x7fedac06d1d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fedc00ba5b0 tx=0x7fedb4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:52.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:52.905+0000 7feda77fe700 1 -- 172.21.15.6:0/755446940 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fedc01e9810 con 0x7fedc006a300 2023-07-21T07:35:53.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.100+0000 7fedc5257700 1 -- 172.21.15.6:0/755446940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fedc01ea1b0 con 0x7fedc006a300 2023-07-21T07:35:53.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.100+0000 7feda77fe700 1 -- 172.21.15.6:0/755446940 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v40) v1 ==== 105+0+11 (secure 0 0 0) 0x7fedc01ea1b0 con 0x7fedc006a300 2023-07-21T07:35:53.153 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:35:53.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.102+0000 7fedc5257700 1 -- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fedac06ad10 msgr2=0x7fedac06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.102+0000 7fedc5257700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fedac06ad10 0x7fedac06d1d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fedc00ba5b0 tx=0x7fedb4008030 comp rx=0 tx=0).stop 2023-07-21T07:35:53.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.102+0000 7fedc5257700 1 -- 172.21.15.6:0/755446940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc006a300 msgr2=0x7fedc00b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.102+0000 7fedc5257700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc006a300 0x7fedc00b67a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fedb000c550 tx=0x7fedb000c910 comp rx=0 tx=0).stop 2023-07-21T07:35:53.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.102+0000 7fedc5257700 1 -- 172.21.15.6:0/755446940 shutdown_connections 2023-07-21T07:35:53.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.102+0000 7fedc5257700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fedac06ad10 0x7fedac06d1d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.102+0000 7fedc5257700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedc00ba140 0x7fedc0070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.102+0000 7fedc5257700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedc006a300 0x7fedc00b67a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.102+0000 7fedc5257700 1 --2- 172.21.15.6:0/755446940 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc006d8a0 0x7fedc00b8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.102+0000 7fedc5257700 1 -- 172.21.15.6:0/755446940 >> 172.21.15.6:0/755446940 conn(0x7fedc00a8660 msgr2=0x7fedc006dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.102+0000 7fedc5257700 1 -- 172.21.15.6:0/755446940 shutdown_connections 2023-07-21T07:35:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.102+0000 7fedc5257700 1 -- 172.21.15.6:0/755446940 wait complete. 2023-07-21T07:35:53.166 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-21T07:35:53.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.242+0000 7fa9ff734700 1 Processor -- start 2023-07-21T07:35:53.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.242+0000 7fa9ff734700 1 -- start start 2023-07-21T07:35:53.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.243+0000 7fa9ff734700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9f80c18c0 0x7fa9f80c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:53.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.243+0000 7fa9ff734700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa9f8072130 0x7fa9f806a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:53.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.243+0000 7fa9ff734700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f80c0b20 con 0x7fa9f80703f0 2023-07-21T07:35:53.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.243+0000 7fa9ff734700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f8151820 con 0x7fa9f80c18c0 2023-07-21T07:35:53.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.243+0000 7fa9ff734700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f80c0de0 con 0x7fa9f8072130 2023-07-21T07:35:53.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.243+0000 7fa9fcccf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9f80c18c0 0x7fa9f80c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:53.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.243+0000 7fa9fcccf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9f80c18c0 0x7fa9f80c25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34842/0 (socket says 172.21.15.6:34842) 2023-07-21T07:35:53.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.243+0000 7fa9fcccf700 1 -- 172.21.15.6:0/1000320094 learned_addr learned my addr 172.21.15.6:0/1000320094 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:53.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.243+0000 7fa9fdcd1700 1 --2- 172.21.15.6:0/1000320094 >> v2:172.21.15.86:3300/0 conn(0x7fa9f8072130 0x7fa9f806a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.243+0000 7fa9fcccf700 1 -- 172.21.15.6:0/1000320094 >> v2:172.21.15.86:3300/0 conn(0x7fa9f8072130 msgr2=0x7fa9f806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.243+0000 7fa9fcccf700 1 --2- 172.21.15.6:0/1000320094 >> v2:172.21.15.86:3300/0 conn(0x7fa9f8072130 0x7fa9f806a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9fcccf700 1 -- 172.21.15.6:0/1000320094 >> v1:172.21.15.86:6789/0 conn(0x7fa9f80703f0 legacy=0x7fa9f814dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9fcccf700 1 -- 172.21.15.6:0/1000320094 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f80c10c0 con 0x7fa9f80c18c0 2023-07-21T07:35:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9fcccf700 1 --2- 172.21.15.6:0/1000320094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f80c18c0 0x7fa9f80c25f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8068620 tx=0x7fa9f400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312e1820cdac9249 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9ebfff700 1 -- 172.21.15.6:0/1000320094 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f400db60 con 0x7fa9f80c18c0 2023-07-21T07:35:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9ebfff700 1 -- 172.21.15.6:0/1000320094 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f400dcc0 con 0x7fa9f80c18c0 2023-07-21T07:35:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9ebfff700 1 -- 172.21.15.6:0/1000320094 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4017630 con 0x7fa9f80c18c0 2023-07-21T07:35:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9ff734700 1 -- 172.21.15.6:0/1000320094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f80c18c0 msgr2=0x7fa9f80c25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9ff734700 1 --2- 172.21.15.6:0/1000320094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f80c18c0 0x7fa9f80c25f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8068620 tx=0x7fa9f400be70 comp rx=0 tx=0).stop 2023-07-21T07:35:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9ff734700 1 -- 172.21.15.6:0/1000320094 shutdown_connections 2023-07-21T07:35:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9ff734700 1 --2- 172.21.15.6:0/1000320094 >> v2:172.21.15.86:3300/0 conn(0x7fa9f8072130 0x7fa9f806a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9ff734700 1 --2- 172.21.15.6:0/1000320094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f80c18c0 0x7fa9f80c25f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9ff734700 1 -- 172.21.15.6:0/1000320094 >> 172.21.15.6:0/1000320094 conn(0x7fa9f80c2c20 msgr2=0x7fa9f80c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9ff734700 1 -- 172.21.15.6:0/1000320094 shutdown_connections 2023-07-21T07:35:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.244+0000 7fa9ff734700 1 -- 172.21.15.6:0/1000320094 wait complete. 2023-07-21T07:35:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.246+0000 7fa9ff734700 1 Processor -- start 2023-07-21T07:35:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.246+0000 7fa9ff734700 1 -- start start 2023-07-21T07:35:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.246+0000 7fa9ff734700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9f80703f0 0x7fa9f81e57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.246+0000 7fa9ff734700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f8072130 0x7fa9f814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.246+0000 7fa9ff734700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f80c18c0 0x7fa9f80ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.246+0000 7fa9ff734700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f8149570 con 0x7fa9f80c18c0 2023-07-21T07:35:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.246+0000 7fa9ff734700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81489f0 con 0x7fa9f8072130 2023-07-21T07:35:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.246+0000 7fa9ff734700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f8148cd0 con 0x7fa9f80703f0 2023-07-21T07:35:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9fdcd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f80c18c0 0x7fa9f80ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9fdcd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f80c18c0 0x7fa9f80ab3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34852/0 (socket says 172.21.15.6:34852) 2023-07-21T07:35:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9fdcd1700 1 -- 172.21.15.6:0/1317217899 learned_addr learned my addr 172.21.15.6:0/1317217899 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9fcccf700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f8072130 0x7fa9f814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9fd4d0700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9f80703f0 0x7fa9f81e57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9fdcd1700 1 -- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9f80703f0 msgr2=0x7fa9f81e57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9fdcd1700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9f80703f0 0x7fa9f81e57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9fdcd1700 1 -- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f8072130 msgr2=0x7fa9f814fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9fdcd1700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f8072130 0x7fa9f814fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9fdcd1700 1 -- 172.21.15.6:0/1317217899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f400b7f0 con 0x7fa9f80c18c0 2023-07-21T07:35:53.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9fdcd1700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f80c18c0 0x7fa9f80ab3f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa9f000efc0 tx=0x7fa9f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:53.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9e9ffb700 1 -- 172.21.15.6:0/1317217899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0009ea0 con 0x7fa9f80c18c0 2023-07-21T07:35:53.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9e9ffb700 1 -- 172.21.15.6:0/1317217899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f000f040 con 0x7fa9f80c18c0 2023-07-21T07:35:53.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9ff734700 1 -- 172.21.15.6:0/1317217899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f8148fb0 con 0x7fa9f80c18c0 2023-07-21T07:35:53.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9e9ffb700 1 -- 172.21.15.6:0/1317217899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f000ced0 con 0x7fa9f80c18c0 2023-07-21T07:35:53.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.247+0000 7fa9ff734700 1 -- 172.21.15.6:0/1317217899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f8150400 con 0x7fa9f80c18c0 2023-07-21T07:35:53.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.248+0000 7fa9ff734700 1 -- 172.21.15.6:0/1317217899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f814a190 con 0x7fa9f80c18c0 2023-07-21T07:35:53.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.249+0000 7fa9e9ffb700 1 -- 172.21.15.6:0/1317217899 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa9f0014480 con 0x7fa9f80c18c0 2023-07-21T07:35:53.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.249+0000 7fa9e9ffb700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa9dc06ace0 0x7fa9dc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:53.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.249+0000 7fa9e9ffb700 1 -- 172.21.15.6:0/1317217899 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fa9f008a040 con 0x7fa9f80c18c0 2023-07-21T07:35:53.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.250+0000 7fa9fd4d0700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa9dc06ace0 0x7fa9dc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:53.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.250+0000 7fa9fd4d0700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa9dc06ace0 0x7fa9dc06d1a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec001800 tx=0x7fa9ec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:53.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.254+0000 7fa9e9ffb700 1 -- 172.21.15.6:0/1317217899 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa9f0054d90 con 0x7fa9f80c18c0 2023-07-21T07:35:53.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.451+0000 7fa9ff734700 1 -- 172.21.15.6:0/1317217899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fa9f8074500 con 0x7fa9f80c18c0 2023-07-21T07:35:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.451+0000 7fa9e9ffb700 1 -- 172.21.15.6:0/1317217899 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v40) v1 ==== 101+0+11 (secure 0 0 0) 0x7fa9f00583b0 con 0x7fa9f80c18c0 2023-07-21T07:35:53.503 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:35:53.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.453+0000 7fa9ff734700 1 -- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa9dc06ace0 msgr2=0x7fa9dc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.453+0000 7fa9ff734700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa9dc06ace0 0x7fa9dc06d1a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec001800 tx=0x7fa9ec009040 comp rx=0 tx=0).stop 2023-07-21T07:35:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.453+0000 7fa9ff734700 1 -- 172.21.15.6:0/1317217899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f80c18c0 msgr2=0x7fa9f80ab3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.453+0000 7fa9ff734700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f80c18c0 0x7fa9f80ab3f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa9f000efc0 tx=0x7fa9f000c3a0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.453+0000 7fa9ff734700 1 -- 172.21.15.6:0/1317217899 shutdown_connections 2023-07-21T07:35:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.453+0000 7fa9ff734700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa9dc06ace0 0x7fa9dc06d1a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.453+0000 7fa9ff734700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f80c18c0 0x7fa9f80ab3f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.453+0000 7fa9ff734700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9f80703f0 0x7fa9f81e57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.453+0000 7fa9ff734700 1 --2- 172.21.15.6:0/1317217899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f8072130 0x7fa9f814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.453+0000 7fa9ff734700 1 -- 172.21.15.6:0/1317217899 >> 172.21.15.6:0/1317217899 conn(0x7fa9f80c2c20 msgr2=0x7fa9f814d150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.453+0000 7fa9ff734700 1 -- 172.21.15.6:0/1317217899 shutdown_connections 2023-07-21T07:35:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.453+0000 7fa9ff734700 1 -- 172.21.15.6:0/1317217899 wait complete. 2023-07-21T07:35:53.517 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T07:35:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.591+0000 7fc97c95f700 1 Processor -- start 2023-07-21T07:35:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.591+0000 7fc97c95f700 1 -- start start 2023-07-21T07:35:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc97c95f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc9780c7260 0x7fc9780c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc97c95f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc978158660 0x7fc97815ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc97c95f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9781581d0 con 0x7fc978151b70 2023-07-21T07:35:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc97c95f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9780c98e0 con 0x7fc978158660 2023-07-21T07:35:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc97c95f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc978155360 con 0x7fc9780c7260 2023-07-21T07:35:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc976d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc978158660 0x7fc97815ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc97659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc978151b70 0x7fc9780bea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42876/0 (socket says 172.21.15.6:42876) 2023-07-21T07:35:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc976d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc978158660 0x7fc97815ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34860/0 (socket says 172.21.15.6:34860) 2023-07-21T07:35:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc97659c700 1 -- 172.21.15.6:0/286511124 learned_addr learned my addr 172.21.15.6:0/286511124 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc975d9b700 1 --2- 172.21.15.6:0/286511124 >> v2:172.21.15.86:3300/0 conn(0x7fc9780c7260 0x7fc9780c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc976d9d700 1 -- 172.21.15.6:0/286511124 >> v2:172.21.15.86:3300/0 conn(0x7fc9780c7260 msgr2=0x7fc9780c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc976d9d700 1 --2- 172.21.15.6:0/286511124 >> v2:172.21.15.86:3300/0 conn(0x7fc9780c7260 0x7fc9780c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc976d9d700 1 -- 172.21.15.6:0/286511124 >> v1:172.21.15.6:6789/0 conn(0x7fc978151b70 legacy=0x7fc9780bea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc976d9d700 1 -- 172.21.15.6:0/286511124 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc978155080 con 0x7fc978158660 2023-07-21T07:35:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.592+0000 7fc97559a700 1 -- 172.21.15.6:0/286511124 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083682746 0 0) 0x7fc9781581d0 con 0x7fc978151b70 2023-07-21T07:35:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.593+0000 7fc976d9d700 1 --2- 172.21.15.6:0/286511124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc978158660 0x7fc97815ede0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc978066810 tx=0x7fc97000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c39f9f9d3b0611 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.593+0000 7fc97559a700 1 -- 172.21.15.6:0/286511124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000e070 con 0x7fc978158660 2023-07-21T07:35:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.593+0000 7fc97559a700 1 -- 172.21.15.6:0/286511124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97000bb20 con 0x7fc978158660 2023-07-21T07:35:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.593+0000 7fc97559a700 1 -- 172.21.15.6:0/286511124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970012430 con 0x7fc978158660 2023-07-21T07:35:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.593+0000 7fc97c95f700 1 -- 172.21.15.6:0/286511124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc978158660 msgr2=0x7fc97815ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.593+0000 7fc97c95f700 1 --2- 172.21.15.6:0/286511124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc978158660 0x7fc97815ede0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc978066810 tx=0x7fc97000b330 comp rx=0 tx=0).stop 2023-07-21T07:35:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.593+0000 7fc97c95f700 1 -- 172.21.15.6:0/286511124 shutdown_connections 2023-07-21T07:35:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.593+0000 7fc97c95f700 1 --2- 172.21.15.6:0/286511124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc978158660 0x7fc97815ede0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.593+0000 7fc97c95f700 1 --2- 172.21.15.6:0/286511124 >> v2:172.21.15.86:3300/0 conn(0x7fc9780c7260 0x7fc9780c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.593+0000 7fc97c95f700 1 -- 172.21.15.6:0/286511124 >> 172.21.15.6:0/286511124 conn(0x7fc9780c6620 msgr2=0x7fc9780c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.593+0000 7fc97c95f700 1 -- 172.21.15.6:0/286511124 shutdown_connections 2023-07-21T07:35:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.593+0000 7fc97c95f700 1 -- 172.21.15.6:0/286511124 wait complete. 2023-07-21T07:35:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.595+0000 7fc97c95f700 1 Processor -- start 2023-07-21T07:35:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.595+0000 7fc97c95f700 1 -- start start 2023-07-21T07:35:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.595+0000 7fc97c95f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9780c7260 0x7fc9781ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.595+0000 7fc97c95f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc978151b70 0x7fc9780ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.595+0000 7fc97c95f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc978158660 0x7fc9780aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.595+0000 7fc97c95f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781edf30 con 0x7fc978151b70 2023-07-21T07:35:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.595+0000 7fc97c95f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc978153890 con 0x7fc978158660 2023-07-21T07:35:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.595+0000 7fc97c95f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc978153b70 con 0x7fc9780c7260 2023-07-21T07:35:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.595+0000 7fc975d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc978151b70 0x7fc9780ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc975d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc978151b70 0x7fc9780ac900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34864/0 (socket says 172.21.15.6:34864) 2023-07-21T07:35:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc975d9b700 1 -- 172.21.15.6:0/3497926997 learned_addr learned my addr 172.21.15.6:0/3497926997 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc97659c700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9780c7260 0x7fc9781ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc976d9d700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc978158660 0x7fc9780aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc975d9b700 1 -- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9780c7260 msgr2=0x7fc9781ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc975d9b700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9780c7260 0x7fc9781ed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc975d9b700 1 -- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc978158660 msgr2=0x7fc9780aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc975d9b700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc978158660 0x7fc9780aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc975d9b700 1 -- 172.21.15.6:0/3497926997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc970009a70 con 0x7fc978151b70 2023-07-21T07:35:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc975d9b700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc978151b70 0x7fc9780ac900 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc96800e870 tx=0x7fc96800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc966ffd700 1 -- 172.21.15.6:0/3497926997 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc968009590 con 0x7fc978151b70 2023-07-21T07:35:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc966ffd700 1 -- 172.21.15.6:0/3497926997 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96800ee70 con 0x7fc978151b70 2023-07-21T07:35:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc97c95f700 1 -- 172.21.15.6:0/3497926997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc978153e50 con 0x7fc978151b70 2023-07-21T07:35:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc966ffd700 1 -- 172.21.15.6:0/3497926997 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96800ca50 con 0x7fc978151b70 2023-07-21T07:35:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.596+0000 7fc97c95f700 1 -- 172.21.15.6:0/3497926997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9780ae6c0 con 0x7fc978151b70 2023-07-21T07:35:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.597+0000 7fc97c95f700 1 -- 172.21.15.6:0/3497926997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97804ecc0 con 0x7fc978151b70 2023-07-21T07:35:53.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.597+0000 7fc966ffd700 1 -- 172.21.15.6:0/3497926997 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc96800cbb0 con 0x7fc978151b70 2023-07-21T07:35:53.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.598+0000 7fc966ffd700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc95806ace0 0x7fc95806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:53.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.598+0000 7fc966ffd700 1 -- 172.21.15.6:0/3497926997 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fc9680896b0 con 0x7fc978151b70 2023-07-21T07:35:53.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.598+0000 7fc97659c700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc95806ace0 0x7fc95806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.599+0000 7fc97659c700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc95806ace0 0x7fc95806d1a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc96c000f60 tx=0x7fc96c007c00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.602+0000 7fc966ffd700 1 -- 172.21.15.6:0/3497926997 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc968057f20 con 0x7fc978151b70 2023-07-21T07:35:53.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.814+0000 7fc97c95f700 1 -- 172.21.15.6:0/3497926997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc9780c94c0 con 0x7fc978151b70 2023-07-21T07:35:53.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.814+0000 7fc966ffd700 1 -- 172.21.15.6:0/3497926997 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc96800ce60 con 0x7fc978151b70 2023-07-21T07:35:53.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.816+0000 7fc97c95f700 1 -- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc95806ace0 msgr2=0x7fc95806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.816+0000 7fc97c95f700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc95806ace0 0x7fc95806d1a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc96c000f60 tx=0x7fc96c007c00 comp rx=0 tx=0).stop 2023-07-21T07:35:53.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.816+0000 7fc97c95f700 1 -- 172.21.15.6:0/3497926997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc978151b70 msgr2=0x7fc9780ac900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:53.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.816+0000 7fc97c95f700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc978151b70 0x7fc9780ac900 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc96800e870 tx=0x7fc96800ec30 comp rx=0 tx=0).stop 2023-07-21T07:35:53.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.816+0000 7fc97c95f700 1 -- 172.21.15.6:0/3497926997 shutdown_connections 2023-07-21T07:35:53.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.816+0000 7fc97c95f700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc95806ace0 0x7fc95806d1a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.816+0000 7fc97c95f700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc978158660 0x7fc9780aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.816+0000 7fc97c95f700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9780c7260 0x7fc9781ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.816+0000 7fc97c95f700 1 --2- 172.21.15.6:0/3497926997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc978151b70 0x7fc9780ac900 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:53.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.816+0000 7fc97c95f700 1 -- 172.21.15.6:0/3497926997 >> 172.21.15.6:0/3497926997 conn(0x7fc9780c6620 msgr2=0x7fc97814f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:53.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.817+0000 7fc97c95f700 1 -- 172.21.15.6:0/3497926997 shutdown_connections 2023-07-21T07:35:53.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:53.817+0000 7fc97c95f700 1 -- 172.21.15.6:0/3497926997 wait complete. 2023-07-21T07:35:53.871 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-21T07:35:53.880 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-21T07:35:53.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:53.881 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-21T07:35:53.924 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-07-21T07:35:53.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:53.925 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-21T07:35:53.981 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:35:53.982 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:54.039 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15810 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-07-21T07:35:54.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T07:35:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.114+0000 7fb4d30ca700 1 Processor -- start 2023-07-21T07:35:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.114+0000 7fb4d30ca700 1 -- start start 2023-07-21T07:35:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d30ca700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4cc14f880 0x7fb4cc06d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d30ca700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4cc152da0 0x7fb4cc06a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d30ca700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4cc0c5300 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d30ca700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4cc0c16d0 con 0x7fb4cc14f880 2023-07-21T07:35:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d30ca700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4cc1532a0 con 0x7fb4cc152da0 2023-07-21T07:35:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d0e66700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4cc14f880 0x7fb4cc06d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d0e66700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4cc14f880 0x7fb4cc06d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34870/0 (socket says 172.21.15.6:34870) 2023-07-21T07:35:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d0e66700 1 -- 172.21.15.6:0/4062503317 learned_addr learned my addr 172.21.15.6:0/4062503317 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d1667700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb4cc06a5d0 0x7fb4cc0c5790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42894/0 (socket says 172.21.15.6:42894) 2023-07-21T07:35:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4cbfff700 1 --2- 172.21.15.6:0/4062503317 >> v2:172.21.15.86:3300/0 conn(0x7fb4cc152da0 0x7fb4cc06a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d0e66700 1 -- 172.21.15.6:0/4062503317 >> v2:172.21.15.86:3300/0 conn(0x7fb4cc152da0 msgr2=0x7fb4cc06a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d0e66700 1 --2- 172.21.15.6:0/4062503317 >> v2:172.21.15.86:3300/0 conn(0x7fb4cc152da0 0x7fb4cc06a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d0e66700 1 -- 172.21.15.6:0/4062503317 >> v1:172.21.15.6:6789/0 conn(0x7fb4cc06a5d0 legacy=0x7fb4cc0c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d0e66700 1 -- 172.21.15.6:0/4062503317 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc0c49d0 con 0x7fb4cc14f880 2023-07-21T07:35:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.115+0000 7fb4d0e66700 1 --2- 172.21.15.6:0/4062503317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc14f880 0x7fb4cc06d8b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0c7a80 tx=0x7fb4c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9654f0576b8ca58a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.116+0000 7fb4cb7fe700 1 -- 172.21.15.6:0/4062503317 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c000b870 con 0x7fb4cc14f880 2023-07-21T07:35:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.116+0000 7fb4cb7fe700 1 -- 172.21.15.6:0/4062503317 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c000b9d0 con 0x7fb4cc14f880 2023-07-21T07:35:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.116+0000 7fb4cb7fe700 1 -- 172.21.15.6:0/4062503317 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c000bd60 con 0x7fb4cc14f880 2023-07-21T07:35:54.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.116+0000 7fb4d30ca700 1 -- 172.21.15.6:0/4062503317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc14f880 msgr2=0x7fb4cc06d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:54.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.116+0000 7fb4d30ca700 1 --2- 172.21.15.6:0/4062503317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc14f880 0x7fb4cc06d8b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0c7a80 tx=0x7fb4c0009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:54.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.116+0000 7fb4d30ca700 1 -- 172.21.15.6:0/4062503317 shutdown_connections 2023-07-21T07:35:54.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.116+0000 7fb4d30ca700 1 --2- 172.21.15.6:0/4062503317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc14f880 0x7fb4cc06d8b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:54.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.116+0000 7fb4d30ca700 1 --2- 172.21.15.6:0/4062503317 >> v2:172.21.15.86:3300/0 conn(0x7fb4cc152da0 0x7fb4cc06a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:54.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.116+0000 7fb4d30ca700 1 -- 172.21.15.6:0/4062503317 >> 172.21.15.6:0/4062503317 conn(0x7fb4cc0a8660 msgr2=0x7fb4cc0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:54.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.116+0000 7fb4d30ca700 1 -- 172.21.15.6:0/4062503317 shutdown_connections 2023-07-21T07:35:54.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.116+0000 7fb4d30ca700 1 -- 172.21.15.6:0/4062503317 wait complete. 2023-07-21T07:35:54.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.117+0000 7fb4d30ca700 1 Processor -- start 2023-07-21T07:35:54.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.117+0000 7fb4d30ca700 1 -- start start 2023-07-21T07:35:54.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.118+0000 7fb4d30ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc06a5d0 0x7fb4cc0bf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:54.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.118+0000 7fb4d30ca700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4cc14f880 0x7fb4cc1e7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:54.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.118+0000 7fb4d30ca700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc152da0 0x7fb4cc0a7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:54.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.118+0000 7fb4d30ca700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0bf700 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.118+0000 7fb4d30ca700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0bdd30 con 0x7fb4cc152da0 2023-07-21T07:35:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.118+0000 7fb4d30ca700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc1e8400 con 0x7fb4cc14f880 2023-07-21T07:35:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.118+0000 7fb4d0e66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc06a5d0 0x7fb4cc0bf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.118+0000 7fb4d0e66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc06a5d0 0x7fb4cc0bf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34876/0 (socket says 172.21.15.6:34876) 2023-07-21T07:35:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.118+0000 7fb4d0e66700 1 -- 172.21.15.6:0/915034999 learned_addr learned my addr 172.21.15.6:0/915034999 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.118+0000 7fb4cbfff700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4cc14f880 0x7fb4cc1e7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.118+0000 7fb4d1667700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc152da0 0x7fb4cc0a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.119+0000 7fb4d0e66700 1 -- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4cc14f880 msgr2=0x7fb4cc1e7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.119+0000 7fb4d0e66700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4cc14f880 0x7fb4cc1e7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.119+0000 7fb4d0e66700 1 -- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc152da0 msgr2=0x7fb4cc0a7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.119+0000 7fb4d0e66700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc152da0 0x7fb4cc0a7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.119+0000 7fb4d0e66700 1 -- 172.21.15.6:0/915034999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c0009550 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.119+0000 7fb4d0e66700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc06a5d0 0x7fb4cc0bf1c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0000c00 tx=0x7fb4c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.119+0000 7fb4c97fa700 1 -- 172.21.15.6:0/915034999 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0004480 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.119+0000 7fb4c97fa700 1 -- 172.21.15.6:0/915034999 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c00045e0 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.119+0000 7fb4c97fa700 1 -- 172.21.15.6:0/915034999 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c00038e0 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.119+0000 7fb4d30ca700 1 -- 172.21.15.6:0/915034999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4cc153b10 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.119+0000 7fb4d30ca700 1 -- 172.21.15.6:0/915034999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4cc153d60 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.120+0000 7fb4d30ca700 1 -- 172.21.15.6:0/915034999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4cc074500 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.120+0000 7fb4c97fa700 1 -- 172.21.15.6:0/915034999 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4c0021070 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.121+0000 7fb4c97fa700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb4b006ad10 0x7fb4b006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.121+0000 7fb4c97fa700 1 -- 172.21.15.6:0/915034999 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fb4c008ad20 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.121+0000 7fb4cbfff700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb4b006ad10 0x7fb4b006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.121+0000 7fb4cbfff700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb4b006ad10 0x7fb4b006d1d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0ac930 tx=0x7fb4b8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.125+0000 7fb4c97fa700 1 -- 172.21.15.6:0/915034999 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb4c0055a80 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.367+0000 7fb4d30ca700 1 -- 172.21.15.6:0/915034999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb4cc06af60 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.367+0000 7fb4c97fa700 1 -- 172.21.15.6:0/915034999 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7fb4c00590a0 con 0x7fb4cc06a5d0 2023-07-21T07:35:54.420 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T07:35:54.420 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-07-21T07:35:54.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.370+0000 7fb4d30ca700 1 -- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb4b006ad10 msgr2=0x7fb4b006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:54.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.370+0000 7fb4d30ca700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb4b006ad10 0x7fb4b006d1d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0ac930 tx=0x7fb4b8008040 comp rx=0 tx=0).stop 2023-07-21T07:35:54.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.370+0000 7fb4d30ca700 1 -- 172.21.15.6:0/915034999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc06a5d0 msgr2=0x7fb4cc0bf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:54.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.370+0000 7fb4d30ca700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc06a5d0 0x7fb4cc0bf1c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0000c00 tx=0x7fb4c0004750 comp rx=0 tx=0).stop 2023-07-21T07:35:54.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.370+0000 7fb4d30ca700 1 -- 172.21.15.6:0/915034999 shutdown_connections 2023-07-21T07:35:54.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.370+0000 7fb4d30ca700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb4b006ad10 0x7fb4b006d1d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:54.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.370+0000 7fb4d30ca700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4cc152da0 0x7fb4cc0a7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:54.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.370+0000 7fb4d30ca700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4cc06a5d0 0x7fb4cc0bf1c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:54.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.370+0000 7fb4d30ca700 1 --2- 172.21.15.6:0/915034999 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4cc14f880 0x7fb4cc1e7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:54.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.370+0000 7fb4d30ca700 1 -- 172.21.15.6:0/915034999 >> 172.21.15.6:0/915034999 conn(0x7fb4cc0a8660 msgr2=0x7fb4cc0c2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:54.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.370+0000 7fb4d30ca700 1 -- 172.21.15.6:0/915034999 shutdown_connections 2023-07-21T07:35:54.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:54.370+0000 7fb4d30ca700 1 -- 172.21.15.6:0/915034999 wait complete. 2023-07-21T07:35:54.434 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-07-21T07:35:54.434 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T07:35:54.434 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-07-21T07:35:54.434 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-21T07:35:54.435 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-21T07:35:54.435 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-07-21T07:35:54.435 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T07:35:54.435 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T07:35:54.436 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:35:54.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:54.436 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-07-21T07:35:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T07:35:54.457 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T07:35:54.457 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T07:35:54.457 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:54.458 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-07-21T07:35:54.458 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:35:54.458 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:35:54.458 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:54.458 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:35:54.459 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T07:35:54.459 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:54.459 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-21T07:35:54.459 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41913sec preferred_lft 41913sec 2023-07-21T07:35:54.459 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::c182:1cf2:777e:c99f/64 scope link noprefixroute 2023-07-21T07:35:54.459 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:54.459 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T07:35:54.460 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 6e:29:3e:ed:f1:91 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:54.460 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T07:35:54.460 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:54.460 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::88c2:92ff:fec4:e7d6/64 scope link 2023-07-21T07:35:54.460 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:54.460 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T07:35:54.460 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 6e:29:3e:ed:f1:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-21T07:35:54.461 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::6c29:3eff:feed:f191/64 scope link 2023-07-21T07:35:54.461 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:54.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:54.461 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T07:35:54.527 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-07-21T07:35:54.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:54.529 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-07-21T07:35:54.589 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-07-21T07:35:54.589 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T07:35:54.589 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T07:35:54.589 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-21T07:35:54.589 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T07:35:54.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:54.590 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-07-21T07:35:54.590 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-07-21T07:35:54.591 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T07:35:54.591 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T07:35:54.591 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T07:35:54.592 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-07-21T07:35:54.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:54.697 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-07-21T07:35:54.714 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-21T07:35:54.715 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:35:54.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:54.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-07-21T07:35:54.782 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:35:54.783 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-21T07:35:54.840 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:35:54.840 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:35:54.840 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-21T07:35:54.896 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-07-21T07:35:54.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:54.898 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:54.982 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:54.982 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:35:55.005 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:55.005 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:35:55.006 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:35:55.006 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 1@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs2=/ 2023-07-21T07:35:55.006 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:35:55.006 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:35:55.006 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:35:55.006 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:35:55.032 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:35:55.032 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:35:55.032 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:35:55.032 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 1@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs2=/ 2023-07-21T07:35:55.033 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:35:55.033 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:35:55.033 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:35:55.033 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:35:55.033 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790" 2023-07-21T07:35:55.033 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2023-07-21T07:35:55.033 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs2,fsid=8c602ac0-17b3-4df5-8928-640a7524b3b3" will pass to kernel 2023-07-21T07:35:55.035 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T07:35:55.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:55.036 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-21T07:35:55.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:55.067 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T07:35:55.153 INFO:teuthology.orchestra.run.smithi086.stdout:client4937 2023-07-21T07:35:55.154 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:35:55.154 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:55.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-07-21T07:35:55.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.263+0000 7f54e665a700 1 Processor -- start 2023-07-21T07:35:55.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.264+0000 7f54e665a700 1 -- start start 2023-07-21T07:35:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.264+0000 7f54e665a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54e0151bd0 0x7f54e00c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.264+0000 7f54e665a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f54e00c7bd0 0x7f54e015ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.264+0000 7f54e665a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e00c8120 con 0x7f54e0155190 2023-07-21T07:35:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.264+0000 7f54e665a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e00c8400 con 0x7f54e0151bd0 2023-07-21T07:35:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.264+0000 7f54e665a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e01544a0 con 0x7f54e00c7bd0 2023-07-21T07:35:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.264+0000 7f54dffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54e0151bd0 0x7f54e00c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.265+0000 7f54dffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54e0151bd0 0x7f54e00c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34884/0 (socket says 172.21.15.6:34884) 2023-07-21T07:35:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.265+0000 7f54dffff700 1 -- 172.21.15.6:0/3990512599 learned_addr learned my addr 172.21.15.6:0/3990512599 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.265+0000 7f54e4bf7700 1 --2- 172.21.15.6:0/3990512599 >> v2:172.21.15.86:3300/0 conn(0x7f54e00c7bd0 0x7f54e015ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.265+0000 7f54dffff700 1 -- 172.21.15.6:0/3990512599 >> v2:172.21.15.86:3300/0 conn(0x7f54e00c7bd0 msgr2=0x7f54e015ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.265+0000 7f54dffff700 1 --2- 172.21.15.6:0/3990512599 >> v2:172.21.15.86:3300/0 conn(0x7f54e00c7bd0 0x7f54e015ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.265+0000 7f54dffff700 1 -- 172.21.15.6:0/3990512599 >> v1:172.21.15.86:6789/0 conn(0x7f54e0155190 legacy=0x7f54e0157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.265+0000 7f54dffff700 1 -- 172.21.15.6:0/3990512599 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e01546b0 con 0x7f54e0151bd0 2023-07-21T07:35:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.265+0000 7f54dffff700 1 --2- 172.21.15.6:0/3990512599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e0151bd0 0x7f54e00c4650 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f54e00c74c0 tx=0x7f54d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a7249f9810f6ff server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.265+0000 7f54deffd700 1 -- 172.21.15.6:0/3990512599 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d0011830 con 0x7f54e0151bd0 2023-07-21T07:35:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.265+0000 7f54deffd700 1 -- 172.21.15.6:0/3990512599 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d0011990 con 0x7f54e0151bd0 2023-07-21T07:35:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.265+0000 7f54deffd700 1 -- 172.21.15.6:0/3990512599 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d0011d20 con 0x7f54e0151bd0 2023-07-21T07:35:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.266+0000 7f54e665a700 1 -- 172.21.15.6:0/3990512599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e0151bd0 msgr2=0x7f54e00c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.266+0000 7f54e665a700 1 --2- 172.21.15.6:0/3990512599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e0151bd0 0x7f54e00c4650 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f54e00c74c0 tx=0x7f54d0009bd0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.266+0000 7f54e665a700 1 -- 172.21.15.6:0/3990512599 shutdown_connections 2023-07-21T07:35:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.266+0000 7f54e665a700 1 --2- 172.21.15.6:0/3990512599 >> v2:172.21.15.86:3300/0 conn(0x7f54e00c7bd0 0x7f54e015ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.266+0000 7f54e665a700 1 --2- 172.21.15.6:0/3990512599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e0151bd0 0x7f54e00c4650 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.266+0000 7f54e665a700 1 -- 172.21.15.6:0/3990512599 >> 172.21.15.6:0/3990512599 conn(0x7f54e00ab860 msgr2=0x7f54e00abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.266+0000 7f54e665a700 1 -- 172.21.15.6:0/3990512599 shutdown_connections 2023-07-21T07:35:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.266+0000 7f54e665a700 1 -- 172.21.15.6:0/3990512599 wait complete. 2023-07-21T07:35:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.267+0000 7f54e665a700 1 Processor -- start 2023-07-21T07:35:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.267+0000 7f54e665a700 1 -- start start 2023-07-21T07:35:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54e665a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54e00c7bd0 0x7f54e00c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54e665a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e0151bd0 0x7f54e01489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54e665a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54e0155190 0x7f54e0148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54e665a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e01485b0 con 0x7f54e0151bd0 2023-07-21T07:35:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54e665a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e01ea760 con 0x7f54e00c7bd0 2023-07-21T07:35:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54e665a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e0149450 con 0x7f54e0155190 2023-07-21T07:35:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e0151bd0 0x7f54e01489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e0151bd0 0x7f54e01489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34892/0 (socket says 172.21.15.6:34892) 2023-07-21T07:35:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54df7fe700 1 -- 172.21.15.6:0/2294185004 learned_addr learned my addr 172.21.15.6:0/2294185004 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54e4bf7700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54e0155190 0x7f54e0148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54dffff700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54e00c7bd0 0x7f54e00c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54df7fe700 1 -- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54e0155190 msgr2=0x7f54e0148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54df7fe700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54e0155190 0x7f54e0148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54df7fe700 1 -- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54e00c7bd0 msgr2=0x7f54e00c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54df7fe700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54e00c7bd0 0x7f54e00c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.268+0000 7f54df7fe700 1 -- 172.21.15.6:0/2294185004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d0009550 con 0x7f54e0151bd0 2023-07-21T07:35:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.269+0000 7f54df7fe700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e0151bd0 0x7f54e01489d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f54c800c420 tx=0x7f54c800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.269+0000 7f54dcff9700 1 -- 172.21.15.6:0/2294185004 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c80052d0 con 0x7f54e0151bd0 2023-07-21T07:35:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.269+0000 7f54dcff9700 1 -- 172.21.15.6:0/2294185004 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c8005430 con 0x7f54e0151bd0 2023-07-21T07:35:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.269+0000 7f54dcff9700 1 -- 172.21.15.6:0/2294185004 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c80038c0 con 0x7f54e0151bd0 2023-07-21T07:35:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.269+0000 7f54e665a700 1 -- 172.21.15.6:0/2294185004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e01e92f0 con 0x7f54e0151bd0 2023-07-21T07:35:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.269+0000 7f54e665a700 1 -- 172.21.15.6:0/2294185004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e0147ef0 con 0x7f54e0151bd0 2023-07-21T07:35:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.270+0000 7f54e665a700 1 -- 172.21.15.6:0/2294185004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e0074500 con 0x7f54e0151bd0 2023-07-21T07:35:55.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.270+0000 7f54dcff9700 1 -- 172.21.15.6:0/2294185004 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f54c8003a20 con 0x7f54e0151bd0 2023-07-21T07:35:55.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.271+0000 7f54dcff9700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f54c006ace0 0x7f54c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:55.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.271+0000 7f54dcff9700 1 -- 172.21.15.6:0/2294185004 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f54c8088b00 con 0x7f54e0151bd0 2023-07-21T07:35:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.271+0000 7f54dffff700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f54c006ace0 0x7f54c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.271+0000 7f54dffff700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f54c006ace0 0x7f54c006d1a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009c10 tx=0x7f54d0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.275+0000 7f54dcff9700 1 -- 172.21.15.6:0/2294185004 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f54c808ae60 con 0x7f54e0151bd0 2023-07-21T07:35:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.519+0000 7f54e665a700 1 -- 172.21.15.6:0/2294185004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f54e00c9320 con 0x7f54e0151bd0 2023-07-21T07:35:55.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.523+0000 7f54dcff9700 1 -- 172.21.15.6:0/2294185004 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v11) v1 ==== 134+0+185 (secure 0 0 0) 0x7f54c8053840 con 0x7f54e0151bd0 2023-07-21T07:35:55.575 INFO:teuthology.orchestra.run.smithi006.stdout:[client.testuser] 2023-07-21T07:35:55.575 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBbNbpkkI0AHxAAxb3qXU0Dc8Jxrc2w5FHegw== 2023-07-21T07:35:55.575 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow rw fsname=cephfs" 2023-07-21T07:35:55.575 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r fsname=cephfs" 2023-07-21T07:35:55.575 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T07:35:55.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.525+0000 7f54e665a700 1 -- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f54c006ace0 msgr2=0x7f54c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:55.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.525+0000 7f54e665a700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f54c006ace0 0x7f54c006d1a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009c10 tx=0x7f54d0008030 comp rx=0 tx=0).stop 2023-07-21T07:35:55.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.525+0000 7f54e665a700 1 -- 172.21.15.6:0/2294185004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e0151bd0 msgr2=0x7f54e01489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:55.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.525+0000 7f54e665a700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e0151bd0 0x7f54e01489d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f54c800c420 tx=0x7f54c800c730 comp rx=0 tx=0).stop 2023-07-21T07:35:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.525+0000 7f54e665a700 1 -- 172.21.15.6:0/2294185004 shutdown_connections 2023-07-21T07:35:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.525+0000 7f54e665a700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f54c006ace0 0x7f54c006d1a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.525+0000 7f54e665a700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54e0155190 0x7f54e0148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.525+0000 7f54e665a700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54e00c7bd0 0x7f54e00c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.525+0000 7f54e665a700 1 --2- 172.21.15.6:0/2294185004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e0151bd0 0x7f54e01489d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.525+0000 7f54e665a700 1 -- 172.21.15.6:0/2294185004 >> 172.21.15.6:0/2294185004 conn(0x7f54e00ab860 msgr2=0x7f54e00c4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.525+0000 7f54e665a700 1 -- 172.21.15.6:0/2294185004 shutdown_connections 2023-07-21T07:35:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.525+0000 7f54e665a700 1 -- 172.21.15.6:0/2294185004 wait complete. 2023-07-21T07:35:55.589 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2023-07-21T07:35:55.606 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.mNns9Iw0M2 2023-07-21T07:35:55.606 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:35:55.607 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/tmp/tmp.mNns9Iw0M2 2023-07-21T07:35:55.662 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:35:55.663 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:55.720 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:35:55.720 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:55.777 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:35:55.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.888+0000 7f888866c700 1 Processor -- start 2023-07-21T07:35:55.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.888+0000 7f888866c700 1 -- start start 2023-07-21T07:35:55.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.889+0000 7f888866c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f88800abdb0 0x7f88800aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:55.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.889+0000 7f888866c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8880066210 0x7f88800aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:55.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.889+0000 7f888866c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88800c6cc0 con 0x7f888014fa10 2023-07-21T07:35:55.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.889+0000 7f888866c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8880152df0 con 0x7f88800abdb0 2023-07-21T07:35:55.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.889+0000 7f888866c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88801530d0 con 0x7f8880066210 2023-07-21T07:35:55.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.889+0000 7f8886408700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f888014fa10 0x7f888006a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42918/0 (socket says 172.21.15.6:42918) 2023-07-21T07:35:55.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.889+0000 7f8886408700 1 -- 172.21.15.6:0/2243635232 learned_addr learned my addr 172.21.15.6:0/2243635232 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:55.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.890+0000 7f8886c09700 1 --2- 172.21.15.6:0/2243635232 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8880066210 0x7f88800aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:55.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.890+0000 7f8885c07700 1 --2- 172.21.15.6:0/2243635232 >> v2:172.21.15.86:3300/0 conn(0x7f88800abdb0 0x7f88800aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:55.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.890+0000 7f8885406700 1 -- 172.21.15.6:0/2243635232 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833771855 0 0) 0x7f88800c6cc0 con 0x7f888014fa10 2023-07-21T07:35:55.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.890+0000 7f8885406700 1 -- 172.21.15.6:0/2243635232 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88680035b0 con 0x7f888014fa10 2023-07-21T07:35:55.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.890+0000 7f8886c09700 1 -- 172.21.15.6:0/2243635232 >> v2:172.21.15.86:3300/0 conn(0x7f88800abdb0 msgr2=0x7f88800aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:55.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.890+0000 7f8886c09700 1 --2- 172.21.15.6:0/2243635232 >> v2:172.21.15.86:3300/0 conn(0x7f88800abdb0 0x7f88800aa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.890+0000 7f8886c09700 1 -- 172.21.15.6:0/2243635232 >> v1:172.21.15.6:6789/0 conn(0x7f888014fa10 legacy=0x7f888006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:55.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.890+0000 7f8886c09700 1 -- 172.21.15.6:0/2243635232 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88800c6f10 con 0x7f8880066210 2023-07-21T07:35:55.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.890+0000 7f8885c07700 1 --2- 172.21.15.6:0/2243635232 >> v2:172.21.15.86:3300/0 conn(0x7f88800abdb0 0x7f88800aa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:55.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.890+0000 7f8886c09700 1 --2- 172.21.15.6:0/2243635232 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8880066210 0x7f88800aaf10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8878009840 tx=0x7f8878009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b131499170e77b81 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:55.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.890+0000 7f8885406700 1 -- 172.21.15.6:0/2243635232 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878011830 con 0x7f8880066210 2023-07-21T07:35:55.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.890+0000 7f8885406700 1 -- 172.21.15.6:0/2243635232 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8878011990 con 0x7f8880066210 2023-07-21T07:35:55.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.890+0000 7f8885406700 1 -- 172.21.15.6:0/2243635232 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878011d20 con 0x7f8880066210 2023-07-21T07:35:55.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.891+0000 7f888866c700 1 -- 172.21.15.6:0/2243635232 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8880066210 msgr2=0x7f88800aaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:55.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.891+0000 7f888866c700 1 --2- 172.21.15.6:0/2243635232 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8880066210 0x7f88800aaf10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8878009840 tx=0x7f8878009b50 comp rx=0 tx=0).stop 2023-07-21T07:35:55.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.891+0000 7f888866c700 1 -- 172.21.15.6:0/2243635232 shutdown_connections 2023-07-21T07:35:55.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.891+0000 7f888866c700 1 --2- 172.21.15.6:0/2243635232 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8880066210 0x7f88800aaf10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.891+0000 7f888866c700 1 --2- 172.21.15.6:0/2243635232 >> v2:172.21.15.86:3300/0 conn(0x7f88800abdb0 0x7f88800aa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.891+0000 7f888866c700 1 -- 172.21.15.6:0/2243635232 >> 172.21.15.6:0/2243635232 conn(0x7f88800c6140 msgr2=0x7f88800c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:55.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.891+0000 7f888866c700 1 -- 172.21.15.6:0/2243635232 shutdown_connections 2023-07-21T07:35:55.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.891+0000 7f888866c700 1 -- 172.21.15.6:0/2243635232 wait complete. 2023-07-21T07:35:55.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.892+0000 7f888866c700 1 Processor -- start 2023-07-21T07:35:55.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.892+0000 7f888866c700 1 -- start start 2023-07-21T07:35:55.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f888866c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8880066210 0x7f88800c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:55.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f888866c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88800abdb0 0x7f8880155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:55.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f888866c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f888014fa10 0x7f8880156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f888866c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8880153440 con 0x7f8880066210 2023-07-21T07:35:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f888866c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88801ea9d0 con 0x7f888014fa10 2023-07-21T07:35:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f888866c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88801eacb0 con 0x7f88800abdb0 2023-07-21T07:35:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f8886408700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8880066210 0x7f88800c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f8886408700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8880066210 0x7f88800c5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34904/0 (socket says 172.21.15.6:34904) 2023-07-21T07:35:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f8886408700 1 -- 172.21.15.6:0/159452532 learned_addr learned my addr 172.21.15.6:0/159452532 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f8885c07700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88800abdb0 0x7f8880155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f8886c09700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f888014fa10 0x7f8880156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:55.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f8886408700 1 -- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88800abdb0 msgr2=0x7f8880155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:55.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f8886408700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88800abdb0 0x7f8880155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f8886408700 1 -- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f888014fa10 msgr2=0x7f8880156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:55.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f8886408700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f888014fa10 0x7f8880156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:55.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f8886408700 1 -- 172.21.15.6:0/159452532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88740094a0 con 0x7f8880066210 2023-07-21T07:35:55.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.893+0000 7f8886408700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8880066210 0x7f88800c5200 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f887000cbc0 tx=0x7f887000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:55.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.894+0000 7f887effd700 1 -- 172.21.15.6:0/159452532 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887000ab50 con 0x7f8880066210 2023-07-21T07:35:55.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.894+0000 7f887effd700 1 -- 172.21.15.6:0/159452532 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887000acb0 con 0x7f8880066210 2023-07-21T07:35:55.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.894+0000 7f888866c700 1 -- 172.21.15.6:0/159452532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88780094a0 con 0x7f8880066210 2023-07-21T07:35:55.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.894+0000 7f887effd700 1 -- 172.21.15.6:0/159452532 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870012620 con 0x7f8880066210 2023-07-21T07:35:55.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.894+0000 7f888866c700 1 -- 172.21.15.6:0/159452532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88801eb270 con 0x7f8880066210 2023-07-21T07:35:55.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.894+0000 7f888866c700 1 -- 172.21.15.6:0/159452532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8880074500 con 0x7f8880066210 2023-07-21T07:35:55.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.895+0000 7f887effd700 1 -- 172.21.15.6:0/159452532 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f887001b3b0 con 0x7f8880066210 2023-07-21T07:35:55.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.895+0000 7f887effd700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f886c06ace0 0x7f886c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:55.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.896+0000 7f887effd700 1 -- 172.21.15.6:0/159452532 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f8870089550 con 0x7f8880066210 2023-07-21T07:35:55.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.896+0000 7f8885c07700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f886c06ace0 0x7f886c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:55.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.896+0000 7f8885c07700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f886c06ace0 0x7f886c06d1a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f88801453e0 tx=0x7f8874008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:55.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:55.900+0000 7f887effd700 1 -- 172.21.15.6:0/159452532 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8870054330 con 0x7f8880066210 2023-07-21T07:35:56.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.097+0000 7f888866c700 1 -- 172.21.15.6:0/159452532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8880150140 con 0x7f8880066210 2023-07-21T07:35:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.099+0000 7f887effd700 1 -- 172.21.15.6:0/159452532 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+21959 (secure 0 0 0) 0x7f8870057950 con 0x7f8880066210 2023-07-21T07:35:56.151 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:35:56.151 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:46.879421+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:35:29.385402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T07:35:29.920618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:35:43.052752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:35:44.270260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:35:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.101+0000 7f888866c700 1 -- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f886c06ace0 msgr2=0x7f886c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.101+0000 7f888866c700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f886c06ace0 0x7f886c06d1a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f88801453e0 tx=0x7f8874008040 comp rx=0 tx=0).stop 2023-07-21T07:35:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.101+0000 7f888866c700 1 -- 172.21.15.6:0/159452532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8880066210 msgr2=0x7f88800c5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.101+0000 7f888866c700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8880066210 0x7f88800c5200 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f887000cbc0 tx=0x7f887000cf80 comp rx=0 tx=0).stop 2023-07-21T07:35:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.101+0000 7f888866c700 1 -- 172.21.15.6:0/159452532 shutdown_connections 2023-07-21T07:35:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.101+0000 7f888866c700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f886c06ace0 0x7f886c06d1a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.101+0000 7f888866c700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f888014fa10 0x7f8880156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.101+0000 7f888866c700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8880066210 0x7f88800c5200 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.101+0000 7f888866c700 1 --2- 172.21.15.6:0/159452532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88800abdb0 0x7f8880155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.101+0000 7f888866c700 1 -- 172.21.15.6:0/159452532 >> 172.21.15.6:0/159452532 conn(0x7f88800c6140 msgr2=0x7f888006a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.101+0000 7f888866c700 1 -- 172.21.15.6:0/159452532 shutdown_connections 2023-07-21T07:35:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.101+0000 7f888866c700 1 -- 172.21.15.6:0/159452532 wait complete. 2023-07-21T07:35:56.165 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:35:29.385402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:35:29.920618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-21T07:35:43.052752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-21T07:35:44.270260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:35:56.166 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:35:56.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.242+0000 7f3c8694c700 1 Processor -- start 2023-07-21T07:35:56.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.242+0000 7f3c8694c700 1 -- start start 2023-07-21T07:35:56.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.242+0000 7f3c8694c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c80072160 0x7f3c8014f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.242+0000 7f3c8694c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c800c4120 0x7f3c8014f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.242+0000 7f3c8694c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c800c3c90 con 0x7f3c800a6f80 2023-07-21T07:35:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.242+0000 7f3c8694c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c800c26e0 con 0x7f3c800c4120 2023-07-21T07:35:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.242+0000 7f3c8694c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c800c3680 con 0x7f3c80072160 2023-07-21T07:35:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.242+0000 7f3c84ee9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c800c4120 0x7f3c8014f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.243+0000 7f3c7ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3c800a6f80 0x7f3c80152380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42932/0 (socket says 172.21.15.6:42932) 2023-07-21T07:35:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.243+0000 7f3c84ee9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c800c4120 0x7f3c8014f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34916/0 (socket says 172.21.15.6:34916) 2023-07-21T07:35:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.243+0000 7f3c7ffff700 1 -- 172.21.15.6:0/3888867885 learned_addr learned my addr 172.21.15.6:0/3888867885 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.243+0000 7f3c7f7fe700 1 --2- 172.21.15.6:0/3888867885 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c80072160 0x7f3c8014f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.243+0000 7f3c84ee9700 1 -- 172.21.15.6:0/3888867885 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c80072160 msgr2=0x7f3c8014f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.243+0000 7f3c84ee9700 1 --2- 172.21.15.6:0/3888867885 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c80072160 0x7f3c8014f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.243+0000 7f3c84ee9700 1 -- 172.21.15.6:0/3888867885 >> v1:172.21.15.6:6789/0 conn(0x7f3c800a6f80 legacy=0x7f3c80152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.243+0000 7f3c84ee9700 1 -- 172.21.15.6:0/3888867885 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c800c6fe0 con 0x7f3c800c4120 2023-07-21T07:35:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.243+0000 7f3c7effd700 1 -- 172.21.15.6:0/3888867885 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349470205 0 0) 0x7f3c800c3c90 con 0x7f3c800a6f80 2023-07-21T07:35:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.243+0000 7f3c84ee9700 1 --2- 172.21.15.6:0/3888867885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c800c4120 0x7f3c8014f960 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009d90 tx=0x7f3c7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62b8ea37297add0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.243+0000 7f3c7effd700 1 -- 172.21.15.6:0/3888867885 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800e070 con 0x7f3c800c4120 2023-07-21T07:35:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.243+0000 7f3c7effd700 1 -- 172.21.15.6:0/3888867885 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7800bb20 con 0x7f3c800c4120 2023-07-21T07:35:56.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.243+0000 7f3c7effd700 1 -- 172.21.15.6:0/3888867885 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78012430 con 0x7f3c800c4120 2023-07-21T07:35:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.244+0000 7f3c8694c700 1 -- 172.21.15.6:0/3888867885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c800c4120 msgr2=0x7f3c8014f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.244+0000 7f3c8694c700 1 --2- 172.21.15.6:0/3888867885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c800c4120 0x7f3c8014f960 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009d90 tx=0x7f3c7800b330 comp rx=0 tx=0).stop 2023-07-21T07:35:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.244+0000 7f3c8694c700 1 -- 172.21.15.6:0/3888867885 shutdown_connections 2023-07-21T07:35:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.244+0000 7f3c8694c700 1 --2- 172.21.15.6:0/3888867885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c800c4120 0x7f3c8014f960 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.244+0000 7f3c8694c700 1 --2- 172.21.15.6:0/3888867885 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c80072160 0x7f3c8014f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.244+0000 7f3c8694c700 1 -- 172.21.15.6:0/3888867885 >> 172.21.15.6:0/3888867885 conn(0x7f3c800c7b50 msgr2=0x7f3c800c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.244+0000 7f3c8694c700 1 -- 172.21.15.6:0/3888867885 shutdown_connections 2023-07-21T07:35:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.244+0000 7f3c8694c700 1 -- 172.21.15.6:0/3888867885 wait complete. 2023-07-21T07:35:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.245+0000 7f3c8694c700 1 Processor -- start 2023-07-21T07:35:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.245+0000 7f3c8694c700 1 -- start start 2023-07-21T07:35:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c8694c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c80072160 0x7f3c80149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c8694c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c800a6f80 0x7f3c8006b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c8694c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c800c4120 0x7f3c801ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c8694c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8014de60 con 0x7f3c800a6f80 2023-07-21T07:35:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c8694c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8014e120 con 0x7f3c80072160 2023-07-21T07:35:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c8694c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8014cad0 con 0x7f3c800c4120 2023-07-21T07:35:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c7f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c800a6f80 0x7f3c8006b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c7f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c800a6f80 0x7f3c8006b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34920/0 (socket says 172.21.15.6:34920) 2023-07-21T07:35:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c7f7fe700 1 -- 172.21.15.6:0/1424402720 learned_addr learned my addr 172.21.15.6:0/1424402720 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c7ffff700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c80072160 0x7f3c80149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c84ee9700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c800c4120 0x7f3c801ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c7f7fe700 1 -- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c800c4120 msgr2=0x7f3c801ecc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c7f7fe700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c800c4120 0x7f3c801ecc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c7f7fe700 1 -- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c80072160 msgr2=0x7f3c80149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c7f7fe700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c80072160 0x7f3c80149ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c7f7fe700 1 -- 172.21.15.6:0/1424402720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78009a70 con 0x7f3c800a6f80 2023-07-21T07:35:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c7f7fe700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c800a6f80 0x7f3c8006b1a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400e9b0 tx=0x7f3c7400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.246+0000 7f3c7cff9700 1 -- 172.21.15.6:0/1424402720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c74009710 con 0x7f3c800a6f80 2023-07-21T07:35:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.247+0000 7f3c7cff9700 1 -- 172.21.15.6:0/1424402720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7400c850 con 0x7f3c800a6f80 2023-07-21T07:35:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.247+0000 7f3c8694c700 1 -- 172.21.15.6:0/1424402720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8014cdb0 con 0x7f3c800a6f80 2023-07-21T07:35:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.247+0000 7f3c7cff9700 1 -- 172.21.15.6:0/1424402720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400cbc0 con 0x7f3c800a6f80 2023-07-21T07:35:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.247+0000 7f3c8694c700 1 -- 172.21.15.6:0/1424402720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8014d370 con 0x7f3c800a6f80 2023-07-21T07:35:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.247+0000 7f3c8694c700 1 -- 172.21.15.6:0/1424402720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c80074500 con 0x7f3c800a6f80 2023-07-21T07:35:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.249+0000 7f3c7cff9700 1 -- 172.21.15.6:0/1424402720 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c7400cd20 con 0x7f3c800a6f80 2023-07-21T07:35:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.249+0000 7f3c7cff9700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3c6c06ace0 0x7f3c6c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.249+0000 7f3c7cff9700 1 -- 172.21.15.6:0/1424402720 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f3c7408a080 con 0x7f3c800a6f80 2023-07-21T07:35:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.249+0000 7f3c7ffff700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3c6c06ace0 0x7f3c6c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.250+0000 7f3c7ffff700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3c6c06ace0 0x7f3c6c06d1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3c70000f60 tx=0x7f3c70009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.252+0000 7f3c7cff9700 1 -- 172.21.15.6:0/1424402720 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3c74058940 con 0x7f3c800a6f80 2023-07-21T07:35:56.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.447+0000 7f3c8694c700 1 -- 172.21.15.6:0/1424402720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c801567a0 con 0x7f3c800a6f80 2023-07-21T07:35:56.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.448+0000 7f3c7cff9700 1 -- 172.21.15.6:0/1424402720 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c740584d0 con 0x7f3c800a6f80 2023-07-21T07:35:56.500 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:35:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.450+0000 7f3c8694c700 1 -- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3c6c06ace0 msgr2=0x7f3c6c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.450+0000 7f3c8694c700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3c6c06ace0 0x7f3c6c06d1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3c70000f60 tx=0x7f3c70009040 comp rx=0 tx=0).stop 2023-07-21T07:35:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.450+0000 7f3c8694c700 1 -- 172.21.15.6:0/1424402720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c800a6f80 msgr2=0x7f3c8006b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.450+0000 7f3c8694c700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c800a6f80 0x7f3c8006b1a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400e9b0 tx=0x7f3c7400ed70 comp rx=0 tx=0).stop 2023-07-21T07:35:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.450+0000 7f3c8694c700 1 -- 172.21.15.6:0/1424402720 shutdown_connections 2023-07-21T07:35:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.450+0000 7f3c8694c700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3c6c06ace0 0x7f3c6c06d1a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.450+0000 7f3c8694c700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c800c4120 0x7f3c801ecc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.450+0000 7f3c8694c700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c80072160 0x7f3c80149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.450+0000 7f3c8694c700 1 --2- 172.21.15.6:0/1424402720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c800a6f80 0x7f3c8006b1a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.450+0000 7f3c8694c700 1 -- 172.21.15.6:0/1424402720 >> 172.21.15.6:0/1424402720 conn(0x7f3c800c7b50 msgr2=0x7f3c800c64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:56.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.450+0000 7f3c8694c700 1 -- 172.21.15.6:0/1424402720 shutdown_connections 2023-07-21T07:35:56.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.450+0000 7f3c8694c700 1 -- 172.21.15.6:0/1424402720 wait complete. 2023-07-21T07:35:56.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:35:56.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.589+0000 7f3bc3d30700 1 Processor -- start 2023-07-21T07:35:56.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.589+0000 7f3bc3d30700 1 -- start start 2023-07-21T07:35:56.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.590+0000 7f3bc3d30700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3bbc151c20 0x7f3bbc0c0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.590+0000 7f3bc3d30700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bbc155000 0x7f3bbc0c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.590+0000 7f3bc3d30700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc0c5a50 con 0x7f3bbc157b70 2023-07-21T07:35:56.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.590+0000 7f3bc3d30700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bbc0c8800 con 0x7f3bbc151c20 2023-07-21T07:35:56.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.590+0000 7f3bc3d30700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc152000 con 0x7f3bbc155000 2023-07-21T07:35:56.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.590+0000 7f3bc22cd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3bbc157b70 0x7f3bbc158020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42950/0 (socket says 172.21.15.6:42950) 2023-07-21T07:35:56.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.590+0000 7f3bc22cd700 1 -- 172.21.15.6:0/3836900803 learned_addr learned my addr 172.21.15.6:0/3836900803 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:56.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc12cb700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bbc155000 0x7f3bbc0c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc1acc700 1 --2- 172.21.15.6:0/3836900803 >> v2:172.21.15.86:3300/0 conn(0x7f3bbc151c20 0x7f3bbc0c0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037993348 0 0) 0x7f3bbc0c5a50 con 0x7f3bbc157b70 2023-07-21T07:35:56.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ba80035b0 con 0x7f3bbc157b70 2023-07-21T07:35:56.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1871957983 0 0) 0x7f3ba80035b0 con 0x7f3bbc157b70 2023-07-21T07:35:56.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bbc155000 msgr2=0x7f3bbc0c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:56.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bbc155000 0x7f3bbc0c13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 >> v2:172.21.15.86:3300/0 conn(0x7f3bbc151c20 msgr2=0x7f3bbc0c0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:56.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 --2- 172.21.15.6:0/3836900803 >> v2:172.21.15.86:3300/0 conn(0x7f3bbc151c20 0x7f3bbc0c0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0c18e0 con 0x7f3bbc157b70 2023-07-21T07:35:56.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f3bb40019f0 con 0x7f3bbc157b70 2023-07-21T07:35:56.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc12cb700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bbc155000 0x7f3bbc0c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:35:56.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 >> v1:172.21.15.6:6789/0 conn(0x7f3bbc157b70 legacy=0x7f3bbc158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba8003a00 0x7f3ba8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba8004850 0x7f3ba8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bbc155000 0x7f3ba8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0c8800 con 0x7f3ba8003a00 2023-07-21T07:35:56.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc152000 con 0x7f3ba8004850 2023-07-21T07:35:56.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba800ba10 con 0x7f3bbc155000 2023-07-21T07:35:56.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc1acc700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba8003a00 0x7f3ba8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc12cb700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba8004850 0x7f3ba8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc22cd700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bbc155000 0x7f3ba8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.591+0000 7f3bc1acc700 1 -- 172.21.15.6:0/3836900803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bbc155000 msgr2=0x7f3ba8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc1acc700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bbc155000 0x7f3ba8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc1acc700 1 -- 172.21.15.6:0/3836900803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba8004850 msgr2=0x7f3ba8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc1acc700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba8004850 0x7f3ba8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc1acc700 1 -- 172.21.15.6:0/3836900803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80094a0 con 0x7f3ba8003a00 2023-07-21T07:35:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc22cd700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bbc155000 0x7f3ba8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc1acc700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba8003a00 0x7f3ba8003e20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009b60 tx=0x7f3ba8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe423bd863c8ed06 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00e6c0 con 0x7f3ba8003a00 2023-07-21T07:35:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00e820 con 0x7f3ba8003a00 2023-07-21T07:35:56.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc0aca700 1 -- 172.21.15.6:0/3836900803 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00eb90 con 0x7f3ba8003a00 2023-07-21T07:35:56.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc3d30700 1 -- 172.21.15.6:0/3836900803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba8003a00 msgr2=0x7f3ba8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc3d30700 1 --2- 172.21.15.6:0/3836900803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ba8003a00 0x7f3ba8003e20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009b60 tx=0x7f3ba8005880 comp rx=0 tx=0).stop 2023-07-21T07:35:56.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc22cd700 1 -- 172.21.15.6:0/3836900803 reap_dead start 2023-07-21T07:35:56.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc3d30700 1 -- 172.21.15.6:0/3836900803 shutdown_connections 2023-07-21T07:35:56.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.592+0000 7f3bc3d30700 1 -- 172.21.15.6:0/3836900803 >> 172.21.15.6:0/3836900803 conn(0x7f3bbc0c7b50 msgr2=0x7f3bbc0c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:56.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.593+0000 7f3bc3d30700 1 -- 172.21.15.6:0/3836900803 shutdown_connections 2023-07-21T07:35:56.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.593+0000 7f3bc3d30700 1 -- 172.21.15.6:0/3836900803 wait complete. 2023-07-21T07:35:56.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.594+0000 7f3bc3d30700 1 Processor -- start 2023-07-21T07:35:56.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.594+0000 7f3bc3d30700 1 -- start start 2023-07-21T07:35:56.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.594+0000 7f3bc3d30700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ba8003a00 0x7f3bbc14c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.594+0000 7f3bc3d30700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bbc06ef40 0x7f3bbc1558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.594+0000 7f3bc3d30700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bbc06bb60 0x7f3bbc155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.594+0000 7f3bc3d30700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc06caf0 con 0x7f3bbc06bb60 2023-07-21T07:35:56.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.594+0000 7f3bc3d30700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc06b7e0 con 0x7f3bbc06ef40 2023-07-21T07:35:56.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.594+0000 7f3bc3d30700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc156650 con 0x7f3ba8003a00 2023-07-21T07:35:56.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bc22cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bbc06bb60 0x7f3bbc155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bc22cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bbc06bb60 0x7f3bbc155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34942/0 (socket says 172.21.15.6:34942) 2023-07-21T07:35:56.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bc22cd700 1 -- 172.21.15.6:0/664588350 learned_addr learned my addr 172.21.15.6:0/664588350 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:56.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bc1acc700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ba8003a00 0x7f3bbc14c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bc12cb700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bbc06ef40 0x7f3bbc1558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bc22cd700 1 -- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ba8003a00 msgr2=0x7f3bbc14c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bc22cd700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ba8003a00 0x7f3bbc14c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bc22cd700 1 -- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bbc06ef40 msgr2=0x7f3bbc1558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bc22cd700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bbc06ef40 0x7f3bbc1558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bc22cd700 1 -- 172.21.15.6:0/664588350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0c2b90 con 0x7f3bbc06bb60 2023-07-21T07:35:56.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bc22cd700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bbc06bb60 0x7f3bbc155df0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc067a60 tx=0x7f3bb400e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:56.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bb27fc700 1 -- 172.21.15.6:0/664588350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400ec20 con 0x7f3bbc06bb60 2023-07-21T07:35:56.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bb27fc700 1 -- 172.21.15.6:0/664588350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb400ed80 con 0x7f3bbc06bb60 2023-07-21T07:35:56.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bb27fc700 1 -- 172.21.15.6:0/664588350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4013660 con 0x7f3bbc06bb60 2023-07-21T07:35:56.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bc3d30700 1 -- 172.21.15.6:0/664588350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bbc14ca10 con 0x7f3bbc06bb60 2023-07-21T07:35:56.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.595+0000 7f3bc3d30700 1 -- 172.21.15.6:0/664588350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc157210 con 0x7f3bbc06bb60 2023-07-21T07:35:56.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.596+0000 7f3bc3d30700 1 -- 172.21.15.6:0/664588350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc157070 con 0x7f3bbc06bb60 2023-07-21T07:35:56.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.597+0000 7f3bb27fc700 1 -- 172.21.15.6:0/664588350 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3bb40137c0 con 0x7f3bbc06bb60 2023-07-21T07:35:56.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.597+0000 7f3bb27fc700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3ba006ad10 0x7f3ba006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.597+0000 7f3bb27fc700 1 -- 172.21.15.6:0/664588350 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f3bb4089d10 con 0x7f3bbc06bb60 2023-07-21T07:35:56.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.597+0000 7f3bc1acc700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3ba006ad10 0x7f3ba006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.598+0000 7f3bc1acc700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3ba006ad10 0x7f3ba006d1d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0090b0 tx=0x7f3bac01f040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:56.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.601+0000 7f3bb27fc700 1 -- 172.21.15.6:0/664588350 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3bbc157070 con 0x7f3bbc06bb60 2023-07-21T07:35:56.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.799+0000 7f3bc3d30700 1 -- 172.21.15.6:0/664588350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3bbc157070 con 0x7f3bbc06bb60 2023-07-21T07:35:56.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.799+0000 7f3bb27fc700 1 -- 172.21.15.6:0/664588350 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3bbc157070 con 0x7f3bbc06bb60 2023-07-21T07:35:56.851 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:35:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.801+0000 7f3bc3d30700 1 -- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3ba006ad10 msgr2=0x7f3ba006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.801+0000 7f3bc3d30700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3ba006ad10 0x7f3ba006d1d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0090b0 tx=0x7f3bac01f040 comp rx=0 tx=0).stop 2023-07-21T07:35:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.801+0000 7f3bc3d30700 1 -- 172.21.15.6:0/664588350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bbc06bb60 msgr2=0x7f3bbc155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.801+0000 7f3bc3d30700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bbc06bb60 0x7f3bbc155df0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc067a60 tx=0x7f3bb400e440 comp rx=0 tx=0).stop 2023-07-21T07:35:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.801+0000 7f3bc3d30700 1 -- 172.21.15.6:0/664588350 shutdown_connections 2023-07-21T07:35:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.801+0000 7f3bc3d30700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f3ba006ad10 0x7f3ba006d1d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.801+0000 7f3bc3d30700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bbc06bb60 0x7f3bbc155df0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.801+0000 7f3bc3d30700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ba8003a00 0x7f3bbc14c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.801+0000 7f3bc3d30700 1 --2- 172.21.15.6:0/664588350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bbc06ef40 0x7f3bbc1558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.801+0000 7f3bc3d30700 1 -- 172.21.15.6:0/664588350 >> 172.21.15.6:0/664588350 conn(0x7f3bbc0c7b50 msgr2=0x7f3bbc1dec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:56.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.801+0000 7f3bc3d30700 1 -- 172.21.15.6:0/664588350 shutdown_connections 2023-07-21T07:35:56.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.801+0000 7f3bc3d30700 1 -- 172.21.15.6:0/664588350 wait complete. 2023-07-21T07:35:56.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:35:56.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.942+0000 7f7d6e49a700 1 Processor -- start 2023-07-21T07:35:56.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.942+0000 7f7d6e49a700 1 -- start start 2023-07-21T07:35:56.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d6e49a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d6806a300 0x7f7d681519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d6e49a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d6806d8a0 0x7f7d68151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:56.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d6e49a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d68155530 con 0x7f7d680ba140 2023-07-21T07:35:56.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d6e49a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d680c1a30 con 0x7f7d6806d8a0 2023-07-21T07:35:56.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d6e49a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d68154920 con 0x7f7d6806a300 2023-07-21T07:35:56.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d6ca37700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d6806d8a0 0x7f7d68151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d6ca37700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d6806d8a0 0x7f7d68151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34948/0 (socket says 172.21.15.6:34948) 2023-07-21T07:35:56.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d6ca37700 1 -- 172.21.15.6:0/2688086649 learned_addr learned my addr 172.21.15.6:0/2688086649 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:56.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d677fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7d680ba140 0x7f7d680c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42966/0 (socket says 172.21.15.6:42966) 2023-07-21T07:35:56.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d67fff700 1 --2- 172.21.15.6:0/2688086649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d6806a300 0x7f7d681519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:56.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d6ca37700 1 -- 172.21.15.6:0/2688086649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d6806a300 msgr2=0x7f7d681519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:56.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d6ca37700 1 --2- 172.21.15.6:0/2688086649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d6806a300 0x7f7d681519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d6ca37700 1 -- 172.21.15.6:0/2688086649 >> v1:172.21.15.6:6789/0 conn(0x7f7d680ba140 legacy=0x7f7d680c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d6ca37700 1 -- 172.21.15.6:0/2688086649 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d68154c00 con 0x7f7d6806d8a0 2023-07-21T07:35:56.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d66ffd700 1 -- 172.21.15.6:0/2688086649 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878122522 0 0) 0x7f7d68155530 con 0x7f7d680ba140 2023-07-21T07:35:56.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.943+0000 7f7d6ca37700 1 --2- 172.21.15.6:0/2688086649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6806d8a0 0x7f7d68151ef0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009e50 tx=0x7f7d6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce1271ad019e725 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:56.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.944+0000 7f7d66ffd700 1 -- 172.21.15.6:0/2688086649 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000e070 con 0x7f7d6806d8a0 2023-07-21T07:35:56.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.944+0000 7f7d66ffd700 1 -- 172.21.15.6:0/2688086649 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000b9c0 con 0x7f7d6806d8a0 2023-07-21T07:35:56.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.944+0000 7f7d66ffd700 1 -- 172.21.15.6:0/2688086649 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000bd70 con 0x7f7d6806d8a0 2023-07-21T07:35:56.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.944+0000 7f7d6e49a700 1 -- 172.21.15.6:0/2688086649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6806d8a0 msgr2=0x7f7d68151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:56.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.944+0000 7f7d6e49a700 1 --2- 172.21.15.6:0/2688086649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6806d8a0 0x7f7d68151ef0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009e50 tx=0x7f7d6000b330 comp rx=0 tx=0).stop 2023-07-21T07:35:56.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.944+0000 7f7d6e49a700 1 -- 172.21.15.6:0/2688086649 shutdown_connections 2023-07-21T07:35:56.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.944+0000 7f7d6e49a700 1 --2- 172.21.15.6:0/2688086649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6806d8a0 0x7f7d68151ef0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:56.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.944+0000 7f7d6e49a700 1 --2- 172.21.15.6:0/2688086649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d6806a300 0x7f7d681519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.944+0000 7f7d6e49a700 1 -- 172.21.15.6:0/2688086649 >> 172.21.15.6:0/2688086649 conn(0x7f7d680a8660 msgr2=0x7f7d680a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:57.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.944+0000 7f7d6e49a700 1 -- 172.21.15.6:0/2688086649 shutdown_connections 2023-07-21T07:35:57.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.944+0000 7f7d6e49a700 1 -- 172.21.15.6:0/2688086649 wait complete. 2023-07-21T07:35:57.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.945+0000 7f7d6e49a700 1 Processor -- start 2023-07-21T07:35:57.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.946+0000 7f7d6e49a700 1 -- start start 2023-07-21T07:35:57.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.946+0000 7f7d6e49a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6806a300 0x7f7d6814f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.946+0000 7f7d6e49a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d6806d8a0 0x7f7d680718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.946+0000 7f7d6e49a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d680ba140 0x7f7d680b9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.946+0000 7f7d6e49a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6814d430 con 0x7f7d6806a300 2023-07-21T07:35:57.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.946+0000 7f7d6e49a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d681ea5b0 con 0x7f7d680ba140 2023-07-21T07:35:57.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.946+0000 7f7d6e49a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d681ea890 con 0x7f7d6806d8a0 2023-07-21T07:35:57.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.946+0000 7f7d67fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6806a300 0x7f7d6814f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.946+0000 7f7d67fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6806a300 0x7f7d6814f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34950/0 (socket says 172.21.15.6:34950) 2023-07-21T07:35:57.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d67fff700 1 -- 172.21.15.6:0/111295017 learned_addr learned my addr 172.21.15.6:0/111295017 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:57.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d677fe700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d6806d8a0 0x7f7d680718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d6ca37700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d680ba140 0x7f7d680b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d67fff700 1 -- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d6806d8a0 msgr2=0x7f7d680718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d67fff700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d6806d8a0 0x7f7d680718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d67fff700 1 -- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d680ba140 msgr2=0x7f7d680b9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d67fff700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d680ba140 0x7f7d680b9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d67fff700 1 -- 172.21.15.6:0/111295017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60009b30 con 0x7f7d6806a300 2023-07-21T07:35:57.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d6ca37700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d680ba140 0x7f7d680b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:57.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d67fff700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6806a300 0x7f7d6814f810 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000d800 tx=0x7f7d5000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:57.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d64ff9700 1 -- 172.21.15.6:0/111295017 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d500125f0 con 0x7f7d6806a300 2023-07-21T07:35:57.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d64ff9700 1 -- 172.21.15.6:0/111295017 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d50012750 con 0x7f7d6806a300 2023-07-21T07:35:57.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d6e49a700 1 -- 172.21.15.6:0/111295017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d681eab70 con 0x7f7d6806a300 2023-07-21T07:35:57.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d64ff9700 1 -- 172.21.15.6:0/111295017 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d50012b00 con 0x7f7d6806a300 2023-07-21T07:35:57.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.947+0000 7f7d6e49a700 1 -- 172.21.15.6:0/111295017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d681ed5e0 con 0x7f7d6806a300 2023-07-21T07:35:57.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.948+0000 7f7d6e49a700 1 -- 172.21.15.6:0/111295017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d681ed7a0 con 0x7f7d6806a300 2023-07-21T07:35:57.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.949+0000 7f7d64ff9700 1 -- 172.21.15.6:0/111295017 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7d50012c60 con 0x7f7d6806a300 2023-07-21T07:35:57.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.949+0000 7f7d64ff9700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7d4806ace0 0x7f7d4806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.949+0000 7f7d64ff9700 1 -- 172.21.15.6:0/111295017 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f7d50089ab0 con 0x7f7d6806a300 2023-07-21T07:35:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.950+0000 7f7d677fe700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7d4806ace0 0x7f7d4806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.950+0000 7f7d677fe700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7d4806ace0 0x7f7d4806d1a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7d680c33a0 tx=0x7f7d58007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:56.954+0000 7f7d64ff9700 1 -- 172.21.15.6:0/111295017 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7d50054890 con 0x7f7d6806a300 2023-07-21T07:35:57.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.151+0000 7f7d6e49a700 1 -- 172.21.15.6:0/111295017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d6804e470 con 0x7f7d6806a300 2023-07-21T07:35:57.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.151+0000 7f7d64ff9700 1 -- 172.21.15.6:0/111295017 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7d50057eb0 con 0x7f7d6806a300 2023-07-21T07:35:57.204 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:35:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.153+0000 7f7d6e49a700 1 -- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7d4806ace0 msgr2=0x7f7d4806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.153+0000 7f7d6e49a700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7d4806ace0 0x7f7d4806d1a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7d680c33a0 tx=0x7f7d58007de0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.153+0000 7f7d6e49a700 1 -- 172.21.15.6:0/111295017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6806a300 msgr2=0x7f7d6814f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.153+0000 7f7d6e49a700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6806a300 0x7f7d6814f810 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000d800 tx=0x7f7d5000db10 comp rx=0 tx=0).stop 2023-07-21T07:35:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.153+0000 7f7d6e49a700 1 -- 172.21.15.6:0/111295017 shutdown_connections 2023-07-21T07:35:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.153+0000 7f7d6e49a700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7d4806ace0 0x7f7d4806d1a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.153+0000 7f7d6e49a700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d680ba140 0x7f7d680b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.153+0000 7f7d6e49a700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6806a300 0x7f7d6814f810 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.153+0000 7f7d6e49a700 1 --2- 172.21.15.6:0/111295017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d6806d8a0 0x7f7d680718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.153+0000 7f7d6e49a700 1 -- 172.21.15.6:0/111295017 >> 172.21.15.6:0/111295017 conn(0x7f7d680a8660 msgr2=0x7f7d680c4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.154+0000 7f7d6e49a700 1 -- 172.21.15.6:0/111295017 shutdown_connections 2023-07-21T07:35:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.154+0000 7f7d6e49a700 1 -- 172.21.15.6:0/111295017 wait complete. 2023-07-21T07:35:57.218 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:35:57.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.294+0000 7f976276b700 1 Processor -- start 2023-07-21T07:35:57.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.294+0000 7f976276b700 1 -- start start 2023-07-21T07:35:57.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.294+0000 7f976276b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f975c06a300 0x7f975c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.294+0000 7f976276b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f975c0ba140 0x7f975c151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.294+0000 7f976276b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f975c06d8a0 0x7f975c0c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.294+0000 7f976276b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c0c1a30 con 0x7f975c06d8a0 2023-07-21T07:35:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.294+0000 7f976276b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c155530 con 0x7f975c0ba140 2023-07-21T07:35:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.294+0000 7f976276b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c154920 con 0x7f975c06a300 2023-07-21T07:35:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f9760d08700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f975c06d8a0 0x7f975c0c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f9760d08700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f975c06d8a0 0x7f975c0c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34962/0 (socket says 172.21.15.6:34962) 2023-07-21T07:35:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f9760d08700 1 -- 172.21.15.6:0/3892389019 learned_addr learned my addr 172.21.15.6:0/3892389019 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f975bfff700 1 --2- 172.21.15.6:0/3892389019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f975c06a300 0x7f975c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f975b7fe700 1 --2- 172.21.15.6:0/3892389019 >> v2:172.21.15.86:3300/0 conn(0x7f975c0ba140 0x7f975c151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f9760d08700 1 -- 172.21.15.6:0/3892389019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f975c06a300 msgr2=0x7f975c1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f9760d08700 1 --2- 172.21.15.6:0/3892389019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f975c06a300 0x7f975c1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f9760d08700 1 -- 172.21.15.6:0/3892389019 >> v2:172.21.15.86:3300/0 conn(0x7f975c0ba140 msgr2=0x7f975c151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:57.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f9760d08700 1 --2- 172.21.15.6:0/3892389019 >> v2:172.21.15.86:3300/0 conn(0x7f975c0ba140 0x7f975c151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f9760d08700 1 -- 172.21.15.6:0/3892389019 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c154c00 con 0x7f975c06d8a0 2023-07-21T07:35:57.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f9760d08700 1 --2- 172.21.15.6:0/3892389019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c06d8a0 0x7f975c0c4a40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f975c0c4630 tx=0x7f975400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b067499fdacb65 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:57.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f975affd700 1 -- 172.21.15.6:0/3892389019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975400e070 con 0x7f975c06d8a0 2023-07-21T07:35:57.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f975affd700 1 -- 172.21.15.6:0/3892389019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975400b910 con 0x7f975c06d8a0 2023-07-21T07:35:57.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.295+0000 7f975affd700 1 -- 172.21.15.6:0/3892389019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975400bcc0 con 0x7f975c06d8a0 2023-07-21T07:35:57.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.296+0000 7f976276b700 1 -- 172.21.15.6:0/3892389019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c06d8a0 msgr2=0x7f975c0c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.296+0000 7f976276b700 1 --2- 172.21.15.6:0/3892389019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c06d8a0 0x7f975c0c4a40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f975c0c4630 tx=0x7f975400b330 comp rx=0 tx=0).stop 2023-07-21T07:35:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.296+0000 7f976276b700 1 -- 172.21.15.6:0/3892389019 shutdown_connections 2023-07-21T07:35:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.296+0000 7f976276b700 1 --2- 172.21.15.6:0/3892389019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c06d8a0 0x7f975c0c4a40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.296+0000 7f976276b700 1 --2- 172.21.15.6:0/3892389019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f975c06a300 0x7f975c1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.296+0000 7f976276b700 1 --2- 172.21.15.6:0/3892389019 >> v2:172.21.15.86:3300/0 conn(0x7f975c0ba140 0x7f975c151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.296+0000 7f976276b700 1 -- 172.21.15.6:0/3892389019 >> 172.21.15.6:0/3892389019 conn(0x7f975c0a8660 msgr2=0x7f975c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.296+0000 7f976276b700 1 -- 172.21.15.6:0/3892389019 shutdown_connections 2023-07-21T07:35:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.296+0000 7f976276b700 1 -- 172.21.15.6:0/3892389019 wait complete. 2023-07-21T07:35:57.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.297+0000 7f976276b700 1 Processor -- start 2023-07-21T07:35:57.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.298+0000 7f976276b700 1 -- start start 2023-07-21T07:35:57.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.298+0000 7f976276b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f975c06a300 0x7f975c1e58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.298+0000 7f976276b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c06d8a0 0x7f975c14d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.298+0000 7f976276b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f975c0ba140 0x7f975c14db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f976276b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c0be300 con 0x7f975c06d8a0 2023-07-21T07:35:57.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f976276b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c0b99b0 con 0x7f975c06a300 2023-07-21T07:35:57.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f976276b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c0b96d0 con 0x7f975c0ba140 2023-07-21T07:35:57.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f975b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c06d8a0 0x7f975c14d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f975b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c06d8a0 0x7f975c14d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34966/0 (socket says 172.21.15.6:34966) 2023-07-21T07:35:57.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f975b7fe700 1 -- 172.21.15.6:0/1166273342 learned_addr learned my addr 172.21.15.6:0/1166273342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:57.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f975bfff700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f975c06a300 0x7f975c1e58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f9760d08700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f975c0ba140 0x7f975c14db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f975b7fe700 1 -- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f975c0ba140 msgr2=0x7f975c14db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f975b7fe700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f975c0ba140 0x7f975c14db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f975b7fe700 1 -- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f975c06a300 msgr2=0x7f975c1e58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f975b7fe700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f975c06a300 0x7f975c1e58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f975b7fe700 1 -- 172.21.15.6:0/1166273342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9754009b30 con 0x7f975c06d8a0 2023-07-21T07:35:57.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f9760d08700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f975c0ba140 0x7f975c14db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:35:57.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f975b7fe700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c06d8a0 0x7f975c14d620 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f975000e9b0 tx=0x7f975000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:57.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f9758ff9700 1 -- 172.21.15.6:0/1166273342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750009710 con 0x7f975c06d8a0 2023-07-21T07:35:57.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f9758ff9700 1 -- 172.21.15.6:0/1166273342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975000c850 con 0x7f975c06d8a0 2023-07-21T07:35:57.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f9758ff9700 1 -- 172.21.15.6:0/1166273342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000cbc0 con 0x7f975c06d8a0 2023-07-21T07:35:57.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f976276b700 1 -- 172.21.15.6:0/1166273342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c0bdcb0 con 0x7f975c06d8a0 2023-07-21T07:35:57.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.299+0000 7f976276b700 1 -- 172.21.15.6:0/1166273342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c0c41c0 con 0x7f975c06d8a0 2023-07-21T07:35:57.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.300+0000 7f976276b700 1 -- 172.21.15.6:0/1166273342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c06a6e0 con 0x7f975c06d8a0 2023-07-21T07:35:57.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.301+0000 7f9758ff9700 1 -- 172.21.15.6:0/1166273342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f975000cd20 con 0x7f975c06d8a0 2023-07-21T07:35:57.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.301+0000 7f9758ff9700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f974806ace0 0x7f974806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.301+0000 7f9758ff9700 1 -- 172.21.15.6:0/1166273342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f97500898c0 con 0x7f975c06d8a0 2023-07-21T07:35:57.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.301+0000 7f975bfff700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f974806ace0 0x7f974806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.302+0000 7f975bfff700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f974806ace0 0x7f974806d1a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f974c009a50 tx=0x7f974c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:57.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.305+0000 7f9758ff9700 1 -- 172.21.15.6:0/1166273342 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9750058130 con 0x7f975c06d8a0 2023-07-21T07:35:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.502+0000 7f976276b700 1 -- 172.21.15.6:0/1166273342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f975c074500 con 0x7f975c06d8a0 2023-07-21T07:35:57.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.503+0000 7f9758ff9700 1 -- 172.21.15.6:0/1166273342 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9750057cc0 con 0x7f975c06d8a0 2023-07-21T07:35:57.555 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:35:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.505+0000 7f976276b700 1 -- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f974806ace0 msgr2=0x7f974806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.505+0000 7f976276b700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f974806ace0 0x7f974806d1a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f974c009a50 tx=0x7f974c008040 comp rx=0 tx=0).stop 2023-07-21T07:35:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.505+0000 7f976276b700 1 -- 172.21.15.6:0/1166273342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c06d8a0 msgr2=0x7f975c14d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.505+0000 7f976276b700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c06d8a0 0x7f975c14d620 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f975000e9b0 tx=0x7f975000ed70 comp rx=0 tx=0).stop 2023-07-21T07:35:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.505+0000 7f976276b700 1 -- 172.21.15.6:0/1166273342 shutdown_connections 2023-07-21T07:35:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.505+0000 7f976276b700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f974806ace0 0x7f974806d1a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.505+0000 7f976276b700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f975c0ba140 0x7f975c14db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.505+0000 7f976276b700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f975c06a300 0x7f975c1e58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.505+0000 7f976276b700 1 --2- 172.21.15.6:0/1166273342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c06d8a0 0x7f975c14d620 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.505+0000 7f976276b700 1 -- 172.21.15.6:0/1166273342 >> 172.21.15.6:0/1166273342 conn(0x7f975c0a8660 msgr2=0x7f975c151780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:57.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.505+0000 7f976276b700 1 -- 172.21.15.6:0/1166273342 shutdown_connections 2023-07-21T07:35:57.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.505+0000 7f976276b700 1 -- 172.21.15.6:0/1166273342 wait complete. 2023-07-21T07:35:57.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-21T07:35:57.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.645+0000 7f78b0bba700 1 Processor -- start 2023-07-21T07:35:57.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.645+0000 7f78b0bba700 1 -- start start 2023-07-21T07:35:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78b0bba700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78ac0c0dc0 0x7f78ac0c3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78b0bba700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f78ac1547c0 0x7f78ac154c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78b0bba700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ac06e3a0 con 0x7f78ac0a5e20 2023-07-21T07:35:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78b0bba700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ac06d3d0 con 0x7f78ac1547c0 2023-07-21T07:35:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78b0bba700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac06d6b0 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78aad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f78ac1547c0 0x7f78ac154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78aad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f78ac1547c0 0x7f78ac154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34976/0 (socket says 172.21.15.6:34976) 2023-07-21T07:35:57.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78aa59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f78ac0a5e20 0x7f78ac0c2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42992/0 (socket says 172.21.15.6:42992) 2023-07-21T07:35:57.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78aad9d700 1 -- 172.21.15.6:0/1804687624 learned_addr learned my addr 172.21.15.6:0/1804687624 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:57.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78a9d9b700 1 --2- 172.21.15.6:0/1804687624 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78ac0c0dc0 0x7f78ac0c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78aad9d700 1 -- 172.21.15.6:0/1804687624 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78ac0c0dc0 msgr2=0x7f78ac0c3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:57.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78aad9d700 1 --2- 172.21.15.6:0/1804687624 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78ac0c0dc0 0x7f78ac0c3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78aad9d700 1 -- 172.21.15.6:0/1804687624 >> v1:172.21.15.6:6789/0 conn(0x7f78ac0a5e20 legacy=0x7f78ac0c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78a959a700 1 -- 172.21.15.6:0/1804687624 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597010095 0 0) 0x7f78ac06e3a0 con 0x7f78ac0a5e20 2023-07-21T07:35:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.646+0000 7f78aad9d700 1 -- 172.21.15.6:0/1804687624 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac06e030 con 0x7f78ac1547c0 2023-07-21T07:35:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.647+0000 7f78aad9d700 1 --2- 172.21.15.6:0/1804687624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ac1547c0 0x7f78ac154c40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009e50 tx=0x7f78a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395bd16790b33c8d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.647+0000 7f78a959a700 1 -- 172.21.15.6:0/1804687624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a400e070 con 0x7f78ac1547c0 2023-07-21T07:35:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.647+0000 7f78a959a700 1 -- 172.21.15.6:0/1804687624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a400b910 con 0x7f78ac1547c0 2023-07-21T07:35:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.647+0000 7f78a959a700 1 -- 172.21.15.6:0/1804687624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a400bcc0 con 0x7f78ac1547c0 2023-07-21T07:35:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.647+0000 7f78b0bba700 1 -- 172.21.15.6:0/1804687624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ac1547c0 msgr2=0x7f78ac154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.647+0000 7f78b0bba700 1 --2- 172.21.15.6:0/1804687624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ac1547c0 0x7f78ac154c40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009e50 tx=0x7f78a400b330 comp rx=0 tx=0).stop 2023-07-21T07:35:57.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.647+0000 7f78b0bba700 1 -- 172.21.15.6:0/1804687624 shutdown_connections 2023-07-21T07:35:57.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.647+0000 7f78b0bba700 1 --2- 172.21.15.6:0/1804687624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ac1547c0 0x7f78ac154c40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.647+0000 7f78b0bba700 1 --2- 172.21.15.6:0/1804687624 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78ac0c0dc0 0x7f78ac0c3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.647+0000 7f78b0bba700 1 -- 172.21.15.6:0/1804687624 >> 172.21.15.6:0/1804687624 conn(0x7f78ac06bac0 msgr2=0x7f78ac0a8660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:57.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.647+0000 7f78b0bba700 1 -- 172.21.15.6:0/1804687624 shutdown_connections 2023-07-21T07:35:57.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.647+0000 7f78b0bba700 1 -- 172.21.15.6:0/1804687624 wait complete. 2023-07-21T07:35:57.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.649+0000 7f78b0bba700 1 Processor -- start 2023-07-21T07:35:57.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.649+0000 7f78b0bba700 1 -- start start 2023-07-21T07:35:57.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.649+0000 7f78b0bba700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78ac0a5e20 0x7f78ac0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.649+0000 7f78b0bba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ac0c0dc0 0x7f78ac153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.649+0000 7f78b0bba700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78ac1547c0 0x7f78ac148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.649+0000 7f78b0bba700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac0c7880 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.649+0000 7f78b0bba700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac14b2a0 con 0x7f78ac1547c0 2023-07-21T07:35:57.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.649+0000 7f78b0bba700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac0c6560 con 0x7f78ac0a5e20 2023-07-21T07:35:57.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.649+0000 7f78a9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ac0c0dc0 0x7f78ac153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.649+0000 7f78a9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ac0c0dc0 0x7f78ac153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34980/0 (socket says 172.21.15.6:34980) 2023-07-21T07:35:57.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.649+0000 7f78a9d9b700 1 -- 172.21.15.6:0/2753611856 learned_addr learned my addr 172.21.15.6:0/2753611856 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:57.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.650+0000 7f78aa59c700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78ac0a5e20 0x7f78ac0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.650+0000 7f78aad9d700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78ac1547c0 0x7f78ac148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.650+0000 7f78a9d9b700 1 -- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78ac0a5e20 msgr2=0x7f78ac0c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.650+0000 7f78a9d9b700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78ac0a5e20 0x7f78ac0c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.650+0000 7f78a9d9b700 1 -- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78ac1547c0 msgr2=0x7f78ac148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.650+0000 7f78a9d9b700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78ac1547c0 0x7f78ac148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.650+0000 7f78a9d9b700 1 -- 172.21.15.6:0/2753611856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a4009b30 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.650+0000 7f78a9d9b700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ac0c0dc0 0x7f78ac153e30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f789c00e980 tx=0x7f789c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:57.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.650+0000 7f789affd700 1 -- 172.21.15.6:0/2753611856 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c009710 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.650+0000 7f789affd700 1 -- 172.21.15.6:0/2753611856 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c00c690 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.650+0000 7f78b0bba700 1 -- 172.21.15.6:0/2753611856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ac0c7370 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.650+0000 7f789affd700 1 -- 172.21.15.6:0/2753611856 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00ca20 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.650+0000 7f78b0bba700 1 -- 172.21.15.6:0/2753611856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ac0c75a0 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.651+0000 7f78b0bba700 1 -- 172.21.15.6:0/2753611856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ac04ecc0 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.652+0000 7f789affd700 1 -- 172.21.15.6:0/2753611856 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f789c00cb80 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.652+0000 7f789affd700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f788c06ad10 0x7f788c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:57.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.652+0000 7f789affd700 1 -- 172.21.15.6:0/2753611856 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f789c0896c0 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.652+0000 7f78aa59c700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f788c06ad10 0x7f788c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:57.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.653+0000 7f78aa59c700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f788c06ad10 0x7f788c06d1d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f78a0000f60 tx=0x7f78a0007e70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.656+0000 7f789affd700 1 -- 172.21.15.6:0/2753611856 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f789c057f30 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.854+0000 7f78b0bba700 1 -- 172.21.15.6:0/2753611856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78ac06de10 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.854+0000 7f789affd700 1 -- 172.21.15.6:0/2753611856 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v40) v1 ==== 105+0+11 (secure 0 0 0) 0x7f789c057ac0 con 0x7f78ac0c0dc0 2023-07-21T07:35:57.907 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:35:57.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.856+0000 7f78b0bba700 1 -- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f788c06ad10 msgr2=0x7f788c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.856+0000 7f78b0bba700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f788c06ad10 0x7f788c06d1d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f78a0000f60 tx=0x7f78a0007e70 comp rx=0 tx=0).stop 2023-07-21T07:35:57.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.856+0000 7f78b0bba700 1 -- 172.21.15.6:0/2753611856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ac0c0dc0 msgr2=0x7f78ac153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:57.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.856+0000 7f78b0bba700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ac0c0dc0 0x7f78ac153e30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f789c00e980 tx=0x7f789c00ec90 comp rx=0 tx=0).stop 2023-07-21T07:35:57.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.856+0000 7f78b0bba700 1 -- 172.21.15.6:0/2753611856 shutdown_connections 2023-07-21T07:35:57.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.856+0000 7f78b0bba700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f788c06ad10 0x7f788c06d1d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.857+0000 7f78b0bba700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78ac1547c0 0x7f78ac148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.857+0000 7f78b0bba700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78ac0a5e20 0x7f78ac0c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.857+0000 7f78b0bba700 1 --2- 172.21.15.6:0/2753611856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ac0c0dc0 0x7f78ac153e30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.857+0000 7f78b0bba700 1 -- 172.21.15.6:0/2753611856 >> 172.21.15.6:0/2753611856 conn(0x7f78ac06bac0 msgr2=0x7f78ac06c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.857+0000 7f78b0bba700 1 -- 172.21.15.6:0/2753611856 shutdown_connections 2023-07-21T07:35:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.857+0000 7f78b0bba700 1 -- 172.21.15.6:0/2753611856 wait complete. 2023-07-21T07:35:57.921 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-21T07:35:58.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.997+0000 7ff019bda700 1 Processor -- start 2023-07-21T07:35:58.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.997+0000 7ff019bda700 1 -- start start 2023-07-21T07:35:58.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff019bda700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff01414c580 0x7ff0140abd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff019bda700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff0140c2260 0x7ff0140aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff019bda700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0140aae10 0x7ff0140ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff019bda700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff014066580 con 0x7ff0140aae10 2023-07-21T07:35:58.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff019bda700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff014152f50 con 0x7ff0140c2260 2023-07-21T07:35:58.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff019bda700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0140a9ac0 con 0x7ff01414c580 2023-07-21T07:35:58.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff013fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0140aae10 0x7ff0140ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff013fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0140aae10 0x7ff0140ab2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34990/0 (socket says 172.21.15.6:34990) 2023-07-21T07:35:58.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff013fff700 1 -- 172.21.15.6:0/1051170194 learned_addr learned my addr 172.21.15.6:0/1051170194 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:58.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff0137fe700 1 --2- 172.21.15.6:0/1051170194 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff01414c580 0x7ff0140abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff012ffd700 1 --2- 172.21.15.6:0/1051170194 >> v2:172.21.15.86:3300/0 conn(0x7ff0140c2260 0x7ff0140aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff013fff700 1 -- 172.21.15.6:0/1051170194 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff01414c580 msgr2=0x7ff0140abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:58.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff013fff700 1 --2- 172.21.15.6:0/1051170194 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff01414c580 0x7ff0140abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff013fff700 1 -- 172.21.15.6:0/1051170194 >> v2:172.21.15.86:3300/0 conn(0x7ff0140c2260 msgr2=0x7ff0140aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:35:58.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff013fff700 1 --2- 172.21.15.6:0/1051170194 >> v2:172.21.15.86:3300/0 conn(0x7ff0140c2260 0x7ff0140aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff013fff700 1 -- 172.21.15.6:0/1051170194 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0140ac280 con 0x7ff0140aae10 2023-07-21T07:35:58.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff012ffd700 1 --2- 172.21.15.6:0/1051170194 >> v2:172.21.15.86:3300/0 conn(0x7ff0140c2260 0x7ff0140aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:58.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff013fff700 1 --2- 172.21.15.6:0/1051170194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0140aae10 0x7ff0140ab2a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff0140c72a0 tx=0x7ff00c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e324d76582e2eef8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:58.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.998+0000 7ff0127fc700 1 -- 172.21.15.6:0/1051170194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00e070 con 0x7ff0140aae10 2023-07-21T07:35:58.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.999+0000 7ff0127fc700 1 -- 172.21.15.6:0/1051170194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c00b910 con 0x7ff0140aae10 2023-07-21T07:35:58.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.999+0000 7ff0127fc700 1 -- 172.21.15.6:0/1051170194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00bcc0 con 0x7ff0140aae10 2023-07-21T07:35:58.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.999+0000 7ff019bda700 1 -- 172.21.15.6:0/1051170194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0140aae10 msgr2=0x7ff0140ab2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.999+0000 7ff019bda700 1 --2- 172.21.15.6:0/1051170194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0140aae10 0x7ff0140ab2a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff0140c72a0 tx=0x7ff00c00b330 comp rx=0 tx=0).stop 2023-07-21T07:35:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.999+0000 7ff019bda700 1 -- 172.21.15.6:0/1051170194 shutdown_connections 2023-07-21T07:35:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.999+0000 7ff019bda700 1 --2- 172.21.15.6:0/1051170194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0140aae10 0x7ff0140ab2a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.999+0000 7ff019bda700 1 --2- 172.21.15.6:0/1051170194 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff01414c580 0x7ff0140abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.999+0000 7ff019bda700 1 --2- 172.21.15.6:0/1051170194 >> v2:172.21.15.86:3300/0 conn(0x7ff0140c2260 0x7ff0140aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.999+0000 7ff019bda700 1 -- 172.21.15.6:0/1051170194 >> 172.21.15.6:0/1051170194 conn(0x7ff0140c2c20 msgr2=0x7ff0140c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.999+0000 7ff019bda700 1 -- 172.21.15.6:0/1051170194 shutdown_connections 2023-07-21T07:35:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:57.999+0000 7ff019bda700 1 -- 172.21.15.6:0/1051170194 wait complete. 2023-07-21T07:35:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.000+0000 7ff019bda700 1 Processor -- start 2023-07-21T07:35:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.000+0000 7ff019bda700 1 -- start start 2023-07-21T07:35:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff019bda700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0140aae10 0x7ff0141e7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff019bda700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0140c2260 0x7ff0140c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff019bda700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff01414c580 0x7ff0141eb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff019bda700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01414f2d0 con 0x7ff0140aae10 2023-07-21T07:35:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff019bda700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff014156570 con 0x7ff01414c580 2023-07-21T07:35:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff019bda700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff014155d60 con 0x7ff0140c2260 2023-07-21T07:35:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff0137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0140aae10 0x7ff0141e7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff0137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0140aae10 0x7ff0141e7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34992/0 (socket says 172.21.15.6:34992) 2023-07-21T07:35:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff0137fe700 1 -- 172.21.15.6:0/1305616241 learned_addr learned my addr 172.21.15.6:0/1305616241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff012ffd700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0140c2260 0x7ff0140c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff013fff700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff01414c580 0x7ff0141eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff0137fe700 1 -- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0140c2260 msgr2=0x7ff0140c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff0137fe700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0140c2260 0x7ff0140c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff0137fe700 1 -- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff01414c580 msgr2=0x7ff0141eb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff0137fe700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff01414c580 0x7ff0141eb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.001+0000 7ff0137fe700 1 -- 172.21.15.6:0/1305616241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c009b30 con 0x7ff0140aae10 2023-07-21T07:35:58.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.002+0000 7ff0137fe700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0140aae10 0x7ff0141e7ed0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff00400e870 tx=0x7ff00400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:58.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.002+0000 7feffbfff700 1 -- 172.21.15.6:0/1305616241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff004009590 con 0x7ff0140aae10 2023-07-21T07:35:58.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.002+0000 7feffbfff700 1 -- 172.21.15.6:0/1305616241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00400ee70 con 0x7ff0140aae10 2023-07-21T07:35:58.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.002+0000 7ff019bda700 1 -- 172.21.15.6:0/1305616241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff014155fb0 con 0x7ff0140aae10 2023-07-21T07:35:58.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.002+0000 7feffbfff700 1 -- 172.21.15.6:0/1305616241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00400ca50 con 0x7ff0140aae10 2023-07-21T07:35:58.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.002+0000 7ff019bda700 1 -- 172.21.15.6:0/1305616241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0141eabf0 con 0x7ff0140aae10 2023-07-21T07:35:58.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.003+0000 7ff019bda700 1 -- 172.21.15.6:0/1305616241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0141eaf60 con 0x7ff0140aae10 2023-07-21T07:35:58.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.003+0000 7feffbfff700 1 -- 172.21.15.6:0/1305616241 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff00400cbb0 con 0x7ff0140aae10 2023-07-21T07:35:58.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.003+0000 7feffbfff700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff00006ace0 0x7ff00006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.004+0000 7feffbfff700 1 -- 172.21.15.6:0/1305616241 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7ff0040897f0 con 0x7ff0140aae10 2023-07-21T07:35:58.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.004+0000 7ff012ffd700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff00006ace0 0x7ff00006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.004+0000 7ff012ffd700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff00006ace0 0x7ff00006d1a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff01406a400 tx=0x7ff008008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:58.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.008+0000 7feffbfff700 1 -- 172.21.15.6:0/1305616241 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff004057fe0 con 0x7ff0140aae10 2023-07-21T07:35:58.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.205+0000 7ff019bda700 1 -- 172.21.15.6:0/1305616241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7ff0141eaa50 con 0x7ff0140aae10 2023-07-21T07:35:58.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.205+0000 7feffbfff700 1 -- 172.21.15.6:0/1305616241 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v40) v1 ==== 101+0+11 (secure 0 0 0) 0x7ff0141eaa50 con 0x7ff0140aae10 2023-07-21T07:35:58.258 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:35:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.207+0000 7ff019bda700 1 -- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff00006ace0 msgr2=0x7ff00006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.207+0000 7ff019bda700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff00006ace0 0x7ff00006d1a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff01406a400 tx=0x7ff008008040 comp rx=0 tx=0).stop 2023-07-21T07:35:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.207+0000 7ff019bda700 1 -- 172.21.15.6:0/1305616241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0140aae10 msgr2=0x7ff0141e7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.207+0000 7ff019bda700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0140aae10 0x7ff0141e7ed0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff00400e870 tx=0x7ff00400ec30 comp rx=0 tx=0).stop 2023-07-21T07:35:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.207+0000 7ff019bda700 1 -- 172.21.15.6:0/1305616241 shutdown_connections 2023-07-21T07:35:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.207+0000 7ff019bda700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff00006ace0 0x7ff00006d1a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.207+0000 7ff019bda700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff01414c580 0x7ff0141eb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.207+0000 7ff019bda700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0140aae10 0x7ff0141e7ed0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.207+0000 7ff019bda700 1 --2- 172.21.15.6:0/1305616241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0140c2260 0x7ff0140c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.207+0000 7ff019bda700 1 -- 172.21.15.6:0/1305616241 >> 172.21.15.6:0/1305616241 conn(0x7ff0140c2c20 msgr2=0x7ff01406a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.207+0000 7ff019bda700 1 -- 172.21.15.6:0/1305616241 shutdown_connections 2023-07-21T07:35:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.207+0000 7ff019bda700 1 -- 172.21.15.6:0/1305616241 wait complete. 2023-07-21T07:35:58.272 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T07:35:58.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.345+0000 7fab973af700 1 Processor -- start 2023-07-21T07:35:58.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.346+0000 7fab973af700 1 -- start start 2023-07-21T07:35:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.346+0000 7fab973af700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab900a9910 0x7fab900a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.346+0000 7fab973af700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab901548e0 con 0x7fab9006e6f0 2023-07-21T07:35:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.346+0000 7fab973af700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab900c1ec0 con 0x7fab90154450 2023-07-21T07:35:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.346+0000 7fab973af700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9006ec00 con 0x7fab900a9910 2023-07-21T07:35:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.346+0000 7fab9494a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fab9006e6f0 0x7fab900c39a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43020/0 (socket says 172.21.15.6:43020) 2023-07-21T07:35:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab9494a700 1 -- 172.21.15.6:0/4175330839 learned_addr learned my addr 172.21.15.6:0/4175330839 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab9514b700 1 --2- 172.21.15.6:0/4175330839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab900a9910 0x7fab900a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab83fff700 1 -- 172.21.15.6:0/4175330839 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512505448 0 0) 0x7fab901548e0 con 0x7fab9006e6f0 2023-07-21T07:35:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab83fff700 1 -- 172.21.15.6:0/4175330839 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab7c0035b0 con 0x7fab9006e6f0 2023-07-21T07:35:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab83fff700 1 -- 172.21.15.6:0/4175330839 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617531740 0 0) 0x7fab900c1ec0 con 0x7fab90154450 2023-07-21T07:35:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab83fff700 1 -- 172.21.15.6:0/4175330839 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab901548e0 con 0x7fab90154450 2023-07-21T07:35:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab9514b700 1 -- 172.21.15.6:0/4175330839 >> v1:172.21.15.86:6789/0 conn(0x7fab90154450 legacy=0x7fab9015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab83fff700 1 -- 172.21.15.6:0/4175330839 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1513507133 0 0) 0x7fab7c0035b0 con 0x7fab9006e6f0 2023-07-21T07:35:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab9514b700 1 -- 172.21.15.6:0/4175330839 >> v1:172.21.15.6:6789/0 conn(0x7fab9006e6f0 legacy=0x7fab900c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab9514b700 1 -- 172.21.15.6:0/4175330839 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900c40b0 con 0x7fab900a9910 2023-07-21T07:35:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab9514b700 1 --2- 172.21.15.6:0/4175330839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab900a9910 0x7fab900a9cf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009870 tx=0x7fab8c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9cc376d75687e0c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab83fff700 1 -- 172.21.15.6:0/4175330839 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84001670 con 0x7fab900a9910 2023-07-21T07:35:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab83fff700 1 -- 172.21.15.6:0/4175330839 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c004030 con 0x7fab900a9910 2023-07-21T07:35:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.347+0000 7fab83fff700 1 -- 172.21.15.6:0/4175330839 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0043a0 con 0x7fab900a9910 2023-07-21T07:35:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.348+0000 7fab973af700 1 -- 172.21.15.6:0/4175330839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab900a9910 msgr2=0x7fab900a9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.348+0000 7fab973af700 1 --2- 172.21.15.6:0/4175330839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab900a9910 0x7fab900a9cf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009870 tx=0x7fab8c009b80 comp rx=0 tx=0).stop 2023-07-21T07:35:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.348+0000 7fab973af700 1 -- 172.21.15.6:0/4175330839 shutdown_connections 2023-07-21T07:35:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.348+0000 7fab973af700 1 --2- 172.21.15.6:0/4175330839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab900a9910 0x7fab900a9cf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.348+0000 7fab973af700 1 -- 172.21.15.6:0/4175330839 >> 172.21.15.6:0/4175330839 conn(0x7fab9006a270 msgr2=0x7fab9006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.348+0000 7fab973af700 1 -- 172.21.15.6:0/4175330839 shutdown_connections 2023-07-21T07:35:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.348+0000 7fab973af700 1 -- 172.21.15.6:0/4175330839 wait complete. 2023-07-21T07:35:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.349+0000 7fab973af700 1 Processor -- start 2023-07-21T07:35:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.349+0000 7fab973af700 1 -- start start 2023-07-21T07:35:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab973af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9006e6f0 0x7fab900717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab973af700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab900a9910 0x7fab900bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab973af700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab90154450 0x7fab900bcb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab973af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9014a4b0 con 0x7fab9006e6f0 2023-07-21T07:35:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab973af700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab901eddc0 con 0x7fab900a9910 2023-07-21T07:35:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab973af700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab900a7510 con 0x7fab90154450 2023-07-21T07:35:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab9514b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9006e6f0 0x7fab900717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab9514b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9006e6f0 0x7fab900717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35006/0 (socket says 172.21.15.6:35006) 2023-07-21T07:35:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab9514b700 1 -- 172.21.15.6:0/3305779578 learned_addr learned my addr 172.21.15.6:0/3305779578 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab9494a700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab900a9910 0x7fab900bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab9594c700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab90154450 0x7fab900bcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab9514b700 1 -- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab90154450 msgr2=0x7fab900bcb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab9514b700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab90154450 0x7fab900bcb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab9514b700 1 -- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab900a9910 msgr2=0x7fab900bc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab9514b700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab900a9910 0x7fab900bc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab9514b700 1 -- 172.21.15.6:0/3305779578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0094a0 con 0x7fab9006e6f0 2023-07-21T07:35:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab9494a700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab900a9910 0x7fab900bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.350+0000 7fab9594c700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab90154450 0x7fab900bcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:35:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.351+0000 7fab9514b700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9006e6f0 0x7fab900717e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0097c0 tx=0x7fab8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.351+0000 7fab81ffb700 1 -- 172.21.15.6:0/3305779578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0045b0 con 0x7fab9006e6f0 2023-07-21T07:35:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.351+0000 7fab81ffb700 1 -- 172.21.15.6:0/3305779578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c01f070 con 0x7fab9006e6f0 2023-07-21T07:35:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.351+0000 7fab973af700 1 -- 172.21.15.6:0/3305779578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab900a77f0 con 0x7fab9006e6f0 2023-07-21T07:35:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.351+0000 7fab81ffb700 1 -- 172.21.15.6:0/3305779578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c011870 con 0x7fab9006e6f0 2023-07-21T07:35:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.351+0000 7fab973af700 1 -- 172.21.15.6:0/3305779578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab90149e60 con 0x7fab9006e6f0 2023-07-21T07:35:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.352+0000 7fab973af700 1 -- 172.21.15.6:0/3305779578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9004ecc0 con 0x7fab9006e6f0 2023-07-21T07:35:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.352+0000 7fab81ffb700 1 -- 172.21.15.6:0/3305779578 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab8c0119d0 con 0x7fab9006e6f0 2023-07-21T07:35:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.353+0000 7fab81ffb700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab7406ace0 0x7fab7406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.353+0000 7fab81ffb700 1 -- 172.21.15.6:0/3305779578 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fab8c021070 con 0x7fab9006e6f0 2023-07-21T07:35:58.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.353+0000 7fab9494a700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab7406ace0 0x7fab7406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.353+0000 7fab9494a700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab7406ace0 0x7fab7406d1a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fab84001eb0 tx=0x7fab84001c20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:58.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.357+0000 7fab81ffb700 1 -- 172.21.15.6:0/3305779578 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab8c055ee0 con 0x7fab9006e6f0 2023-07-21T07:35:58.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.569+0000 7fab973af700 1 -- 172.21.15.6:0/3305779578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fab900bd6a0 con 0x7fab9006e6f0 2023-07-21T07:35:58.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.569+0000 7fab81ffb700 1 -- 172.21.15.6:0/3305779578 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7fab8c059500 con 0x7fab9006e6f0 2023-07-21T07:35:58.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.571+0000 7fab973af700 1 -- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab7406ace0 msgr2=0x7fab7406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.571+0000 7fab973af700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab7406ace0 0x7fab7406d1a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fab84001eb0 tx=0x7fab84001c20 comp rx=0 tx=0).stop 2023-07-21T07:35:58.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.571+0000 7fab973af700 1 -- 172.21.15.6:0/3305779578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9006e6f0 msgr2=0x7fab900717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.571+0000 7fab973af700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9006e6f0 0x7fab900717e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0097c0 tx=0x7fab8c004750 comp rx=0 tx=0).stop 2023-07-21T07:35:58.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.571+0000 7fab973af700 1 -- 172.21.15.6:0/3305779578 shutdown_connections 2023-07-21T07:35:58.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.571+0000 7fab973af700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fab7406ace0 0x7fab7406d1a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.571+0000 7fab973af700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab90154450 0x7fab900bcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.571+0000 7fab973af700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9006e6f0 0x7fab900717e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.571+0000 7fab973af700 1 --2- 172.21.15.6:0/3305779578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab900a9910 0x7fab900bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.571+0000 7fab973af700 1 -- 172.21.15.6:0/3305779578 >> 172.21.15.6:0/3305779578 conn(0x7fab9006a270 msgr2=0x7fab9014a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.571+0000 7fab973af700 1 -- 172.21.15.6:0/3305779578 shutdown_connections 2023-07-21T07:35:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.571+0000 7fab973af700 1 -- 172.21.15.6:0/3305779578 wait complete. 2023-07-21T07:35:58.627 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-21T07:35:58.636 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-21T07:35:58.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:58.636 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-21T07:35:58.682 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T07:35:58.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:58.682 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T07:35:58.740 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:35:58.740 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:35:58.799 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18692 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-07-21T07:35:58.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T07:35:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.912+0000 7fa825cb2700 1 Processor -- start 2023-07-21T07:35:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.912+0000 7fa825cb2700 1 -- start start 2023-07-21T07:35:58.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.913+0000 7fa825cb2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa82014fa10 0x7fa82006a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.913+0000 7fa825cb2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8200c6cc0 con 0x7fa820066210 2023-07-21T07:35:58.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.913+0000 7fa825cb2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa820152df0 con 0x7fa8200abdb0 2023-07-21T07:35:58.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.913+0000 7fa825cb2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8201530d0 con 0x7fa82014fa10 2023-07-21T07:35:58.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.913+0000 7fa81f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa82014fa10 0x7fa82006a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.913+0000 7fa81ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa820066210 0x7fa8200ab0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43038/0 (socket says 172.21.15.6:43038) 2023-07-21T07:35:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.913+0000 7fa81f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa82014fa10 0x7fa82006a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35014/0 (socket says 172.21.15.6:35014) 2023-07-21T07:35:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.913+0000 7fa81ffff700 1 -- 172.21.15.6:0/1823317596 learned_addr learned my addr 172.21.15.6:0/1823317596 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:35:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.913+0000 7fa81f7fe700 1 -- 172.21.15.6:0/1823317596 >> v1:172.21.15.86:6789/0 conn(0x7fa8200abdb0 legacy=0x7fa8200aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.913+0000 7fa81f7fe700 1 -- 172.21.15.6:0/1823317596 >> v1:172.21.15.6:6789/0 conn(0x7fa820066210 legacy=0x7fa8200ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.913+0000 7fa81f7fe700 1 -- 172.21.15.6:0/1823317596 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8200c6f10 con 0x7fa82014fa10 2023-07-21T07:35:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.914+0000 7fa81f7fe700 1 --2- 172.21.15.6:0/1823317596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa82014fa10 0x7fa82006a090 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa818009d90 tx=0x7fa81800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e679b664ea07f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.914+0000 7fa81e7fc700 1 -- 172.21.15.6:0/1823317596 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81800e070 con 0x7fa82014fa10 2023-07-21T07:35:58.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.914+0000 7fa81e7fc700 1 -- 172.21.15.6:0/1823317596 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81800bbd0 con 0x7fa82014fa10 2023-07-21T07:35:58.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.914+0000 7fa81e7fc700 1 -- 172.21.15.6:0/1823317596 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818012430 con 0x7fa82014fa10 2023-07-21T07:35:58.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.914+0000 7fa825cb2700 1 -- 172.21.15.6:0/1823317596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa82014fa10 msgr2=0x7fa82006a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.914+0000 7fa825cb2700 1 --2- 172.21.15.6:0/1823317596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa82014fa10 0x7fa82006a090 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa818009d90 tx=0x7fa81800b330 comp rx=0 tx=0).stop 2023-07-21T07:35:58.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.914+0000 7fa825cb2700 1 -- 172.21.15.6:0/1823317596 shutdown_connections 2023-07-21T07:35:58.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.914+0000 7fa825cb2700 1 --2- 172.21.15.6:0/1823317596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa82014fa10 0x7fa82006a090 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.914+0000 7fa825cb2700 1 -- 172.21.15.6:0/1823317596 >> 172.21.15.6:0/1823317596 conn(0x7fa8200c6140 msgr2=0x7fa8200c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:58.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.914+0000 7fa825cb2700 1 -- 172.21.15.6:0/1823317596 shutdown_connections 2023-07-21T07:35:58.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.914+0000 7fa825cb2700 1 -- 172.21.15.6:0/1823317596 wait complete. 2023-07-21T07:35:58.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.916+0000 7fa825cb2700 1 Processor -- start 2023-07-21T07:35:58.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.916+0000 7fa825cb2700 1 -- start start 2023-07-21T07:35:58.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.916+0000 7fa825cb2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa820066210 0x7fa8201e8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.916+0000 7fa825cb2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8200abdb0 0x7fa820146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.916+0000 7fa825cb2700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa82014fa10 0x7fa8201540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.916+0000 7fa825cb2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8201e7d90 con 0x7fa820066210 2023-07-21T07:35:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.916+0000 7fa825cb2700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8201ebdb0 con 0x7fa82014fa10 2023-07-21T07:35:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.916+0000 7fa825cb2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8201ec090 con 0x7fa8200abdb0 2023-07-21T07:35:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.916+0000 7fa81f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa820066210 0x7fa8201e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa81f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa820066210 0x7fa8201e8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35020/0 (socket says 172.21.15.6:35020) 2023-07-21T07:35:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa81f7fe700 1 -- 172.21.15.6:0/1753521307 learned_addr learned my addr 172.21.15.6:0/1753521307 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:35:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa81ffff700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa82014fa10 0x7fa8201540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa81effd700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8200abdb0 0x7fa820146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa81f7fe700 1 -- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8200abdb0 msgr2=0x7fa820146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa81f7fe700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8200abdb0 0x7fa820146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa81f7fe700 1 -- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa82014fa10 msgr2=0x7fa8201540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:58.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa81f7fe700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa82014fa10 0x7fa8201540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:58.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa81f7fe700 1 -- 172.21.15.6:0/1753521307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa818009a70 con 0x7fa820066210 2023-07-21T07:35:58.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa81f7fe700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa820066210 0x7fa8201e8850 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa818014040 tx=0x7fa818004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:58.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa817fff700 1 -- 172.21.15.6:0/1753521307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818012e20 con 0x7fa820066210 2023-07-21T07:35:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa817fff700 1 -- 172.21.15.6:0/1753521307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa818020070 con 0x7fa820066210 2023-07-21T07:35:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa825cb2700 1 -- 172.21.15.6:0/1753521307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8201e8050 con 0x7fa820066210 2023-07-21T07:35:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa817fff700 1 -- 172.21.15.6:0/1753521307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818004280 con 0x7fa820066210 2023-07-21T07:35:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.917+0000 7fa825cb2700 1 -- 172.21.15.6:0/1753521307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa820146590 con 0x7fa820066210 2023-07-21T07:35:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.918+0000 7fa825cb2700 1 -- 172.21.15.6:0/1753521307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8201e8570 con 0x7fa820066210 2023-07-21T07:35:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.919+0000 7fa817fff700 1 -- 172.21.15.6:0/1753521307 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa8180043e0 con 0x7fa820066210 2023-07-21T07:35:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.919+0000 7fa817fff700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa80006ace0 0x7fa80006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:35:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.919+0000 7fa817fff700 1 -- 172.21.15.6:0/1753521307 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fa818022070 con 0x7fa820066210 2023-07-21T07:35:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.919+0000 7fa81effd700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa80006ace0 0x7fa80006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:35:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.920+0000 7fa81effd700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa80006ace0 0x7fa80006d1a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa820147a40 tx=0x7fa810009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:35:58.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:58.924+0000 7fa817fff700 1 -- 172.21.15.6:0/1753521307 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa818056570 con 0x7fa820066210 2023-07-21T07:35:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.167+0000 7fa825cb2700 1 -- 172.21.15.6:0/1753521307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa820074500 con 0x7fa820066210 2023-07-21T07:35:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.167+0000 7fa817fff700 1 -- 172.21.15.6:0/1753521307 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7fa818059b90 con 0x7fa820066210 2023-07-21T07:35:59.220 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T07:35:59.220 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-07-21T07:35:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.169+0000 7fa825cb2700 1 -- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa80006ace0 msgr2=0x7fa80006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.169+0000 7fa825cb2700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa80006ace0 0x7fa80006d1a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa820147a40 tx=0x7fa810009040 comp rx=0 tx=0).stop 2023-07-21T07:35:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.169+0000 7fa825cb2700 1 -- 172.21.15.6:0/1753521307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa820066210 msgr2=0x7fa8201e8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:35:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.169+0000 7fa825cb2700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa820066210 0x7fa8201e8850 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa818014040 tx=0x7fa818004ad0 comp rx=0 tx=0).stop 2023-07-21T07:35:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.169+0000 7fa825cb2700 1 -- 172.21.15.6:0/1753521307 shutdown_connections 2023-07-21T07:35:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.169+0000 7fa825cb2700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa80006ace0 0x7fa80006d1a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.169+0000 7fa825cb2700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa82014fa10 0x7fa8201540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.169+0000 7fa825cb2700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa820066210 0x7fa8201e8850 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:59.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.169+0000 7fa825cb2700 1 --2- 172.21.15.6:0/1753521307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8200abdb0 0x7fa820146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:35:59.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.169+0000 7fa825cb2700 1 -- 172.21.15.6:0/1753521307 >> 172.21.15.6:0/1753521307 conn(0x7fa8200c6140 msgr2=0x7fa82006a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:35:59.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.169+0000 7fa825cb2700 1 -- 172.21.15.6:0/1753521307 shutdown_connections 2023-07-21T07:35:59.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:35:59.169+0000 7fa825cb2700 1 -- 172.21.15.6:0/1753521307 wait complete. 2023-07-21T07:35:59.233 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-07-21T07:35:59.234 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T07:35:59.234 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T07:35:59.235 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-07-21T07:35:59.236 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T07:35:59.236 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-07-21T07:35:59.236 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T07:35:59.237 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.mNns9Iw0M2 2023-07-21T07:35:59.237 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2023-07-21T07:35:59.254 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.wgJCsem2Cv 2023-07-21T07:35:59.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /tmp/tmp.mNns9Iw0M2 /tmp/tmp.wgJCsem2Cv 2023-07-21T07:35:59.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.wgJCsem2Cv 2023-07-21T07:35:59.448 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.wgJCsem2Cv is 185B 2023-07-21T07:35:59.469 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.wgJCsem2Cv 2023-07-21T07:35:59.486 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBbNbpkkI0AHxAAxb3qXU0Dc8Jxrc2w5FHegw== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T07:35:59.486 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T07:35:59.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:59.487 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T07:35:59.542 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T07:35:59.542 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T07:35:59.542 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T07:35:59.542 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T07:35:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:59.543 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:35:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:59.543 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:35:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:59.543 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T07:35:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-21T07:35:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41849sec preferred_lft 41849sec 2023-07-21T07:35:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T07:35:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:59.544 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:35:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:59.544 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T07:35:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 92:ed:19:c0:57:d2 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:35:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T07:35:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::98ec:6eff:fe8a:86bb/64 scope link 2023-07-21T07:35:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:59.545 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T07:35:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 92:ed:19:c0:57:d2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T07:35:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::90ed:19ff:fec0:57d2/64 scope link 2023-07-21T07:35:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:35:59.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:59.546 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T07:35:59.608 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T07:35:59.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:59.610 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T07:35:59.669 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T07:35:59.669 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T07:35:59.669 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-21T07:35:59.669 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-21T07:35:59.670 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T07:35:59.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:59.670 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T07:35:59.671 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T07:35:59.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T07:35:59.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T07:35:59.672 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T07:35:59.672 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T07:35:59.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:59.776 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T07:35:59.793 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T07:35:59.793 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T07:35:59.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:35:59.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T07:35:59.860 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:35:59.861 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T07:35:59.918 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T07:35:59.918 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:35:59.919 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T07:35:59.974 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:35:59.975 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/tmp/tmp.mNns9Iw0M2 of=/dev/stdout 2023-07-21T07:36:00.032 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-07-21T07:36:00.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:00.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQBbNbpkkI0AHxAAxb3qXU0Dc8Jxrc2w5FHegw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:00.119 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,secret=AQBbNbpkkI0AHxAAxb3qXU0Dc8Jxrc2w5FHegw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:00.120 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:36:00.120 INFO:teuthology.orchestra.run.smithi006.stdout:keyring.get_secret failed 2023-07-21T07:36:00.150 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,secret=AQBbNbpkkI0AHxAAxb3qXU0Dc8Jxrc2w5FHegw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:00.151 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:36:00.151 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:36:00.152 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: testuser@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs2=/ 2023-07-21T07:36:00.152 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:36:00.152 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:36:00.153 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:36:00.153 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:36:00.153 INFO:teuthology.orchestra.run.smithi006.stdout:keyring.get_secret failed 2023-07-21T07:36:00.206 INFO:teuthology.orchestra.run.smithi006.stderr:mount error 2 = No such file or directory 2023-07-21T07:36:00.207 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,secret=AQBbNbpkkI0AHxAAxb3qXU0Dc8Jxrc2w5FHegw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:00.207 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:36:00.208 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:36:00.208 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: testuser@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs2=/ 2023-07-21T07:36:00.208 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:36:00.208 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:36:00.209 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:36:00.209 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:36:00.209 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790" 2023-07-21T07:36:00.209 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2023-07-21T07:36:00.210 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,key=testuser,mds_namespace=cephfs2,fsid=8c602ac0-17b3-4df5-8928-640a7524b3b3" will pass to kernel 2023-07-21T07:36:00.211 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T07:36:00.211 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-07-21T07:36:00.212 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T07:36:00.213 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T07:36:00.259 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T07:36:00.306 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T07:36:00.307 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:36:00.307 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:36:00.325 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18692 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-07-21T07:36:00.326 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:36:00.326 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:36:00.347 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:36:00.347 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:36:00.405 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.478+0000 7f6a6e20f700 1 Processor -- start 2023-07-21T07:36:00.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.478+0000 7f6a6e20f700 1 -- start start 2023-07-21T07:36:00.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a6e20f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6a68151c90 0x7f6a680c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:00.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a6e20f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a681545c0 0x7f6a681549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:00.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a6e20f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a68152070 con 0x7f6a680c4920 2023-07-21T07:36:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a6e20f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a680c5630 con 0x7f6a68151c90 2023-07-21T07:36:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a6e20f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680c4e10 con 0x7f6a681545c0 2023-07-21T07:36:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a677fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6a68151c90 0x7f6a680c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a677fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6a68151c90 0x7f6a680c50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35030/0 (socket says 172.21.15.6:35030) 2023-07-21T07:36:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a677fe700 1 -- 172.21.15.6:0/3744204216 learned_addr learned my addr 172.21.15.6:0/3744204216 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a66ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6a680c4920 0x7f6a6806a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43050/0 (socket says 172.21.15.6:43050) 2023-07-21T07:36:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a67fff700 1 --2- 172.21.15.6:0/3744204216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a681545c0 0x7f6a681549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a677fe700 1 -- 172.21.15.6:0/3744204216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a681545c0 msgr2=0x7f6a681549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a677fe700 1 --2- 172.21.15.6:0/3744204216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a681545c0 0x7f6a681549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a677fe700 1 -- 172.21.15.6:0/3744204216 >> v1:172.21.15.6:6789/0 conn(0x7f6a680c4920 legacy=0x7f6a6806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a677fe700 1 -- 172.21.15.6:0/3744204216 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6806d670 con 0x7f6a68151c90 2023-07-21T07:36:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a677fe700 1 --2- 172.21.15.6:0/3744204216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a68151c90 0x7f6a680c50f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6a580098f0 tx=0x7f6a58009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935da343839fa21 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a667fc700 1 -- 172.21.15.6:0/3744204216 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800b8a0 con 0x7f6a68151c90 2023-07-21T07:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a667fc700 1 -- 172.21.15.6:0/3744204216 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5800ba00 con 0x7f6a68151c90 2023-07-21T07:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.479+0000 7f6a667fc700 1 -- 172.21.15.6:0/3744204216 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800bd90 con 0x7f6a68151c90 2023-07-21T07:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.480+0000 7f6a6e20f700 1 -- 172.21.15.6:0/3744204216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a68151c90 msgr2=0x7f6a680c50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.480+0000 7f6a6e20f700 1 --2- 172.21.15.6:0/3744204216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a68151c90 0x7f6a680c50f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6a580098f0 tx=0x7f6a58009c00 comp rx=0 tx=0).stop 2023-07-21T07:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.480+0000 7f6a6e20f700 1 -- 172.21.15.6:0/3744204216 shutdown_connections 2023-07-21T07:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.480+0000 7f6a6e20f700 1 --2- 172.21.15.6:0/3744204216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a681545c0 0x7f6a681549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.480+0000 7f6a6e20f700 1 --2- 172.21.15.6:0/3744204216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a68151c90 0x7f6a680c50f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.480+0000 7f6a6e20f700 1 -- 172.21.15.6:0/3744204216 >> 172.21.15.6:0/3744204216 conn(0x7f6a680a85f0 msgr2=0x7f6a680a8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.480+0000 7f6a6e20f700 1 -- 172.21.15.6:0/3744204216 shutdown_connections 2023-07-21T07:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.480+0000 7f6a6e20f700 1 -- 172.21.15.6:0/3744204216 wait complete. 2023-07-21T07:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.481+0000 7f6a6e20f700 1 Processor -- start 2023-07-21T07:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.481+0000 7f6a6e20f700 1 -- start start 2023-07-21T07:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.482+0000 7f6a6e20f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a680c4920 0x7f6a68071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.482+0000 7f6a6e20f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a68151c90 0x7f6a680a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.482+0000 7f6a6e20f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a681545c0 0x7f6a680a6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.482+0000 7f6a6e20f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6814fbf0 con 0x7f6a68151c90 2023-07-21T07:36:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.482+0000 7f6a6e20f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a681507d0 con 0x7f6a681545c0 2023-07-21T07:36:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.482+0000 7f6a6e20f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a68150d70 con 0x7f6a680c4920 2023-07-21T07:36:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.482+0000 7f6a66ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a68151c90 0x7f6a680a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.482+0000 7f6a66ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a68151c90 0x7f6a680a60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35038/0 (socket says 172.21.15.6:35038) 2023-07-21T07:36:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.482+0000 7f6a66ffd700 1 -- 172.21.15.6:0/1831567619 learned_addr learned my addr 172.21.15.6:0/1831567619 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:00.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.482+0000 7f6a67fff700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a681545c0 0x7f6a680a6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:00.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.482+0000 7f6a677fe700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a680c4920 0x7f6a68071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:00.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.482+0000 7f6a66ffd700 1 -- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a680c4920 msgr2=0x7f6a68071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:00.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.482+0000 7f6a66ffd700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a680c4920 0x7f6a68071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.483+0000 7f6a66ffd700 1 -- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a681545c0 msgr2=0x7f6a680a6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:00.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.483+0000 7f6a66ffd700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a681545c0 0x7f6a680a6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.483+0000 7f6a66ffd700 1 -- 172.21.15.6:0/1831567619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a58009550 con 0x7f6a68151c90 2023-07-21T07:36:00.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.483+0000 7f6a66ffd700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a68151c90 0x7f6a680a60e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000c500 tx=0x7f6a5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:00.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.483+0000 7f6a5ffff700 1 -- 172.21.15.6:0/1831567619 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a50005cb0 con 0x7f6a68151c90 2023-07-21T07:36:00.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.483+0000 7f6a5ffff700 1 -- 172.21.15.6:0/1831567619 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a50005e10 con 0x7f6a68151c90 2023-07-21T07:36:00.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.483+0000 7f6a6e20f700 1 -- 172.21.15.6:0/1831567619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a68150a90 con 0x7f6a68151c90 2023-07-21T07:36:00.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.483+0000 7f6a5ffff700 1 -- 172.21.15.6:0/1831567619 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a500072d0 con 0x7f6a68151c90 2023-07-21T07:36:00.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.483+0000 7f6a6e20f700 1 -- 172.21.15.6:0/1831567619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a68072350 con 0x7f6a68151c90 2023-07-21T07:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.484+0000 7f6a6e20f700 1 -- 172.21.15.6:0/1831567619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6814fd80 con 0x7f6a68151c90 2023-07-21T07:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.484+0000 7f6a5ffff700 1 -- 172.21.15.6:0/1831567619 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a50007430 con 0x7f6a68151c90 2023-07-21T07:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.485+0000 7f6a5ffff700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6a4806ace0 0x7f6a4806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.485+0000 7f6a5ffff700 1 -- 172.21.15.6:0/1831567619 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f6a50088b20 con 0x7f6a68151c90 2023-07-21T07:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.485+0000 7f6a677fe700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6a4806ace0 0x7f6a4806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.485+0000 7f6a677fe700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6a4806ace0 0x7f6a4806d1a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6a58014040 tx=0x7f6a58008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.489+0000 7f6a5ffff700 1 -- 172.21.15.6:0/1831567619 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6a50053910 con 0x7f6a68151c90 2023-07-21T07:36:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.690+0000 7f6a6e20f700 1 -- 172.21.15.6:0/1831567619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a68074500 con 0x7f6a68151c90 2023-07-21T07:36:00.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.692+0000 7f6a5ffff700 1 -- 172.21.15.6:0/1831567619 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+21959 (secure 0 0 0) 0x7f6a50056f30 con 0x7f6a68151c90 2023-07-21T07:36:00.744 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:00.744 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:46.879421+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:35:29.385402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T07:35:29.920618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:35:43.052752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:35:44.270260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:00.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.694+0000 7f6a6e20f700 1 -- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6a4806ace0 msgr2=0x7f6a4806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:00.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.694+0000 7f6a6e20f700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6a4806ace0 0x7f6a4806d1a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6a58014040 tx=0x7f6a58008030 comp rx=0 tx=0).stop 2023-07-21T07:36:00.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.694+0000 7f6a6e20f700 1 -- 172.21.15.6:0/1831567619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a68151c90 msgr2=0x7f6a680a60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:00.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.694+0000 7f6a6e20f700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a68151c90 0x7f6a680a60e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000c500 tx=0x7f6a5000c8c0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.694+0000 7f6a6e20f700 1 -- 172.21.15.6:0/1831567619 shutdown_connections 2023-07-21T07:36:00.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.694+0000 7f6a6e20f700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6a4806ace0 0x7f6a4806d1a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.694+0000 7f6a6e20f700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a681545c0 0x7f6a680a6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.694+0000 7f6a6e20f700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a680c4920 0x7f6a68071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.694+0000 7f6a6e20f700 1 --2- 172.21.15.6:0/1831567619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a68151c90 0x7f6a680a60e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.694+0000 7f6a6e20f700 1 -- 172.21.15.6:0/1831567619 >> 172.21.15.6:0/1831567619 conn(0x7f6a680a85f0 msgr2=0x7f6a681549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.694+0000 7f6a6e20f700 1 -- 172.21.15.6:0/1831567619 shutdown_connections 2023-07-21T07:36:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.694+0000 7f6a6e20f700 1 -- 172.21.15.6:0/1831567619 wait complete. 2023-07-21T07:36:00.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:35:29.385402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:35:29.920618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-21T07:35:43.052752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-21T07:35:44.270260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:36:00.760 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:36:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.836+0000 7fa5fd2b1700 1 Processor -- start 2023-07-21T07:36:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.836+0000 7fa5fd2b1700 1 -- start start 2023-07-21T07:36:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5fd2b1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5f8151d80 0x7fa5f80c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5fd2b1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa5f80bd360 0x7fa5f806b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5fd2b1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f8154dc0 con 0x7fa5f80c7bd0 2023-07-21T07:36:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5fd2b1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f806ad50 con 0x7fa5f80bd360 2023-07-21T07:36:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5fd2b1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81552f0 con 0x7fa5f8151d80 2023-07-21T07:36:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5f77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa5f80bd360 0x7fa5f806b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5f77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa5f80bd360 0x7fa5f806b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35048/0 (socket says 172.21.15.6:35048) 2023-07-21T07:36:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5f67fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa5f80c7bd0 0x7fa5f806b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43064/0 (socket says 172.21.15.6:43064) 2023-07-21T07:36:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5f77fe700 1 -- 172.21.15.6:0/321032452 learned_addr learned my addr 172.21.15.6:0/321032452 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5f6ffd700 1 --2- 172.21.15.6:0/321032452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5f8151d80 0x7fa5f80c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5f77fe700 1 -- 172.21.15.6:0/321032452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5f8151d80 msgr2=0x7fa5f80c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5f77fe700 1 --2- 172.21.15.6:0/321032452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5f8151d80 0x7fa5f80c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5f77fe700 1 -- 172.21.15.6:0/321032452 >> v1:172.21.15.6:6789/0 conn(0x7fa5f80c7bd0 legacy=0x7fa5f806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5f77fe700 1 -- 172.21.15.6:0/321032452 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8155010 con 0x7fa5f80bd360 2023-07-21T07:36:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5f77fe700 1 --2- 172.21.15.6:0/321032452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f80bd360 0x7fa5f806b8f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009e50 tx=0x7fa5f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca9c8aaeac54a8c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.837+0000 7fa5f5ffb700 1 -- 172.21.15.6:0/321032452 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f000e070 con 0x7fa5f80bd360 2023-07-21T07:36:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.838+0000 7fa5f5ffb700 1 -- 172.21.15.6:0/321032452 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f000b910 con 0x7fa5f80bd360 2023-07-21T07:36:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.838+0000 7fa5f5ffb700 1 -- 172.21.15.6:0/321032452 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f000bcc0 con 0x7fa5f80bd360 2023-07-21T07:36:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.838+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/321032452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f80bd360 msgr2=0x7fa5f806b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.838+0000 7fa5fd2b1700 1 --2- 172.21.15.6:0/321032452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f80bd360 0x7fa5f806b8f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009e50 tx=0x7fa5f000b330 comp rx=0 tx=0).stop 2023-07-21T07:36:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.838+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/321032452 shutdown_connections 2023-07-21T07:36:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.838+0000 7fa5fd2b1700 1 --2- 172.21.15.6:0/321032452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f80bd360 0x7fa5f806b8f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.838+0000 7fa5fd2b1700 1 --2- 172.21.15.6:0/321032452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5f8151d80 0x7fa5f80c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.838+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/321032452 >> 172.21.15.6:0/321032452 conn(0x7fa5f80c9cd0 msgr2=0x7fa5f80ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.838+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/321032452 shutdown_connections 2023-07-21T07:36:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.838+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/321032452 wait complete. 2023-07-21T07:36:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.839+0000 7fa5fd2b1700 1 Processor -- start 2023-07-21T07:36:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.839+0000 7fa5fd2b1700 1 -- start start 2023-07-21T07:36:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.840+0000 7fa5fd2b1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5f80bd360 0x7fa5f80bf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.840+0000 7fa5fd2b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f80c7bd0 0x7fa5f80be020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.840+0000 7fa5fd2b1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f8151d80 0x7fa5f81ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.840+0000 7fa5fd2b1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f814ed60 con 0x7fa5f80c7bd0 2023-07-21T07:36:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.840+0000 7fa5fd2b1700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81560d0 con 0x7fa5f8151d80 2023-07-21T07:36:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.840+0000 7fa5fd2b1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81ed4d0 con 0x7fa5f80bd360 2023-07-21T07:36:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.840+0000 7fa5f67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f80c7bd0 0x7fa5f80be020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.840+0000 7fa5f67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f80c7bd0 0x7fa5f80be020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35054/0 (socket says 172.21.15.6:35054) 2023-07-21T07:36:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.840+0000 7fa5f67fc700 1 -- 172.21.15.6:0/1182178870 learned_addr learned my addr 172.21.15.6:0/1182178870 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.840+0000 7fa5f6ffd700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5f80bd360 0x7fa5f80bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.840+0000 7fa5f77fe700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f8151d80 0x7fa5f81ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.841+0000 7fa5f67fc700 1 -- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5f80bd360 msgr2=0x7fa5f80bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.841+0000 7fa5f67fc700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5f80bd360 0x7fa5f80bf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.841+0000 7fa5f67fc700 1 -- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f8151d80 msgr2=0x7fa5f81ed960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.841+0000 7fa5f67fc700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f8151d80 0x7fa5f81ed960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.841+0000 7fa5f67fc700 1 -- 172.21.15.6:0/1182178870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0009b30 con 0x7fa5f80c7bd0 2023-07-21T07:36:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.841+0000 7fa5f6ffd700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5f80bd360 0x7fa5f80bf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.841+0000 7fa5f77fe700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f8151d80 0x7fa5f81ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.841+0000 7fa5f67fc700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f80c7bd0 0x7fa5f80be020 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c520 tx=0x7fa5e800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.841+0000 7fa5df7fe700 1 -- 172.21.15.6:0/1182178870 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8005cb0 con 0x7fa5f80c7bd0 2023-07-21T07:36:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.841+0000 7fa5df7fe700 1 -- 172.21.15.6:0/1182178870 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8005e10 con 0x7fa5f80c7bd0 2023-07-21T07:36:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.841+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/1182178870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f8155a10 con 0x7fa5f80c7bd0 2023-07-21T07:36:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.841+0000 7fa5df7fe700 1 -- 172.21.15.6:0/1182178870 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80072d0 con 0x7fa5f80c7bd0 2023-07-21T07:36:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.841+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/1182178870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f80bebc0 con 0x7fa5f80c7bd0 2023-07-21T07:36:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.842+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/1182178870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f81ed660 con 0x7fa5f80c7bd0 2023-07-21T07:36:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.842+0000 7fa5df7fe700 1 -- 172.21.15.6:0/1182178870 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa5e8007430 con 0x7fa5f80c7bd0 2023-07-21T07:36:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.843+0000 7fa5df7fe700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa5e406ace0 0x7fa5e406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.843+0000 7fa5df7fe700 1 -- 172.21.15.6:0/1182178870 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fa5e8088ac0 con 0x7fa5f80c7bd0 2023-07-21T07:36:00.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.843+0000 7fa5f6ffd700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa5e406ace0 0x7fa5e406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:00.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.844+0000 7fa5f6ffd700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa5e406ace0 0x7fa5e406d1a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80aabc0 tx=0x7fa5ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:00.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:00.847+0000 7fa5df7fe700 1 -- 172.21.15.6:0/1182178870 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa5e8053950 con 0x7fa5f80c7bd0 2023-07-21T07:36:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.045+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/1182178870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5f8074500 con 0x7fa5f80c7bd0 2023-07-21T07:36:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.046+0000 7fa5df7fe700 1 -- 172.21.15.6:0/1182178870 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5e8017020 con 0x7fa5f80c7bd0 2023-07-21T07:36:01.098 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:36:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.048+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa5e406ace0 msgr2=0x7fa5e406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.048+0000 7fa5fd2b1700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa5e406ace0 0x7fa5e406d1a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80aabc0 tx=0x7fa5ec008040 comp rx=0 tx=0).stop 2023-07-21T07:36:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.048+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/1182178870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f80c7bd0 msgr2=0x7fa5f80be020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.048+0000 7fa5fd2b1700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f80c7bd0 0x7fa5f80be020 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c520 tx=0x7fa5e800c8e0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.048+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/1182178870 shutdown_connections 2023-07-21T07:36:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.048+0000 7fa5fd2b1700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa5e406ace0 0x7fa5e406d1a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.048+0000 7fa5fd2b1700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f8151d80 0x7fa5f81ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.048+0000 7fa5fd2b1700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5f80bd360 0x7fa5f80bf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.048+0000 7fa5fd2b1700 1 --2- 172.21.15.6:0/1182178870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f80c7bd0 0x7fa5f80be020 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.048+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/1182178870 >> 172.21.15.6:0/1182178870 conn(0x7fa5f80c9cd0 msgr2=0x7fa5f80c4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.048+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/1182178870 shutdown_connections 2023-07-21T07:36:01.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.048+0000 7fa5fd2b1700 1 -- 172.21.15.6:0/1182178870 wait complete. 2023-07-21T07:36:01.112 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:36:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.188+0000 7f7c4cf8d700 1 Processor -- start 2023-07-21T07:36:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.188+0000 7f7c4cf8d700 1 -- start start 2023-07-21T07:36:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4cf8d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c480a6f80 0x7f7c48152380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4cf8d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c48072160 0x7f7c4814f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4cf8d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c480c3c90 con 0x7f7c480c4120 2023-07-21T07:36:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4cf8d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c480c26e0 con 0x7f7c480a6f80 2023-07-21T07:36:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4cf8d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480c3680 con 0x7f7c48072160 2023-07-21T07:36:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c46d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7c480c4120 0x7f7c480c5a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43082/0 (socket says 172.21.15.6:43082) 2023-07-21T07:36:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c46d9d700 1 -- 172.21.15.6:0/3702114566 learned_addr learned my addr 172.21.15.6:0/3702114566 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4659c700 1 --2- 172.21.15.6:0/3702114566 >> v2:172.21.15.86:3300/0 conn(0x7f7c480a6f80 0x7f7c48152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c45d9b700 1 --2- 172.21.15.6:0/3702114566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c48072160 0x7f7c4814f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408107764 0 0) 0x7f7c480c3c90 con 0x7f7c480c4120 2023-07-21T07:36:01.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c300035b0 con 0x7f7c480c4120 2023-07-21T07:36:01.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2796895611 0 0) 0x7f7c300035b0 con 0x7f7c480c4120 2023-07-21T07:36:01.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c48072160 msgr2=0x7f7c4814f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:01.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4559a700 1 --2- 172.21.15.6:0/3702114566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c48072160 0x7f7c4814f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 >> v2:172.21.15.86:3300/0 conn(0x7f7c480a6f80 msgr2=0x7f7c48152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:01.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4559a700 1 --2- 172.21.15.6:0/3702114566 >> v2:172.21.15.86:3300/0 conn(0x7f7c480a6f80 0x7f7c48152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480c6fe0 con 0x7f7c480c4120 2023-07-21T07:36:01.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f7c400019f0 con 0x7f7c480c4120 2023-07-21T07:36:01.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 >> v1:172.21.15.6:6789/0 conn(0x7f7c480c4120 legacy=0x7f7c480c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4559a700 1 --2- 172.21.15.6:0/3702114566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c30003a00 0x7f7c30003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4559a700 1 --2- 172.21.15.6:0/3702114566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c48072160 0x7f7c30004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.189+0000 7f7c4559a700 1 --2- 172.21.15.6:0/3702114566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30004d90 0x7f7c30005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480c26e0 con 0x7f7c30003a00 2023-07-21T07:36:01.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480c3680 con 0x7f7c30004d90 2023-07-21T07:36:01.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3000ba10 con 0x7f7c48072160 2023-07-21T07:36:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c4659c700 1 --2- 172.21.15.6:0/3702114566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c30003a00 0x7f7c30003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c45d9b700 1 --2- 172.21.15.6:0/3702114566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c48072160 0x7f7c30004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c46d9d700 1 --2- 172.21.15.6:0/3702114566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30004d90 0x7f7c30005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c4659c700 1 -- 172.21.15.6:0/3702114566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c48072160 msgr2=0x7f7c30004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c4659c700 1 --2- 172.21.15.6:0/3702114566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c48072160 0x7f7c30004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c4659c700 1 -- 172.21.15.6:0/3702114566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30004d90 msgr2=0x7f7c30005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c4659c700 1 --2- 172.21.15.6:0/3702114566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30004d90 0x7f7c30005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c4659c700 1 -- 172.21.15.6:0/3702114566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c300035b0 con 0x7f7c30003a00 2023-07-21T07:36:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c4659c700 1 --2- 172.21.15.6:0/3702114566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c30003a00 0x7f7c30003e20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009b60 tx=0x7f7c30005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69312ff893f04d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800e6c0 con 0x7f7c30003a00 2023-07-21T07:36:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3800e820 con 0x7f7c30003a00 2023-07-21T07:36:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.190+0000 7f7c4559a700 1 -- 172.21.15.6:0/3702114566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800eb90 con 0x7f7c30003a00 2023-07-21T07:36:01.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.191+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/3702114566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c30003a00 msgr2=0x7f7c30003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.191+0000 7f7c4cf8d700 1 --2- 172.21.15.6:0/3702114566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c30003a00 0x7f7c30003e20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009b60 tx=0x7f7c30005880 comp rx=0 tx=0).stop 2023-07-21T07:36:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.191+0000 7f7c46d9d700 1 -- 172.21.15.6:0/3702114566 reap_dead start 2023-07-21T07:36:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.191+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/3702114566 shutdown_connections 2023-07-21T07:36:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.191+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/3702114566 >> 172.21.15.6:0/3702114566 conn(0x7f7c480c7b50 msgr2=0x7f7c480c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.191+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/3702114566 shutdown_connections 2023-07-21T07:36:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.191+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/3702114566 wait complete. 2023-07-21T07:36:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.192+0000 7f7c4cf8d700 1 Processor -- start 2023-07-21T07:36:01.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.192+0000 7f7c4cf8d700 1 -- start start 2023-07-21T07:36:01.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c4cf8d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30003a00 0x7f7c481ea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c4cf8d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c481dba30 0x7f7c480c1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c4cf8d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c480a7b50 0x7f7c4806b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c4cf8d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480a8580 con 0x7f7c480a7b50 2023-07-21T07:36:01.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c4cf8d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4806d1f0 con 0x7f7c30003a00 2023-07-21T07:36:01.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c4cf8d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c481ea840 con 0x7f7c481dba30 2023-07-21T07:36:01.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c46d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c480a7b50 0x7f7c4806b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c46d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c480a7b50 0x7f7c4806b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35074/0 (socket says 172.21.15.6:35074) 2023-07-21T07:36:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c46d9d700 1 -- 172.21.15.6:0/671883445 learned_addr learned my addr 172.21.15.6:0/671883445 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c45d9b700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c481dba30 0x7f7c480c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c4659c700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30003a00 0x7f7c481ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c46d9d700 1 -- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c481dba30 msgr2=0x7f7c480c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c46d9d700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c481dba30 0x7f7c480c1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c46d9d700 1 -- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30003a00 msgr2=0x7f7c481ea300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c46d9d700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30003a00 0x7f7c481ea300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c46d9d700 1 -- 172.21.15.6:0/671883445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c481db5a0 con 0x7f7c480a7b50 2023-07-21T07:36:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.193+0000 7f7c46d9d700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c480a7b50 0x7f7c4806b2c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7c400013d0 tx=0x7f7c4000a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.194+0000 7f7c36ffd700 1 -- 172.21.15.6:0/671883445 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400019e0 con 0x7f7c480a7b50 2023-07-21T07:36:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.194+0000 7f7c36ffd700 1 -- 172.21.15.6:0/671883445 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4000ade0 con 0x7f7c480a7b50 2023-07-21T07:36:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.194+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/671883445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c481dacb0 con 0x7f7c480a7b50 2023-07-21T07:36:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.194+0000 7f7c36ffd700 1 -- 172.21.15.6:0/671883445 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40013650 con 0x7f7c480a7b50 2023-07-21T07:36:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.194+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/671883445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c481db230 con 0x7f7c480a7b50 2023-07-21T07:36:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.195+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/671883445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c481db730 con 0x7f7c480a7b50 2023-07-21T07:36:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.195+0000 7f7c36ffd700 1 -- 172.21.15.6:0/671883445 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c400137b0 con 0x7f7c480a7b50 2023-07-21T07:36:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.196+0000 7f7c36ffd700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7c2806ad10 0x7f7c2806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.196+0000 7f7c36ffd700 1 -- 172.21.15.6:0/671883445 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f7c40089fd0 con 0x7f7c480a7b50 2023-07-21T07:36:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.196+0000 7f7c4659c700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7c2806ad10 0x7f7c2806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.196+0000 7f7c4659c700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7c2806ad10 0x7f7c2806d1d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7c380090b0 tx=0x7f7c3801f040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.200+0000 7f7c36ffd700 1 -- 172.21.15.6:0/671883445 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7c40054d20 con 0x7f7c480a7b50 2023-07-21T07:36:01.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.395+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/671883445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7c481db3c0 con 0x7f7c480a7b50 2023-07-21T07:36:01.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.395+0000 7f7c36ffd700 1 -- 172.21.15.6:0/671883445 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7c40001f00 con 0x7f7c480a7b50 2023-07-21T07:36:01.447 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:36:01.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.397+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7c2806ad10 msgr2=0x7f7c2806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.397+0000 7f7c4cf8d700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7c2806ad10 0x7f7c2806d1d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7c380090b0 tx=0x7f7c3801f040 comp rx=0 tx=0).stop 2023-07-21T07:36:01.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.397+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/671883445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c480a7b50 msgr2=0x7f7c4806b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.397+0000 7f7c4cf8d700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c480a7b50 0x7f7c4806b2c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7c400013d0 tx=0x7f7c4000a640 comp rx=0 tx=0).stop 2023-07-21T07:36:01.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.397+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/671883445 shutdown_connections 2023-07-21T07:36:01.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.397+0000 7f7c4cf8d700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7c2806ad10 0x7f7c2806d1d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.397+0000 7f7c4cf8d700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c480a7b50 0x7f7c4806b2c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.397+0000 7f7c4cf8d700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c30003a00 0x7f7c481ea300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.397+0000 7f7c4cf8d700 1 --2- 172.21.15.6:0/671883445 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c481dba30 0x7f7c480c1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.397+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/671883445 >> 172.21.15.6:0/671883445 conn(0x7f7c480c7b50 msgr2=0x7f7c48149110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:01.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.397+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/671883445 shutdown_connections 2023-07-21T07:36:01.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.397+0000 7f7c4cf8d700 1 -- 172.21.15.6:0/671883445 wait complete. 2023-07-21T07:36:01.461 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:36:01.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.537+0000 7f273aa09700 1 Processor -- start 2023-07-21T07:36:01.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.538+0000 7f273aa09700 1 -- start start 2023-07-21T07:36:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.538+0000 7f273aa09700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f27340a6f80 0x7f2734152380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.538+0000 7f273aa09700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f273414fb30 0x7f273415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.538+0000 7f273aa09700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27340c3c90 con 0x7f2734072160 2023-07-21T07:36:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.538+0000 7f273aa09700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27340c26e0 con 0x7f273414fb30 2023-07-21T07:36:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.538+0000 7f273aa09700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27340c3680 con 0x7f27340a6f80 2023-07-21T07:36:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.538+0000 7f2738fa6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f273414fb30 0x7f273415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.538+0000 7f2738fa6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f273414fb30 0x7f273415cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35082/0 (socket says 172.21.15.6:35082) 2023-07-21T07:36:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.538+0000 7f27337fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2734072160 0x7f273414f420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43098/0 (socket says 172.21.15.6:43098) 2023-07-21T07:36:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.538+0000 7f2738fa6700 1 -- 172.21.15.6:0/3046936507 learned_addr learned my addr 172.21.15.6:0/3046936507 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.539+0000 7f2733fff700 1 --2- 172.21.15.6:0/3046936507 >> v2:172.21.15.86:3300/0 conn(0x7f27340a6f80 0x7f2734152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.539+0000 7f2738fa6700 1 -- 172.21.15.6:0/3046936507 >> v2:172.21.15.86:3300/0 conn(0x7f27340a6f80 msgr2=0x7f2734152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.539+0000 7f2738fa6700 1 --2- 172.21.15.6:0/3046936507 >> v2:172.21.15.86:3300/0 conn(0x7f27340a6f80 0x7f2734152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.539+0000 7f2738fa6700 1 -- 172.21.15.6:0/3046936507 >> v1:172.21.15.6:6789/0 conn(0x7f2734072160 legacy=0x7f273414f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.539+0000 7f2738fa6700 1 -- 172.21.15.6:0/3046936507 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27340c6fe0 con 0x7f273414fb30 2023-07-21T07:36:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.539+0000 7f2733fff700 1 --2- 172.21.15.6:0/3046936507 >> v2:172.21.15.86:3300/0 conn(0x7f27340a6f80 0x7f2734152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.539+0000 7f2738fa6700 1 --2- 172.21.15.6:0/3046936507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273414fb30 0x7f273415cd00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2734067440 tx=0x7f272c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78b82d8924bf941 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.539+0000 7f2732ffd700 1 -- 172.21.15.6:0/3046936507 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c00e070 con 0x7f273414fb30 2023-07-21T07:36:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.539+0000 7f2732ffd700 1 -- 172.21.15.6:0/3046936507 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c00b9c0 con 0x7f273414fb30 2023-07-21T07:36:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.539+0000 7f2732ffd700 1 -- 172.21.15.6:0/3046936507 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c00bd70 con 0x7f273414fb30 2023-07-21T07:36:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.540+0000 7f273aa09700 1 -- 172.21.15.6:0/3046936507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273414fb30 msgr2=0x7f273415cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.540+0000 7f273aa09700 1 --2- 172.21.15.6:0/3046936507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273414fb30 0x7f273415cd00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2734067440 tx=0x7f272c00b330 comp rx=0 tx=0).stop 2023-07-21T07:36:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.540+0000 7f273aa09700 1 -- 172.21.15.6:0/3046936507 shutdown_connections 2023-07-21T07:36:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.540+0000 7f273aa09700 1 --2- 172.21.15.6:0/3046936507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273414fb30 0x7f273415cd00 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.540+0000 7f273aa09700 1 --2- 172.21.15.6:0/3046936507 >> v2:172.21.15.86:3300/0 conn(0x7f27340a6f80 0x7f2734152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.540+0000 7f273aa09700 1 -- 172.21.15.6:0/3046936507 >> 172.21.15.6:0/3046936507 conn(0x7f27340c7b50 msgr2=0x7f27340c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:01.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.540+0000 7f273aa09700 1 -- 172.21.15.6:0/3046936507 shutdown_connections 2023-07-21T07:36:01.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.540+0000 7f273aa09700 1 -- 172.21.15.6:0/3046936507 wait complete. 2023-07-21T07:36:01.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.541+0000 7f273aa09700 1 Processor -- start 2023-07-21T07:36:01.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.541+0000 7f273aa09700 1 -- start start 2023-07-21T07:36:01.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f273aa09700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2734072160 0x7f27341ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f273aa09700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27340a6f80 0x7f27341ea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f273aa09700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273414fb30 0x7f27340c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f273aa09700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2734153d70 con 0x7f273414fb30 2023-07-21T07:36:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f273aa09700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27341edc50 con 0x7f27340a6f80 2023-07-21T07:36:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f273aa09700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27341e9790 con 0x7f2734072160 2023-07-21T07:36:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f2738fa6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273414fb30 0x7f27340c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f2738fa6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273414fb30 0x7f27340c10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35088/0 (socket says 172.21.15.6:35088) 2023-07-21T07:36:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f2738fa6700 1 -- 172.21.15.6:0/1731672602 learned_addr learned my addr 172.21.15.6:0/1731672602 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f2733fff700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2734072160 0x7f27341ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f27337fe700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27340a6f80 0x7f27341ea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f2738fa6700 1 -- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2734072160 msgr2=0x7f27341ed710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f2738fa6700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2734072160 0x7f27341ed710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f2738fa6700 1 -- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27340a6f80 msgr2=0x7f27341ea1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f2738fa6700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27340a6f80 0x7f27341ea1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.542+0000 7f2738fa6700 1 -- 172.21.15.6:0/1731672602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c009b30 con 0x7f273414fb30 2023-07-21T07:36:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.543+0000 7f2738fa6700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273414fb30 0x7f27340c10d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f272c00b730 tx=0x7f272c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:01.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.543+0000 7f2730ff9700 1 -- 172.21.15.6:0/1731672602 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c004870 con 0x7f273414fb30 2023-07-21T07:36:01.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.543+0000 7f2730ff9700 1 -- 172.21.15.6:0/1731672602 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c0099b0 con 0x7f273414fb30 2023-07-21T07:36:01.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.543+0000 7f273aa09700 1 -- 172.21.15.6:0/1731672602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27341ea6e0 con 0x7f273414fb30 2023-07-21T07:36:01.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.543+0000 7f2730ff9700 1 -- 172.21.15.6:0/1731672602 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c01c680 con 0x7f273414fb30 2023-07-21T07:36:01.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.543+0000 7f273aa09700 1 -- 172.21.15.6:0/1731672602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273406cb90 con 0x7f273414fb30 2023-07-21T07:36:01.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.544+0000 7f273aa09700 1 -- 172.21.15.6:0/1731672602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2734074500 con 0x7f273414fb30 2023-07-21T07:36:01.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.544+0000 7f2730ff9700 1 -- 172.21.15.6:0/1731672602 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f272c01c7e0 con 0x7f273414fb30 2023-07-21T07:36:01.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.545+0000 7f2730ff9700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f272006ace0 0x7f272006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.545+0000 7f2730ff9700 1 -- 172.21.15.6:0/1731672602 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f272c08b130 con 0x7f273414fb30 2023-07-21T07:36:01.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.545+0000 7f2733fff700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f272006ace0 0x7f272006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.545+0000 7f2733fff700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f272006ace0 0x7f272006d1a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2724006fd0 tx=0x7f2724008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:01.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.549+0000 7f2730ff9700 1 -- 172.21.15.6:0/1731672602 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f272c055f10 con 0x7f273414fb30 2023-07-21T07:36:01.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.749+0000 7f273aa09700 1 -- 172.21.15.6:0/1731672602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2734070f50 con 0x7f273414fb30 2023-07-21T07:36:01.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.749+0000 7f2730ff9700 1 -- 172.21.15.6:0/1731672602 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f272c059530 con 0x7f273414fb30 2023-07-21T07:36:01.802 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:36:01.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.751+0000 7f273aa09700 1 -- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f272006ace0 msgr2=0x7f272006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.751+0000 7f273aa09700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f272006ace0 0x7f272006d1a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2724006fd0 tx=0x7f2724008040 comp rx=0 tx=0).stop 2023-07-21T07:36:01.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.751+0000 7f273aa09700 1 -- 172.21.15.6:0/1731672602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273414fb30 msgr2=0x7f27340c10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.751+0000 7f273aa09700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273414fb30 0x7f27340c10d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f272c00b730 tx=0x7f272c004ad0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.751+0000 7f273aa09700 1 -- 172.21.15.6:0/1731672602 shutdown_connections 2023-07-21T07:36:01.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.751+0000 7f273aa09700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f272006ace0 0x7f272006d1a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.751+0000 7f273aa09700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273414fb30 0x7f27340c10d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.751+0000 7f273aa09700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2734072160 0x7f27341ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.751+0000 7f273aa09700 1 --2- 172.21.15.6:0/1731672602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27340a6f80 0x7f27341ea1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.751+0000 7f273aa09700 1 -- 172.21.15.6:0/1731672602 >> 172.21.15.6:0/1731672602 conn(0x7f27340c7b50 msgr2=0x7f2734071650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:01.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.751+0000 7f273aa09700 1 -- 172.21.15.6:0/1731672602 shutdown_connections 2023-07-21T07:36:01.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.751+0000 7f273aa09700 1 -- 172.21.15.6:0/1731672602 wait complete. 2023-07-21T07:36:01.816 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:36:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.891+0000 7fb84cd93700 1 Processor -- start 2023-07-21T07:36:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.891+0000 7fb84cd93700 1 -- start start 2023-07-21T07:36:01.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb84cd93700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb84806a300 0x7fb8481519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb84cd93700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb84806d8a0 0x7fb848151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb84cd93700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb848155530 con 0x7fb8480ba140 2023-07-21T07:36:01.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb84cd93700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480c1a30 con 0x7fb84806d8a0 2023-07-21T07:36:01.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb84cd93700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb848154920 con 0x7fb84806a300 2023-07-21T07:36:01.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb846d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb84806d8a0 0x7fb848151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb846d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb84806d8a0 0x7fb848151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35096/0 (socket says 172.21.15.6:35096) 2023-07-21T07:36:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb846d9d700 1 -- 172.21.15.6:0/2805501532 learned_addr learned my addr 172.21.15.6:0/2805501532 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb84659c700 1 --2- 172.21.15.6:0/2805501532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb84806a300 0x7fb8481519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb846d9d700 1 -- 172.21.15.6:0/2805501532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb84806a300 msgr2=0x7fb8481519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb846d9d700 1 --2- 172.21.15.6:0/2805501532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb84806a300 0x7fb8481519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb846d9d700 1 -- 172.21.15.6:0/2805501532 >> v1:172.21.15.86:6789/0 conn(0x7fb8480ba140 legacy=0x7fb8480c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb846d9d700 1 -- 172.21.15.6:0/2805501532 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848154c00 con 0x7fb84806d8a0 2023-07-21T07:36:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.892+0000 7fb846d9d700 1 --2- 172.21.15.6:0/2805501532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb84806d8a0 0x7fb848151ef0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb840009e50 tx=0x7fb84000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f165c312da5c56a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.893+0000 7fb84559a700 1 -- 172.21.15.6:0/2805501532 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84000e070 con 0x7fb84806d8a0 2023-07-21T07:36:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.893+0000 7fb84559a700 1 -- 172.21.15.6:0/2805501532 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84000b910 con 0x7fb84806d8a0 2023-07-21T07:36:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.893+0000 7fb84559a700 1 -- 172.21.15.6:0/2805501532 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84000bcc0 con 0x7fb84806d8a0 2023-07-21T07:36:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.893+0000 7fb84cd93700 1 -- 172.21.15.6:0/2805501532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb84806d8a0 msgr2=0x7fb848151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.893+0000 7fb84cd93700 1 --2- 172.21.15.6:0/2805501532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb84806d8a0 0x7fb848151ef0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb840009e50 tx=0x7fb84000b330 comp rx=0 tx=0).stop 2023-07-21T07:36:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.893+0000 7fb84cd93700 1 -- 172.21.15.6:0/2805501532 shutdown_connections 2023-07-21T07:36:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.893+0000 7fb84cd93700 1 --2- 172.21.15.6:0/2805501532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb84806d8a0 0x7fb848151ef0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.893+0000 7fb84cd93700 1 --2- 172.21.15.6:0/2805501532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb84806a300 0x7fb8481519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.893+0000 7fb84cd93700 1 -- 172.21.15.6:0/2805501532 >> 172.21.15.6:0/2805501532 conn(0x7fb8480a8660 msgr2=0x7fb8480a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.893+0000 7fb84cd93700 1 -- 172.21.15.6:0/2805501532 shutdown_connections 2023-07-21T07:36:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.893+0000 7fb84cd93700 1 -- 172.21.15.6:0/2805501532 wait complete. 2023-07-21T07:36:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.895+0000 7fb84cd93700 1 Processor -- start 2023-07-21T07:36:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.895+0000 7fb84cd93700 1 -- start start 2023-07-21T07:36:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb84cd93700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb84806a300 0x7fb8481ee010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb84cd93700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb84806d8a0 0x7fb8480a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb84cd93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8480ba140 0x7fb8481e9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb84cd93700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480bfe30 con 0x7fb8480ba140 2023-07-21T07:36:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb84cd93700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480bde30 con 0x7fb84806d8a0 2023-07-21T07:36:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb84cd93700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480be080 con 0x7fb84806a300 2023-07-21T07:36:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb846d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8480ba140 0x7fb8481e9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb846d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8480ba140 0x7fb8481e9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35102/0 (socket says 172.21.15.6:35102) 2023-07-21T07:36:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb846d9d700 1 -- 172.21.15.6:0/3064555403 learned_addr learned my addr 172.21.15.6:0/3064555403 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb84659c700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb84806a300 0x7fb8481ee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb845d9b700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb84806d8a0 0x7fb8480a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb846d9d700 1 -- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb84806a300 msgr2=0x7fb8481ee010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb846d9d700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb84806a300 0x7fb8481ee010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb846d9d700 1 -- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb84806d8a0 msgr2=0x7fb8480a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb846d9d700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb84806d8a0 0x7fb8480a7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb846d9d700 1 -- 172.21.15.6:0/3064555403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840009b30 con 0x7fb8480ba140 2023-07-21T07:36:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb846d9d700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8480ba140 0x7fb8481e9fc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb84806d570 tx=0x7fb840004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.896+0000 7fb836ffd700 1 -- 172.21.15.6:0/3064555403 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840004870 con 0x7fb8480ba140 2023-07-21T07:36:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.897+0000 7fb84cd93700 1 -- 172.21.15.6:0/3064555403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8481ed530 con 0x7fb8480ba140 2023-07-21T07:36:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.897+0000 7fb836ffd700 1 -- 172.21.15.6:0/3064555403 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400099b0 con 0x7fb8480ba140 2023-07-21T07:36:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.897+0000 7fb836ffd700 1 -- 172.21.15.6:0/3064555403 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84001b670 con 0x7fb8480ba140 2023-07-21T07:36:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.897+0000 7fb84cd93700 1 -- 172.21.15.6:0/3064555403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8481edaf0 con 0x7fb8480ba140 2023-07-21T07:36:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.898+0000 7fb84cd93700 1 -- 172.21.15.6:0/3064555403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb848074500 con 0x7fb8480ba140 2023-07-21T07:36:01.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.898+0000 7fb836ffd700 1 -- 172.21.15.6:0/3064555403 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb84001b7d0 con 0x7fb8480ba140 2023-07-21T07:36:01.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.898+0000 7fb836ffd700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb82806ad30 0x7fb82806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:01.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.898+0000 7fb836ffd700 1 -- 172.21.15.6:0/3064555403 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fb84008af40 con 0x7fb8480ba140 2023-07-21T07:36:01.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.899+0000 7fb84659c700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb82806ad30 0x7fb82806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:01.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.899+0000 7fb84659c700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb82806ad30 0x7fb82806d1f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb84814fe30 tx=0x7fb838009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:01.903+0000 7fb836ffd700 1 -- 172.21.15.6:0/3064555403 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb8400bd310 con 0x7fb8480ba140 2023-07-21T07:36:02.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.103+0000 7fb84cd93700 1 -- 172.21.15.6:0/3064555403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8480c3b90 con 0x7fb8480ba140 2023-07-21T07:36:02.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.104+0000 7fb836ffd700 1 -- 172.21.15.6:0/3064555403 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb840055e00 con 0x7fb8480ba140 2023-07-21T07:36:02.156 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:36:02.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.106+0000 7fb84cd93700 1 -- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb82806ad30 msgr2=0x7fb82806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:02.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.106+0000 7fb84cd93700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb82806ad30 0x7fb82806d1f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb84814fe30 tx=0x7fb838009210 comp rx=0 tx=0).stop 2023-07-21T07:36:02.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.106+0000 7fb84cd93700 1 -- 172.21.15.6:0/3064555403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8480ba140 msgr2=0x7fb8481e9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:02.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.106+0000 7fb84cd93700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8480ba140 0x7fb8481e9fc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb84806d570 tx=0x7fb840004ad0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.106+0000 7fb84cd93700 1 -- 172.21.15.6:0/3064555403 shutdown_connections 2023-07-21T07:36:02.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.106+0000 7fb84cd93700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb82806ad30 0x7fb82806d1f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.106+0000 7fb84cd93700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8480ba140 0x7fb8481e9fc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.106+0000 7fb84cd93700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb84806a300 0x7fb8481ee010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.106+0000 7fb84cd93700 1 --2- 172.21.15.6:0/3064555403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb84806d8a0 0x7fb8480a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.106+0000 7fb84cd93700 1 -- 172.21.15.6:0/3064555403 >> 172.21.15.6:0/3064555403 conn(0x7fb8480a8660 msgr2=0x7fb84814e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:02.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.106+0000 7fb84cd93700 1 -- 172.21.15.6:0/3064555403 shutdown_connections 2023-07-21T07:36:02.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.106+0000 7fb84cd93700 1 -- 172.21.15.6:0/3064555403 wait complete. 2023-07-21T07:36:02.170 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-21T07:36:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.246+0000 7f5e3b78a700 1 Processor -- start 2023-07-21T07:36:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.246+0000 7f5e3b78a700 1 -- start start 2023-07-21T07:36:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e3b78a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e3406a300 0x7f5e341519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:02.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e3b78a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5e340ba140 0x7f5e34151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:02.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e3b78a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e3406d8a0 0x7f5e340c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:02.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e3b78a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e340c1a30 con 0x7f5e3406a300 2023-07-21T07:36:02.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e3b78a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e34155530 con 0x7f5e340ba140 2023-07-21T07:36:02.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e3b78a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34154920 con 0x7f5e3406d8a0 2023-07-21T07:36:02.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e39526700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e3406a300 0x7f5e341519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:02.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e39526700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e3406a300 0x7f5e341519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35106/0 (socket says 172.21.15.6:35106) 2023-07-21T07:36:02.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e39526700 1 -- 172.21.15.6:0/1898946164 learned_addr learned my addr 172.21.15.6:0/1898946164 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:02.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e38d25700 1 --2- 172.21.15.6:0/1898946164 >> v2:172.21.15.86:3300/0 conn(0x7f5e340ba140 0x7f5e34151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:02.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e39d27700 1 --2- 172.21.15.6:0/1898946164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e3406d8a0 0x7f5e340c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:02.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e39526700 1 -- 172.21.15.6:0/1898946164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e3406d8a0 msgr2=0x7f5e340c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:02.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e39526700 1 --2- 172.21.15.6:0/1898946164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e3406d8a0 0x7f5e340c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e39526700 1 -- 172.21.15.6:0/1898946164 >> v2:172.21.15.86:3300/0 conn(0x7f5e340ba140 msgr2=0x7f5e34151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:02.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e39526700 1 --2- 172.21.15.6:0/1898946164 >> v2:172.21.15.86:3300/0 conn(0x7f5e340ba140 0x7f5e34151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e39526700 1 -- 172.21.15.6:0/1898946164 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34154c00 con 0x7f5e3406a300 2023-07-21T07:36:02.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.247+0000 7f5e39526700 1 --2- 172.21.15.6:0/1898946164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3406a300 0x7f5e341519b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5e340c1f00 tx=0x7f5e24009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32d7954b03ea89e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:02.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.248+0000 7f5e2bfff700 1 -- 172.21.15.6:0/1898946164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2400b870 con 0x7f5e3406a300 2023-07-21T07:36:02.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.248+0000 7f5e2bfff700 1 -- 172.21.15.6:0/1898946164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2400b9d0 con 0x7f5e3406a300 2023-07-21T07:36:02.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.248+0000 7f5e2bfff700 1 -- 172.21.15.6:0/1898946164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2400bd60 con 0x7f5e3406a300 2023-07-21T07:36:02.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.248+0000 7f5e3b78a700 1 -- 172.21.15.6:0/1898946164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3406a300 msgr2=0x7f5e341519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:02.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.248+0000 7f5e3b78a700 1 --2- 172.21.15.6:0/1898946164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3406a300 0x7f5e341519b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5e340c1f00 tx=0x7f5e24009bd0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.248+0000 7f5e3b78a700 1 -- 172.21.15.6:0/1898946164 shutdown_connections 2023-07-21T07:36:02.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.248+0000 7f5e3b78a700 1 --2- 172.21.15.6:0/1898946164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e3406d8a0 0x7f5e340c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.248+0000 7f5e3b78a700 1 --2- 172.21.15.6:0/1898946164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3406a300 0x7f5e341519b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.248+0000 7f5e3b78a700 1 --2- 172.21.15.6:0/1898946164 >> v2:172.21.15.86:3300/0 conn(0x7f5e340ba140 0x7f5e34151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.248+0000 7f5e3b78a700 1 -- 172.21.15.6:0/1898946164 >> 172.21.15.6:0/1898946164 conn(0x7f5e340a8660 msgr2=0x7f5e340a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:02.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.248+0000 7f5e3b78a700 1 -- 172.21.15.6:0/1898946164 shutdown_connections 2023-07-21T07:36:02.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.248+0000 7f5e3b78a700 1 -- 172.21.15.6:0/1898946164 wait complete. 2023-07-21T07:36:02.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.249+0000 7f5e3b78a700 1 Processor -- start 2023-07-21T07:36:02.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.249+0000 7f5e3b78a700 1 -- start start 2023-07-21T07:36:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e3b78a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3406a300 0x7f5e340c01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e3b78a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3406d8a0 0x7f5e341ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e3b78a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340ba140 0x7f5e341edd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e3b78a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e340c31b0 con 0x7f5e3406a300 2023-07-21T07:36:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e3b78a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e340be860 con 0x7f5e3406d8a0 2023-07-21T07:36:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e3b78a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e341ed220 con 0x7f5e340ba140 2023-07-21T07:36:02.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e39526700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3406a300 0x7f5e340c01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:02.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e39526700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3406a300 0x7f5e340c01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35112/0 (socket says 172.21.15.6:35112) 2023-07-21T07:36:02.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e39526700 1 -- 172.21.15.6:0/461887084 learned_addr learned my addr 172.21.15.6:0/461887084 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:02.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e39d27700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340ba140 0x7f5e341edd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:02.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e38d25700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3406d8a0 0x7f5e341ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:02.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e39526700 1 -- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340ba140 msgr2=0x7f5e341edd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:02.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e39526700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340ba140 0x7f5e341edd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e39526700 1 -- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3406d8a0 msgr2=0x7f5e341ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.250+0000 7f5e39526700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3406d8a0 0x7f5e341ed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.251+0000 7f5e39526700 1 -- 172.21.15.6:0/461887084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e24009550 con 0x7f5e3406a300 2023-07-21T07:36:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.251+0000 7f5e39d27700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340ba140 0x7f5e341edd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.251+0000 7f5e39526700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3406a300 0x7f5e340c01f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5e24000c00 tx=0x7f5e24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.251+0000 7f5e29ffb700 1 -- 172.21.15.6:0/461887084 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24004520 con 0x7f5e3406a300 2023-07-21T07:36:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.251+0000 7f5e29ffb700 1 -- 172.21.15.6:0/461887084 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2401e070 con 0x7f5e3406a300 2023-07-21T07:36:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.251+0000 7f5e3b78a700 1 -- 172.21.15.6:0/461887084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e340bdf30 con 0x7f5e3406a300 2023-07-21T07:36:02.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.251+0000 7f5e29ffb700 1 -- 172.21.15.6:0/461887084 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e240038c0 con 0x7f5e3406a300 2023-07-21T07:36:02.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.251+0000 7f5e3b78a700 1 -- 172.21.15.6:0/461887084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e340be4f0 con 0x7f5e3406a300 2023-07-21T07:36:02.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.252+0000 7f5e3b78a700 1 -- 172.21.15.6:0/461887084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e340be680 con 0x7f5e3406a300 2023-07-21T07:36:02.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.253+0000 7f5e29ffb700 1 -- 172.21.15.6:0/461887084 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e24003a20 con 0x7f5e3406a300 2023-07-21T07:36:02.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.253+0000 7f5e29ffb700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e1806ace0 0x7f5e1806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:02.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.253+0000 7f5e29ffb700 1 -- 172.21.15.6:0/461887084 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f5e24020070 con 0x7f5e3406a300 2023-07-21T07:36:02.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.253+0000 7f5e38d25700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e1806ace0 0x7f5e1806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:02.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.254+0000 7f5e38d25700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e1806ace0 0x7f5e1806d1a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5e341e7af0 tx=0x7f5e30008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:02.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.258+0000 7f5e29ffb700 1 -- 172.21.15.6:0/461887084 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5e24055a80 con 0x7f5e3406a300 2023-07-21T07:36:02.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.455+0000 7f5e3b78a700 1 -- 172.21.15.6:0/461887084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e340bea10 con 0x7f5e3406a300 2023-07-21T07:36:02.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.456+0000 7f5e29ffb700 1 -- 172.21.15.6:0/461887084 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v40) v1 ==== 105+0+11 (secure 0 0 0) 0x7f5e240150b0 con 0x7f5e3406a300 2023-07-21T07:36:02.508 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:36:02.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.458+0000 7f5e3b78a700 1 -- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e1806ace0 msgr2=0x7f5e1806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:02.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.458+0000 7f5e3b78a700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e1806ace0 0x7f5e1806d1a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5e341e7af0 tx=0x7f5e30008040 comp rx=0 tx=0).stop 2023-07-21T07:36:02.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.458+0000 7f5e3b78a700 1 -- 172.21.15.6:0/461887084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3406a300 msgr2=0x7f5e340c01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:02.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.458+0000 7f5e3b78a700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3406a300 0x7f5e340c01f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5e24000c00 tx=0x7f5e24004750 comp rx=0 tx=0).stop 2023-07-21T07:36:02.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.458+0000 7f5e3b78a700 1 -- 172.21.15.6:0/461887084 shutdown_connections 2023-07-21T07:36:02.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.458+0000 7f5e3b78a700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5e1806ace0 0x7f5e1806d1a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.458+0000 7f5e3b78a700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340ba140 0x7f5e341edd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.458+0000 7f5e3b78a700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e3406a300 0x7f5e340c01f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.458+0000 7f5e3b78a700 1 --2- 172.21.15.6:0/461887084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3406d8a0 0x7f5e341ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.458+0000 7f5e3b78a700 1 -- 172.21.15.6:0/461887084 >> 172.21.15.6:0/461887084 conn(0x7f5e340a8660 msgr2=0x7f5e3414d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:02.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.458+0000 7f5e3b78a700 1 -- 172.21.15.6:0/461887084 shutdown_connections 2023-07-21T07:36:02.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.458+0000 7f5e3b78a700 1 -- 172.21.15.6:0/461887084 wait complete. 2023-07-21T07:36:02.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-21T07:36:02.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.599+0000 7f7fadf9a700 1 Processor -- start 2023-07-21T07:36:02.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.599+0000 7f7fadf9a700 1 -- start start 2023-07-21T07:36:02.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fadf9a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fa806a300 0x7f7fa81519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:02.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fadf9a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7fa80ba140 0x7f7fa8151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:02.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fadf9a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa8155530 con 0x7f7fa806d8a0 2023-07-21T07:36:02.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fadf9a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa80c1a30 con 0x7f7fa80ba140 2023-07-21T07:36:02.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fadf9a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8154920 con 0x7f7fa806a300 2023-07-21T07:36:02.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fa7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7fa806d8a0 0x7f7fa80c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43144/0 (socket says 172.21.15.6:43144) 2023-07-21T07:36:02.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fa7fff700 1 -- 172.21.15.6:0/1083055510 learned_addr learned my addr 172.21.15.6:0/1083055510 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:02.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fa77fe700 1 --2- 172.21.15.6:0/1083055510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fa806a300 0x7f7fa81519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:02.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fa6ffd700 1 --2- 172.21.15.6:0/1083055510 >> v2:172.21.15.86:3300/0 conn(0x7f7fa80ba140 0x7f7fa8151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:02.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fa67fc700 1 -- 172.21.15.6:0/1083055510 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125999973 0 0) 0x7f7fa8155530 con 0x7f7fa806d8a0 2023-07-21T07:36:02.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fa67fc700 1 -- 172.21.15.6:0/1083055510 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f940035b0 con 0x7f7fa806d8a0 2023-07-21T07:36:02.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fa77fe700 1 -- 172.21.15.6:0/1083055510 >> v2:172.21.15.86:3300/0 conn(0x7f7fa80ba140 msgr2=0x7f7fa8151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:02.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fa77fe700 1 --2- 172.21.15.6:0/1083055510 >> v2:172.21.15.86:3300/0 conn(0x7f7fa80ba140 0x7f7fa8151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fa77fe700 1 -- 172.21.15.6:0/1083055510 >> v1:172.21.15.6:6789/0 conn(0x7f7fa806d8a0 legacy=0x7f7fa80c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:02.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fa77fe700 1 -- 172.21.15.6:0/1083055510 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8154c00 con 0x7f7fa806a300 2023-07-21T07:36:02.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.600+0000 7f7fa6ffd700 1 --2- 172.21.15.6:0/1083055510 >> v2:172.21.15.86:3300/0 conn(0x7f7fa80ba140 0x7f7fa8151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:02.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.601+0000 7f7fa77fe700 1 --2- 172.21.15.6:0/1083055510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fa806a300 0x7f7fa81519b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009840 tx=0x7f7f98009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b68e0c45f55a26ae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:02.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.601+0000 7f7fa67fc700 1 -- 172.21.15.6:0/1083055510 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98011830 con 0x7f7fa806a300 2023-07-21T07:36:02.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.601+0000 7f7fa67fc700 1 -- 172.21.15.6:0/1083055510 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f98011990 con 0x7f7fa806a300 2023-07-21T07:36:02.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.601+0000 7f7fa67fc700 1 -- 172.21.15.6:0/1083055510 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98011d00 con 0x7f7fa806a300 2023-07-21T07:36:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.601+0000 7f7fadf9a700 1 -- 172.21.15.6:0/1083055510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fa806a300 msgr2=0x7f7fa81519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.601+0000 7f7fadf9a700 1 --2- 172.21.15.6:0/1083055510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fa806a300 0x7f7fa81519b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009840 tx=0x7f7f98009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.601+0000 7f7fadf9a700 1 -- 172.21.15.6:0/1083055510 shutdown_connections 2023-07-21T07:36:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.601+0000 7f7fadf9a700 1 --2- 172.21.15.6:0/1083055510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fa806a300 0x7f7fa81519b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.601+0000 7f7fadf9a700 1 --2- 172.21.15.6:0/1083055510 >> v2:172.21.15.86:3300/0 conn(0x7f7fa80ba140 0x7f7fa8151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.601+0000 7f7fadf9a700 1 -- 172.21.15.6:0/1083055510 >> 172.21.15.6:0/1083055510 conn(0x7f7fa80a8660 msgr2=0x7f7fa80a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.602+0000 7f7fadf9a700 1 -- 172.21.15.6:0/1083055510 shutdown_connections 2023-07-21T07:36:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.602+0000 7f7fadf9a700 1 -- 172.21.15.6:0/1083055510 wait complete. 2023-07-21T07:36:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.603+0000 7f7fadf9a700 1 Processor -- start 2023-07-21T07:36:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.603+0000 7f7fadf9a700 1 -- start start 2023-07-21T07:36:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fadf9a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa806a300 0x7f7fa80a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fadf9a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fa806d8a0 0x7f7fa80a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fadf9a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fa80ba140 0x7f7fa80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fadf9a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80a75e0 con 0x7f7fa806a300 2023-07-21T07:36:02.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fadf9a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80a8270 con 0x7f7fa806d8a0 2023-07-21T07:36:02.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fadf9a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa814a8b0 con 0x7f7fa80ba140 2023-07-21T07:36:02.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fa77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa806a300 0x7f7fa80a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:02.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fa77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa806a300 0x7f7fa80a6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35126/0 (socket says 172.21.15.6:35126) 2023-07-21T07:36:02.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fa77fe700 1 -- 172.21.15.6:0/3888297082 learned_addr learned my addr 172.21.15.6:0/3888297082 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:02.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fa7fff700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fa80ba140 0x7f7fa80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:02.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fa6ffd700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fa806d8a0 0x7f7fa80a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:02.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fa77fe700 1 -- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fa80ba140 msgr2=0x7f7fa80707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fa77fe700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fa80ba140 0x7f7fa80707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fa77fe700 1 -- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fa806d8a0 msgr2=0x7f7fa80a6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fa77fe700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fa806d8a0 0x7f7fa80a6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fa77fe700 1 -- 172.21.15.6:0/3888297082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f900094a0 con 0x7f7fa806a300 2023-07-21T07:36:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fa7fff700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fa80ba140 0x7f7fa80707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fa6ffd700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fa806d8a0 0x7f7fa80a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fa77fe700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa806a300 0x7f7fa80a6880 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7f980090b0 tx=0x7f7f98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7f9ffff700 1 -- 172.21.15.6:0/3888297082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9801a6d0 con 0x7f7fa806a300 2023-07-21T07:36:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7f9ffff700 1 -- 172.21.15.6:0/3888297082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9801a850 con 0x7f7fa806a300 2023-07-21T07:36:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7f9ffff700 1 -- 172.21.15.6:0/3888297082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9801ac00 con 0x7f7fa806a300 2023-07-21T07:36:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fadf9a700 1 -- 172.21.15.6:0/3888297082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f980094a0 con 0x7f7fa806a300 2023-07-21T07:36:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.604+0000 7f7fadf9a700 1 -- 172.21.15.6:0/3888297082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa80a7c20 con 0x7f7fa806a300 2023-07-21T07:36:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.605+0000 7f7fadf9a700 1 -- 172.21.15.6:0/3888297082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa8074500 con 0x7f7fa806a300 2023-07-21T07:36:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.606+0000 7f7f9ffff700 1 -- 172.21.15.6:0/3888297082 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f98022070 con 0x7f7fa806a300 2023-07-21T07:36:02.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.606+0000 7f7f9ffff700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7f8806ace0 0x7f7f8806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:02.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.606+0000 7f7f9ffff700 1 -- 172.21.15.6:0/3888297082 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f7f9808a5b0 con 0x7f7fa806a300 2023-07-21T07:36:02.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.607+0000 7f7fa6ffd700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7f8806ace0 0x7f7f8806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:02.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.607+0000 7f7fa6ffd700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7f8806ace0 0x7f7f8806d1a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80bd840 tx=0x7f7f90008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:02.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.611+0000 7f7f9ffff700 1 -- 172.21.15.6:0/3888297082 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7f98055310 con 0x7f7fa806a300 2023-07-21T07:36:02.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.807+0000 7f7fadf9a700 1 -- 172.21.15.6:0/3888297082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f7fa8154eb0 con 0x7f7fa806a300 2023-07-21T07:36:02.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.807+0000 7f7f9ffff700 1 -- 172.21.15.6:0/3888297082 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v40) v1 ==== 101+0+11 (secure 0 0 0) 0x7f7f98058930 con 0x7f7fa806a300 2023-07-21T07:36:02.860 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:36:02.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.810+0000 7f7fadf9a700 1 -- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7f8806ace0 msgr2=0x7f7f8806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:02.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.810+0000 7f7fadf9a700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7f8806ace0 0x7f7f8806d1a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80bd840 tx=0x7f7f90008040 comp rx=0 tx=0).stop 2023-07-21T07:36:02.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.810+0000 7f7fadf9a700 1 -- 172.21.15.6:0/3888297082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa806a300 msgr2=0x7f7fa80a6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:02.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.810+0000 7f7fadf9a700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa806a300 0x7f7fa80a6880 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7f980090b0 tx=0x7f7f98004750 comp rx=0 tx=0).stop 2023-07-21T07:36:02.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.810+0000 7f7fadf9a700 1 -- 172.21.15.6:0/3888297082 shutdown_connections 2023-07-21T07:36:02.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.810+0000 7f7fadf9a700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7f8806ace0 0x7f7f8806d1a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.810+0000 7f7fadf9a700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fa80ba140 0x7f7fa80707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.810+0000 7f7fadf9a700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa806a300 0x7f7fa80a6880 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.810+0000 7f7fadf9a700 1 --2- 172.21.15.6:0/3888297082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fa806d8a0 0x7f7fa80a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:02.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.810+0000 7f7fadf9a700 1 -- 172.21.15.6:0/3888297082 >> 172.21.15.6:0/3888297082 conn(0x7f7fa80a8660 msgr2=0x7f7fa81de1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:02.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.810+0000 7f7fadf9a700 1 -- 172.21.15.6:0/3888297082 shutdown_connections 2023-07-21T07:36:02.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.810+0000 7f7fadf9a700 1 -- 172.21.15.6:0/3888297082 wait complete. 2023-07-21T07:36:02.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T07:36:03.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.949+0000 7f6929ee0700 1 Processor -- start 2023-07-21T07:36:03.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.949+0000 7f6929ee0700 1 -- start start 2023-07-21T07:36:03.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.949+0000 7f6929ee0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f69240c1330 0x7f6924151c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.949+0000 7f6929ee0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6924155110 0x7f692414e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f6929ee0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6924152160 con 0x7f69240c6c90 2023-07-21T07:36:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f6929ee0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69240c4b70 con 0x7f69240c1330 2023-07-21T07:36:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f6929ee0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69240c17d0 con 0x7f6924155110 2023-07-21T07:36:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f6922ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f69240c1330 0x7f6924151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f69237fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f69240c6c90 0x7f69240c5230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43154/0 (socket says 172.21.15.6:43154) 2023-07-21T07:36:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f69237fe700 1 -- 172.21.15.6:0/1184386605 learned_addr learned my addr 172.21.15.6:0/1184386605 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f6923fff700 1 --2- 172.21.15.6:0/1184386605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6924155110 0x7f692414e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f6922ffd700 1 -- 172.21.15.6:0/1184386605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6924155110 msgr2=0x7f692414e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f6922ffd700 1 --2- 172.21.15.6:0/1184386605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6924155110 0x7f692414e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f6922ffd700 1 -- 172.21.15.6:0/1184386605 >> v1:172.21.15.6:6789/0 conn(0x7f69240c6c90 legacy=0x7f69240c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f6922ffd700 1 -- 172.21.15.6:0/1184386605 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240c1ab0 con 0x7f69240c1330 2023-07-21T07:36:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f6923fff700 1 --2- 172.21.15.6:0/1184386605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6924155110 0x7f692414e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f6922ffd700 1 --2- 172.21.15.6:0/1184386605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69240c1330 0x7f6924151c20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6918009840 tx=0x7f6918009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d27e5b938176837 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f69227fc700 1 -- 172.21.15.6:0/1184386605 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6918011830 con 0x7f69240c1330 2023-07-21T07:36:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f69227fc700 1 -- 172.21.15.6:0/1184386605 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6918011990 con 0x7f69240c1330 2023-07-21T07:36:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.950+0000 7f69227fc700 1 -- 172.21.15.6:0/1184386605 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6918011d20 con 0x7f69240c1330 2023-07-21T07:36:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.951+0000 7f6929ee0700 1 -- 172.21.15.6:0/1184386605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69240c1330 msgr2=0x7f6924151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.951+0000 7f6929ee0700 1 --2- 172.21.15.6:0/1184386605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69240c1330 0x7f6924151c20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6918009840 tx=0x7f6918009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.951+0000 7f6929ee0700 1 -- 172.21.15.6:0/1184386605 shutdown_connections 2023-07-21T07:36:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.951+0000 7f6929ee0700 1 --2- 172.21.15.6:0/1184386605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6924155110 0x7f692414e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.951+0000 7f6929ee0700 1 --2- 172.21.15.6:0/1184386605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69240c1330 0x7f6924151c20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.951+0000 7f6929ee0700 1 -- 172.21.15.6:0/1184386605 >> 172.21.15.6:0/1184386605 conn(0x7f692406b1a0 msgr2=0x7f692406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.951+0000 7f6929ee0700 1 -- 172.21.15.6:0/1184386605 shutdown_connections 2023-07-21T07:36:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.951+0000 7f6929ee0700 1 -- 172.21.15.6:0/1184386605 wait complete. 2023-07-21T07:36:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.952+0000 7f6929ee0700 1 Processor -- start 2023-07-21T07:36:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.952+0000 7f6929ee0700 1 -- start start 2023-07-21T07:36:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6929ee0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69240c1330 0x7f6924150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6929ee0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69240c6c90 0x7f692414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6929ee0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6924155110 0x7f692414b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6929ee0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69241e7bf0 con 0x7f6924155110 2023-07-21T07:36:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6929ee0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69241dc570 con 0x7f69240c6c90 2023-07-21T07:36:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6929ee0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69241e72c0 con 0x7f69240c1330 2023-07-21T07:36:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6923fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6924155110 0x7f692414b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6923fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6924155110 0x7f692414b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35144/0 (socket says 172.21.15.6:35144) 2023-07-21T07:36:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6923fff700 1 -- 172.21.15.6:0/4215184001 learned_addr learned my addr 172.21.15.6:0/4215184001 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f69237fe700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69240c1330 0x7f6924150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6922ffd700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69240c6c90 0x7f692414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6923fff700 1 -- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69240c1330 msgr2=0x7f6924150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6923fff700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69240c1330 0x7f6924150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6923fff700 1 -- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69240c6c90 msgr2=0x7f692414b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6923fff700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69240c6c90 0x7f692414b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6923fff700 1 -- 172.21.15.6:0/4215184001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69180094a0 con 0x7f6924155110 2023-07-21T07:36:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.953+0000 7f6923fff700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6924155110 0x7f692414b680 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f691c00cd50 tx=0x7f691c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.954+0000 7f690bfff700 1 -- 172.21.15.6:0/4215184001 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c00f480 con 0x7f6924155110 2023-07-21T07:36:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.954+0000 7f690bfff700 1 -- 172.21.15.6:0/4215184001 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c00f600 con 0x7f6924155110 2023-07-21T07:36:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.954+0000 7f690bfff700 1 -- 172.21.15.6:0/4215184001 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c00f9b0 con 0x7f6924155110 2023-07-21T07:36:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.954+0000 7f6929ee0700 1 -- 172.21.15.6:0/4215184001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69241e75a0 con 0x7f6924155110 2023-07-21T07:36:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.954+0000 7f6929ee0700 1 -- 172.21.15.6:0/4215184001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692414bbc0 con 0x7f6924155110 2023-07-21T07:36:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.955+0000 7f6929ee0700 1 -- 172.21.15.6:0/4215184001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692406bae0 con 0x7f6924155110 2023-07-21T07:36:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.955+0000 7f690bfff700 1 -- 172.21.15.6:0/4215184001 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f691c00b040 con 0x7f6924155110 2023-07-21T07:36:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.956+0000 7f690bfff700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f691006ad10 0x7f691006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.956+0000 7f690bfff700 1 -- 172.21.15.6:0/4215184001 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f691c08a0a0 con 0x7f6924155110 2023-07-21T07:36:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.956+0000 7f69237fe700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f691006ad10 0x7f691006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.957+0000 7f69237fe700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f691006ad10 0x7f691006d1d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6914005910 tx=0x7f6914009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:02.960+0000 7f690bfff700 1 -- 172.21.15.6:0/4215184001 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f691c054f60 con 0x7f6924155110 2023-07-21T07:36:03.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.173+0000 7f6929ee0700 1 -- 172.21.15.6:0/4215184001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f69240c7070 con 0x7f6924155110 2023-07-21T07:36:03.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.173+0000 7f690bfff700 1 -- 172.21.15.6:0/4215184001 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7f691c058580 con 0x7f6924155110 2023-07-21T07:36:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.175+0000 7f6929ee0700 1 -- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f691006ad10 msgr2=0x7f691006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.175+0000 7f6929ee0700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f691006ad10 0x7f691006d1d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6914005910 tx=0x7f6914009040 comp rx=0 tx=0).stop 2023-07-21T07:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.175+0000 7f6929ee0700 1 -- 172.21.15.6:0/4215184001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6924155110 msgr2=0x7f692414b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.175+0000 7f6929ee0700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6924155110 0x7f692414b680 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f691c00cd50 tx=0x7f691c00a560 comp rx=0 tx=0).stop 2023-07-21T07:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.175+0000 7f6929ee0700 1 -- 172.21.15.6:0/4215184001 shutdown_connections 2023-07-21T07:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.175+0000 7f6929ee0700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f691006ad10 0x7f691006d1d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.175+0000 7f6929ee0700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6924155110 0x7f692414b680 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.175+0000 7f6929ee0700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69240c1330 0x7f6924150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.175+0000 7f6929ee0700 1 --2- 172.21.15.6:0/4215184001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69240c6c90 0x7f692414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.175+0000 7f6929ee0700 1 -- 172.21.15.6:0/4215184001 >> 172.21.15.6:0/4215184001 conn(0x7f692406b1a0 msgr2=0x7f692414e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.175+0000 7f6929ee0700 1 -- 172.21.15.6:0/4215184001 shutdown_connections 2023-07-21T07:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.175+0000 7f6929ee0700 1 -- 172.21.15.6:0/4215184001 wait complete. 2023-07-21T07:36:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-21T07:36:03.239 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-21T07:36:03.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:03.240 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-21T07:36:03.285 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-07-21T07:36:03.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:03.286 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-21T07:36:03.305 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:36:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.378+0000 7fc79248b700 1 Processor -- start 2023-07-21T07:36:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.379+0000 7fc79248b700 1 -- start start 2023-07-21T07:36:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.379+0000 7fc79248b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc78c06da20 0x7fc78c151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.379+0000 7fc79248b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c0c2ab0 con 0x7fc78c151c50 2023-07-21T07:36:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.379+0000 7fc79248b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c06e000 con 0x7fc78c06a300 2023-07-21T07:36:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.379+0000 7fc79248b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78c152090 con 0x7fc78c06da20 2023-07-21T07:36:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.379+0000 7fc78b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc78c06da20 0x7fc78c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.379+0000 7fc790a28700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc78c151c50 0x7fc78c0c2f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43172/0 (socket says 172.21.15.6:43172) 2023-07-21T07:36:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.379+0000 7fc790a28700 1 -- 172.21.15.6:0/3876063291 learned_addr learned my addr 172.21.15.6:0/3876063291 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.380+0000 7fc78b7fe700 1 -- 172.21.15.6:0/3876063291 >> v1:172.21.15.86:6789/0 conn(0x7fc78c06a300 legacy=0x7fc78c155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.380+0000 7fc78b7fe700 1 -- 172.21.15.6:0/3876063291 >> v1:172.21.15.6:6789/0 conn(0x7fc78c151c50 legacy=0x7fc78c0c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.380+0000 7fc78b7fe700 1 -- 172.21.15.6:0/3876063291 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c06e2e0 con 0x7fc78c06da20 2023-07-21T07:36:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.380+0000 7fc78b7fe700 1 --2- 172.21.15.6:0/3876063291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc78c06da20 0x7fc78c151710 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc774009870 tx=0x7fc774009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0e6a07106ff0ef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.380+0000 7fc78affd700 1 -- 172.21.15.6:0/3876063291 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774011830 con 0x7fc78c06da20 2023-07-21T07:36:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.380+0000 7fc78affd700 1 -- 172.21.15.6:0/3876063291 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774011990 con 0x7fc78c06da20 2023-07-21T07:36:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.380+0000 7fc78affd700 1 -- 172.21.15.6:0/3876063291 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774011d20 con 0x7fc78c06da20 2023-07-21T07:36:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.381+0000 7fc79248b700 1 -- 172.21.15.6:0/3876063291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc78c06da20 msgr2=0x7fc78c151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.381+0000 7fc79248b700 1 --2- 172.21.15.6:0/3876063291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc78c06da20 0x7fc78c151710 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc774009870 tx=0x7fc774009b80 comp rx=0 tx=0).stop 2023-07-21T07:36:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.381+0000 7fc79248b700 1 -- 172.21.15.6:0/3876063291 shutdown_connections 2023-07-21T07:36:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.381+0000 7fc79248b700 1 --2- 172.21.15.6:0/3876063291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc78c06da20 0x7fc78c151710 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.381+0000 7fc79248b700 1 -- 172.21.15.6:0/3876063291 >> 172.21.15.6:0/3876063291 conn(0x7fc78c0a8c90 msgr2=0x7fc78c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.381+0000 7fc79248b700 1 -- 172.21.15.6:0/3876063291 shutdown_connections 2023-07-21T07:36:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.381+0000 7fc79248b700 1 -- 172.21.15.6:0/3876063291 wait complete. 2023-07-21T07:36:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.382+0000 7fc79248b700 1 Processor -- start 2023-07-21T07:36:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.382+0000 7fc79248b700 1 -- start start 2023-07-21T07:36:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc79248b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc78c06a300 0x7fc78c0be5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc79248b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc78c06da20 0x7fc78c153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc79248b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc78c151c50 0x7fc78c0bf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc79248b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0bbbd0 con 0x7fc78c151c50 2023-07-21T07:36:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc79248b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0bcfa0 con 0x7fc78c06da20 2023-07-21T07:36:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc79248b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0c0220 con 0x7fc78c06a300 2023-07-21T07:36:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc790a28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc78c151c50 0x7fc78c0bf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc790a28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc78c151c50 0x7fc78c0bf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35158/0 (socket says 172.21.15.6:35158) 2023-07-21T07:36:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc790a28700 1 -- 172.21.15.6:0/3864511206 learned_addr learned my addr 172.21.15.6:0/3864511206 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc78b7fe700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc78c06da20 0x7fc78c153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc78bfff700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc78c06a300 0x7fc78c0be5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc790a28700 1 -- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc78c06a300 msgr2=0x7fc78c0be5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc790a28700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc78c06a300 0x7fc78c0be5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc790a28700 1 -- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc78c06da20 msgr2=0x7fc78c153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc790a28700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc78c06da20 0x7fc78c153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc790a28700 1 -- 172.21.15.6:0/3864511206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7740094a0 con 0x7fc78c151c50 2023-07-21T07:36:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.383+0000 7fc790a28700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc78c151c50 0x7fc78c0bf1d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc78400ca80 tx=0x7fc78400cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.384+0000 7fc788ff9700 1 -- 172.21.15.6:0/3864511206 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78400a9e0 con 0x7fc78c151c50 2023-07-21T07:36:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.384+0000 7fc788ff9700 1 -- 172.21.15.6:0/3864511206 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78400ab40 con 0x7fc78c151c50 2023-07-21T07:36:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.384+0000 7fc788ff9700 1 -- 172.21.15.6:0/3864511206 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784012400 con 0x7fc78c151c50 2023-07-21T07:36:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.384+0000 7fc79248b700 1 -- 172.21.15.6:0/3864511206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78c0bcb80 con 0x7fc78c151c50 2023-07-21T07:36:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.384+0000 7fc79248b700 1 -- 172.21.15.6:0/3864511206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c0bd1d0 con 0x7fc78c151c50 2023-07-21T07:36:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.385+0000 7fc79248b700 1 -- 172.21.15.6:0/3864511206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78c0bfff0 con 0x7fc78c151c50 2023-07-21T07:36:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.385+0000 7fc788ff9700 1 -- 172.21.15.6:0/3864511206 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc78401b3b0 con 0x7fc78c151c50 2023-07-21T07:36:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.386+0000 7fc788ff9700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc76c06ace0 0x7fc76c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.386+0000 7fc788ff9700 1 -- 172.21.15.6:0/3864511206 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fc784089210 con 0x7fc78c151c50 2023-07-21T07:36:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.386+0000 7fc78bfff700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc76c06ace0 0x7fc76c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.386+0000 7fc78bfff700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc76c06ace0 0x7fc76c06d1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc77c007fd0 tx=0x7fc77c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.390+0000 7fc788ff9700 1 -- 172.21.15.6:0/3864511206 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc78c0bfff0 con 0x7fc78c151c50 2023-07-21T07:36:03.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.637+0000 7fc79248b700 1 -- 172.21.15.6:0/3864511206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc78c0bfff0 con 0x7fc78c151c50 2023-07-21T07:36:03.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.637+0000 7fc788ff9700 1 -- 172.21.15.6:0/3864511206 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5804 (secure 0 0 0) 0x7fc78c0bfff0 con 0x7fc78c151c50 2023-07-21T07:36:03.690 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:03.690 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1808819585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1808819585},{"type":"v1","addr":"172.21.15.6:6834","nonce":1808819585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/422116109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":422116109},{"type":"v1","addr":"172.21.15.86:6836","nonce":422116109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:30.954456+0000","modified":"2023-07-21T07:35:34.571830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/459917011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":459917011},{"type":"v1","addr":"172.21.15.6:6835","nonce":459917011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:45.299013+0000","modified":"2023-07-21T07:35:48.891082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.86:6837/3328348149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3328348149},{"type":"v1","addr":"172.21.15.86:6837","nonce":3328348149}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T07:36:03.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.640+0000 7fc79248b700 1 -- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc76c06ace0 msgr2=0x7fc76c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.640+0000 7fc79248b700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc76c06ace0 0x7fc76c06d1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc77c007fd0 tx=0x7fc77c009040 comp rx=0 tx=0).stop 2023-07-21T07:36:03.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.640+0000 7fc79248b700 1 -- 172.21.15.6:0/3864511206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc78c151c50 msgr2=0x7fc78c0bf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.640+0000 7fc79248b700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc78c151c50 0x7fc78c0bf1d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc78400ca80 tx=0x7fc78400cd90 comp rx=0 tx=0).stop 2023-07-21T07:36:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.640+0000 7fc79248b700 1 -- 172.21.15.6:0/3864511206 shutdown_connections 2023-07-21T07:36:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.640+0000 7fc79248b700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc76c06ace0 0x7fc76c06d1a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.640+0000 7fc79248b700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc78c151c50 0x7fc78c0bf1d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.640+0000 7fc79248b700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc78c06a300 0x7fc78c0be5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.640+0000 7fc79248b700 1 --2- 172.21.15.6:0/3864511206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc78c06da20 0x7fc78c153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.640+0000 7fc79248b700 1 -- 172.21.15.6:0/3864511206 >> 172.21.15.6:0/3864511206 conn(0x7fc78c0a8c90 msgr2=0x7fc78c06b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.640+0000 7fc79248b700 1 -- 172.21.15.6:0/3864511206 shutdown_connections 2023-07-21T07:36:03.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.640+0000 7fc79248b700 1 -- 172.21.15.6:0/3864511206 wait complete. 2023-07-21T07:36:03.694 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 22 2023-07-21T07:36:03.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:03.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.777+0000 7fc75e8ce700 1 Processor -- start 2023-07-21T07:36:03.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.777+0000 7fc75e8ce700 1 -- start start 2023-07-21T07:36:03.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.778+0000 7fc75e8ce700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc75814fa60 0x7fc75806a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.778+0000 7fc75e8ce700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc75806bf00 0x7fc7580c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.778+0000 7fc75e8ce700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc758153270 con 0x7fc75806b8b0 2023-07-21T07:36:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.778+0000 7fc75e8ce700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc758152d80 con 0x7fc75814fa60 2023-07-21T07:36:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.778+0000 7fc75e8ce700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580c4b00 con 0x7fc75806bf00 2023-07-21T07:36:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.778+0000 7fc75ce6b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc75806b8b0 0x7fc7580c5490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43186/0 (socket says 172.21.15.6:43186) 2023-07-21T07:36:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.778+0000 7fc75ce6b700 1 -- 172.21.15.6:0/3581157332 learned_addr learned my addr 172.21.15.6:0/3581157332 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc757fff700 1 --2- 172.21.15.6:0/3581157332 >> v2:172.21.15.86:3300/0 conn(0x7fc75814fa60 0x7fc75806a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc7577fe700 1 --2- 172.21.15.6:0/3581157332 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc75806bf00 0x7fc7580c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672015243 0 0) 0x7fc758153270 con 0x7fc75806b8b0 2023-07-21T07:36:03.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7440035b0 con 0x7fc75806b8b0 2023-07-21T07:36:03.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1760633657 0 0) 0x7fc7440035b0 con 0x7fc75806b8b0 2023-07-21T07:36:03.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc75806bf00 msgr2=0x7fc7580c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:03.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 --2- 172.21.15.6:0/3581157332 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc75806bf00 0x7fc7580c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 >> v2:172.21.15.86:3300/0 conn(0x7fc75814fa60 msgr2=0x7fc75806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:03.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 --2- 172.21.15.6:0/3581157332 >> v2:172.21.15.86:3300/0 conn(0x7fc75814fa60 0x7fc75806a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75806de30 con 0x7fc75806b8b0 2023-07-21T07:36:03.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7fc7500019f0 con 0x7fc75806b8b0 2023-07-21T07:36:03.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 >> v1:172.21.15.6:6789/0 conn(0x7fc75806b8b0 legacy=0x7fc7580c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 --2- 172.21.15.6:0/3581157332 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc75806bf00 0x7fc744003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 --2- 172.21.15.6:0/3581157332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc744003f80 0x7fc744004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 --2- 172.21.15.6:0/3581157332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc744004d90 0x7fc744005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758152d80 con 0x7fc744004d90 2023-07-21T07:36:03.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580c4b00 con 0x7fc744003f80 2023-07-21T07:36:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74400ba60 con 0x7fc75806bf00 2023-07-21T07:36:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc75ce6b700 1 --2- 172.21.15.6:0/3581157332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc744004d90 0x7fc744005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc757fff700 1 --2- 172.21.15.6:0/3581157332 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc75806bf00 0x7fc744003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc7577fe700 1 --2- 172.21.15.6:0/3581157332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc744003f80 0x7fc744004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc75ce6b700 1 -- 172.21.15.6:0/3581157332 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc75806bf00 msgr2=0x7fc744003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:03.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc75ce6b700 1 --2- 172.21.15.6:0/3581157332 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc75806bf00 0x7fc744003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc75ce6b700 1 -- 172.21.15.6:0/3581157332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc744003f80 msgr2=0x7fc744004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:03.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc75ce6b700 1 --2- 172.21.15.6:0/3581157332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc744003f80 0x7fc744004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.779+0000 7fc75ce6b700 1 -- 172.21.15.6:0/3581157332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7440035b0 con 0x7fc744004d90 2023-07-21T07:36:03.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.780+0000 7fc75ce6b700 1 --2- 172.21.15.6:0/3581157332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc744004d90 0x7fc744005210 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc75000a830 tx=0x7fc744005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe03c5975b5ade8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:03.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.780+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750012600 con 0x7fc744004d90 2023-07-21T07:36:03.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.780+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc750012780 con 0x7fc744004d90 2023-07-21T07:36:03.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.780+0000 7fc756ffd700 1 -- 172.21.15.6:0/3581157332 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750012b30 con 0x7fc744004d90 2023-07-21T07:36:03.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.780+0000 7fc75e8ce700 1 -- 172.21.15.6:0/3581157332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc744004d90 msgr2=0x7fc744005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.780+0000 7fc75e8ce700 1 --2- 172.21.15.6:0/3581157332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc744004d90 0x7fc744005210 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc75000a830 tx=0x7fc744005880 comp rx=0 tx=0).stop 2023-07-21T07:36:03.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.780+0000 7fc75ce6b700 1 -- 172.21.15.6:0/3581157332 reap_dead start 2023-07-21T07:36:03.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.780+0000 7fc75e8ce700 1 -- 172.21.15.6:0/3581157332 shutdown_connections 2023-07-21T07:36:03.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.780+0000 7fc75e8ce700 1 -- 172.21.15.6:0/3581157332 >> 172.21.15.6:0/3581157332 conn(0x7fc7580a8c90 msgr2=0x7fc75806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:03.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.780+0000 7fc75e8ce700 1 -- 172.21.15.6:0/3581157332 shutdown_connections 2023-07-21T07:36:03.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.780+0000 7fc75e8ce700 1 -- 172.21.15.6:0/3581157332 wait complete. 2023-07-21T07:36:03.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.782+0000 7fc75e8ce700 1 Processor -- start 2023-07-21T07:36:03.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.782+0000 7fc75e8ce700 1 -- start start 2023-07-21T07:36:03.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.782+0000 7fc75e8ce700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7581eb530 0x7fc7581eb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.782+0000 7fc75e8ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7580c0940 0x7fc7580bebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.782+0000 7fc75e8ce700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7580bf130 0x7fc75814e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.782+0000 7fc75e8ce700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580b8ce0 con 0x7fc7580c0940 2023-07-21T07:36:03.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.782+0000 7fc75e8ce700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7581ec2f0 con 0x7fc7580bf130 2023-07-21T07:36:03.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.782+0000 7fc75e8ce700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580be710 con 0x7fc7581eb530 2023-07-21T07:36:03.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc7577fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7580c0940 0x7fc7580bebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc7577fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7580c0940 0x7fc7580bebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35176/0 (socket says 172.21.15.6:35176) 2023-07-21T07:36:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc7577fe700 1 -- 172.21.15.6:0/2980123881 learned_addr learned my addr 172.21.15.6:0/2980123881 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc757fff700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7581eb530 0x7fc7581eb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc75ce6b700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7580bf130 0x7fc75814e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc7577fe700 1 -- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7581eb530 msgr2=0x7fc7581eb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc7577fe700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7581eb530 0x7fc7581eb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc7577fe700 1 -- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7580bf130 msgr2=0x7fc75814e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc7577fe700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7580bf130 0x7fc75814e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc7577fe700 1 -- 172.21.15.6:0/2980123881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7580b8f30 con 0x7fc7580c0940 2023-07-21T07:36:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc7577fe700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7580c0940 0x7fc7580bebf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc7480119a0 tx=0x7fc748011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc754ff9700 1 -- 172.21.15.6:0/2980123881 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74800f730 con 0x7fc7580c0940 2023-07-21T07:36:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc754ff9700 1 -- 172.21.15.6:0/2980123881 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74800f890 con 0x7fc7580c0940 2023-07-21T07:36:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc75e8ce700 1 -- 172.21.15.6:0/2980123881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7581ec010 con 0x7fc7580c0940 2023-07-21T07:36:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc754ff9700 1 -- 172.21.15.6:0/2980123881 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74800fc20 con 0x7fc7580c0940 2023-07-21T07:36:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.783+0000 7fc75e8ce700 1 -- 172.21.15.6:0/2980123881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7581e92f0 con 0x7fc7580c0940 2023-07-21T07:36:03.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.784+0000 7fc75e8ce700 1 -- 172.21.15.6:0/2980123881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7581ebe50 con 0x7fc7580c0940 2023-07-21T07:36:03.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.785+0000 7fc754ff9700 1 -- 172.21.15.6:0/2980123881 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc74800fd80 con 0x7fc7580c0940 2023-07-21T07:36:03.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.785+0000 7fc754ff9700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc73806acb0 0x7fc73806d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:03.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.785+0000 7fc754ff9700 1 -- 172.21.15.6:0/2980123881 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fc748089d30 con 0x7fc7580c0940 2023-07-21T07:36:03.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.786+0000 7fc757fff700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc73806acb0 0x7fc73806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:03.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.786+0000 7fc757fff700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc73806acb0 0x7fc73806d170 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc7580a5e10 tx=0x7fc740009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:03.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.790+0000 7fc754ff9700 1 -- 172.21.15.6:0/2980123881 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc7480585a0 con 0x7fc7580c0940 2023-07-21T07:36:04.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.988+0000 7fc75e8ce700 1 -- 172.21.15.6:0/2980123881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7580be850 con 0x7fc7580c0940 2023-07-21T07:36:04.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.989+0000 7fc754ff9700 1 -- 172.21.15.6:0/2980123881 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+21959 (secure 0 0 0) 0x7fc748058130 con 0x7fc7580c0940 2023-07-21T07:36:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:04.042 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:46.879421+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:35:29.385402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T07:35:29.920618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:35:43.052752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:35:44.270260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.991+0000 7fc75e8ce700 1 -- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc73806acb0 msgr2=0x7fc73806d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.991+0000 7fc75e8ce700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc73806acb0 0x7fc73806d170 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc7580a5e10 tx=0x7fc740009210 comp rx=0 tx=0).stop 2023-07-21T07:36:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.991+0000 7fc75e8ce700 1 -- 172.21.15.6:0/2980123881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7580c0940 msgr2=0x7fc7580bebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.991+0000 7fc75e8ce700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7580c0940 0x7fc7580bebf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc7480119a0 tx=0x7fc748011cb0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.991+0000 7fc75e8ce700 1 -- 172.21.15.6:0/2980123881 shutdown_connections 2023-07-21T07:36:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.991+0000 7fc75e8ce700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc73806acb0 0x7fc73806d170 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.991+0000 7fc75e8ce700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7580bf130 0x7fc75814e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.991+0000 7fc75e8ce700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7581eb530 0x7fc7581eb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.991+0000 7fc75e8ce700 1 --2- 172.21.15.6:0/2980123881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7580c0940 0x7fc7580bebf0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.991+0000 7fc75e8ce700 1 -- 172.21.15.6:0/2980123881 >> 172.21.15.6:0/2980123881 conn(0x7fc7580a8c90 msgr2=0x7fc7580c4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.991+0000 7fc75e8ce700 1 -- 172.21.15.6:0/2980123881 shutdown_connections 2023-07-21T07:36:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:03.991+0000 7fc75e8ce700 1 -- 172.21.15.6:0/2980123881 wait complete. 2023-07-21T07:36:04.056 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:35:29.385402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:35:29.920618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-21T07:35:43.052752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-21T07:35:44.270260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:36:04.058 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:36:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.134+0000 7f0a05430700 1 Processor -- start 2023-07-21T07:36:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.135+0000 7f0a05430700 1 -- start start 2023-07-21T07:36:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.135+0000 7f0a05430700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a0014e740 0x7f0a001585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.135+0000 7f0a05430700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0a0006c600 0x7f0a0006b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.135+0000 7f0a05430700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a000c1300 con 0x7f0a00066160 2023-07-21T07:36:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.135+0000 7f0a05430700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a00157b50 con 0x7f0a0014e740 2023-07-21T07:36:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.135+0000 7f0a05430700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a00158ae0 con 0x7f0a0006c600 2023-07-21T07:36:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.135+0000 7f09feffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a0014e740 0x7f0a001585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.135+0000 7f09feffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a0014e740 0x7f0a001585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35182/0 (socket says 172.21.15.6:35182) 2023-07-21T07:36:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.136+0000 7f09feffd700 1 -- 172.21.15.6:0/1188690164 learned_addr learned my addr 172.21.15.6:0/1188690164 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.136+0000 7f09ff7fe700 1 --2- 172.21.15.6:0/1188690164 >> v2:172.21.15.86:3300/0 conn(0x7f0a0006c600 0x7f0a0006b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.136+0000 7f09feffd700 1 -- 172.21.15.6:0/1188690164 >> v2:172.21.15.86:3300/0 conn(0x7f0a0006c600 msgr2=0x7f0a0006b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.136+0000 7f09feffd700 1 --2- 172.21.15.6:0/1188690164 >> v2:172.21.15.86:3300/0 conn(0x7f0a0006c600 0x7f0a0006b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.136+0000 7f09feffd700 1 -- 172.21.15.6:0/1188690164 >> v1:172.21.15.86:6789/0 conn(0x7f0a00066160 legacy=0x7f0a00154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.136+0000 7f09feffd700 1 -- 172.21.15.6:0/1188690164 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a000c0aa0 con 0x7f0a0014e740 2023-07-21T07:36:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.136+0000 7f09feffd700 1 --2- 172.21.15.6:0/1188690164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0014e740 0x7f0a001585a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0a000669e0 tx=0x7f09f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fdab5f1206ebd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.136+0000 7f09fdffb700 1 -- 172.21.15.6:0/1188690164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0004230 con 0x7f0a0014e740 2023-07-21T07:36:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.136+0000 7f09fdffb700 1 -- 172.21.15.6:0/1188690164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f0004390 con 0x7f0a0014e740 2023-07-21T07:36:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.136+0000 7f09fdffb700 1 -- 172.21.15.6:0/1188690164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f00036a0 con 0x7f0a0014e740 2023-07-21T07:36:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.137+0000 7f0a05430700 1 -- 172.21.15.6:0/1188690164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0014e740 msgr2=0x7f0a001585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.137+0000 7f0a05430700 1 --2- 172.21.15.6:0/1188690164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0014e740 0x7f0a001585a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0a000669e0 tx=0x7f09f0009bd0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.137+0000 7f0a05430700 1 -- 172.21.15.6:0/1188690164 shutdown_connections 2023-07-21T07:36:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.137+0000 7f0a05430700 1 --2- 172.21.15.6:0/1188690164 >> v2:172.21.15.86:3300/0 conn(0x7f0a0006c600 0x7f0a0006b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.137+0000 7f0a05430700 1 --2- 172.21.15.6:0/1188690164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0014e740 0x7f0a001585a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.137+0000 7f0a05430700 1 -- 172.21.15.6:0/1188690164 >> 172.21.15.6:0/1188690164 conn(0x7f0a000c2bc0 msgr2=0x7f0a000c2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.137+0000 7f0a05430700 1 -- 172.21.15.6:0/1188690164 shutdown_connections 2023-07-21T07:36:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.137+0000 7f0a05430700 1 -- 172.21.15.6:0/1188690164 wait complete. 2023-07-21T07:36:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.138+0000 7f0a05430700 1 Processor -- start 2023-07-21T07:36:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.138+0000 7f0a05430700 1 -- start start 2023-07-21T07:36:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f0a05430700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a00066160 0x7f0a0014bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f0a05430700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0006c600 0x7f0a00153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f0a05430700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a0014e740 0x7f0a001536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f0a05430700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a00155d30 con 0x7f0a0006c600 2023-07-21T07:36:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f0a05430700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a001ed470 con 0x7f0a00066160 2023-07-21T07:36:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f0a05430700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a001ea190 con 0x7f0a0014e740 2023-07-21T07:36:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f09fe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0006c600 0x7f0a00153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f09fe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0006c600 0x7f0a00153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35190/0 (socket says 172.21.15.6:35190) 2023-07-21T07:36:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f09fe7fc700 1 -- 172.21.15.6:0/1821229876 learned_addr learned my addr 172.21.15.6:0/1821229876 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f09feffd700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a00066160 0x7f0a0014bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f09ff7fe700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a0014e740 0x7f0a001536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f09fe7fc700 1 -- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a0014e740 msgr2=0x7f0a001536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f09fe7fc700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a0014e740 0x7f0a001536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f09fe7fc700 1 -- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a00066160 msgr2=0x7f0a0014bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f09fe7fc700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a00066160 0x7f0a0014bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f09fe7fc700 1 -- 172.21.15.6:0/1821229876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0009550 con 0x7f0a0006c600 2023-07-21T07:36:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f09fe7fc700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0006c600 0x7f0a00153170 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f09e800c4d0 tx=0x7f09e800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.139+0000 7f09f77fe700 1 -- 172.21.15.6:0/1821229876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8011790 con 0x7f0a0006c600 2023-07-21T07:36:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.140+0000 7f09f77fe700 1 -- 172.21.15.6:0/1821229876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e80118f0 con 0x7f0a0006c600 2023-07-21T07:36:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.140+0000 7f0a05430700 1 -- 172.21.15.6:0/1821229876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a001ea470 con 0x7f0a0006c600 2023-07-21T07:36:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.140+0000 7f09f77fe700 1 -- 172.21.15.6:0/1821229876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8011ca0 con 0x7f0a0006c600 2023-07-21T07:36:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.140+0000 7f0a05430700 1 -- 172.21.15.6:0/1821229876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a001ed100 con 0x7f0a0006c600 2023-07-21T07:36:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.140+0000 7f0a05430700 1 -- 172.21.15.6:0/1821229876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a001ed620 con 0x7f0a0006c600 2023-07-21T07:36:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.141+0000 7f09f77fe700 1 -- 172.21.15.6:0/1821229876 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09e801c460 con 0x7f0a0006c600 2023-07-21T07:36:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.141+0000 7f09f77fe700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09e006ace0 0x7f09e006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.141+0000 7f09f77fe700 1 -- 172.21.15.6:0/1821229876 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f09e8089510 con 0x7f0a0006c600 2023-07-21T07:36:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.141+0000 7f09feffd700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09e006ace0 0x7f09e006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.142+0000 7f09feffd700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09e006ace0 0x7f09e006d1a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009840 tx=0x7f09f0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:04.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.146+0000 7f09f77fe700 1 -- 172.21.15.6:0/1821229876 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0a001ed620 con 0x7f0a0006c600 2023-07-21T07:36:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.341+0000 7f0a05430700 1 -- 172.21.15.6:0/1821229876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a001ed5e0 con 0x7f0a0006c600 2023-07-21T07:36:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.342+0000 7f09f77fe700 1 -- 172.21.15.6:0/1821229876 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f09e8054260 con 0x7f0a0006c600 2023-07-21T07:36:04.395 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:36:04.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.344+0000 7f0a05430700 1 -- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09e006ace0 msgr2=0x7f09e006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.344+0000 7f0a05430700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09e006ace0 0x7f09e006d1a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009840 tx=0x7f09f0008030 comp rx=0 tx=0).stop 2023-07-21T07:36:04.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.344+0000 7f0a05430700 1 -- 172.21.15.6:0/1821229876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0006c600 msgr2=0x7f0a00153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.344+0000 7f0a05430700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0006c600 0x7f0a00153170 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f09e800c4d0 tx=0x7f09e800c7e0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.344+0000 7f0a05430700 1 -- 172.21.15.6:0/1821229876 shutdown_connections 2023-07-21T07:36:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.344+0000 7f0a05430700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f09e006ace0 0x7f09e006d1a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.344+0000 7f0a05430700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a0014e740 0x7f0a001536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.344+0000 7f0a05430700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a00066160 0x7f0a0014bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.344+0000 7f0a05430700 1 --2- 172.21.15.6:0/1821229876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a0006c600 0x7f0a00153170 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.344+0000 7f0a05430700 1 -- 172.21.15.6:0/1821229876 >> 172.21.15.6:0/1821229876 conn(0x7f0a000c2bc0 msgr2=0x7f0a000c2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.344+0000 7f0a05430700 1 -- 172.21.15.6:0/1821229876 shutdown_connections 2023-07-21T07:36:04.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.344+0000 7f0a05430700 1 -- 172.21.15.6:0/1821229876 wait complete. 2023-07-21T07:36:04.408 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:36:04.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.484+0000 7f792c35a700 1 Processor -- start 2023-07-21T07:36:04.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.484+0000 7f792c35a700 1 -- start start 2023-07-21T07:36:04.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f792c35a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79240ba140 0x7f79240c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f792c35a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f792406d8a0 0x7f79240c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f792c35a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7924155530 con 0x7f792406a300 2023-07-21T07:36:04.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f792c35a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79240c1a30 con 0x7f792406d8a0 2023-07-21T07:36:04.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f792c35a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7924154920 con 0x7f79240ba140 2023-07-21T07:36:04.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f792a8f7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f792406d8a0 0x7f79240c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f792a8f7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f792406d8a0 0x7f79240c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35200/0 (socket says 172.21.15.6:35200) 2023-07-21T07:36:04.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f792a8f7700 1 -- 172.21.15.6:0/2992858789 learned_addr learned my addr 172.21.15.6:0/2992858789 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:04.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f79298f5700 1 --2- 172.21.15.6:0/2992858789 >> v2:172.21.15.86:3300/0 conn(0x7f79240ba140 0x7f79240c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f792a8f7700 1 -- 172.21.15.6:0/2992858789 >> v2:172.21.15.86:3300/0 conn(0x7f79240ba140 msgr2=0x7f79240c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:04.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f792a8f7700 1 --2- 172.21.15.6:0/2992858789 >> v2:172.21.15.86:3300/0 conn(0x7f79240ba140 0x7f79240c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f792a8f7700 1 -- 172.21.15.6:0/2992858789 >> v1:172.21.15.86:6789/0 conn(0x7f792406a300 legacy=0x7f79241519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:04.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f792a8f7700 1 -- 172.21.15.6:0/2992858789 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7924154c00 con 0x7f792406d8a0 2023-07-21T07:36:04.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f79298f5700 1 --2- 172.21.15.6:0/2992858789 >> v2:172.21.15.86:3300/0 conn(0x7f79240ba140 0x7f79240c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:04.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f792a8f7700 1 --2- 172.21.15.6:0/2992858789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f792406d8a0 0x7f79240c4f80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f792406c510 tx=0x7f791c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879a371c1cc998bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:04.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f79290f4700 1 -- 172.21.15.6:0/2992858789 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00e070 con 0x7f792406d8a0 2023-07-21T07:36:04.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.485+0000 7f79290f4700 1 -- 172.21.15.6:0/2992858789 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c003a20 con 0x7f792406d8a0 2023-07-21T07:36:04.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.486+0000 7f79290f4700 1 -- 172.21.15.6:0/2992858789 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c003dd0 con 0x7f792406d8a0 2023-07-21T07:36:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.486+0000 7f792c35a700 1 -- 172.21.15.6:0/2992858789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f792406d8a0 msgr2=0x7f79240c4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.486+0000 7f792c35a700 1 --2- 172.21.15.6:0/2992858789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f792406d8a0 0x7f79240c4f80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f792406c510 tx=0x7f791c00b330 comp rx=0 tx=0).stop 2023-07-21T07:36:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.486+0000 7f792c35a700 1 -- 172.21.15.6:0/2992858789 shutdown_connections 2023-07-21T07:36:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.486+0000 7f792c35a700 1 --2- 172.21.15.6:0/2992858789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f792406d8a0 0x7f79240c4f80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.486+0000 7f792c35a700 1 --2- 172.21.15.6:0/2992858789 >> v2:172.21.15.86:3300/0 conn(0x7f79240ba140 0x7f79240c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.486+0000 7f792c35a700 1 -- 172.21.15.6:0/2992858789 >> 172.21.15.6:0/2992858789 conn(0x7f79240a8660 msgr2=0x7f79240a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.486+0000 7f792c35a700 1 -- 172.21.15.6:0/2992858789 shutdown_connections 2023-07-21T07:36:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.486+0000 7f792c35a700 1 -- 172.21.15.6:0/2992858789 wait complete. 2023-07-21T07:36:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.487+0000 7f792c35a700 1 Processor -- start 2023-07-21T07:36:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.487+0000 7f792c35a700 1 -- start start 2023-07-21T07:36:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.488+0000 7f792c35a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f792406a300 0x7f79240be160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.488+0000 7f792c35a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f792406d8a0 0x7f7924153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.488+0000 7f792c35a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79240ba140 0x7f79241ea8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.488+0000 7f792c35a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79240bf5a0 con 0x7f792406a300 2023-07-21T07:36:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.488+0000 7f792c35a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79241ea460 con 0x7f792406d8a0 2023-07-21T07:36:04.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.488+0000 7f792c35a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79241eded0 con 0x7f79240ba140 2023-07-21T07:36:04.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.488+0000 7f792a0f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f792406a300 0x7f79240be160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.488+0000 7f792a0f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f792406a300 0x7f79240be160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35202/0 (socket says 172.21.15.6:35202) 2023-07-21T07:36:04.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.488+0000 7f792a0f6700 1 -- 172.21.15.6:0/4226478580 learned_addr learned my addr 172.21.15.6:0/4226478580 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:04.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.488+0000 7f792a0f6700 1 -- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79240ba140 msgr2=0x7f79241ea8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.488+0000 7f79298f5700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f792406d8a0 0x7f7924153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.488+0000 7f792a8f7700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79240ba140 0x7f79241ea8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.488+0000 7f792a0f6700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79240ba140 0x7f79241ea8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.489+0000 7f792a0f6700 1 -- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f792406d8a0 msgr2=0x7f7924153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.489+0000 7f792a0f6700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f792406d8a0 0x7f7924153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.489+0000 7f792a0f6700 1 -- 172.21.15.6:0/4226478580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c009b30 con 0x7f792406a300 2023-07-21T07:36:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.489+0000 7f792a8f7700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79240ba140 0x7f79241ea8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.489+0000 7f79298f5700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f792406d8a0 0x7f7924153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.489+0000 7f792a0f6700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f792406a300 0x7f79240be160 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f791400b4a0 tx=0x7f791400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.489+0000 7f791affd700 1 -- 172.21.15.6:0/4226478580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914011830 con 0x7f792406a300 2023-07-21T07:36:04.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.489+0000 7f791affd700 1 -- 172.21.15.6:0/4226478580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7914011990 con 0x7f792406a300 2023-07-21T07:36:04.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.489+0000 7f792c35a700 1 -- 172.21.15.6:0/4226478580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79241ee400 con 0x7f792406a300 2023-07-21T07:36:04.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.489+0000 7f791affd700 1 -- 172.21.15.6:0/4226478580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914011d40 con 0x7f792406a300 2023-07-21T07:36:04.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.489+0000 7f792c35a700 1 -- 172.21.15.6:0/4226478580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79240be6a0 con 0x7f792406a300 2023-07-21T07:36:04.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.490+0000 7f792c35a700 1 -- 172.21.15.6:0/4226478580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79241ea740 con 0x7f792406a300 2023-07-21T07:36:04.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.491+0000 7f791affd700 1 -- 172.21.15.6:0/4226478580 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f791401a400 con 0x7f792406a300 2023-07-21T07:36:04.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.491+0000 7f791affd700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f790806ace0 0x7f790806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.491+0000 7f791affd700 1 -- 172.21.15.6:0/4226478580 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f7914089580 con 0x7f792406a300 2023-07-21T07:36:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.491+0000 7f79298f5700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f790806ace0 0x7f790806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.492+0000 7f79298f5700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f790806ace0 0x7f790806d1a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7924158df0 tx=0x7f7920008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:04.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.495+0000 7f791affd700 1 -- 172.21.15.6:0/4226478580 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f79140542d0 con 0x7f792406a300 2023-07-21T07:36:04.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.691+0000 7f792c35a700 1 -- 172.21.15.6:0/4226478580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7924154eb0 con 0x7f792406a300 2023-07-21T07:36:04.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.691+0000 7f791affd700 1 -- 172.21.15.6:0/4226478580 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f79140578f0 con 0x7f792406a300 2023-07-21T07:36:04.744 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:36:04.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.693+0000 7f792c35a700 1 -- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f790806ace0 msgr2=0x7f790806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.693+0000 7f792c35a700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f790806ace0 0x7f790806d1a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7924158df0 tx=0x7f7920008040 comp rx=0 tx=0).stop 2023-07-21T07:36:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.693+0000 7f792c35a700 1 -- 172.21.15.6:0/4226478580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f792406a300 msgr2=0x7f79240be160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.693+0000 7f792c35a700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f792406a300 0x7f79240be160 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f791400b4a0 tx=0x7f791400b860 comp rx=0 tx=0).stop 2023-07-21T07:36:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.693+0000 7f792c35a700 1 -- 172.21.15.6:0/4226478580 shutdown_connections 2023-07-21T07:36:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.693+0000 7f792c35a700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f790806ace0 0x7f790806d1a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.693+0000 7f792c35a700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79240ba140 0x7f79241ea8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.693+0000 7f792c35a700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f792406a300 0x7f79240be160 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.693+0000 7f792c35a700 1 --2- 172.21.15.6:0/4226478580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f792406d8a0 0x7f7924153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.693+0000 7f792c35a700 1 -- 172.21.15.6:0/4226478580 >> 172.21.15.6:0/4226478580 conn(0x7f79240a8660 msgr2=0x7f79240c2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.693+0000 7f792c35a700 1 -- 172.21.15.6:0/4226478580 shutdown_connections 2023-07-21T07:36:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.693+0000 7f792c35a700 1 -- 172.21.15.6:0/4226478580 wait complete. 2023-07-21T07:36:04.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:36:04.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.832+0000 7fa4d6fb7700 1 Processor -- start 2023-07-21T07:36:04.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.832+0000 7fa4d6fb7700 1 -- start start 2023-07-21T07:36:04.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.833+0000 7fa4d6fb7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4d00a6f80 0x7fa4d0152380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.833+0000 7fa4d6fb7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4d0072160 0x7fa4d014f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.833+0000 7fa4d6fb7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d00c3c90 con 0x7fa4d00c4120 2023-07-21T07:36:04.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.833+0000 7fa4d6fb7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d00c26e0 con 0x7fa4d0072160 2023-07-21T07:36:04.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.833+0000 7fa4d6fb7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d00c3680 con 0x7fa4d00a6f80 2023-07-21T07:36:04.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.833+0000 7fa4cffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4d0072160 0x7fa4d014f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.833+0000 7fa4cffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4d0072160 0x7fa4d014f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35212/0 (socket says 172.21.15.6:35212) 2023-07-21T07:36:04.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.833+0000 7fa4cffff700 1 -- 172.21.15.6:0/2975624232 learned_addr learned my addr 172.21.15.6:0/2975624232 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:04.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.834+0000 7fa4d4d53700 1 --2- 172.21.15.6:0/2975624232 >> v2:172.21.15.86:3300/0 conn(0x7fa4d00a6f80 0x7fa4d0152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.834+0000 7fa4cffff700 1 -- 172.21.15.6:0/2975624232 >> v2:172.21.15.86:3300/0 conn(0x7fa4d00a6f80 msgr2=0x7fa4d0152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:04.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.834+0000 7fa4cffff700 1 --2- 172.21.15.6:0/2975624232 >> v2:172.21.15.86:3300/0 conn(0x7fa4d00a6f80 0x7fa4d0152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.834+0000 7fa4cffff700 1 -- 172.21.15.6:0/2975624232 >> v1:172.21.15.86:6789/0 conn(0x7fa4d00c4120 legacy=0x7fa4d00c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:04.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.834+0000 7fa4cffff700 1 -- 172.21.15.6:0/2975624232 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d00c6fe0 con 0x7fa4d0072160 2023-07-21T07:36:04.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.834+0000 7fa4cffff700 1 --2- 172.21.15.6:0/2975624232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d0072160 0x7fa4d014f420 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0067440 tx=0x7fa4bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92252a4dc3668600 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:04.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.834+0000 7fa4cf7fe700 1 -- 172.21.15.6:0/2975624232 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc00b870 con 0x7fa4d0072160 2023-07-21T07:36:04.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.834+0000 7fa4cf7fe700 1 -- 172.21.15.6:0/2975624232 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc00b9d0 con 0x7fa4d0072160 2023-07-21T07:36:04.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.834+0000 7fa4cf7fe700 1 -- 172.21.15.6:0/2975624232 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc00bd60 con 0x7fa4d0072160 2023-07-21T07:36:04.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.834+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/2975624232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d0072160 msgr2=0x7fa4d014f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.834+0000 7fa4d6fb7700 1 --2- 172.21.15.6:0/2975624232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d0072160 0x7fa4d014f420 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0067440 tx=0x7fa4bc009bd0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.835+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/2975624232 shutdown_connections 2023-07-21T07:36:04.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.835+0000 7fa4d6fb7700 1 --2- 172.21.15.6:0/2975624232 >> v2:172.21.15.86:3300/0 conn(0x7fa4d00a6f80 0x7fa4d0152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.835+0000 7fa4d6fb7700 1 --2- 172.21.15.6:0/2975624232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d0072160 0x7fa4d014f420 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.835+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/2975624232 >> 172.21.15.6:0/2975624232 conn(0x7fa4d00c7b50 msgr2=0x7fa4d00c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:04.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.835+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/2975624232 shutdown_connections 2023-07-21T07:36:04.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.835+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/2975624232 wait complete. 2023-07-21T07:36:04.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.836+0000 7fa4d6fb7700 1 Processor -- start 2023-07-21T07:36:04.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.836+0000 7fa4d6fb7700 1 -- start start 2023-07-21T07:36:04.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d6fb7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4d0072160 0x7fa4d006ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d6fb7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d00a6f80 0x7fa4d00c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d6fb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d00c4120 0x7fa4d00ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d6fb7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d00c1a20 con 0x7fa4d00c4120 2023-07-21T07:36:04.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d6fb7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d00abec0 con 0x7fa4d0072160 2023-07-21T07:36:04.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d6fb7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d00ad0b0 con 0x7fa4d00a6f80 2023-07-21T07:36:04.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d5554700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d00c4120 0x7fa4d00ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d5554700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d00c4120 0x7fa4d00ac3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35220/0 (socket says 172.21.15.6:35220) 2023-07-21T07:36:04.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d5554700 1 -- 172.21.15.6:0/467353578 learned_addr learned my addr 172.21.15.6:0/467353578 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:04.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4cffff700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d00a6f80 0x7fa4d00c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d4d53700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4d0072160 0x7fa4d006ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d5554700 1 -- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d00a6f80 msgr2=0x7fa4d00c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d5554700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d00a6f80 0x7fa4d00c10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d5554700 1 -- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4d0072160 msgr2=0x7fa4d006ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:04.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d5554700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4d0072160 0x7fa4d006ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:04.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d5554700 1 -- 172.21.15.6:0/467353578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc009550 con 0x7fa4d00c4120 2023-07-21T07:36:04.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4d5554700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d00c4120 0x7fa4d00ac3a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800cc50 tx=0x7fa4c800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:04.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.837+0000 7fa4cd7fa700 1 -- 172.21.15.6:0/467353578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800ad80 con 0x7fa4d00c4120 2023-07-21T07:36:04.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.838+0000 7fa4cd7fa700 1 -- 172.21.15.6:0/467353578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c800ce50 con 0x7fa4d00c4120 2023-07-21T07:36:04.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.838+0000 7fa4cd7fa700 1 -- 172.21.15.6:0/467353578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8003c40 con 0x7fa4d00c4120 2023-07-21T07:36:04.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.838+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/467353578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d00ad390 con 0x7fa4d00c4120 2023-07-21T07:36:04.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.838+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/467353578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d00ad950 con 0x7fa4d00c4120 2023-07-21T07:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.838+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/467353578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d00adb70 con 0x7fa4d00c4120 2023-07-21T07:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.839+0000 7fa4cd7fa700 1 -- 172.21.15.6:0/467353578 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa4c80050d0 con 0x7fa4d00c4120 2023-07-21T07:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.839+0000 7fa4cd7fa700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa4b406ace0 0x7fa4b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.839+0000 7fa4cd7fa700 1 -- 172.21.15.6:0/467353578 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fa4c8089860 con 0x7fa4d00c4120 2023-07-21T07:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.840+0000 7fa4d4d53700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa4b406ace0 0x7fa4b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:04.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.840+0000 7fa4d4d53700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa4b406ace0 0x7fa4b406d1a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0147c50 tx=0x7fa4c4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:04.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:04.844+0000 7fa4cd7fa700 1 -- 172.21.15.6:0/467353578 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa4c8054640 con 0x7fa4d00c4120 2023-07-21T07:36:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.041+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/467353578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4d0074500 con 0x7fa4d00c4120 2023-07-21T07:36:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.042+0000 7fa4cd7fa700 1 -- 172.21.15.6:0/467353578 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa4c8057c60 con 0x7fa4d00c4120 2023-07-21T07:36:05.095 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:36:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.044+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa4b406ace0 msgr2=0x7fa4b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.044+0000 7fa4d6fb7700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa4b406ace0 0x7fa4b406d1a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0147c50 tx=0x7fa4c4008040 comp rx=0 tx=0).stop 2023-07-21T07:36:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.044+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/467353578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d00c4120 msgr2=0x7fa4d00ac3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.044+0000 7fa4d6fb7700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d00c4120 0x7fa4d00ac3a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800cc50 tx=0x7fa4c800a340 comp rx=0 tx=0).stop 2023-07-21T07:36:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.044+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/467353578 shutdown_connections 2023-07-21T07:36:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.044+0000 7fa4d6fb7700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa4b406ace0 0x7fa4b406d1a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.044+0000 7fa4d6fb7700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d00c4120 0x7fa4d00ac3a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.044+0000 7fa4d6fb7700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4d0072160 0x7fa4d006ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.044+0000 7fa4d6fb7700 1 --2- 172.21.15.6:0/467353578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d00a6f80 0x7fa4d00c10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.044+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/467353578 >> 172.21.15.6:0/467353578 conn(0x7fa4d00c7b50 msgr2=0x7fa4d0071650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.044+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/467353578 shutdown_connections 2023-07-21T07:36:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.044+0000 7fa4d6fb7700 1 -- 172.21.15.6:0/467353578 wait complete. 2023-07-21T07:36:05.108 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:36:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.184+0000 7f4baf217700 1 Processor -- start 2023-07-21T07:36:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.184+0000 7f4baf217700 1 -- start start 2023-07-21T07:36:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.184+0000 7f4baf217700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ba80c1860 0x7f4ba8151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.184+0000 7f4baf217700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba81517c0 con 0x7f4ba80c5260 2023-07-21T07:36:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.184+0000 7f4baf217700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba80c4e50 con 0x7f4ba80c3f80 2023-07-21T07:36:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.184+0000 7f4baf217700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba81519f0 con 0x7f4ba80c1860 2023-07-21T07:36:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.185+0000 7f4ba7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4ba80c5260 0x7f4ba806dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43246/0 (socket says 172.21.15.6:43246) 2023-07-21T07:36:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.185+0000 7f4ba7fff700 1 -- 172.21.15.6:0/1811763226 learned_addr learned my addr 172.21.15.6:0/1811763226 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.185+0000 7f4bacfb3700 1 --2- 172.21.15.6:0/1811763226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ba80c1860 0x7f4ba8151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.185+0000 7f4ba77fe700 1 -- 172.21.15.6:0/1811763226 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540722925 0 0) 0x7f4ba81517c0 con 0x7f4ba80c5260 2023-07-21T07:36:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.185+0000 7f4ba77fe700 1 -- 172.21.15.6:0/1811763226 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b980035b0 con 0x7f4ba80c5260 2023-07-21T07:36:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.185+0000 7f4ba77fe700 1 -- 172.21.15.6:0/1811763226 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934172255 0 0) 0x7f4ba80c4e50 con 0x7f4ba80c3f80 2023-07-21T07:36:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.185+0000 7f4ba77fe700 1 -- 172.21.15.6:0/1811763226 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ba81517c0 con 0x7f4ba80c3f80 2023-07-21T07:36:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.185+0000 7f4ba77fe700 1 -- 172.21.15.6:0/1811763226 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3707483914 0 0) 0x7f4b980035b0 con 0x7f4ba80c5260 2023-07-21T07:36:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.185+0000 7f4bacfb3700 1 -- 172.21.15.6:0/1811763226 >> v1:172.21.15.86:6789/0 conn(0x7f4ba80c3f80 legacy=0x7f4ba80c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.185+0000 7f4bacfb3700 1 -- 172.21.15.6:0/1811763226 >> v1:172.21.15.6:6789/0 conn(0x7f4ba80c5260 legacy=0x7f4ba806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.185+0000 7f4bacfb3700 1 -- 172.21.15.6:0/1811763226 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba8151cd0 con 0x7f4ba80c1860 2023-07-21T07:36:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.185+0000 7f4bacfb3700 1 --2- 172.21.15.6:0/1811763226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ba80c1860 0x7f4ba8151280 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009870 tx=0x7f4b9c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78212f9834f48f0d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.185+0000 7f4ba77fe700 1 -- 172.21.15.6:0/1811763226 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94001670 con 0x7f4ba80c1860 2023-07-21T07:36:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.186+0000 7f4ba77fe700 1 -- 172.21.15.6:0/1811763226 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c004030 con 0x7f4ba80c1860 2023-07-21T07:36:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.186+0000 7f4ba77fe700 1 -- 172.21.15.6:0/1811763226 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0043c0 con 0x7f4ba80c1860 2023-07-21T07:36:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.186+0000 7f4baf217700 1 -- 172.21.15.6:0/1811763226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ba80c1860 msgr2=0x7f4ba8151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.186+0000 7f4baf217700 1 --2- 172.21.15.6:0/1811763226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ba80c1860 0x7f4ba8151280 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009870 tx=0x7f4b9c009b80 comp rx=0 tx=0).stop 2023-07-21T07:36:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.186+0000 7f4baf217700 1 -- 172.21.15.6:0/1811763226 shutdown_connections 2023-07-21T07:36:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.186+0000 7f4baf217700 1 --2- 172.21.15.6:0/1811763226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ba80c1860 0x7f4ba8151280 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.186+0000 7f4baf217700 1 -- 172.21.15.6:0/1811763226 >> 172.21.15.6:0/1811763226 conn(0x7f4ba80a8660 msgr2=0x7f4ba80a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.186+0000 7f4baf217700 1 -- 172.21.15.6:0/1811763226 shutdown_connections 2023-07-21T07:36:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.186+0000 7f4baf217700 1 -- 172.21.15.6:0/1811763226 wait complete. 2023-07-21T07:36:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.187+0000 7f4baf217700 1 Processor -- start 2023-07-21T07:36:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.187+0000 7f4baf217700 1 -- start start 2023-07-21T07:36:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4baf217700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ba80c1860 0x7f4ba81e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4baf217700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba80c3f80 0x7f4ba80baa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4baf217700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ba80c5260 0x7f4ba80bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4baf217700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80bb6d0 con 0x7f4ba80c3f80 2023-07-21T07:36:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4baf217700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba81e8310 con 0x7f4ba80c1860 2023-07-21T07:36:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4baf217700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba81e85b0 con 0x7f4ba80c5260 2023-07-21T07:36:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4ba7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba80c3f80 0x7f4ba80baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4ba7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba80c3f80 0x7f4ba80baa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35232/0 (socket says 172.21.15.6:35232) 2023-07-21T07:36:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4ba7fff700 1 -- 172.21.15.6:0/3841339226 learned_addr learned my addr 172.21.15.6:0/3841339226 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4bacfb3700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ba80c1860 0x7f4ba81e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4bad7b4700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ba80c5260 0x7f4ba80bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4ba7fff700 1 -- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ba80c5260 msgr2=0x7f4ba80bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4ba7fff700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ba80c5260 0x7f4ba80bbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4ba7fff700 1 -- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ba80c1860 msgr2=0x7f4ba81e4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4ba7fff700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ba80c1860 0x7f4ba81e4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4ba7fff700 1 -- 172.21.15.6:0/3841339226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c0094a0 con 0x7f4ba80c3f80 2023-07-21T07:36:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.188+0000 7f4bacfb3700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ba80c1860 0x7f4ba81e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.189+0000 7f4ba7fff700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba80c3f80 0x7f4ba80baa60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400c4d0 tx=0x7f4b9400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.189+0000 7f4ba57fa700 1 -- 172.21.15.6:0/3841339226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94004c80 con 0x7f4ba80c3f80 2023-07-21T07:36:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.189+0000 7f4ba57fa700 1 -- 172.21.15.6:0/3841339226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b94004de0 con 0x7f4ba80c3f80 2023-07-21T07:36:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.189+0000 7f4baf217700 1 -- 172.21.15.6:0/3841339226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba80bbbc0 con 0x7f4ba80c3f80 2023-07-21T07:36:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.189+0000 7f4ba57fa700 1 -- 172.21.15.6:0/3841339226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b940072f0 con 0x7f4ba80c3f80 2023-07-21T07:36:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.189+0000 7f4baf217700 1 -- 172.21.15.6:0/3841339226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba81e5360 con 0x7f4ba80c3f80 2023-07-21T07:36:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.190+0000 7f4baf217700 1 -- 172.21.15.6:0/3841339226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba81522a0 con 0x7f4ba80c3f80 2023-07-21T07:36:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.190+0000 7f4ba57fa700 1 -- 172.21.15.6:0/3841339226 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b94007450 con 0x7f4ba80c3f80 2023-07-21T07:36:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.191+0000 7f4ba57fa700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b8c06ace0 0x7f4b8c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.191+0000 7f4ba57fa700 1 -- 172.21.15.6:0/3841339226 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f4b940895d0 con 0x7f4ba80c3f80 2023-07-21T07:36:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.191+0000 7f4bacfb3700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b8c06ace0 0x7f4b8c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.192+0000 7f4bacfb3700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b8c06ace0 0x7f4b8c06d1a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0097c0 tx=0x7f4b9c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.195+0000 7f4ba57fa700 1 -- 172.21.15.6:0/3841339226 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b940542a0 con 0x7f4ba80c3f80 2023-07-21T07:36:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.392+0000 7f4baf217700 1 -- 172.21.15.6:0/3841339226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ba80a9240 con 0x7f4ba80c3f80 2023-07-21T07:36:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.392+0000 7f4ba57fa700 1 -- 172.21.15.6:0/3841339226 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b940578c0 con 0x7f4ba80c3f80 2023-07-21T07:36:05.445 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:36:05.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.394+0000 7f4baf217700 1 -- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b8c06ace0 msgr2=0x7f4b8c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.394+0000 7f4baf217700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b8c06ace0 0x7f4b8c06d1a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0097c0 tx=0x7f4b9c008030 comp rx=0 tx=0).stop 2023-07-21T07:36:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.394+0000 7f4baf217700 1 -- 172.21.15.6:0/3841339226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba80c3f80 msgr2=0x7f4ba80baa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.394+0000 7f4baf217700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba80c3f80 0x7f4ba80baa60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400c4d0 tx=0x7f4b9400c890 comp rx=0 tx=0).stop 2023-07-21T07:36:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.394+0000 7f4baf217700 1 -- 172.21.15.6:0/3841339226 shutdown_connections 2023-07-21T07:36:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.394+0000 7f4baf217700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4b8c06ace0 0x7f4b8c06d1a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.394+0000 7f4baf217700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ba80c5260 0x7f4ba80bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.394+0000 7f4baf217700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ba80c1860 0x7f4ba81e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.394+0000 7f4baf217700 1 --2- 172.21.15.6:0/3841339226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ba80c3f80 0x7f4ba80baa60 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.394+0000 7f4baf217700 1 -- 172.21.15.6:0/3841339226 >> 172.21.15.6:0/3841339226 conn(0x7f4ba80a8660 msgr2=0x7f4ba8071c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.394+0000 7f4baf217700 1 -- 172.21.15.6:0/3841339226 shutdown_connections 2023-07-21T07:36:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.394+0000 7f4baf217700 1 -- 172.21.15.6:0/3841339226 wait complete. 2023-07-21T07:36:05.458 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-21T07:36:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.533+0000 7fa73fc2c700 1 Processor -- start 2023-07-21T07:36:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.533+0000 7fa73fc2c700 1 -- start start 2023-07-21T07:36:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.534+0000 7fa73fc2c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa73806a300 0x7fa7381519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.534+0000 7fa73fc2c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa7380ba140 0x7fa738151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.534+0000 7fa73fc2c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa738155530 con 0x7fa73806d8a0 2023-07-21T07:36:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.534+0000 7fa73fc2c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7380c1a30 con 0x7fa7380ba140 2023-07-21T07:36:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.534+0000 7fa73fc2c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa738154920 con 0x7fa73806a300 2023-07-21T07:36:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.534+0000 7fa73e1c9700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa73806d8a0 0x7fa7380c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43260/0 (socket says 172.21.15.6:43260) 2023-07-21T07:36:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.534+0000 7fa73e1c9700 1 -- 172.21.15.6:0/2855430533 learned_addr learned my addr 172.21.15.6:0/2855430533 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.534+0000 7fa73d1c7700 1 --2- 172.21.15.6:0/2855430533 >> v2:172.21.15.86:3300/0 conn(0x7fa7380ba140 0x7fa738151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.535+0000 7fa73d9c8700 1 --2- 172.21.15.6:0/2855430533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa73806a300 0x7fa7381519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.535+0000 7fa73c9c6700 1 -- 172.21.15.6:0/2855430533 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400553159 0 0) 0x7fa738155530 con 0x7fa73806d8a0 2023-07-21T07:36:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.535+0000 7fa73c9c6700 1 -- 172.21.15.6:0/2855430533 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7240035b0 con 0x7fa73806d8a0 2023-07-21T07:36:05.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.535+0000 7fa73d1c7700 1 -- 172.21.15.6:0/2855430533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa73806a300 msgr2=0x7fa7381519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:05.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.535+0000 7fa73d1c7700 1 --2- 172.21.15.6:0/2855430533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa73806a300 0x7fa7381519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.535+0000 7fa73c9c6700 1 -- 172.21.15.6:0/2855430533 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 753769048 0 0) 0x7fa7240035b0 con 0x7fa73806d8a0 2023-07-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.535+0000 7fa73d1c7700 1 -- 172.21.15.6:0/2855430533 >> v1:172.21.15.6:6789/0 conn(0x7fa73806d8a0 legacy=0x7fa7380c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.535+0000 7fa73d1c7700 1 -- 172.21.15.6:0/2855430533 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa738154c00 con 0x7fa7380ba140 2023-07-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.535+0000 7fa73d9c8700 1 --2- 172.21.15.6:0/2855430533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa73806a300 0x7fa7381519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.535+0000 7fa73d1c7700 1 --2- 172.21.15.6:0/2855430533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7380ba140 0x7fa738151ef0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa734009840 tx=0x7fa734009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b0dde600ace1736 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.535+0000 7fa73c9c6700 1 -- 172.21.15.6:0/2855430533 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300019f0 con 0x7fa7380ba140 2023-07-21T07:36:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.535+0000 7fa73c9c6700 1 -- 172.21.15.6:0/2855430533 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa734004030 con 0x7fa7380ba140 2023-07-21T07:36:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.535+0000 7fa73c9c6700 1 -- 172.21.15.6:0/2855430533 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340043c0 con 0x7fa7380ba140 2023-07-21T07:36:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.536+0000 7fa73fc2c700 1 -- 172.21.15.6:0/2855430533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7380ba140 msgr2=0x7fa738151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.536+0000 7fa73fc2c700 1 --2- 172.21.15.6:0/2855430533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7380ba140 0x7fa738151ef0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa734009840 tx=0x7fa734009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.536+0000 7fa73fc2c700 1 -- 172.21.15.6:0/2855430533 shutdown_connections 2023-07-21T07:36:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.536+0000 7fa73fc2c700 1 --2- 172.21.15.6:0/2855430533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa73806a300 0x7fa7381519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.536+0000 7fa73fc2c700 1 --2- 172.21.15.6:0/2855430533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7380ba140 0x7fa738151ef0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.536+0000 7fa73fc2c700 1 -- 172.21.15.6:0/2855430533 >> 172.21.15.6:0/2855430533 conn(0x7fa7380a8660 msgr2=0x7fa7380a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.536+0000 7fa73fc2c700 1 -- 172.21.15.6:0/2855430533 shutdown_connections 2023-07-21T07:36:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.536+0000 7fa73fc2c700 1 -- 172.21.15.6:0/2855430533 wait complete. 2023-07-21T07:36:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.537+0000 7fa73fc2c700 1 Processor -- start 2023-07-21T07:36:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.537+0000 7fa73fc2c700 1 -- start start 2023-07-21T07:36:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73fc2c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa73806a300 0x7fa73814c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73fc2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73806d8a0 0x7fa7380bddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73fc2c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7380ba140 0x7fa738071a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73fc2c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa738071220 con 0x7fa73806d8a0 2023-07-21T07:36:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73fc2c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73814bd20 con 0x7fa7380ba140 2023-07-21T07:36:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73fc2c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa738070fb0 con 0x7fa73806a300 2023-07-21T07:36:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73d1c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73806d8a0 0x7fa7380bddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73d1c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73806d8a0 0x7fa7380bddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35244/0 (socket says 172.21.15.6:35244) 2023-07-21T07:36:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73d1c7700 1 -- 172.21.15.6:0/675439334 learned_addr learned my addr 172.21.15.6:0/675439334 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73d9c8700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa73806a300 0x7fa73814c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73e1c9700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7380ba140 0x7fa738071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73d1c7700 1 -- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa73806a300 msgr2=0x7fa73814c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73d1c7700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa73806a300 0x7fa73814c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73d1c7700 1 -- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7380ba140 msgr2=0x7fa738071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73d1c7700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7380ba140 0x7fa738071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73d1c7700 1 -- 172.21.15.6:0/675439334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7280094a0 con 0x7fa73806d8a0 2023-07-21T07:36:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73d9c8700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa73806a300 0x7fa73814c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.538+0000 7fa73d1c7700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73806d8a0 0x7fa7380bddd0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa7340090b0 tx=0x7fa734004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.539+0000 7fa72e7fc700 1 -- 172.21.15.6:0/675439334 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734003e20 con 0x7fa73806d8a0 2023-07-21T07:36:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.539+0000 7fa72e7fc700 1 -- 172.21.15.6:0/675439334 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73401f070 con 0x7fa73806d8a0 2023-07-21T07:36:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.539+0000 7fa73fc2c700 1 -- 172.21.15.6:0/675439334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7340094a0 con 0x7fa73806d8a0 2023-07-21T07:36:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.539+0000 7fa72e7fc700 1 -- 172.21.15.6:0/675439334 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734011870 con 0x7fa73806d8a0 2023-07-21T07:36:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.539+0000 7fa73fc2c700 1 -- 172.21.15.6:0/675439334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73814b9b0 con 0x7fa73806d8a0 2023-07-21T07:36:05.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.540+0000 7fa73fc2c700 1 -- 172.21.15.6:0/675439334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73814be90 con 0x7fa73806d8a0 2023-07-21T07:36:05.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.540+0000 7fa72e7fc700 1 -- 172.21.15.6:0/675439334 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa7340119d0 con 0x7fa73806d8a0 2023-07-21T07:36:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.540+0000 7fa72e7fc700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa71c06ace0 0x7fa71c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.541+0000 7fa72e7fc700 1 -- 172.21.15.6:0/675439334 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fa734021070 con 0x7fa73806d8a0 2023-07-21T07:36:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.541+0000 7fa73d9c8700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa71c06ace0 0x7fa71c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.541+0000 7fa73d9c8700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa71c06ace0 0x7fa71c06d1a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa728009d20 tx=0x7fa728008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.545+0000 7fa72e7fc700 1 -- 172.21.15.6:0/675439334 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa734055e60 con 0x7fa73806d8a0 2023-07-21T07:36:05.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.741+0000 7fa73fc2c700 1 -- 172.21.15.6:0/675439334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa738074500 con 0x7fa73806d8a0 2023-07-21T07:36:05.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.742+0000 7fa72e7fc700 1 -- 172.21.15.6:0/675439334 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v40) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa734059480 con 0x7fa73806d8a0 2023-07-21T07:36:05.794 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:36:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.744+0000 7fa73fc2c700 1 -- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa71c06ace0 msgr2=0x7fa71c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.744+0000 7fa73fc2c700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa71c06ace0 0x7fa71c06d1a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa728009d20 tx=0x7fa728008040 comp rx=0 tx=0).stop 2023-07-21T07:36:05.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.744+0000 7fa73fc2c700 1 -- 172.21.15.6:0/675439334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73806d8a0 msgr2=0x7fa7380bddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.744+0000 7fa73fc2c700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73806d8a0 0x7fa7380bddd0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa7340090b0 tx=0x7fa734004750 comp rx=0 tx=0).stop 2023-07-21T07:36:05.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.744+0000 7fa73fc2c700 1 -- 172.21.15.6:0/675439334 shutdown_connections 2023-07-21T07:36:05.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.744+0000 7fa73fc2c700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa71c06ace0 0x7fa71c06d1a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.744+0000 7fa73fc2c700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7380ba140 0x7fa738071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.744+0000 7fa73fc2c700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa73806a300 0x7fa73814c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.744+0000 7fa73fc2c700 1 --2- 172.21.15.6:0/675439334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73806d8a0 0x7fa7380bddd0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.744+0000 7fa73fc2c700 1 -- 172.21.15.6:0/675439334 >> 172.21.15.6:0/675439334 conn(0x7fa7380a8660 msgr2=0x7fa7381ddd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.744+0000 7fa73fc2c700 1 -- 172.21.15.6:0/675439334 shutdown_connections 2023-07-21T07:36:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.744+0000 7fa73fc2c700 1 -- 172.21.15.6:0/675439334 wait complete. 2023-07-21T07:36:05.808 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-21T07:36:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.884+0000 7f43a3517700 1 Processor -- start 2023-07-21T07:36:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.884+0000 7f43a3517700 1 -- start start 2023-07-21T07:36:05.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a3517700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439c06a300 0x7f439c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a3517700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f439c06d8a0 0x7f439c151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a3517700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c155530 con 0x7f439c0ba140 2023-07-21T07:36:05.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a3517700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439c0c1a30 con 0x7f439c06d8a0 2023-07-21T07:36:05.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a3517700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c154920 con 0x7f439c06a300 2023-07-21T07:36:05.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a0ab2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f439c0ba140 0x7f439c0c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43270/0 (socket says 172.21.15.6:43270) 2023-07-21T07:36:05.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a0ab2700 1 -- 172.21.15.6:0/34928556 learned_addr learned my addr 172.21.15.6:0/34928556 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:05.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a1ab4700 1 --2- 172.21.15.6:0/34928556 >> v2:172.21.15.86:3300/0 conn(0x7f439c06d8a0 0x7f439c151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a12b3700 1 --2- 172.21.15.6:0/34928556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439c06a300 0x7f439c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f4393fff700 1 -- 172.21.15.6:0/34928556 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301847432 0 0) 0x7f439c155530 con 0x7f439c0ba140 2023-07-21T07:36:05.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f4393fff700 1 -- 172.21.15.6:0/34928556 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43880035b0 con 0x7f439c0ba140 2023-07-21T07:36:05.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f4393fff700 1 -- 172.21.15.6:0/34928556 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3781124735 0 0) 0x7f43880035b0 con 0x7f439c0ba140 2023-07-21T07:36:05.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a12b3700 1 -- 172.21.15.6:0/34928556 >> v2:172.21.15.86:3300/0 conn(0x7f439c06d8a0 msgr2=0x7f439c151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a12b3700 1 --2- 172.21.15.6:0/34928556 >> v2:172.21.15.86:3300/0 conn(0x7f439c06d8a0 0x7f439c151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a12b3700 1 -- 172.21.15.6:0/34928556 >> v1:172.21.15.6:6789/0 conn(0x7f439c0ba140 legacy=0x7f439c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a12b3700 1 -- 172.21.15.6:0/34928556 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c154c00 con 0x7f439c06a300 2023-07-21T07:36:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.885+0000 7f43a1ab4700 1 --2- 172.21.15.6:0/34928556 >> v2:172.21.15.86:3300/0 conn(0x7f439c06d8a0 0x7f439c151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.886+0000 7f43a12b3700 1 --2- 172.21.15.6:0/34928556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439c06a300 0x7f439c1519b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4398009840 tx=0x7f4398009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c467553fa69ae00 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.886+0000 7f4393fff700 1 -- 172.21.15.6:0/34928556 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c001670 con 0x7f439c06a300 2023-07-21T07:36:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.886+0000 7f4393fff700 1 -- 172.21.15.6:0/34928556 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4398004030 con 0x7f439c06a300 2023-07-21T07:36:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.886+0000 7f4393fff700 1 -- 172.21.15.6:0/34928556 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43980043a0 con 0x7f439c06a300 2023-07-21T07:36:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.886+0000 7f43a3517700 1 -- 172.21.15.6:0/34928556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439c06a300 msgr2=0x7f439c1519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.886+0000 7f43a3517700 1 --2- 172.21.15.6:0/34928556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439c06a300 0x7f439c1519b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4398009840 tx=0x7f4398009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.886+0000 7f43a3517700 1 -- 172.21.15.6:0/34928556 shutdown_connections 2023-07-21T07:36:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.886+0000 7f43a3517700 1 --2- 172.21.15.6:0/34928556 >> v2:172.21.15.86:3300/0 conn(0x7f439c06d8a0 0x7f439c151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.886+0000 7f43a3517700 1 --2- 172.21.15.6:0/34928556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439c06a300 0x7f439c1519b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.886+0000 7f43a3517700 1 -- 172.21.15.6:0/34928556 >> 172.21.15.6:0/34928556 conn(0x7f439c0a8660 msgr2=0x7f439c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.886+0000 7f43a3517700 1 -- 172.21.15.6:0/34928556 shutdown_connections 2023-07-21T07:36:05.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.886+0000 7f43a3517700 1 -- 172.21.15.6:0/34928556 wait complete. 2023-07-21T07:36:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.888+0000 7f43a3517700 1 Processor -- start 2023-07-21T07:36:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.888+0000 7f43a3517700 1 -- start start 2023-07-21T07:36:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.888+0000 7f43a3517700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06a300 0x7f439c1eb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.888+0000 7f43a3517700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439c06d8a0 0x7f439c14c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.888+0000 7f43a3517700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f439c0ba140 0x7f439c1eab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.888+0000 7f43a3517700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c1ea730 con 0x7f439c06a300 2023-07-21T07:36:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.888+0000 7f43a3517700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c153ba0 con 0x7f439c0ba140 2023-07-21T07:36:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.888+0000 7f43a3517700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c151090 con 0x7f439c06d8a0 2023-07-21T07:36:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.888+0000 7f43a12b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06a300 0x7f439c1eb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.888+0000 7f43a12b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06a300 0x7f439c1eb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35256/0 (socket says 172.21.15.6:35256) 2023-07-21T07:36:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.888+0000 7f43a12b3700 1 -- 172.21.15.6:0/497599356 learned_addr learned my addr 172.21.15.6:0/497599356 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.888+0000 7f43a0ab2700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439c06d8a0 0x7f439c14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.889+0000 7f43a1ab4700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f439c0ba140 0x7f439c1eab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.889+0000 7f43a12b3700 1 -- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439c06d8a0 msgr2=0x7f439c14c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.889+0000 7f43a12b3700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439c06d8a0 0x7f439c14c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.889+0000 7f43a12b3700 1 -- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f439c0ba140 msgr2=0x7f439c1eab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.889+0000 7f43a12b3700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f439c0ba140 0x7f439c1eab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.889+0000 7f43a12b3700 1 -- 172.21.15.6:0/497599356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4394009a70 con 0x7f439c06a300 2023-07-21T07:36:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.889+0000 7f43a12b3700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06a300 0x7f439c1eb6b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f43980090b0 tx=0x7f4398004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.889+0000 7f4391ffb700 1 -- 172.21.15.6:0/497599356 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398003d00 con 0x7f439c06a300 2023-07-21T07:36:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.889+0000 7f4391ffb700 1 -- 172.21.15.6:0/497599356 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439801f070 con 0x7f439c06a300 2023-07-21T07:36:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.889+0000 7f43a3517700 1 -- 172.21.15.6:0/497599356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43980094a0 con 0x7f439c06a300 2023-07-21T07:36:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.889+0000 7f4391ffb700 1 -- 172.21.15.6:0/497599356 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398011870 con 0x7f439c06a300 2023-07-21T07:36:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.889+0000 7f43a3517700 1 -- 172.21.15.6:0/497599356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c152ea0 con 0x7f439c06a300 2023-07-21T07:36:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.890+0000 7f43a3517700 1 -- 172.21.15.6:0/497599356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439c066990 con 0x7f439c06a300 2023-07-21T07:36:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.891+0000 7f4391ffb700 1 -- 172.21.15.6:0/497599356 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4398021030 con 0x7f439c06a300 2023-07-21T07:36:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.892+0000 7f4391ffb700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f438006ad10 0x7f438006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.892+0000 7f4391ffb700 1 -- 172.21.15.6:0/497599356 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f439808ace0 con 0x7f439c06a300 2023-07-21T07:36:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.892+0000 7f43a0ab2700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f438006ad10 0x7f438006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:05.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.892+0000 7f43a0ab2700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f438006ad10 0x7f438006d1d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f439c0a79a0 tx=0x7f438c001e40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:05.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:05.896+0000 7f4391ffb700 1 -- 172.21.15.6:0/497599356 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4398055ba0 con 0x7f439c06a300 2023-07-21T07:36:06.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.098+0000 7f43a3517700 1 -- 172.21.15.6:0/497599356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f439c0c0c50 con 0x7f439c06a300 2023-07-21T07:36:06.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.099+0000 7f4391ffb700 1 -- 172.21.15.6:0/497599356 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v40) v1 ==== 101+0+11 (secure 0 0 0) 0x7f43980591c0 con 0x7f439c06a300 2023-07-21T07:36:06.151 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:36:06.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.101+0000 7f43a3517700 1 -- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f438006ad10 msgr2=0x7f438006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.101+0000 7f43a3517700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f438006ad10 0x7f438006d1d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f439c0a79a0 tx=0x7f438c001e40 comp rx=0 tx=0).stop 2023-07-21T07:36:06.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.101+0000 7f43a3517700 1 -- 172.21.15.6:0/497599356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06a300 msgr2=0x7f439c1eb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.101+0000 7f43a3517700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06a300 0x7f439c1eb6b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f43980090b0 tx=0x7f4398004750 comp rx=0 tx=0).stop 2023-07-21T07:36:06.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.101+0000 7f43a3517700 1 -- 172.21.15.6:0/497599356 shutdown_connections 2023-07-21T07:36:06.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.101+0000 7f43a3517700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f438006ad10 0x7f438006d1d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.101+0000 7f43a3517700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f439c0ba140 0x7f439c1eab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.101+0000 7f43a3517700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06a300 0x7f439c1eb6b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.101+0000 7f43a3517700 1 --2- 172.21.15.6:0/497599356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439c06d8a0 0x7f439c14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.101+0000 7f43a3517700 1 -- 172.21.15.6:0/497599356 >> 172.21.15.6:0/497599356 conn(0x7f439c0a8660 msgr2=0x7f439c06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:06.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.101+0000 7f43a3517700 1 -- 172.21.15.6:0/497599356 shutdown_connections 2023-07-21T07:36:06.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.101+0000 7f43a3517700 1 -- 172.21.15.6:0/497599356 wait complete. 2023-07-21T07:36:06.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:36:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.237+0000 7fc7cbb3d700 1 Processor -- start 2023-07-21T07:36:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.238+0000 7fc7cbb3d700 1 -- start start 2023-07-21T07:36:06.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.238+0000 7fc7cbb3d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc7c4066050 0x7fc7c406a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.238+0000 7fc7cbb3d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c40c0400 0x7fc7c406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.238+0000 7fc7cbb3d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c40c1940 con 0x7fc7c4151aa0 2023-07-21T07:36:06.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.238+0000 7fc7cbb3d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c40c1dd0 con 0x7fc7c4066050 2023-07-21T07:36:06.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.238+0000 7fc7cbb3d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4151e80 con 0x7fc7c40c0400 2023-07-21T07:36:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c98d9700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc7c4151aa0 0x7fc7c40bf5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43284/0 (socket says 172.21.15.6:43284) 2023-07-21T07:36:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c98d9700 1 -- 172.21.15.6:0/2655212386 learned_addr learned my addr 172.21.15.6:0/2655212386 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7ca0da700 1 --2- 172.21.15.6:0/2655212386 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c40c0400 0x7fc7c406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c90d8700 1 --2- 172.21.15.6:0/2655212386 >> v2:172.21.15.86:3300/0 conn(0x7fc7c4066050 0x7fc7c406a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128511937 0 0) 0x7fc7c40c1940 con 0x7fc7c4151aa0 2023-07-21T07:36:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b00035b0 con 0x7fc7c4151aa0 2023-07-21T07:36:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1919442504 0 0) 0x7fc7b00035b0 con 0x7fc7c4151aa0 2023-07-21T07:36:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c40c0400 msgr2=0x7fc7c406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 --2- 172.21.15.6:0/2655212386 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c40c0400 0x7fc7c406a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 >> v2:172.21.15.86:3300/0 conn(0x7fc7c4066050 msgr2=0x7fc7c406a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 --2- 172.21.15.6:0/2655212386 >> v2:172.21.15.86:3300/0 conn(0x7fc7c4066050 0x7fc7c406a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c4158580 con 0x7fc7c4151aa0 2023-07-21T07:36:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7fc7c0001670 con 0x7fc7c4151aa0 2023-07-21T07:36:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 >> v1:172.21.15.6:6789/0 conn(0x7fc7c4151aa0 legacy=0x7fc7c40bf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 --2- 172.21.15.6:0/2655212386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7b0003a00 0x7fc7b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 --2- 172.21.15.6:0/2655212386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b0004850 0x7fc7b0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 --2- 172.21.15.6:0/2655212386 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c40c0400 0x7fc7b0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40c1dd0 con 0x7fc7b0004850 2023-07-21T07:36:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4151e80 con 0x7fc7b0003a00 2023-07-21T07:36:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b000ba90 con 0x7fc7c40c0400 2023-07-21T07:36:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c90d8700 1 --2- 172.21.15.6:0/2655212386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b0004850 0x7fc7b0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7c98d9700 1 --2- 172.21.15.6:0/2655212386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7b0003a00 0x7fc7b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.239+0000 7fc7ca0da700 1 --2- 172.21.15.6:0/2655212386 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c40c0400 0x7fc7b0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7c90d8700 1 -- 172.21.15.6:0/2655212386 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c40c0400 msgr2=0x7fc7b0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7c90d8700 1 --2- 172.21.15.6:0/2655212386 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c40c0400 0x7fc7b0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7c90d8700 1 -- 172.21.15.6:0/2655212386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7b0003a00 msgr2=0x7fc7b0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7c90d8700 1 --2- 172.21.15.6:0/2655212386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7b0003a00 0x7fc7b0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7c90d8700 1 -- 172.21.15.6:0/2655212386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b00035b0 con 0x7fc7b0004850 2023-07-21T07:36:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7c98d9700 1 --2- 172.21.15.6:0/2655212386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7b0003a00 0x7fc7b0003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:06.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7c90d8700 1 --2- 172.21.15.6:0/2655212386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b0004850 0x7fc7b0004cd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009b30 tx=0x7fc7b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4d080def67418b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:06.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b800e6c0 con 0x7fc7b0004850 2023-07-21T07:36:06.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b800e820 con 0x7fc7b0004850 2023-07-21T07:36:06.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7c88d7700 1 -- 172.21.15.6:0/2655212386 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b800eb90 con 0x7fc7b0004850 2023-07-21T07:36:06.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/2655212386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b0004850 msgr2=0x7fc7b0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7cbb3d700 1 --2- 172.21.15.6:0/2655212386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b0004850 0x7fc7b0004cd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009b30 tx=0x7fc7b0005880 comp rx=0 tx=0).stop 2023-07-21T07:36:06.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7ca0da700 1 -- 172.21.15.6:0/2655212386 reap_dead start 2023-07-21T07:36:06.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/2655212386 shutdown_connections 2023-07-21T07:36:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.240+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/2655212386 >> 172.21.15.6:0/2655212386 conn(0x7fc7c40c6120 msgr2=0x7fc7c40c6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.241+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/2655212386 shutdown_connections 2023-07-21T07:36:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.241+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/2655212386 wait complete. 2023-07-21T07:36:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.242+0000 7fc7cbb3d700 1 Processor -- start 2023-07-21T07:36:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.242+0000 7fc7cbb3d700 1 -- start start 2023-07-21T07:36:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.242+0000 7fc7cbb3d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b0004850 0x7fc7c41eab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.242+0000 7fc7cbb3d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c4146070 0x7fc7c40ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.242+0000 7fc7cbb3d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7c4145540 0x7fc7c41459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7cbb3d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c41eb0c0 con 0x7fc7b0004850 2023-07-21T07:36:06.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7cbb3d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4155240 con 0x7fc7c4145540 2023-07-21T07:36:06.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7cbb3d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40a9ec0 con 0x7fc7c4146070 2023-07-21T07:36:06.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7c98d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b0004850 0x7fc7c41eab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7c98d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b0004850 0x7fc7c41eab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35276/0 (socket says 172.21.15.6:35276) 2023-07-21T07:36:06.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7c98d9700 1 -- 172.21.15.6:0/4050456968 learned_addr learned my addr 172.21.15.6:0/4050456968 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:06.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7c90d8700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c4146070 0x7fc7c40ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7ca0da700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7c4145540 0x7fc7c41459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7c98d9700 1 -- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c4146070 msgr2=0x7fc7c40ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7c98d9700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c4146070 0x7fc7c40ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7c98d9700 1 -- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7c4145540 msgr2=0x7fc7c41459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7c98d9700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7c4145540 0x7fc7c41459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7c98d9700 1 -- 172.21.15.6:0/4050456968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c40a92b0 con 0x7fc7b0004850 2023-07-21T07:36:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7c90d8700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c4146070 0x7fc7c40ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7c98d9700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b0004850 0x7fc7c41eab80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0000ff0 tx=0x7fc7c000eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7b67fc700 1 -- 172.21.15.6:0/4050456968 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0012590 con 0x7fc7b0004850 2023-07-21T07:36:06.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7b67fc700 1 -- 172.21.15.6:0/4050456968 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c00126f0 con 0x7fc7b0004850 2023-07-21T07:36:06.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/4050456968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c40a9590 con 0x7fc7b0004850 2023-07-21T07:36:06.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7b67fc700 1 -- 172.21.15.6:0/4050456968 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0012a60 con 0x7fc7b0004850 2023-07-21T07:36:06.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.243+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/4050456968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c40a9b50 con 0x7fc7b0004850 2023-07-21T07:36:06.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.244+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/4050456968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c40ac530 con 0x7fc7b0004850 2023-07-21T07:36:06.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.245+0000 7fc7b67fc700 1 -- 172.21.15.6:0/4050456968 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7c0012bc0 con 0x7fc7b0004850 2023-07-21T07:36:06.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.245+0000 7fc7b67fc700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc7a806ace0 0x7fc7a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.245+0000 7fc7b67fc700 1 -- 172.21.15.6:0/4050456968 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fc7c0089560 con 0x7fc7b0004850 2023-07-21T07:36:06.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.245+0000 7fc7c90d8700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc7a806ace0 0x7fc7a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.246+0000 7fc7c90d8700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc7a806ace0 0x7fc7a806d1a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80090b0 tx=0x7fc7b8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.249+0000 7fc7b67fc700 1 -- 172.21.15.6:0/4050456968 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc7c0054340 con 0x7fc7b0004850 2023-07-21T07:36:06.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.491+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/4050456968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7c4074500 con 0x7fc7b0004850 2023-07-21T07:36:06.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.491+0000 7fc7b67fc700 1 -- 172.21.15.6:0/4050456968 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5804 (secure 0 0 0) 0x7fc7c0057960 con 0x7fc7b0004850 2023-07-21T07:36:06.544 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:06.544 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1808819585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1808819585},{"type":"v1","addr":"172.21.15.6:6834","nonce":1808819585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/422116109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":422116109},{"type":"v1","addr":"172.21.15.86:6836","nonce":422116109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:30.954456+0000","modified":"2023-07-21T07:35:34.571830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/459917011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":459917011},{"type":"v1","addr":"172.21.15.6:6835","nonce":459917011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:45.299013+0000","modified":"2023-07-21T07:35:48.891082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.86:6837/3328348149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3328348149},{"type":"v1","addr":"172.21.15.86:6837","nonce":3328348149}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T07:36:06.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.493+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc7a806ace0 msgr2=0x7fc7a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.493+0000 7fc7cbb3d700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc7a806ace0 0x7fc7a806d1a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80090b0 tx=0x7fc7b8008030 comp rx=0 tx=0).stop 2023-07-21T07:36:06.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.493+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/4050456968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b0004850 msgr2=0x7fc7c41eab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.493+0000 7fc7cbb3d700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b0004850 0x7fc7c41eab80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0000ff0 tx=0x7fc7c000eb10 comp rx=0 tx=0).stop 2023-07-21T07:36:06.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.493+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/4050456968 shutdown_connections 2023-07-21T07:36:06.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.493+0000 7fc7cbb3d700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc7a806ace0 0x7fc7a806d1a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.493+0000 7fc7cbb3d700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7c4145540 0x7fc7c41459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.493+0000 7fc7cbb3d700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b0004850 0x7fc7c41eab80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.493+0000 7fc7cbb3d700 1 --2- 172.21.15.6:0/4050456968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c4146070 0x7fc7c40ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.493+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/4050456968 >> 172.21.15.6:0/4050456968 conn(0x7fc7c40c6120 msgr2=0x7fc7c40c3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:06.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.493+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/4050456968 shutdown_connections 2023-07-21T07:36:06.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.493+0000 7fc7cbb3d700 1 -- 172.21.15.6:0/4050456968 wait complete. 2023-07-21T07:36:06.548 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 22 2023-07-21T07:36:06.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:06.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.630+0000 7f038b726700 1 Processor -- start 2023-07-21T07:36:06.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.630+0000 7f038b726700 1 -- start start 2023-07-21T07:36:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.631+0000 7f038b726700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f038414fa10 0x7f038406a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.631+0000 7f038b726700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03840abdb0 0x7f03840aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.631+0000 7f038b726700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03840c6cc0 con 0x7f0384066210 2023-07-21T07:36:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.631+0000 7f038b726700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0384152df0 con 0x7f038414fa10 2023-07-21T07:36:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.631+0000 7f038b726700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03841530d0 con 0x7f03840abdb0 2023-07-21T07:36:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.631+0000 7f0389cc3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0384066210 0x7f03840aaf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43308/0 (socket says 172.21.15.6:43308) 2023-07-21T07:36:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.631+0000 7f0389cc3700 1 -- 172.21.15.6:0/3251188895 learned_addr learned my addr 172.21.15.6:0/3251188895 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0388cc1700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03840abdb0 0x7f03840aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f03894c2700 1 --2- 172.21.15.6:0/3251188895 >> v2:172.21.15.86:3300/0 conn(0x7f038414fa10 0x7f038406a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551707020 0 0) 0x7f03840c6cc0 con 0x7f0384066210 2023-07-21T07:36:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03700035b0 con 0x7f0384066210 2023-07-21T07:36:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2916296492 0 0) 0x7f03700035b0 con 0x7f0384066210 2023-07-21T07:36:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03840abdb0 msgr2=0x7f03840aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03840abdb0 0x7f03840aa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 >> v2:172.21.15.86:3300/0 conn(0x7f038414fa10 msgr2=0x7f038406a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 --2- 172.21.15.6:0/3251188895 >> v2:172.21.15.86:3300/0 conn(0x7f038414fa10 0x7f038406a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03840c6f10 con 0x7f0384066210 2023-07-21T07:36:06.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f037c0019f0 con 0x7f0384066210 2023-07-21T07:36:06.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 >> v1:172.21.15.6:6789/0 conn(0x7f0384066210 legacy=0x7f03840aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0370003a00 0x7f0370003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0370004850 0x7f0370004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0370005210 0x7f037000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0384152df0 con 0x7f0370003a00 2023-07-21T07:36:06.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03841530d0 con 0x7f0370004850 2023-07-21T07:36:06.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037000bf80 con 0x7f0370005210 2023-07-21T07:36:06.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0388cc1700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03840abdb0 0x7f03840aa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:06.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f03894c2700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0370003a00 0x7f0370003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0389cc3700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0370005210 0x7f037000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0388cc1700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0370004850 0x7f0370004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f03894c2700 1 -- 172.21.15.6:0/3251188895 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0370005210 msgr2=0x7f037000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:06.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f03894c2700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0370005210 0x7f037000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f03894c2700 1 -- 172.21.15.6:0/3251188895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0370004850 msgr2=0x7f0370004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:06.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f03894c2700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0370004850 0x7f0370004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f03894c2700 1 -- 172.21.15.6:0/3251188895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700035b0 con 0x7f0370003a00 2023-07-21T07:36:06.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.632+0000 7f0388cc1700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0370004850 0x7f0370004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:06.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.633+0000 7f03894c2700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0370003a00 0x7f0370003e20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0380009b60 tx=0x7f0370005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d52e1e7638f2326 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:06.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.633+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038000e660 con 0x7f0370003a00 2023-07-21T07:36:06.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.633+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038000e7c0 con 0x7f0370003a00 2023-07-21T07:36:06.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.633+0000 7f0377fff700 1 -- 172.21.15.6:0/3251188895 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038000eb30 con 0x7f0370003a00 2023-07-21T07:36:06.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.633+0000 7f038b726700 1 -- 172.21.15.6:0/3251188895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0370003a00 msgr2=0x7f0370003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.633+0000 7f038b726700 1 --2- 172.21.15.6:0/3251188895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0370003a00 0x7f0370003e20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0380009b60 tx=0x7f0370005880 comp rx=0 tx=0).stop 2023-07-21T07:36:06.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.633+0000 7f0389cc3700 1 -- 172.21.15.6:0/3251188895 reap_dead start 2023-07-21T07:36:06.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.633+0000 7f038b726700 1 -- 172.21.15.6:0/3251188895 shutdown_connections 2023-07-21T07:36:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.633+0000 7f038b726700 1 -- 172.21.15.6:0/3251188895 >> 172.21.15.6:0/3251188895 conn(0x7f03840c6140 msgr2=0x7f03840c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.633+0000 7f038b726700 1 -- 172.21.15.6:0/3251188895 shutdown_connections 2023-07-21T07:36:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.633+0000 7f038b726700 1 -- 172.21.15.6:0/3251188895 wait complete. 2023-07-21T07:36:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.634+0000 7f038b726700 1 Processor -- start 2023-07-21T07:36:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.635+0000 7f038b726700 1 -- start start 2023-07-21T07:36:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.635+0000 7f038b726700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0370003a00 0x7f0384070a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.635+0000 7f038b726700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841ed820 0x7f0384071450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.635+0000 7f038b726700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03840bf720 0x7f03841eac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.635+0000 7f038b726700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038414a1c0 con 0x7f03841ed820 2023-07-21T07:36:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.635+0000 7f038b726700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03841edca0 con 0x7f03840bf720 2023-07-21T07:36:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.635+0000 7f038b726700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0384071990 con 0x7f0370003a00 2023-07-21T07:36:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.635+0000 7f0388cc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841ed820 0x7f0384071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.635+0000 7f0388cc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841ed820 0x7f0384071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35298/0 (socket says 172.21.15.6:35298) 2023-07-21T07:36:06.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.635+0000 7f0388cc1700 1 -- 172.21.15.6:0/4272970883 learned_addr learned my addr 172.21.15.6:0/4272970883 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:06.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.635+0000 7f03894c2700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0370003a00 0x7f0384070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.636+0000 7f0389cc3700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03840bf720 0x7f03841eac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.636+0000 7f0388cc1700 1 -- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0370003a00 msgr2=0x7f0384070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.636+0000 7f0388cc1700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0370003a00 0x7f0384070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.636+0000 7f0388cc1700 1 -- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03840bf720 msgr2=0x7f03841eac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.636+0000 7f0388cc1700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03840bf720 0x7f03841eac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.636+0000 7f0388cc1700 1 -- 172.21.15.6:0/4272970883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0384071bf0 con 0x7f03841ed820 2023-07-21T07:36:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.636+0000 7f0389cc3700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03840bf720 0x7f03841eac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.636+0000 7f0388cc1700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841ed820 0x7f0384071450 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f03780108e0 tx=0x7f0378010bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.636+0000 7f0375ffb700 1 -- 172.21.15.6:0/4272970883 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378016670 con 0x7f03841ed820 2023-07-21T07:36:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.636+0000 7f0375ffb700 1 -- 172.21.15.6:0/4272970883 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03780167d0 con 0x7f03841ed820 2023-07-21T07:36:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.636+0000 7f0375ffb700 1 -- 172.21.15.6:0/4272970883 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378016b40 con 0x7f03841ed820 2023-07-21T07:36:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.636+0000 7f038b726700 1 -- 172.21.15.6:0/4272970883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038406ffa0 con 0x7f03841ed820 2023-07-21T07:36:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.636+0000 7f038b726700 1 -- 172.21.15.6:0/4272970883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0384070560 con 0x7f03841ed820 2023-07-21T07:36:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.637+0000 7f038b726700 1 -- 172.21.15.6:0/4272970883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038406fe00 con 0x7f03841ed820 2023-07-21T07:36:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.638+0000 7f0375ffb700 1 -- 172.21.15.6:0/4272970883 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0378016ca0 con 0x7f03841ed820 2023-07-21T07:36:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.638+0000 7f0375ffb700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f036806ad10 0x7f036806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.639+0000 7f0375ffb700 1 -- 172.21.15.6:0/4272970883 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f037808a1b0 con 0x7f03841ed820 2023-07-21T07:36:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.639+0000 7f03894c2700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f036806ad10 0x7f036806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.639+0000 7f03894c2700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f036806ad10 0x7f036806d1d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f03800090b0 tx=0x7f0380008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.642+0000 7f0375ffb700 1 -- 172.21.15.6:0/4272970883 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0378054ee0 con 0x7f03841ed820 2023-07-21T07:36:06.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.841+0000 7f038b726700 1 -- 172.21.15.6:0/4272970883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f038406fe00 con 0x7f03841ed820 2023-07-21T07:36:06.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.842+0000 7f0375ffb700 1 -- 172.21.15.6:0/4272970883 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+21959 (secure 0 0 0) 0x7f038406fe00 con 0x7f03841ed820 2023-07-21T07:36:06.895 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:06.895 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:46.879421+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:35:29.385402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T07:35:29.920618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:35:43.052752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:35:44.270260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.844+0000 7f038b726700 1 -- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f036806ad10 msgr2=0x7f036806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.844+0000 7f038b726700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f036806ad10 0x7f036806d1d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f03800090b0 tx=0x7f0380008030 comp rx=0 tx=0).stop 2023-07-21T07:36:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.844+0000 7f038b726700 1 -- 172.21.15.6:0/4272970883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841ed820 msgr2=0x7f0384071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.844+0000 7f038b726700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841ed820 0x7f0384071450 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f03780108e0 tx=0x7f0378010bf0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.844+0000 7f038b726700 1 -- 172.21.15.6:0/4272970883 shutdown_connections 2023-07-21T07:36:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.844+0000 7f038b726700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f036806ad10 0x7f036806d1d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.844+0000 7f038b726700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03840bf720 0x7f03841eac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.844+0000 7f038b726700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0370003a00 0x7f0384070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.844+0000 7f038b726700 1 --2- 172.21.15.6:0/4272970883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03841ed820 0x7f0384071450 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.844+0000 7f038b726700 1 -- 172.21.15.6:0/4272970883 >> 172.21.15.6:0/4272970883 conn(0x7f03840c6140 msgr2=0x7f03840aa920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.844+0000 7f038b726700 1 -- 172.21.15.6:0/4272970883 shutdown_connections 2023-07-21T07:36:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.844+0000 7f038b726700 1 -- 172.21.15.6:0/4272970883 wait complete. 2023-07-21T07:36:06.909 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T07:36:06.910 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:36:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.985+0000 7f8b91c8c700 1 Processor -- start 2023-07-21T07:36:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.985+0000 7f8b91c8c700 1 -- start start 2023-07-21T07:36:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.985+0000 7f8b91c8c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b8c14ed60 0x7f8b8c0c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.985+0000 7f8b91c8c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8c0ba440 con 0x7f8b8c0c3750 2023-07-21T07:36:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.985+0000 7f8b91c8c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8c0c15d0 con 0x7f8b8c0c6170 2023-07-21T07:36:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.985+0000 7f8b91c8c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c0c18b0 con 0x7f8b8c14ed60 2023-07-21T07:36:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.986+0000 7f8b8b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8b8c0c3750 0x7f8b8c14e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43324/0 (socket says 172.21.15.6:43324) 2023-07-21T07:36:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.986+0000 7f8b8b7fe700 1 -- 172.21.15.6:0/2921012166 learned_addr learned my addr 172.21.15.6:0/2921012166 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.986+0000 7f8b8bfff700 1 --2- 172.21.15.6:0/2921012166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b8c14ed60 0x7f8b8c0c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.986+0000 7f8b8a7fc700 1 -- 172.21.15.6:0/2921012166 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651165918 0 0) 0x7f8b8c0ba440 con 0x7f8b8c0c3750 2023-07-21T07:36:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.986+0000 7f8b8a7fc700 1 -- 172.21.15.6:0/2921012166 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b740035b0 con 0x7f8b8c0c3750 2023-07-21T07:36:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.986+0000 7f8b8a7fc700 1 -- 172.21.15.6:0/2921012166 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229482000 0 0) 0x7f8b8c0c15d0 con 0x7f8b8c0c6170 2023-07-21T07:36:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.986+0000 7f8b8a7fc700 1 -- 172.21.15.6:0/2921012166 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b8c0ba440 con 0x7f8b8c0c6170 2023-07-21T07:36:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.986+0000 7f8b8bfff700 1 -- 172.21.15.6:0/2921012166 >> v1:172.21.15.86:6789/0 conn(0x7f8b8c0c6170 legacy=0x7f8b8c154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.986+0000 7f8b8bfff700 1 -- 172.21.15.6:0/2921012166 >> v1:172.21.15.6:6789/0 conn(0x7f8b8c0c3750 legacy=0x7f8b8c14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.986+0000 7f8b8a7fc700 1 -- 172.21.15.6:0/2921012166 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2158078006 0 0) 0x7f8b740035b0 con 0x7f8b8c0c3750 2023-07-21T07:36:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.986+0000 7f8b8bfff700 1 -- 172.21.15.6:0/2921012166 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c0c1b90 con 0x7f8b8c14ed60 2023-07-21T07:36:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.986+0000 7f8b8bfff700 1 --2- 172.21.15.6:0/2921012166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b8c14ed60 0x7f8b8c0c53e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009dc0 tx=0x7f8b8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f61321c0ebd15356 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.987+0000 7f8b8a7fc700 1 -- 172.21.15.6:0/2921012166 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8400e070 con 0x7f8b8c14ed60 2023-07-21T07:36:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.987+0000 7f8b8a7fc700 1 -- 172.21.15.6:0/2921012166 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b84003a20 con 0x7f8b8c14ed60 2023-07-21T07:36:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.987+0000 7f8b8a7fc700 1 -- 172.21.15.6:0/2921012166 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c001670 con 0x7f8b8c14ed60 2023-07-21T07:36:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.987+0000 7f8b91c8c700 1 -- 172.21.15.6:0/2921012166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b8c14ed60 msgr2=0x7f8b8c0c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.987+0000 7f8b91c8c700 1 --2- 172.21.15.6:0/2921012166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b8c14ed60 0x7f8b8c0c53e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009dc0 tx=0x7f8b8400b330 comp rx=0 tx=0).stop 2023-07-21T07:36:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.987+0000 7f8b91c8c700 1 -- 172.21.15.6:0/2921012166 shutdown_connections 2023-07-21T07:36:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.987+0000 7f8b91c8c700 1 --2- 172.21.15.6:0/2921012166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b8c14ed60 0x7f8b8c0c53e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.987+0000 7f8b91c8c700 1 -- 172.21.15.6:0/2921012166 >> 172.21.15.6:0/2921012166 conn(0x7f8b8c0a8c90 msgr2=0x7f8b8c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.987+0000 7f8b91c8c700 1 -- 172.21.15.6:0/2921012166 shutdown_connections 2023-07-21T07:36:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.987+0000 7f8b91c8c700 1 -- 172.21.15.6:0/2921012166 wait complete. 2023-07-21T07:36:07.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.988+0000 7f8b91c8c700 1 Processor -- start 2023-07-21T07:36:07.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.989+0000 7f8b91c8c700 1 -- start start 2023-07-21T07:36:07.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.989+0000 7f8b91c8c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8c0c3750 0x7f8b8c153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.989+0000 7f8b91c8c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b8c0c6170 0x7f8b8c14d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.989+0000 7f8b91c8c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b8c14ed60 0x7f8b8c152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.989+0000 7f8b91c8c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c154540 con 0x7f8b8c0c3750 2023-07-21T07:36:07.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.989+0000 7f8b91c8c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c1e6e40 con 0x7f8b8c14ed60 2023-07-21T07:36:07.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.989+0000 7f8b91c8c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c151290 con 0x7f8b8c0c6170 2023-07-21T07:36:07.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.989+0000 7f8b8b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8c0c3750 0x7f8b8c153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.989+0000 7f8b8b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8c0c3750 0x7f8b8c153a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35310/0 (socket says 172.21.15.6:35310) 2023-07-21T07:36:07.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.989+0000 7f8b8b7fe700 1 -- 172.21.15.6:0/3348412169 learned_addr learned my addr 172.21.15.6:0/3348412169 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:07.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b8b7fe700 1 -- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b8c0c6170 msgr2=0x7f8b8c14d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b8bfff700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b8c14ed60 0x7f8b8c152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b8affd700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b8c0c6170 0x7f8b8c14d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b8b7fe700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b8c0c6170 0x7f8b8c14d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b8b7fe700 1 -- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b8c14ed60 msgr2=0x7f8b8c152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b8b7fe700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b8c14ed60 0x7f8b8c152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b8b7fe700 1 -- 172.21.15.6:0/3348412169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84009a70 con 0x7f8b8c0c3750 2023-07-21T07:36:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b8bfff700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b8c14ed60 0x7f8b8c152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b8affd700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b8c0c6170 0x7f8b8c14d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b8b7fe700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8c0c3750 0x7f8b8c153a80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00c770 tx=0x7f8b7c00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b73fff700 1 -- 172.21.15.6:0/3348412169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c007560 con 0x7f8b8c0c3750 2023-07-21T07:36:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b73fff700 1 -- 172.21.15.6:0/3348412169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c0076c0 con 0x7f8b8c0c3750 2023-07-21T07:36:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b91c8c700 1 -- 172.21.15.6:0/3348412169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8c153fc0 con 0x7f8b8c0c3750 2023-07-21T07:36:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b73fff700 1 -- 172.21.15.6:0/3348412169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c004a70 con 0x7f8b8c0c3750 2023-07-21T07:36:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.990+0000 7f8b91c8c700 1 -- 172.21.15.6:0/3348412169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8c1e67f0 con 0x7f8b8c0c3750 2023-07-21T07:36:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.991+0000 7f8b91c8c700 1 -- 172.21.15.6:0/3348412169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8c1e6650 con 0x7f8b8c0c3750 2023-07-21T07:36:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.991+0000 7f8b73fff700 1 -- 172.21.15.6:0/3348412169 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b7c004bd0 con 0x7f8b8c0c3750 2023-07-21T07:36:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.992+0000 7f8b73fff700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8b7806ace0 0x7f8b7806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.992+0000 7f8b73fff700 1 -- 172.21.15.6:0/3348412169 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f8b7c088990 con 0x7f8b8c0c3750 2023-07-21T07:36:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.992+0000 7f8b8affd700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8b7806ace0 0x7f8b7806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.993+0000 7f8b8affd700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8b7806ace0 0x7f8b7806d1a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0c7a40 tx=0x7f8b80009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:06.996+0000 7f8b73fff700 1 -- 172.21.15.6:0/3348412169 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b8c1e6650 con 0x7f8b8c0c3750 2023-07-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.244+0000 7f8b91c8c700 1 -- 172.21.15.6:0/3348412169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b8c1e6650 con 0x7f8b8c0c3750 2023-07-21T07:36:07.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.244+0000 7f8b73fff700 1 -- 172.21.15.6:0/3348412169 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5804 (secure 0 0 0) 0x7f8b8c1e6650 con 0x7f8b8c0c3750 2023-07-21T07:36:07.297 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:07.297 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1808819585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1808819585},{"type":"v1","addr":"172.21.15.6:6834","nonce":1808819585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/422116109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":422116109},{"type":"v1","addr":"172.21.15.86:6836","nonce":422116109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:30.954456+0000","modified":"2023-07-21T07:35:34.571830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/459917011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":459917011},{"type":"v1","addr":"172.21.15.6:6835","nonce":459917011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:45.299013+0000","modified":"2023-07-21T07:35:48.891082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.86:6837/3328348149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3328348149},{"type":"v1","addr":"172.21.15.86:6837","nonce":3328348149}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T07:36:07.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.246+0000 7f8b91c8c700 1 -- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8b7806ace0 msgr2=0x7f8b7806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.246+0000 7f8b91c8c700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8b7806ace0 0x7f8b7806d1a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0c7a40 tx=0x7f8b80009040 comp rx=0 tx=0).stop 2023-07-21T07:36:07.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.247+0000 7f8b91c8c700 1 -- 172.21.15.6:0/3348412169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8c0c3750 msgr2=0x7f8b8c153a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.247+0000 7f8b91c8c700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8c0c3750 0x7f8b8c153a80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00c770 tx=0x7f8b7c00cb30 comp rx=0 tx=0).stop 2023-07-21T07:36:07.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.247+0000 7f8b91c8c700 1 -- 172.21.15.6:0/3348412169 shutdown_connections 2023-07-21T07:36:07.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.247+0000 7f8b91c8c700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8b7806ace0 0x7f8b7806d1a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.247+0000 7f8b91c8c700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b8c14ed60 0x7f8b8c152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.247+0000 7f8b91c8c700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8c0c3750 0x7f8b8c153a80 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.247+0000 7f8b91c8c700 1 --2- 172.21.15.6:0/3348412169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b8c0c6170 0x7f8b8c14d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.247+0000 7f8b91c8c700 1 -- 172.21.15.6:0/3348412169 >> 172.21.15.6:0/3348412169 conn(0x7f8b8c0a8c90 msgr2=0x7f8b8c0c48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:07.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.247+0000 7f8b91c8c700 1 -- 172.21.15.6:0/3348412169 shutdown_connections 2023-07-21T07:36:07.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.247+0000 7f8b91c8c700 1 -- 172.21.15.6:0/3348412169 wait complete. 2023-07-21T07:36:07.301 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 22 2023-07-21T07:36:07.311 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:36:07.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.383+0000 7ff21c1a5700 1 Processor -- start 2023-07-21T07:36:07.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.383+0000 7ff21c1a5700 1 -- start start 2023-07-21T07:36:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff21c1a5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff21414e870 0x7ff21414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff21c1a5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff2140c4930 0x7ff214151330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff21c1a5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2140c4ef0 con 0x7ff2140a5f00 2023-07-21T07:36:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff21c1a5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2140c1df0 con 0x7ff2140c4930 2023-07-21T07:36:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff21c1a5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140c1450 con 0x7ff21414e870 2023-07-21T07:36:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff21a742700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff2140c4930 0x7ff214151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff21a742700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff2140c4930 0x7ff214151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35322/0 (socket says 172.21.15.6:35322) 2023-07-21T07:36:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff21a742700 1 -- 172.21.15.6:0/1905322143 learned_addr learned my addr 172.21.15.6:0/1905322143 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff219f41700 1 --2- 172.21.15.6:0/1905322143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff21414e870 0x7ff21414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff21a742700 1 -- 172.21.15.6:0/1905322143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff21414e870 msgr2=0x7ff21414ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff21a742700 1 --2- 172.21.15.6:0/1905322143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff21414e870 0x7ff21414ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff21a742700 1 -- 172.21.15.6:0/1905322143 >> v1:172.21.15.86:6789/0 conn(0x7ff2140a5f00 legacy=0x7ff2140c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:07.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff21a742700 1 -- 172.21.15.6:0/1905322143 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2140c1730 con 0x7ff2140c4930 2023-07-21T07:36:07.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.384+0000 7ff219f41700 1 --2- 172.21.15.6:0/1905322143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff21414e870 0x7ff21414ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:07.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.385+0000 7ff21a742700 1 --2- 172.21.15.6:0/1905322143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2140c4930 0x7ff214151330 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009e50 tx=0x7ff20c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84247990dcfbd9a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:07.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.385+0000 7ff218f3f700 1 -- 172.21.15.6:0/1905322143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00e070 con 0x7ff2140c4930 2023-07-21T07:36:07.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.385+0000 7ff218f3f700 1 -- 172.21.15.6:0/1905322143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c003a20 con 0x7ff2140c4930 2023-07-21T07:36:07.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.385+0000 7ff218f3f700 1 -- 172.21.15.6:0/1905322143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c003dd0 con 0x7ff2140c4930 2023-07-21T07:36:07.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.385+0000 7ff21c1a5700 1 -- 172.21.15.6:0/1905322143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2140c4930 msgr2=0x7ff214151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.385+0000 7ff21c1a5700 1 --2- 172.21.15.6:0/1905322143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2140c4930 0x7ff214151330 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009e50 tx=0x7ff20c00b330 comp rx=0 tx=0).stop 2023-07-21T07:36:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.385+0000 7ff21c1a5700 1 -- 172.21.15.6:0/1905322143 shutdown_connections 2023-07-21T07:36:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.385+0000 7ff21c1a5700 1 --2- 172.21.15.6:0/1905322143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2140c4930 0x7ff214151330 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.385+0000 7ff21c1a5700 1 --2- 172.21.15.6:0/1905322143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff21414e870 0x7ff21414ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.385+0000 7ff21c1a5700 1 -- 172.21.15.6:0/1905322143 >> 172.21.15.6:0/1905322143 conn(0x7ff2140a8660 msgr2=0x7ff2140a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.385+0000 7ff21c1a5700 1 -- 172.21.15.6:0/1905322143 shutdown_connections 2023-07-21T07:36:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.385+0000 7ff21c1a5700 1 -- 172.21.15.6:0/1905322143 wait complete. 2023-07-21T07:36:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.387+0000 7ff21c1a5700 1 Processor -- start 2023-07-21T07:36:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.387+0000 7ff21c1a5700 1 -- start start 2023-07-21T07:36:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.387+0000 7ff21c1a5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2140a5f00 0x7ff2140bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.387+0000 7ff21c1a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2140c4930 0x7ff2140bff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.387+0000 7ff21c1a5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff21414e870 0x7ff214071080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.387+0000 7ff21c1a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140c0e70 con 0x7ff2140c4930 2023-07-21T07:36:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.387+0000 7ff21c1a5700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff214141e10 con 0x7ff21414e870 2023-07-21T07:36:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.387+0000 7ff21c1a5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140bdb00 con 0x7ff2140a5f00 2023-07-21T07:36:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.387+0000 7ff219740700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2140c4930 0x7ff2140bff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.387+0000 7ff219740700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2140c4930 0x7ff2140bff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35326/0 (socket says 172.21.15.6:35326) 2023-07-21T07:36:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.387+0000 7ff219740700 1 -- 172.21.15.6:0/361575400 learned_addr learned my addr 172.21.15.6:0/361575400 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.387+0000 7ff21a742700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff21414e870 0x7ff214071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.387+0000 7ff219f41700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2140a5f00 0x7ff2140bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.388+0000 7ff219740700 1 -- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2140a5f00 msgr2=0x7ff2140bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.388+0000 7ff219740700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2140a5f00 0x7ff2140bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.388+0000 7ff219740700 1 -- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff21414e870 msgr2=0x7ff214071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.388+0000 7ff219740700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff21414e870 0x7ff214071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.388+0000 7ff219740700 1 -- 172.21.15.6:0/361575400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c009b30 con 0x7ff2140c4930 2023-07-21T07:36:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.388+0000 7ff219740700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2140c4930 0x7ff2140bff40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff21000b4a0 tx=0x7ff21000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.388+0000 7ff20a7fc700 1 -- 172.21.15.6:0/361575400 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210011830 con 0x7ff2140c4930 2023-07-21T07:36:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.388+0000 7ff20a7fc700 1 -- 172.21.15.6:0/361575400 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff210011990 con 0x7ff2140c4930 2023-07-21T07:36:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.388+0000 7ff21c1a5700 1 -- 172.21.15.6:0/361575400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2140c0480 con 0x7ff2140c4930 2023-07-21T07:36:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.388+0000 7ff20a7fc700 1 -- 172.21.15.6:0/361575400 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210011d40 con 0x7ff2140c4930 2023-07-21T07:36:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.388+0000 7ff21c1a5700 1 -- 172.21.15.6:0/361575400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2140be080 con 0x7ff2140c4930 2023-07-21T07:36:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.389+0000 7ff21c1a5700 1 -- 172.21.15.6:0/361575400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff214074500 con 0x7ff2140c4930 2023-07-21T07:36:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.390+0000 7ff20a7fc700 1 -- 172.21.15.6:0/361575400 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff21001a400 con 0x7ff2140c4930 2023-07-21T07:36:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.390+0000 7ff20a7fc700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff1f806ace0 0x7ff1f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.390+0000 7ff20a7fc700 1 -- 172.21.15.6:0/361575400 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7ff210089290 con 0x7ff2140c4930 2023-07-21T07:36:07.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.390+0000 7ff219f41700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff1f806ace0 0x7ff1f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.391+0000 7ff219f41700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff1f806ace0 0x7ff1f806d1a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff204006fd0 tx=0x7ff204008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:07.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.394+0000 7ff20a7fc700 1 -- 172.21.15.6:0/361575400 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff210054120 con 0x7ff2140c4930 2023-07-21T07:36:07.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.637+0000 7ff21c1a5700 1 -- 172.21.15.6:0/361575400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2140bdd70 con 0x7ff2140c4930 2023-07-21T07:36:07.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.638+0000 7ff20a7fc700 1 -- 172.21.15.6:0/361575400 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5804 (secure 0 0 0) 0x7ff210057740 con 0x7ff2140c4930 2023-07-21T07:36:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:07.691 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1808819585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1808819585},{"type":"v1","addr":"172.21.15.6:6834","nonce":1808819585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/422116109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":422116109},{"type":"v1","addr":"172.21.15.86:6836","nonce":422116109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:30.954456+0000","modified":"2023-07-21T07:35:34.571830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/459917011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":459917011},{"type":"v1","addr":"172.21.15.6:6835","nonce":459917011}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:45.299013+0000","modified":"2023-07-21T07:35:48.891082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.86:6837/3328348149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3328348149},{"type":"v1","addr":"172.21.15.86:6837","nonce":3328348149}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T07:36:07.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.640+0000 7ff21c1a5700 1 -- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff1f806ace0 msgr2=0x7ff1f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.640+0000 7ff21c1a5700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff1f806ace0 0x7ff1f806d1a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff204006fd0 tx=0x7ff204008040 comp rx=0 tx=0).stop 2023-07-21T07:36:07.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.640+0000 7ff21c1a5700 1 -- 172.21.15.6:0/361575400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2140c4930 msgr2=0x7ff2140bff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.640+0000 7ff21c1a5700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2140c4930 0x7ff2140bff40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff21000b4a0 tx=0x7ff21000b7b0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.640+0000 7ff21c1a5700 1 -- 172.21.15.6:0/361575400 shutdown_connections 2023-07-21T07:36:07.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.640+0000 7ff21c1a5700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff1f806ace0 0x7ff1f806d1a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.640+0000 7ff21c1a5700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff21414e870 0x7ff214071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.640+0000 7ff21c1a5700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2140a5f00 0x7ff2140bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.640+0000 7ff21c1a5700 1 --2- 172.21.15.6:0/361575400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2140c4930 0x7ff2140bff40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.640+0000 7ff21c1a5700 1 -- 172.21.15.6:0/361575400 >> 172.21.15.6:0/361575400 conn(0x7ff2140a8660 msgr2=0x7ff214147900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:07.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.640+0000 7ff21c1a5700 1 -- 172.21.15.6:0/361575400 shutdown_connections 2023-07-21T07:36:07.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.640+0000 7ff21c1a5700 1 -- 172.21.15.6:0/361575400 wait complete. 2023-07-21T07:36:07.694 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 22 2023-07-21T07:36:07.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:07.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.778+0000 7f4aebd3b700 1 Processor -- start 2023-07-21T07:36:07.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.778+0000 7f4aebd3b700 1 -- start start 2023-07-21T07:36:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.779+0000 7f4aebd3b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4ae414ed60 0x7f4ae40c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.779+0000 7f4aebd3b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae40ba440 con 0x7f4ae40c6170 2023-07-21T07:36:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.779+0000 7f4aebd3b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae40c15d0 con 0x7f4ae40c3750 2023-07-21T07:36:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.779+0000 7f4aebd3b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae414f140 con 0x7f4ae414ed60 2023-07-21T07:36:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.779+0000 7f4ae92d6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4ae40c6170 0x7f4ae4154c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43352/0 (socket says 172.21.15.6:43352) 2023-07-21T07:36:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.779+0000 7f4ae92d6700 1 -- 172.21.15.6:0/3983420936 learned_addr learned my addr 172.21.15.6:0/3983420936 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.779+0000 7f4aea2d8700 1 --2- 172.21.15.6:0/3983420936 >> v2:172.21.15.86:3300/0 conn(0x7f4ae414ed60 0x7f4ae40c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.779+0000 7f4ae8ad5700 1 -- 172.21.15.6:0/3983420936 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020986295 0 0) 0x7f4ae40ba440 con 0x7f4ae40c6170 2023-07-21T07:36:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.779+0000 7f4ae8ad5700 1 -- 172.21.15.6:0/3983420936 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ad00057c0 con 0x7f4ae40c6170 2023-07-21T07:36:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.780+0000 7f4ae8ad5700 1 -- 172.21.15.6:0/3983420936 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2338962681 0 0) 0x7f4ad00057c0 con 0x7f4ae40c6170 2023-07-21T07:36:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.780+0000 7f4aea2d8700 1 -- 172.21.15.6:0/3983420936 >> v1:172.21.15.86:6789/0 conn(0x7f4ae40c3750 legacy=0x7f4ae414e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.780+0000 7f4aea2d8700 1 -- 172.21.15.6:0/3983420936 >> v1:172.21.15.6:6789/0 conn(0x7f4ae40c6170 legacy=0x7f4ae4154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.780+0000 7f4aea2d8700 1 -- 172.21.15.6:0/3983420936 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae40c18b0 con 0x7f4ae414ed60 2023-07-21T07:36:07.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.780+0000 7f4aea2d8700 1 --2- 172.21.15.6:0/3983420936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae414ed60 0x7f4ae40c53e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009d90 tx=0x7f4adc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c15b57b9a27036f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:07.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.780+0000 7f4ae8ad5700 1 -- 172.21.15.6:0/3983420936 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00e070 con 0x7f4ae414ed60 2023-07-21T07:36:07.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.780+0000 7f4ae8ad5700 1 -- 172.21.15.6:0/3983420936 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc003a20 con 0x7f4ae414ed60 2023-07-21T07:36:07.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.780+0000 7f4ae8ad5700 1 -- 172.21.15.6:0/3983420936 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0001670 con 0x7f4ae414ed60 2023-07-21T07:36:07.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.780+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3983420936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae414ed60 msgr2=0x7f4ae40c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.780+0000 7f4aebd3b700 1 --2- 172.21.15.6:0/3983420936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae414ed60 0x7f4ae40c53e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009d90 tx=0x7f4adc00b330 comp rx=0 tx=0).stop 2023-07-21T07:36:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.781+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3983420936 shutdown_connections 2023-07-21T07:36:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.781+0000 7f4aebd3b700 1 --2- 172.21.15.6:0/3983420936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae414ed60 0x7f4ae40c53e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.781+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3983420936 >> 172.21.15.6:0/3983420936 conn(0x7f4ae40a8c90 msgr2=0x7f4ae406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.781+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3983420936 shutdown_connections 2023-07-21T07:36:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.781+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3983420936 wait complete. 2023-07-21T07:36:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.782+0000 7f4aebd3b700 1 Processor -- start 2023-07-21T07:36:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.782+0000 7f4aebd3b700 1 -- start start 2023-07-21T07:36:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4aebd3b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ae40c3750 0x7f4ae41ed250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4aebd3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40c6170 0x7f4ae40a7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4aebd3b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae414ed60 0x7f4ae414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4aebd3b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41ed790 con 0x7f4ae40c6170 2023-07-21T07:36:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4aebd3b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41547e0 con 0x7f4ae414ed60 2023-07-21T07:36:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4aebd3b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae4153c60 con 0x7f4ae40c3750 2023-07-21T07:36:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ae92d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40c6170 0x7f4ae40a7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ae92d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40c6170 0x7f4ae40a7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35340/0 (socket says 172.21.15.6:35340) 2023-07-21T07:36:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ae92d6700 1 -- 172.21.15.6:0/3736360108 learned_addr learned my addr 172.21.15.6:0/3736360108 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ae9ad7700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ae40c3750 0x7f4ae41ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4aea2d8700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae414ed60 0x7f4ae414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ae92d6700 1 -- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ae40c3750 msgr2=0x7f4ae41ed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ae92d6700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ae40c3750 0x7f4ae41ed250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ae92d6700 1 -- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae414ed60 msgr2=0x7f4ae414a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ae92d6700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae414ed60 0x7f4ae414a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ae92d6700 1 -- 172.21.15.6:0/3736360108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc009a70 con 0x7f4ae40c6170 2023-07-21T07:36:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ae9ad7700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ae40c3750 0x7f4ae41ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ae92d6700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40c6170 0x7f4ae40a7570 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000c770 tx=0x7f4ae000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ada7fc700 1 -- 172.21.15.6:0/3736360108 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0007560 con 0x7f4ae40c6170 2023-07-21T07:36:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ada7fc700 1 -- 172.21.15.6:0/3736360108 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae00076c0 con 0x7f4ae40c6170 2023-07-21T07:36:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3736360108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae4153f40 con 0x7f4ae40c6170 2023-07-21T07:36:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4ada7fc700 1 -- 172.21.15.6:0/3736360108 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0004a90 con 0x7f4ae40c6170 2023-07-21T07:36:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.783+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3736360108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae4154500 con 0x7f4ae40c6170 2023-07-21T07:36:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.784+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3736360108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae40c3030 con 0x7f4ae40c6170 2023-07-21T07:36:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.785+0000 7f4ada7fc700 1 -- 172.21.15.6:0/3736360108 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ae0004bf0 con 0x7f4ae40c6170 2023-07-21T07:36:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.785+0000 7f4ada7fc700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4ac806ace0 0x7f4ac806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.785+0000 7f4ada7fc700 1 -- 172.21.15.6:0/3736360108 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f4ae0089690 con 0x7f4ae40c6170 2023-07-21T07:36:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.785+0000 7f4ae9ad7700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4ac806ace0 0x7f4ac806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.786+0000 7f4ae9ad7700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4ac806ace0 0x7f4ac806d1a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4000f60 tx=0x7f4ad4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.789+0000 7f4ada7fc700 1 -- 172.21.15.6:0/3736360108 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4ae00543f0 con 0x7f4ae40c6170 2023-07-21T07:36:08.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.992+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3736360108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ae4074500 con 0x7f4ae40c6170 2023-07-21T07:36:08.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.994+0000 7f4ada7fc700 1 -- 172.21.15.6:0/3736360108 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+21959 (secure 0 0 0) 0x7f4ae0057a10 con 0x7f4ae40c6170 2023-07-21T07:36:08.047 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:08.047 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:35:46.879421+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:35:29.385402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T07:35:29.920618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:35:43.052752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:35:44.270260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.996+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4ac806ace0 msgr2=0x7f4ac806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.996+0000 7f4aebd3b700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4ac806ace0 0x7f4ac806d1a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4000f60 tx=0x7f4ad4009040 comp rx=0 tx=0).stop 2023-07-21T07:36:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.996+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3736360108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40c6170 msgr2=0x7f4ae40a7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.996+0000 7f4aebd3b700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40c6170 0x7f4ae40a7570 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000c770 tx=0x7f4ae000cb30 comp rx=0 tx=0).stop 2023-07-21T07:36:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.996+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3736360108 shutdown_connections 2023-07-21T07:36:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.996+0000 7f4aebd3b700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4ac806ace0 0x7f4ac806d1a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.996+0000 7f4aebd3b700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae414ed60 0x7f4ae414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.996+0000 7f4aebd3b700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ae40c3750 0x7f4ae41ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.996+0000 7f4aebd3b700 1 --2- 172.21.15.6:0/3736360108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40c6170 0x7f4ae40a7570 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.996+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3736360108 >> 172.21.15.6:0/3736360108 conn(0x7f4ae40a8c90 msgr2=0x7f4ae40709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:08.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.996+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3736360108 shutdown_connections 2023-07-21T07:36:08.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:07.996+0000 7f4aebd3b700 1 -- 172.21.15.6:0/3736360108 wait complete. 2023-07-21T07:36:08.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T07:36:08.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.133+0000 7f0784644700 1 Processor -- start 2023-07-21T07:36:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.133+0000 7f0784644700 1 -- start start 2023-07-21T07:36:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.134+0000 7f0784644700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f077c155110 0x7f077c14e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:08.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.134+0000 7f0784644700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0c4b70 con 0x7f077c0c1330 2023-07-21T07:36:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.134+0000 7f0784644700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0c17d0 con 0x7f077c0c6c90 2023-07-21T07:36:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.134+0000 7f0784644700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c0c1ab0 con 0x7f077c155110 2023-07-21T07:36:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.134+0000 7f0782be1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f077c155110 0x7f077c14e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.134+0000 7f0781bdf700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f077c0c1330 0x7f077c151c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43366/0 (socket says 172.21.15.6:43366) 2023-07-21T07:36:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.134+0000 7f0781bdf700 1 -- 172.21.15.6:0/2582236227 learned_addr learned my addr 172.21.15.6:0/2582236227 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.134+0000 7f0782be1700 1 -- 172.21.15.6:0/2582236227 >> v1:172.21.15.86:6789/0 conn(0x7f077c0c6c90 legacy=0x7f077c0c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:08.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.134+0000 7f0782be1700 1 -- 172.21.15.6:0/2582236227 >> v1:172.21.15.6:6789/0 conn(0x7f077c0c1330 legacy=0x7f077c151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.134+0000 7f0782be1700 1 -- 172.21.15.6:0/2582236227 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c154910 con 0x7f077c155110 2023-07-21T07:36:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.134+0000 7f07813de700 1 -- 172.21.15.6:0/2582236227 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436863909 0 0) 0x7f077c0c4b70 con 0x7f077c0c1330 2023-07-21T07:36:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.135+0000 7f0782be1700 1 --2- 172.21.15.6:0/2582236227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077c155110 0x7f077c14e5c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0774009d90 tx=0x7f077400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3f44cfe08310f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.135+0000 7f07813de700 1 -- 172.21.15.6:0/2582236227 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400e070 con 0x7f077c155110 2023-07-21T07:36:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.135+0000 7f07813de700 1 -- 172.21.15.6:0/2582236227 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077400bbd0 con 0x7f077c155110 2023-07-21T07:36:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.135+0000 7f07813de700 1 -- 172.21.15.6:0/2582236227 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774003a20 con 0x7f077c155110 2023-07-21T07:36:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.135+0000 7f0784644700 1 -- 172.21.15.6:0/2582236227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077c155110 msgr2=0x7f077c14e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.135+0000 7f0784644700 1 --2- 172.21.15.6:0/2582236227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077c155110 0x7f077c14e5c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0774009d90 tx=0x7f077400b330 comp rx=0 tx=0).stop 2023-07-21T07:36:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.135+0000 7f0784644700 1 -- 172.21.15.6:0/2582236227 shutdown_connections 2023-07-21T07:36:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.135+0000 7f0784644700 1 --2- 172.21.15.6:0/2582236227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077c155110 0x7f077c14e5c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.135+0000 7f0784644700 1 -- 172.21.15.6:0/2582236227 >> 172.21.15.6:0/2582236227 conn(0x7f077c06b1a0 msgr2=0x7f077c06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.135+0000 7f0784644700 1 -- 172.21.15.6:0/2582236227 shutdown_connections 2023-07-21T07:36:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.135+0000 7f0784644700 1 -- 172.21.15.6:0/2582236227 wait complete. 2023-07-21T07:36:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.137+0000 7f0784644700 1 Processor -- start 2023-07-21T07:36:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.137+0000 7f0784644700 1 -- start start 2023-07-21T07:36:08.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.137+0000 7f0784644700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f077c0c1330 0x7f077c0a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:08.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.137+0000 7f0784644700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077c0c6c90 0x7f077c1ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:08.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.137+0000 7f0784644700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f077c155110 0x7f077c1ea630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:08.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.137+0000 7f0784644700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0aa080 con 0x7f077c0c6c90 2023-07-21T07:36:08.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.137+0000 7f0784644700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0aa270 con 0x7f077c155110 2023-07-21T07:36:08.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.137+0000 7f0784644700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0a9bf0 con 0x7f077c0c1330 2023-07-21T07:36:08.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.137+0000 7f0781bdf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077c0c6c90 0x7f077c1ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:08.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.137+0000 7f0781bdf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077c0c6c90 0x7f077c1ea0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35354/0 (socket says 172.21.15.6:35354) 2023-07-21T07:36:08.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.137+0000 7f0781bdf700 1 -- 172.21.15.6:0/1567595935 learned_addr learned my addr 172.21.15.6:0/1567595935 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:08.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f0782be1700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f077c155110 0x7f077c1ea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:08.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f0781bdf700 1 -- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f077c0c1330 msgr2=0x7f077c0a8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:08.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f07823e0700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f077c0c1330 0x7f077c0a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:08.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f0781bdf700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f077c0c1330 0x7f077c0a8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f0781bdf700 1 -- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f077c155110 msgr2=0x7f077c1ea630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:08.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f0781bdf700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f077c155110 0x7f077c1ea630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f0781bdf700 1 -- 172.21.15.6:0/1567595935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0774009a70 con 0x7f077c0c6c90 2023-07-21T07:36:08.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f0782be1700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f077c155110 0x7f077c1ea630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f0781bdf700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077c0c6c90 0x7f077c1ea0f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f077800e960 tx=0x7f077800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f076effd700 1 -- 172.21.15.6:0/1567595935 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077800ee40 con 0x7f077c0c6c90 2023-07-21T07:36:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f076effd700 1 -- 172.21.15.6:0/1567595935 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0778004a80 con 0x7f077c0c6c90 2023-07-21T07:36:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f0784644700 1 -- 172.21.15.6:0/1567595935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c1dcca0 con 0x7f077c0c6c90 2023-07-21T07:36:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f076effd700 1 -- 172.21.15.6:0/1567595935 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778004e30 con 0x7f077c0c6c90 2023-07-21T07:36:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.138+0000 7f0784644700 1 -- 172.21.15.6:0/1567595935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c154300 con 0x7f077c0c6c90 2023-07-21T07:36:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.139+0000 7f0784644700 1 -- 172.21.15.6:0/1567595935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c04ecc0 con 0x7f077c0c6c90 2023-07-21T07:36:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.140+0000 7f076effd700 1 -- 172.21.15.6:0/1567595935 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f07780070d0 con 0x7f077c0c6c90 2023-07-21T07:36:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.140+0000 7f076effd700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f076006ace0 0x7f076006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.140+0000 7f076effd700 1 -- 172.21.15.6:0/1567595935 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f077808bde0 con 0x7f077c0c6c90 2023-07-21T07:36:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.140+0000 7f07823e0700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f076006ace0 0x7f076006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.141+0000 7f07823e0700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f076006ace0 0x7f076006d1a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f077c0ab8b0 tx=0x7f0770009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:08.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.144+0000 7f076effd700 1 -- 172.21.15.6:0/1567595935 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0778056bc0 con 0x7f077c0c6c90 2023-07-21T07:36:08.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.387+0000 7f0784644700 1 -- 172.21.15.6:0/1567595935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f077c0a9d30 con 0x7f077c0c6c90 2023-07-21T07:36:08.441 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T07:36:08.388+0000 7f4b07aab700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T07:36:08.446 INFO:tasks.ceph.mds.c.smithi006.stderr: -3946> 2023-07-21T07:35:35.515+0000 7f32dbf33700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T07:36:08.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.399+0000 7f076effd700 1 -- 172.21.15.6:0/1567595935 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0778015020 con 0x7f077c0c6c90 2023-07-21T07:36:08.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.401+0000 7f0784644700 1 -- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f076006ace0 msgr2=0x7f076006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:08.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.401+0000 7f0784644700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f076006ace0 0x7f076006d1a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f077c0ab8b0 tx=0x7f0770009040 comp rx=0 tx=0).stop 2023-07-21T07:36:08.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.401+0000 7f0784644700 1 -- 172.21.15.6:0/1567595935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077c0c6c90 msgr2=0x7f077c1ea0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:08.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.401+0000 7f0784644700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077c0c6c90 0x7f077c1ea0f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f077800e960 tx=0x7f077800ed20 comp rx=0 tx=0).stop 2023-07-21T07:36:08.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.401+0000 7f0784644700 1 -- 172.21.15.6:0/1567595935 shutdown_connections 2023-07-21T07:36:08.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.401+0000 7f0784644700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f076006ace0 0x7f076006d1a0 secure :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f077c0ab8b0 tx=0x7f0770009040 comp rx=0 tx=0).stop 2023-07-21T07:36:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.401+0000 7f0784644700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f077c155110 0x7f077c1ea630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.401+0000 7f0784644700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f077c0c1330 0x7f077c0a8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.401+0000 7f0784644700 1 --2- 172.21.15.6:0/1567595935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077c0c6c90 0x7f077c1ea0f0 secure :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f077800e960 tx=0x7f077800ed20 comp rx=0 tx=0).stop 2023-07-21T07:36:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.401+0000 7f0784644700 1 -- 172.21.15.6:0/1567595935 >> 172.21.15.6:0/1567595935 conn(0x7f077c06b1a0 msgr2=0x7f077c14e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.402+0000 7f0784644700 1 -- 172.21.15.6:0/1567595935 shutdown_connections 2023-07-21T07:36:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.402+0000 7f0784644700 1 -- 172.21.15.6:0/1567595935 wait complete. 2023-07-21T07:36:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T07:36:08.468 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T07:36:08.478 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T07:36:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.544+0000 7f76345c0700 1 Processor -- start 2023-07-21T07:36:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.544+0000 7f76345c0700 1 -- start start 2023-07-21T07:36:08.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f76345c0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f762c151d80 0x7f762c0c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f76345c0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f762c0bd360 0x7f762c06b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f76345c0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762c154dc0 con 0x7f762c0c7bd0 2023-07-21T07:36:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f76345c0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c06ad50 con 0x7f762c151d80 2023-07-21T07:36:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f76345c0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c1552f0 con 0x7f762c0bd360 2023-07-21T07:36:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f763235c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f762c151d80 0x7f762c0c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:08.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f763235c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f762c151d80 0x7f762c0c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35372/0 (socket says 172.21.15.6:35372) 2023-07-21T07:36:08.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f763235c700 1 -- 172.21.15.6:0/1393641751 learned_addr learned my addr 172.21.15.6:0/1393641751 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:08.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f7632b5d700 1 --2- 172.21.15.6:0/1393641751 >> v2:172.21.15.86:3300/0 conn(0x7f762c0bd360 0x7f762c06b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:08.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f763235c700 1 -- 172.21.15.6:0/1393641751 >> v2:172.21.15.86:3300/0 conn(0x7f762c0bd360 msgr2=0x7f762c06b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:08.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f763235c700 1 --2- 172.21.15.6:0/1393641751 >> v2:172.21.15.86:3300/0 conn(0x7f762c0bd360 0x7f762c06b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f763235c700 1 -- 172.21.15.6:0/1393641751 >> v1:172.21.15.86:6789/0 conn(0x7f762c0c7bd0 legacy=0x7f762c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:08.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f763235c700 1 -- 172.21.15.6:0/1393641751 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c155010 con 0x7f762c151d80 2023-07-21T07:36:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f763235c700 1 --2- 172.21.15.6:0/1393641751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762c151d80 0x7f762c0c4650 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f762c08be30 tx=0x7f7628009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6084288d87ad69 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f763135a700 1 -- 172.21.15.6:0/1393641751 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628004230 con 0x7f762c151d80 2023-07-21T07:36:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f763135a700 1 -- 172.21.15.6:0/1393641751 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7628004390 con 0x7f762c151d80 2023-07-21T07:36:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.545+0000 7f763135a700 1 -- 172.21.15.6:0/1393641751 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280036a0 con 0x7f762c151d80 2023-07-21T07:36:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.546+0000 7f76345c0700 1 -- 172.21.15.6:0/1393641751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762c151d80 msgr2=0x7f762c0c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.546+0000 7f76345c0700 1 --2- 172.21.15.6:0/1393641751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762c151d80 0x7f762c0c4650 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f762c08be30 tx=0x7f7628009bd0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.546+0000 7f76345c0700 1 -- 172.21.15.6:0/1393641751 shutdown_connections 2023-07-21T07:36:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.546+0000 7f76345c0700 1 --2- 172.21.15.6:0/1393641751 >> v2:172.21.15.86:3300/0 conn(0x7f762c0bd360 0x7f762c06b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.546+0000 7f76345c0700 1 --2- 172.21.15.6:0/1393641751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762c151d80 0x7f762c0c4650 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.546+0000 7f76345c0700 1 -- 172.21.15.6:0/1393641751 >> 172.21.15.6:0/1393641751 conn(0x7f762c0c9cd0 msgr2=0x7f762c0ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.546+0000 7f76345c0700 1 -- 172.21.15.6:0/1393641751 shutdown_connections 2023-07-21T07:36:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.546+0000 7f76345c0700 1 -- 172.21.15.6:0/1393641751 wait complete. 2023-07-21T07:36:08.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.548+0000 7f76345c0700 1 Processor -- start 2023-07-21T07:36:08.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.548+0000 7f76345c0700 1 -- start start 2023-07-21T07:36:08.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f76345c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762c0bd360 0x7f762c1ed3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:08.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f76345c0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f762c0c7bd0 0x7f762c1ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:08.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f76345c0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f762c151d80 0x7f762c0be3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:08.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f76345c0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0c02f0 con 0x7f762c0bd360 2023-07-21T07:36:08.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f76345c0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0c0820 con 0x7f762c151d80 2023-07-21T07:36:08.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f76345c0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0c0540 con 0x7f762c0c7bd0 2023-07-21T07:36:08.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f763235c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762c0bd360 0x7f762c1ed3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:08.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f763235c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762c0bd360 0x7f762c1ed3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35376/0 (socket says 172.21.15.6:35376) 2023-07-21T07:36:08.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f763235c700 1 -- 172.21.15.6:0/1669871745 learned_addr learned my addr 172.21.15.6:0/1669871745 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:08.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f7632b5d700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f762c151d80 0x7f762c0be3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:08.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f7631b5b700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f762c0c7bd0 0x7f762c1ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:08.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f763235c700 1 -- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f762c0c7bd0 msgr2=0x7f762c1ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:08.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f763235c700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f762c0c7bd0 0x7f762c1ed8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f763235c700 1 -- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f762c151d80 msgr2=0x7f762c0be3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:08.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f763235c700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f762c151d80 0x7f762c0be3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:08.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f763235c700 1 -- 172.21.15.6:0/1669871745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7628009550 con 0x7f762c0bd360 2023-07-21T07:36:08.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f763235c700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762c0bd360 0x7f762c1ed3a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7628009840 tx=0x7f7628004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:08.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f7622ffd700 1 -- 172.21.15.6:0/1669871745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628003d40 con 0x7f762c0bd360 2023-07-21T07:36:08.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f7622ffd700 1 -- 172.21.15.6:0/1669871745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762801f070 con 0x7f762c0bd360 2023-07-21T07:36:08.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f7622ffd700 1 -- 172.21.15.6:0/1669871745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628003ea0 con 0x7f762c0bd360 2023-07-21T07:36:08.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f76345c0700 1 -- 172.21.15.6:0/1669871745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c1556e0 con 0x7f762c0bd360 2023-07-21T07:36:08.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.549+0000 7f76345c0700 1 -- 172.21.15.6:0/1669871745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762c0bf5f0 con 0x7f762c0bd360 2023-07-21T07:36:08.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.550+0000 7f76345c0700 1 -- 172.21.15.6:0/1669871745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762c0bf780 con 0x7f762c0bd360 2023-07-21T07:36:08.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.551+0000 7f7622ffd700 1 -- 172.21.15.6:0/1669871745 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7628021030 con 0x7f762c0bd360 2023-07-21T07:36:08.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.551+0000 7f7622ffd700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f761006ace0 0x7f761006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:08.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.551+0000 7f7622ffd700 1 -- 172.21.15.6:0/1669871745 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f762808ae30 con 0x7f762c0bd360 2023-07-21T07:36:08.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.551+0000 7f7631b5b700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f761006ace0 0x7f761006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:08.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.552+0000 7f7631b5b700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f761006ace0 0x7f761006d1a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f762c1541a0 tx=0x7f761c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:08.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.556+0000 7f7622ffd700 1 -- 172.21.15.6:0/1669871745 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7628055ce0 con 0x7f762c0bd360 2023-07-21T07:36:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:08.809+0000 7f76345c0700 1 -- 172.21.15.6:0/1669871745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f762c0bf780 con 0x7f762c0bd360 2023-07-21T07:36:09.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:36:09.155 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:36:09.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.400+0000 7f7622ffd700 1 -- 172.21.15.6:0/1669871745 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7628059300 con 0x7f762c0bd360 2023-07-21T07:36:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.402+0000 7f76345c0700 1 -- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f761006ace0 msgr2=0x7f761006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.402+0000 7f76345c0700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f761006ace0 0x7f761006d1a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f762c1541a0 tx=0x7f761c008040 comp rx=0 tx=0).stop 2023-07-21T07:36:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.402+0000 7f76345c0700 1 -- 172.21.15.6:0/1669871745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762c0bd360 msgr2=0x7f762c1ed3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.402+0000 7f76345c0700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762c0bd360 0x7f762c1ed3a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7628009840 tx=0x7f7628004750 comp rx=0 tx=0).stop 2023-07-21T07:36:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.402+0000 7f76345c0700 1 -- 172.21.15.6:0/1669871745 shutdown_connections 2023-07-21T07:36:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.402+0000 7f76345c0700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f761006ace0 0x7f761006d1a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.402+0000 7f76345c0700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f762c151d80 0x7f762c0be3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.402+0000 7f76345c0700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762c0bd360 0x7f762c1ed3a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.402+0000 7f76345c0700 1 --2- 172.21.15.6:0/1669871745 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f762c0c7bd0 0x7f762c1ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.402+0000 7f76345c0700 1 -- 172.21.15.6:0/1669871745 >> 172.21.15.6:0/1669871745 conn(0x7f762c0c9cd0 msgr2=0x7f762c0a9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.403+0000 7f76345c0700 1 -- 172.21.15.6:0/1669871745 shutdown_connections 2023-07-21T07:36:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.403+0000 7f76345c0700 1 -- 172.21.15.6:0/1669871745 wait complete. 2023-07-21T07:36:09.470 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T07:36:09.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.548+0000 7f304ba1b700 1 Processor -- start 2023-07-21T07:36:09.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.549+0000 7f304ba1b700 1 -- start start 2023-07-21T07:36:09.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.549+0000 7f304ba1b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3044157420 0x7f3044157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:09.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.549+0000 7f304ba1b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30440c6360 0x7f304406a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:09.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.549+0000 7f304ba1b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f304406a5d0 0x7f30440c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:09.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.549+0000 7f304ba1b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3044157800 con 0x7f30440c6360 2023-07-21T07:36:09.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.549+0000 7f304ba1b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30441583b0 con 0x7f304406a5d0 2023-07-21T07:36:09.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.549+0000 7f304ba1b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3044158690 con 0x7f3044157420 2023-07-21T07:36:09.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f3048fb6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30440c6360 0x7f304406a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:09.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f3048fb6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30440c6360 0x7f304406a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35388/0 (socket says 172.21.15.6:35388) 2023-07-21T07:36:09.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f3048fb6700 1 -- 172.21.15.6:0/3971827343 learned_addr learned my addr 172.21.15.6:0/3971827343 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:09.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f30497b7700 1 --2- 172.21.15.6:0/3971827343 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3044157420 0x7f3044157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:09.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f3049fb8700 1 --2- 172.21.15.6:0/3971827343 >> v2:172.21.15.86:3300/0 conn(0x7f304406a5d0 0x7f30440c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:09.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f3048fb6700 1 -- 172.21.15.6:0/3971827343 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3044157420 msgr2=0x7f3044157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:09.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f3048fb6700 1 --2- 172.21.15.6:0/3971827343 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3044157420 0x7f3044157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:09.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f3048fb6700 1 -- 172.21.15.6:0/3971827343 >> v2:172.21.15.86:3300/0 conn(0x7f304406a5d0 msgr2=0x7f30440c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:09.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f3048fb6700 1 --2- 172.21.15.6:0/3971827343 >> v2:172.21.15.86:3300/0 conn(0x7f304406a5d0 0x7f30440c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:09.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f3048fb6700 1 -- 172.21.15.6:0/3971827343 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30440c4c10 con 0x7f30440c6360 2023-07-21T07:36:09.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f3048fb6700 1 --2- 172.21.15.6:0/3971827343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30440c6360 0x7f304406a090 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f30440686c0 tx=0x7f3040009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc340e75aa75b06a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:09.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f303bfff700 1 -- 172.21.15.6:0/3971827343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040011830 con 0x7f30440c6360 2023-07-21T07:36:09.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f303bfff700 1 -- 172.21.15.6:0/3971827343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3040011990 con 0x7f30440c6360 2023-07-21T07:36:09.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.550+0000 7f303bfff700 1 -- 172.21.15.6:0/3971827343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040011d20 con 0x7f30440c6360 2023-07-21T07:36:09.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.551+0000 7f304ba1b700 1 -- 172.21.15.6:0/3971827343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30440c6360 msgr2=0x7f304406a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:09.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.551+0000 7f304ba1b700 1 --2- 172.21.15.6:0/3971827343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30440c6360 0x7f304406a090 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f30440686c0 tx=0x7f3040009bd0 comp rx=0 tx=0).stop 2023-07-21T07:36:09.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.551+0000 7f304ba1b700 1 -- 172.21.15.6:0/3971827343 shutdown_connections 2023-07-21T07:36:09.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.551+0000 7f304ba1b700 1 --2- 172.21.15.6:0/3971827343 >> v2:172.21.15.86:3300/0 conn(0x7f304406a5d0 0x7f30440c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:09.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.551+0000 7f304ba1b700 1 --2- 172.21.15.6:0/3971827343 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3044157420 0x7f3044157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:09.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.551+0000 7f304ba1b700 1 --2- 172.21.15.6:0/3971827343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30440c6360 0x7f304406a090 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:09.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.551+0000 7f304ba1b700 1 -- 172.21.15.6:0/3971827343 >> 172.21.15.6:0/3971827343 conn(0x7f30440c36f0 msgr2=0x7f30440c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:09.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.551+0000 7f304ba1b700 1 -- 172.21.15.6:0/3971827343 shutdown_connections 2023-07-21T07:36:09.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.551+0000 7f304ba1b700 1 -- 172.21.15.6:0/3971827343 wait complete. 2023-07-21T07:36:09.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.552+0000 7f304ba1b700 1 Processor -- start 2023-07-21T07:36:09.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.552+0000 7f304ba1b700 1 -- start start 2023-07-21T07:36:09.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f304ba1b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f304406a5d0 0x7f30441ea010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:09.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f304ba1b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30440c6360 0x7f30440ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:09.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f304ba1b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044157420 0x7f304414fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:09.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f304ba1b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30440ac9c0 con 0x7f3044157420 2023-07-21T07:36:09.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f304ba1b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30440abe40 con 0x7f304406a5d0 2023-07-21T07:36:09.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f304ba1b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30440ac120 con 0x7f30440c6360 2023-07-21T07:36:09.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f3049fb8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044157420 0x7f304414fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:09.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f3049fb8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044157420 0x7f304414fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35396/0 (socket says 172.21.15.6:35396) 2023-07-21T07:36:09.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f3049fb8700 1 -- 172.21.15.6:0/2026670062 learned_addr learned my addr 172.21.15.6:0/2026670062 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f3048fb6700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30440c6360 0x7f30440ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f30497b7700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f304406a5d0 0x7f30441ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f3049fb8700 1 -- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30440c6360 msgr2=0x7f30440ab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f3049fb8700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30440c6360 0x7f30440ab7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f3049fb8700 1 -- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f304406a5d0 msgr2=0x7f30441ea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f3049fb8700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f304406a5d0 0x7f30441ea010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f3049fb8700 1 -- 172.21.15.6:0/2026670062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3040009550 con 0x7f3044157420 2023-07-21T07:36:09.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.553+0000 7f3049fb8700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044157420 0x7f304414fa50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f303c00eed0 tx=0x7f303c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:09.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.554+0000 7f3039ffb700 1 -- 172.21.15.6:0/2026670062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c010040 con 0x7f3044157420 2023-07-21T07:36:09.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.554+0000 7f3039ffb700 1 -- 172.21.15.6:0/2026670062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c00b9f0 con 0x7f3044157420 2023-07-21T07:36:09.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.554+0000 7f304ba1b700 1 -- 172.21.15.6:0/2026670062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30440ac400 con 0x7f3044157420 2023-07-21T07:36:09.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.554+0000 7f3039ffb700 1 -- 172.21.15.6:0/2026670062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c00bda0 con 0x7f3044157420 2023-07-21T07:36:09.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.554+0000 7f304ba1b700 1 -- 172.21.15.6:0/2026670062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30440b9fe0 con 0x7f3044157420 2023-07-21T07:36:09.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.555+0000 7f304ba1b700 1 -- 172.21.15.6:0/2026670062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30440a9bd0 con 0x7f3044157420 2023-07-21T07:36:09.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.555+0000 7f3039ffb700 1 -- 172.21.15.6:0/2026670062 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f303c014400 con 0x7f3044157420 2023-07-21T07:36:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.556+0000 7f3039ffb700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f302806ace0 0x7f302806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.556+0000 7f3039ffb700 1 -- 172.21.15.6:0/2026670062 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f303c089a80 con 0x7f3044157420 2023-07-21T07:36:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.556+0000 7f30497b7700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f302806ace0 0x7f302806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.556+0000 7f30497b7700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f302806ace0 0x7f302806d1a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3034009be0 tx=0x7f3034009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.560+0000 7f3039ffb700 1 -- 172.21.15.6:0/2026670062 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f30440a9bd0 con 0x7f3044157420 2023-07-21T07:36:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:09.757+0000 7f304ba1b700 1 -- 172.21.15.6:0/2026670062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f30440a9bd0 con 0x7f3044157420 2023-07-21T07:36:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.401+0000 7f3039ffb700 1 -- 172.21.15.6:0/2026670062 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7f30440a9bd0 con 0x7f3044157420 2023-07-21T07:36:10.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.405+0000 7f304ba1b700 1 -- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f302806ace0 msgr2=0x7f302806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.405+0000 7f304ba1b700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f302806ace0 0x7f302806d1a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3034009be0 tx=0x7f3034009210 comp rx=0 tx=0).stop 2023-07-21T07:36:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.405+0000 7f304ba1b700 1 -- 172.21.15.6:0/2026670062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044157420 msgr2=0x7f304414fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.405+0000 7f304ba1b700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044157420 0x7f304414fa50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f303c00eed0 tx=0x7f303c00ef00 comp rx=0 tx=0).stop 2023-07-21T07:36:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.405+0000 7f304ba1b700 1 -- 172.21.15.6:0/2026670062 shutdown_connections 2023-07-21T07:36:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.405+0000 7f304ba1b700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f302806ace0 0x7f302806d1a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.405+0000 7f304ba1b700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3044157420 0x7f304414fa50 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.405+0000 7f304ba1b700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f304406a5d0 0x7f30441ea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.405+0000 7f304ba1b700 1 --2- 172.21.15.6:0/2026670062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30440c6360 0x7f30440ab7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.405+0000 7f304ba1b700 1 -- 172.21.15.6:0/2026670062 >> 172.21.15.6:0/2026670062 conn(0x7f30440c36f0 msgr2=0x7f304406caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.405+0000 7f304ba1b700 1 -- 172.21.15.6:0/2026670062 shutdown_connections 2023-07-21T07:36:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.405+0000 7f304ba1b700 1 -- 172.21.15.6:0/2026670062 wait complete. 2023-07-21T07:36:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-21T07:36:10.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T07:36:10.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.554+0000 7fbbbf942700 1 Processor -- start 2023-07-21T07:36:10.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.555+0000 7fbbbf942700 1 -- start start 2023-07-21T07:36:10.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.555+0000 7fbbbf942700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb80c5300 0x7fbbb8151d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.555+0000 7fbbbf942700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbbb80c13c0 0x7fbbb80c3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.555+0000 7fbbbf942700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb80c1850 con 0x7fbbb814e930 2023-07-21T07:36:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.555+0000 7fbbbf942700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb81518f0 con 0x7fbbb80c13c0 2023-07-21T07:36:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.555+0000 7fbbbf942700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb806d7d0 con 0x7fbbb80c5300 2023-07-21T07:36:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.556+0000 7fbbbdedf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbbb80c13c0 0x7fbbb80c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.556+0000 7fbbbd6de700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbbb814e930 0x7fbbb806d0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43420/0 (socket says 172.21.15.6:43420) 2023-07-21T07:36:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.556+0000 7fbbbd6de700 1 -- 172.21.15.6:0/843730046 learned_addr learned my addr 172.21.15.6:0/843730046 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.556+0000 7fbbbcedd700 1 --2- 172.21.15.6:0/843730046 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb80c5300 0x7fbbb8151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.556+0000 7fbbbdedf700 1 -- 172.21.15.6:0/843730046 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb80c5300 msgr2=0x7fbbb8151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.556+0000 7fbbbdedf700 1 --2- 172.21.15.6:0/843730046 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb80c5300 0x7fbbb8151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.556+0000 7fbbbdedf700 1 -- 172.21.15.6:0/843730046 >> v1:172.21.15.6:6789/0 conn(0x7fbbb814e930 legacy=0x7fbbb806d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.556+0000 7fbbbdedf700 1 -- 172.21.15.6:0/843730046 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb80c1a80 con 0x7fbbb80c13c0 2023-07-21T07:36:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.556+0000 7fbbaffff700 1 -- 172.21.15.6:0/843730046 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495774738 0 0) 0x7fbbb80c1850 con 0x7fbbb814e930 2023-07-21T07:36:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.556+0000 7fbbbdedf700 1 --2- 172.21.15.6:0/843730046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb80c13c0 0x7fbbb80c3380 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009d90 tx=0x7fbbb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3723ee6c53652cb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.556+0000 7fbbaffff700 1 -- 172.21.15.6:0/843730046 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb000e070 con 0x7fbbb80c13c0 2023-07-21T07:36:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.556+0000 7fbbaffff700 1 -- 172.21.15.6:0/843730046 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb000bbd0 con 0x7fbbb80c13c0 2023-07-21T07:36:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.556+0000 7fbbaffff700 1 -- 172.21.15.6:0/843730046 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0012430 con 0x7fbbb80c13c0 2023-07-21T07:36:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.557+0000 7fbbbf942700 1 -- 172.21.15.6:0/843730046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb80c13c0 msgr2=0x7fbbb80c3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.557+0000 7fbbbf942700 1 --2- 172.21.15.6:0/843730046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb80c13c0 0x7fbbb80c3380 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009d90 tx=0x7fbbb000b330 comp rx=0 tx=0).stop 2023-07-21T07:36:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.557+0000 7fbbbf942700 1 -- 172.21.15.6:0/843730046 shutdown_connections 2023-07-21T07:36:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.557+0000 7fbbbf942700 1 --2- 172.21.15.6:0/843730046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb80c13c0 0x7fbbb80c3380 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.557+0000 7fbbbf942700 1 --2- 172.21.15.6:0/843730046 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb80c5300 0x7fbbb8151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.557+0000 7fbbbf942700 1 -- 172.21.15.6:0/843730046 >> 172.21.15.6:0/843730046 conn(0x7fbbb80a85f0 msgr2=0x7fbbb80a8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.557+0000 7fbbbf942700 1 -- 172.21.15.6:0/843730046 shutdown_connections 2023-07-21T07:36:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.557+0000 7fbbbf942700 1 -- 172.21.15.6:0/843730046 wait complete. 2023-07-21T07:36:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.558+0000 7fbbbf942700 1 Processor -- start 2023-07-21T07:36:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.558+0000 7fbbbf942700 1 -- start start 2023-07-21T07:36:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbf942700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb80c13c0 0x7fbbb8154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbf942700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb80c5300 0x7fbbb81551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbf942700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb814e930 0x7fbbb81eca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbf942700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80be270 con 0x7fbbb80c5300 2023-07-21T07:36:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbf942700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80c0a60 con 0x7fbbb80c13c0 2023-07-21T07:36:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbf942700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80c0780 con 0x7fbbb814e930 2023-07-21T07:36:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbcedd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb80c5300 0x7fbbb81551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbcedd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb80c5300 0x7fbbb81551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35410/0 (socket says 172.21.15.6:35410) 2023-07-21T07:36:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbcedd700 1 -- 172.21.15.6:0/1449520757 learned_addr learned my addr 172.21.15.6:0/1449520757 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbdedf700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb814e930 0x7fbbb81eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbd6de700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb80c13c0 0x7fbbb8154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbcedd700 1 -- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb814e930 msgr2=0x7fbbb81eca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbcedd700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb814e930 0x7fbbb81eca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbcedd700 1 -- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb80c13c0 msgr2=0x7fbbb8154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbcedd700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb80c13c0 0x7fbbb8154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbcedd700 1 -- 172.21.15.6:0/1449520757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb0009a70 con 0x7fbbb80c5300 2023-07-21T07:36:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbd6de700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb80c13c0 0x7fbbb8154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbdedf700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb814e930 0x7fbbb81eca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.559+0000 7fbbbcedd700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb80c5300 0x7fbbb81551e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400e810 tx=0x7fbbb400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.560+0000 7fbbadffb700 1 -- 172.21.15.6:0/1449520757 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4013610 con 0x7fbbb80c5300 2023-07-21T07:36:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.560+0000 7fbbadffb700 1 -- 172.21.15.6:0/1449520757 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb4013770 con 0x7fbbb80c5300 2023-07-21T07:36:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.560+0000 7fbbbf942700 1 -- 172.21.15.6:0/1449520757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb80bdbb0 con 0x7fbbb80c5300 2023-07-21T07:36:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.560+0000 7fbbadffb700 1 -- 172.21.15.6:0/1449520757 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4013b00 con 0x7fbbb80c5300 2023-07-21T07:36:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.560+0000 7fbbbf942700 1 -- 172.21.15.6:0/1449520757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb80c03a0 con 0x7fbbb80c5300 2023-07-21T07:36:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.561+0000 7fbbbf942700 1 -- 172.21.15.6:0/1449520757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb80c0530 con 0x7fbbb80c5300 2023-07-21T07:36:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.561+0000 7fbbadffb700 1 -- 172.21.15.6:0/1449520757 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbbb4013c60 con 0x7fbbb80c5300 2023-07-21T07:36:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.561+0000 7fbbadffb700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbb9c06ace0 0x7fbb9c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.562+0000 7fbbadffb700 1 -- 172.21.15.6:0/1449520757 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6566+0+0 (secure 0 0 0) 0x7fbbb40892d0 con 0x7fbbb80c5300 2023-07-21T07:36:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.562+0000 7fbbbd6de700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbb9c06ace0 0x7fbb9c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.562+0000 7fbbbd6de700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbb9c06ace0 0x7fbb9c06d1a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbba8000f60 tx=0x7fbba8007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.566+0000 7fbbadffb700 1 -- 172.21.15.6:0/1449520757 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbbb4057ca0 con 0x7fbbb80c5300 2023-07-21T07:36:10.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:10.762+0000 7fbbbf942700 1 -- 172.21.15.6:0/1449520757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbbb8074500 con 0x7fbbb80c5300 2023-07-21T07:36:11.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.410+0000 7fbbadffb700 1 -- 172.21.15.6:0/1449520757 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbbb4057830 con 0x7fbbb80c5300 2023-07-21T07:36:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.415+0000 7fbbbf942700 1 -- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbb9c06ace0 msgr2=0x7fbb9c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.415+0000 7fbbbf942700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbb9c06ace0 0x7fbb9c06d1a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbba8000f60 tx=0x7fbba8007d30 comp rx=0 tx=0).stop 2023-07-21T07:36:11.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.415+0000 7fbbbf942700 1 -- 172.21.15.6:0/1449520757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb80c5300 msgr2=0x7fbbb81551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:11.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.415+0000 7fbbbf942700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb80c5300 0x7fbbb81551e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400e810 tx=0x7fbbb400ebd0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.415+0000 7fbbbf942700 1 -- 172.21.15.6:0/1449520757 shutdown_connections 2023-07-21T07:36:11.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.415+0000 7fbbbf942700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbb9c06ace0 0x7fbb9c06d1a0 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbba8000f60 tx=0x7fbba8007d30 comp rx=0 tx=0).stop 2023-07-21T07:36:11.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.415+0000 7fbbbf942700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb814e930 0x7fbbb81eca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.415+0000 7fbbbf942700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb80c13c0 0x7fbbb8154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.415+0000 7fbbbf942700 1 --2- 172.21.15.6:0/1449520757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb80c5300 0x7fbbb81551e0 secure :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400e810 tx=0x7fbbb400ebd0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.415+0000 7fbbbf942700 1 -- 172.21.15.6:0/1449520757 >> 172.21.15.6:0/1449520757 conn(0x7fbbb80a85f0 msgr2=0x7fbbb814c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:11.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.417+0000 7fbbbf942700 1 -- 172.21.15.6:0/1449520757 shutdown_connections 2023-07-21T07:36:11.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.417+0000 7fbbbf942700 1 -- 172.21.15.6:0/1449520757 wait complete. 2023-07-21T07:36:11.473 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-21T07:36:11.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.565+0000 7fb4d77b4700 1 Processor -- start 2023-07-21T07:36:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.565+0000 7fb4d77b4700 1 -- start start 2023-07-21T07:36:11.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.566+0000 7fb4d77b4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4d006da20 0x7fb4d0151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:11.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.566+0000 7fb4d77b4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4d0151c50 0x7fb4d00c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:11.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.566+0000 7fb4d77b4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d00c2ab0 con 0x7fb4d006a300 2023-07-21T07:36:11.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.566+0000 7fb4d77b4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d006e000 con 0x7fb4d0151c50 2023-07-21T07:36:11.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.566+0000 7fb4d77b4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d006e2e0 con 0x7fb4d006da20 2023-07-21T07:36:11.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.566+0000 7fb4d5d51700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4d0151c50 0x7fb4d00c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:11.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.566+0000 7fb4d5550700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb4d006a300 0x7fb4d0155050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43434/0 (socket says 172.21.15.6:43434) 2023-07-21T07:36:11.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.566+0000 7fb4d5550700 1 -- 172.21.15.6:0/3380962457 learned_addr learned my addr 172.21.15.6:0/3380962457 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:11.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.566+0000 7fb4d4d4f700 1 --2- 172.21.15.6:0/3380962457 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4d006da20 0x7fb4d0151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:11.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.567+0000 7fb4d5d51700 1 -- 172.21.15.6:0/3380962457 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4d006da20 msgr2=0x7fb4d0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:11.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.567+0000 7fb4d5d51700 1 --2- 172.21.15.6:0/3380962457 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4d006da20 0x7fb4d0151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.567+0000 7fb4d5d51700 1 -- 172.21.15.6:0/3380962457 >> v1:172.21.15.6:6789/0 conn(0x7fb4d006a300 legacy=0x7fb4d0155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:11.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.567+0000 7fb4c7fff700 1 -- 172.21.15.6:0/3380962457 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3971565450 0 0) 0x7fb4d00c2ab0 con 0x7fb4d006a300 2023-07-21T07:36:11.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.567+0000 7fb4d5d51700 1 -- 172.21.15.6:0/3380962457 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d006e5c0 con 0x7fb4d0151c50 2023-07-21T07:36:11.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.567+0000 7fb4d5d51700 1 --2- 172.21.15.6:0/3380962457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d0151c50 0x7fb4d00c2f40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009d90 tx=0x7fb4c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3495f083f2155 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:11.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.567+0000 7fb4c7fff700 1 -- 172.21.15.6:0/3380962457 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c800e070 con 0x7fb4d0151c50 2023-07-21T07:36:11.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.567+0000 7fb4c7fff700 1 -- 172.21.15.6:0/3380962457 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c800bb20 con 0x7fb4d0151c50 2023-07-21T07:36:11.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.567+0000 7fb4c7fff700 1 -- 172.21.15.6:0/3380962457 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8012430 con 0x7fb4d0151c50 2023-07-21T07:36:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.568+0000 7fb4d77b4700 1 -- 172.21.15.6:0/3380962457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d0151c50 msgr2=0x7fb4d00c2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.568+0000 7fb4d77b4700 1 --2- 172.21.15.6:0/3380962457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d0151c50 0x7fb4d00c2f40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009d90 tx=0x7fb4c800b330 comp rx=0 tx=0).stop 2023-07-21T07:36:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.568+0000 7fb4d77b4700 1 -- 172.21.15.6:0/3380962457 shutdown_connections 2023-07-21T07:36:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.568+0000 7fb4d77b4700 1 --2- 172.21.15.6:0/3380962457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d0151c50 0x7fb4d00c2f40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.568+0000 7fb4d77b4700 1 --2- 172.21.15.6:0/3380962457 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4d006da20 0x7fb4d0151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.568+0000 7fb4d77b4700 1 -- 172.21.15.6:0/3380962457 >> 172.21.15.6:0/3380962457 conn(0x7fb4d00a8c90 msgr2=0x7fb4d006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.568+0000 7fb4d77b4700 1 -- 172.21.15.6:0/3380962457 shutdown_connections 2023-07-21T07:36:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.568+0000 7fb4d77b4700 1 -- 172.21.15.6:0/3380962457 wait complete. 2023-07-21T07:36:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.569+0000 7fb4d77b4700 1 Processor -- start 2023-07-21T07:36:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.569+0000 7fb4d77b4700 1 -- start start 2023-07-21T07:36:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d77b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d006a300 0x7fb4d00bde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d77b4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4d006da20 0x7fb4d00b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d77b4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4d0151c50 0x7fb4d00b9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:11.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d77b4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d014daa0 con 0x7fb4d006a300 2023-07-21T07:36:11.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d77b4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d014ce20 con 0x7fb4d006da20 2023-07-21T07:36:11.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d77b4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d014d100 con 0x7fb4d0151c50 2023-07-21T07:36:11.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d5d51700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4d0151c50 0x7fb4d00b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:11.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d5d51700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4d0151c50 0x7fb4d00b9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:32816/0 (socket says 172.21.15.6:32816) 2023-07-21T07:36:11.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d5d51700 1 -- 172.21.15.6:0/1253126100 learned_addr learned my addr 172.21.15.6:0/1253126100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:11.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d5550700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d006a300 0x7fb4d00bde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:11.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d4d4f700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4d006da20 0x7fb4d00b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:11.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d5d51700 1 -- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4d006da20 msgr2=0x7fb4d00b8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:11.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d5d51700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4d006da20 0x7fb4d00b8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d5d51700 1 -- 172.21.15.6:0/1253126100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d006a300 msgr2=0x7fb4d00bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:11.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d5d51700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d006a300 0x7fb4d00bde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d5d51700 1 -- 172.21.15.6:0/1253126100 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c8009a70 con 0x7fb4d0151c50 2023-07-21T07:36:11.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.570+0000 7fb4d5550700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d006a300 0x7fb4d00bde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:11.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.571+0000 7fb4d5d51700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4d0151c50 0x7fb4d00b9340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00c4650 tx=0x7fb4c8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:11.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.571+0000 7fb4c5ffb700 1 -- 172.21.15.6:0/1253126100 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8012430 con 0x7fb4d0151c50 2023-07-21T07:36:11.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.571+0000 7fb4c5ffb700 1 -- 172.21.15.6:0/1253126100 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c8020070 con 0x7fb4d0151c50 2023-07-21T07:36:11.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.571+0000 7fb4d77b4700 1 -- 172.21.15.6:0/1253126100 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d014d3e0 con 0x7fb4d0151c50 2023-07-21T07:36:11.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.571+0000 7fb4c5ffb700 1 -- 172.21.15.6:0/1253126100 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8004280 con 0x7fb4d0151c50 2023-07-21T07:36:11.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.571+0000 7fb4d77b4700 1 -- 172.21.15.6:0/1253126100 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d00be350 con 0x7fb4d0151c50 2023-07-21T07:36:11.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.572+0000 7fb4d77b4700 1 -- 172.21.15.6:0/1253126100 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d014dbe0 con 0x7fb4d0151c50 2023-07-21T07:36:11.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.573+0000 7fb4c5ffb700 1 -- 172.21.15.6:0/1253126100 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4c80043e0 con 0x7fb4d0151c50 2023-07-21T07:36:11.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.573+0000 7fb4c5ffb700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb4b406ace0 0x7fb4b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:11.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.573+0000 7fb4c5ffb700 1 -- 172.21.15.6:0/1253126100 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb4c8022070 con 0x7fb4d0151c50 2023-07-21T07:36:11.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.573+0000 7fb4d5550700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb4b406ace0 0x7fb4b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:11.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.574+0000 7fb4d5550700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb4b406ace0 0x7fb4b406d1a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc007fd0 tx=0x7fb4cc007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:11.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.578+0000 7fb4c5ffb700 1 -- 172.21.15.6:0/1253126100 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb4c80568b0 con 0x7fb4d0151c50 2023-07-21T07:36:11.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.778+0000 7fb4d77b4700 1 -- 172.21.15.6:0/1253126100 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4d0074500 con 0x7fb4d0151c50 2023-07-21T07:36:11.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.780+0000 7fb4c5ffb700 1 -- 172.21.15.6:0/1253126100 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18372 (secure 0 0 0) 0x7fb4c8059ed0 con 0x7fb4d0151c50 2023-07-21T07:36:11.833 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:11.834 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:36:11.401679+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:35:43.052752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:35:44.270260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/459917011":"2023-07-22T07:36:08.389211+0000","172.21.15.6:6832/459917011":"2023-07-22T07:36:08.389211+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:11.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.782+0000 7fb4d77b4700 1 -- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb4b406ace0 msgr2=0x7fb4b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:11.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.782+0000 7fb4d77b4700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb4b406ace0 0x7fb4b406d1a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc007fd0 tx=0x7fb4cc007de0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.782+0000 7fb4d77b4700 1 -- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4d0151c50 msgr2=0x7fb4d00b9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:11.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.782+0000 7fb4d77b4700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4d0151c50 0x7fb4d00b9340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00c4650 tx=0x7fb4c8004ad0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.782+0000 7fb4d77b4700 1 -- 172.21.15.6:0/1253126100 shutdown_connections 2023-07-21T07:36:11.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.782+0000 7fb4d77b4700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb4b406ace0 0x7fb4b406d1a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.782+0000 7fb4d77b4700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4d0151c50 0x7fb4d00b9340 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.782+0000 7fb4d77b4700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d006a300 0x7fb4d00bde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.782+0000 7fb4d77b4700 1 --2- 172.21.15.6:0/1253126100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4d006da20 0x7fb4d00b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.782+0000 7fb4d77b4700 1 -- 172.21.15.6:0/1253126100 >> 172.21.15.6:0/1253126100 conn(0x7fb4d00a8c90 msgr2=0x7fb4d0070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:11.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.782+0000 7fb4d77b4700 1 -- 172.21.15.6:0/1253126100 shutdown_connections 2023-07-21T07:36:11.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.782+0000 7fb4d77b4700 1 -- 172.21.15.6:0/1253126100 wait complete. 2023-07-21T07:36:11.849 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-21T07:35:43.052752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-21T07:35:44.270260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:36:11.850 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:36:11.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.926+0000 7fc5b2700700 1 Processor -- start 2023-07-21T07:36:11.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.927+0000 7fc5b2700700 1 -- start start 2023-07-21T07:36:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.927+0000 7fc5b2700700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5ac06b4c0 0x7fc5ac0c1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.927+0000 7fc5b2700700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5ac0c1a90 0x7fc5ac15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.927+0000 7fc5b2700700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ac06bfb0 con 0x7fc5ac0c0ac0 2023-07-21T07:36:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.927+0000 7fc5b2700700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac06c250 con 0x7fc5ac0c1a90 2023-07-21T07:36:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.927+0000 7fc5b2700700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac1517e0 con 0x7fc5ac06b4c0 2023-07-21T07:36:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.928+0000 7fc5abfff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5ac06b4c0 0x7fc5ac0c1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.928+0000 7fc5b0c9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5ac0c1a90 0x7fc5ac15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:11.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.928+0000 7fc5b0c9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5ac0c1a90 0x7fc5ac15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:57236/0 (socket says 172.21.15.6:57236) 2023-07-21T07:36:11.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.928+0000 7fc5b0c9d700 1 -- 172.21.15.6:0/1145449828 learned_addr learned my addr 172.21.15.6:0/1145449828 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:11.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.928+0000 7fc5abfff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5ac06b4c0 0x7fc5ac0c1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:32822/0 (socket says 172.21.15.6:32822) 2023-07-21T07:36:11.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.928+0000 7fc5abfff700 1 -- 172.21.15.6:0/1145449828 >> v2:172.21.15.86:3300/0 conn(0x7fc5ac0c1a90 msgr2=0x7fc5ac15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:11.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.928+0000 7fc5abfff700 1 --2- 172.21.15.6:0/1145449828 >> v2:172.21.15.86:3300/0 conn(0x7fc5ac0c1a90 0x7fc5ac15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.928+0000 7fc5abfff700 1 -- 172.21.15.6:0/1145449828 >> v1:172.21.15.86:6789/0 conn(0x7fc5ac0c0ac0 legacy=0x7fc5ac14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:11.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.928+0000 7fc5aaffd700 1 -- 172.21.15.6:0/1145449828 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967243719 0 0) 0x7fc5ac06bfb0 con 0x7fc5ac0c0ac0 2023-07-21T07:36:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.928+0000 7fc5abfff700 1 -- 172.21.15.6:0/1145449828 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac1514d0 con 0x7fc5ac06b4c0 2023-07-21T07:36:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.928+0000 7fc5b0c9d700 1 --2- 172.21.15.6:0/1145449828 >> v2:172.21.15.86:3300/0 conn(0x7fc5ac0c1a90 0x7fc5ac15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.928+0000 7fc5abfff700 1 --2- 172.21.15.6:0/1145449828 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5ac06b4c0 0x7fc5ac0c1550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc59400bae0 tx=0x7fc59400bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8306b34e4dedca0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.929+0000 7fc5aaffd700 1 -- 172.21.15.6:0/1145449828 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59400db60 con 0x7fc5ac06b4c0 2023-07-21T07:36:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.929+0000 7fc5aaffd700 1 -- 172.21.15.6:0/1145449828 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59400dcc0 con 0x7fc5ac06b4c0 2023-07-21T07:36:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.929+0000 7fc5aaffd700 1 -- 172.21.15.6:0/1145449828 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594017630 con 0x7fc5ac06b4c0 2023-07-21T07:36:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.929+0000 7fc5b2700700 1 -- 172.21.15.6:0/1145449828 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5ac06b4c0 msgr2=0x7fc5ac0c1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:11.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.929+0000 7fc5b2700700 1 --2- 172.21.15.6:0/1145449828 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5ac06b4c0 0x7fc5ac0c1550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc59400bae0 tx=0x7fc59400bdf0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.929+0000 7fc5b2700700 1 -- 172.21.15.6:0/1145449828 shutdown_connections 2023-07-21T07:36:11.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.929+0000 7fc5b2700700 1 --2- 172.21.15.6:0/1145449828 >> v2:172.21.15.86:3300/0 conn(0x7fc5ac0c1a90 0x7fc5ac15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.929+0000 7fc5b2700700 1 --2- 172.21.15.6:0/1145449828 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5ac06b4c0 0x7fc5ac0c1550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.929+0000 7fc5b2700700 1 -- 172.21.15.6:0/1145449828 >> 172.21.15.6:0/1145449828 conn(0x7fc5ac0a7750 msgr2=0x7fc5ac0a7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:11.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.929+0000 7fc5b2700700 1 -- 172.21.15.6:0/1145449828 shutdown_connections 2023-07-21T07:36:11.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.929+0000 7fc5b2700700 1 -- 172.21.15.6:0/1145449828 wait complete. 2023-07-21T07:36:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.930+0000 7fc5b2700700 1 Processor -- start 2023-07-21T07:36:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.930+0000 7fc5b2700700 1 -- start start 2023-07-21T07:36:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.931+0000 7fc5b2700700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5ac06b4c0 0x7fc5ac0a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.931+0000 7fc5b2700700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5ac0c0ac0 0x7fc5ac1eced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.931+0000 7fc5b2700700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ac0c1a90 0x7fc5ac1ed410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.931+0000 7fc5b2700700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0719d0 con 0x7fc5ac0c1a90 2023-07-21T07:36:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.931+0000 7fc5b2700700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac071f90 con 0x7fc5ac0c0ac0 2023-07-21T07:36:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.931+0000 7fc5b2700700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac1d6f30 con 0x7fc5ac06b4c0 2023-07-21T07:36:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.931+0000 7fc5b0c9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ac0c1a90 0x7fc5ac1ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.931+0000 7fc5b0c9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ac0c1a90 0x7fc5ac1ed410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35438/0 (socket says 172.21.15.6:35438) 2023-07-21T07:36:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.931+0000 7fc5b0c9d700 1 -- 172.21.15.6:0/1692500951 learned_addr learned my addr 172.21.15.6:0/1692500951 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.932+0000 7fc5abfff700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5ac06b4c0 0x7fc5ac0a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.932+0000 7fc5ab7fe700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5ac0c0ac0 0x7fc5ac1eced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.932+0000 7fc5b0c9d700 1 -- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5ac06b4c0 msgr2=0x7fc5ac0a9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.932+0000 7fc5b0c9d700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5ac06b4c0 0x7fc5ac0a9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.932+0000 7fc5b0c9d700 1 -- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5ac0c0ac0 msgr2=0x7fc5ac1eced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.932+0000 7fc5b0c9d700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5ac0c0ac0 0x7fc5ac1eced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.932+0000 7fc5b0c9d700 1 -- 172.21.15.6:0/1692500951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4009b30 con 0x7fc5ac0c1a90 2023-07-21T07:36:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.932+0000 7fc5b0c9d700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ac0c1a90 0x7fc5ac1ed410 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400efc0 tx=0x7fc5a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.932+0000 7fc5a8ff9700 1 -- 172.21.15.6:0/1692500951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4018070 con 0x7fc5ac0c1a90 2023-07-21T07:36:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.932+0000 7fc5a8ff9700 1 -- 172.21.15.6:0/1692500951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a400f040 con 0x7fc5ac0c1a90 2023-07-21T07:36:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.932+0000 7fc5b2700700 1 -- 172.21.15.6:0/1692500951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59400b740 con 0x7fc5ac0c1a90 2023-07-21T07:36:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.932+0000 7fc5a8ff9700 1 -- 172.21.15.6:0/1692500951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4003c90 con 0x7fc5ac0c1a90 2023-07-21T07:36:11.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.932+0000 7fc5b2700700 1 -- 172.21.15.6:0/1692500951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac0c0800 con 0x7fc5ac0c1a90 2023-07-21T07:36:11.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.933+0000 7fc5b2700700 1 -- 172.21.15.6:0/1692500951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac0c2ed0 con 0x7fc5ac0c1a90 2023-07-21T07:36:11.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.933+0000 7fc5a8ff9700 1 -- 172.21.15.6:0/1692500951 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc5a400c9f0 con 0x7fc5ac0c1a90 2023-07-21T07:36:11.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.934+0000 7fc5a8ff9700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc58c06ace0 0x7fc58c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:11.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.934+0000 7fc5a8ff9700 1 -- 172.21.15.6:0/1692500951 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fc5a40895b0 con 0x7fc5ac0c1a90 2023-07-21T07:36:11.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.934+0000 7fc5abfff700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc58c06ace0 0x7fc58c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:11.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.935+0000 7fc5abfff700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc58c06ace0 0x7fc58c06d1a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc594019040 tx=0x7fc594014000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:11.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:11.938+0000 7fc5a8ff9700 1 -- 172.21.15.6:0/1692500951 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc5a4058120 con 0x7fc5ac0c1a90 2023-07-21T07:36:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.134+0000 7fc5b2700700 1 -- 172.21.15.6:0/1692500951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5ac074500 con 0x7fc5ac0c1a90 2023-07-21T07:36:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.135+0000 7fc5a8ff9700 1 -- 172.21.15.6:0/1692500951 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5a4057cb0 con 0x7fc5ac0c1a90 2023-07-21T07:36:12.188 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:36:12.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.137+0000 7fc5b2700700 1 -- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc58c06ace0 msgr2=0x7fc58c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.137+0000 7fc5b2700700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc58c06ace0 0x7fc58c06d1a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc594019040 tx=0x7fc594014000 comp rx=0 tx=0).stop 2023-07-21T07:36:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.137+0000 7fc5b2700700 1 -- 172.21.15.6:0/1692500951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ac0c1a90 msgr2=0x7fc5ac1ed410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.137+0000 7fc5b2700700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ac0c1a90 0x7fc5ac1ed410 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400efc0 tx=0x7fc5a400c3a0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.137+0000 7fc5b2700700 1 -- 172.21.15.6:0/1692500951 shutdown_connections 2023-07-21T07:36:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.137+0000 7fc5b2700700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc58c06ace0 0x7fc58c06d1a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.137+0000 7fc5b2700700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ac0c1a90 0x7fc5ac1ed410 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.137+0000 7fc5b2700700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5ac06b4c0 0x7fc5ac0a9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.137+0000 7fc5b2700700 1 --2- 172.21.15.6:0/1692500951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5ac0c0ac0 0x7fc5ac1eced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.137+0000 7fc5b2700700 1 -- 172.21.15.6:0/1692500951 >> 172.21.15.6:0/1692500951 conn(0x7fc5ac0a7750 msgr2=0x7fc5ac14f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:12.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.137+0000 7fc5b2700700 1 -- 172.21.15.6:0/1692500951 shutdown_connections 2023-07-21T07:36:12.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.137+0000 7fc5b2700700 1 -- 172.21.15.6:0/1692500951 wait complete. 2023-07-21T07:36:12.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:36:12.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.276+0000 7fc938623700 1 Processor -- start 2023-07-21T07:36:12.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.276+0000 7fc938623700 1 -- start start 2023-07-21T07:36:12.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc938623700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc93014c580 0x7fc9300abd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc938623700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9300aafe0 0x7fc93015cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc938623700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9300ac280 con 0x7fc9300c2260 2023-07-21T07:36:12.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc938623700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc930066580 con 0x7fc9300aafe0 2023-07-21T07:36:12.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc938623700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc930152f50 con 0x7fc93014c580 2023-07-21T07:36:12.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc936bc0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9300aafe0 0x7fc93015cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc936bc0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9300aafe0 0x7fc93015cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35444/0 (socket says 172.21.15.6:35444) 2023-07-21T07:36:12.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc936bc0700 1 -- 172.21.15.6:0/2535742744 learned_addr learned my addr 172.21.15.6:0/2535742744 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:12.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc9363bf700 1 --2- 172.21.15.6:0/2535742744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc93014c580 0x7fc9300abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc936bc0700 1 -- 172.21.15.6:0/2535742744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc93014c580 msgr2=0x7fc9300abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:12.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc936bc0700 1 --2- 172.21.15.6:0/2535742744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc93014c580 0x7fc9300abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc936bc0700 1 -- 172.21.15.6:0/2535742744 >> v1:172.21.15.86:6789/0 conn(0x7fc9300c2260 legacy=0x7fc9300aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc936bc0700 1 -- 172.21.15.6:0/2535742744 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc930066050 con 0x7fc9300aafe0 2023-07-21T07:36:12.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.277+0000 7fc9363bf700 1 --2- 172.21.15.6:0/2535742744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc93014c580 0x7fc9300abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:12.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.278+0000 7fc936bc0700 1 --2- 172.21.15.6:0/2535742744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300aafe0 0x7fc93015cbb0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc928009e50 tx=0x7fc92800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65e50b23a92177a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:12.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.278+0000 7fc9353bd700 1 -- 172.21.15.6:0/2535742744 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92800e070 con 0x7fc9300aafe0 2023-07-21T07:36:12.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.278+0000 7fc9353bd700 1 -- 172.21.15.6:0/2535742744 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92800b9c0 con 0x7fc9300aafe0 2023-07-21T07:36:12.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.278+0000 7fc9353bd700 1 -- 172.21.15.6:0/2535742744 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92800bd70 con 0x7fc9300aafe0 2023-07-21T07:36:12.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.278+0000 7fc938623700 1 -- 172.21.15.6:0/2535742744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300aafe0 msgr2=0x7fc93015cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.278+0000 7fc938623700 1 --2- 172.21.15.6:0/2535742744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300aafe0 0x7fc93015cbb0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc928009e50 tx=0x7fc92800b330 comp rx=0 tx=0).stop 2023-07-21T07:36:12.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.278+0000 7fc938623700 1 -- 172.21.15.6:0/2535742744 shutdown_connections 2023-07-21T07:36:12.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.278+0000 7fc938623700 1 --2- 172.21.15.6:0/2535742744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300aafe0 0x7fc93015cbb0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.278+0000 7fc938623700 1 --2- 172.21.15.6:0/2535742744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc93014c580 0x7fc9300abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.278+0000 7fc938623700 1 -- 172.21.15.6:0/2535742744 >> 172.21.15.6:0/2535742744 conn(0x7fc9300c2c20 msgr2=0x7fc9300c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:12.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.278+0000 7fc938623700 1 -- 172.21.15.6:0/2535742744 shutdown_connections 2023-07-21T07:36:12.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.278+0000 7fc938623700 1 -- 172.21.15.6:0/2535742744 wait complete. 2023-07-21T07:36:12.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.280+0000 7fc938623700 1 Processor -- start 2023-07-21T07:36:12.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.280+0000 7fc938623700 1 -- start start 2023-07-21T07:36:12.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc938623700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300aafe0 0x7fc9301510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc938623700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9300c2260 0x7fc9301483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc938623700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc93014c580 0x7fc93014f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc938623700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93014db70 con 0x7fc9300aafe0 2023-07-21T07:36:12.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc938623700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc930143750 con 0x7fc93014c580 2023-07-21T07:36:12.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc938623700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93014ec60 con 0x7fc9300c2260 2023-07-21T07:36:12.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc9363bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300aafe0 0x7fc9301510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc9363bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300aafe0 0x7fc9301510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35446/0 (socket says 172.21.15.6:35446) 2023-07-21T07:36:12.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc9363bf700 1 -- 172.21.15.6:0/4039063762 learned_addr learned my addr 172.21.15.6:0/4039063762 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:12.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc9363bf700 1 -- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9300c2260 msgr2=0x7fc9301483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc935bbe700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9300c2260 0x7fc9301483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc9363bf700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9300c2260 0x7fc9301483c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc9363bf700 1 -- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc93014c580 msgr2=0x7fc93014f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc936bc0700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc93014c580 0x7fc93014f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc9363bf700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc93014c580 0x7fc93014f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc9363bf700 1 -- 172.21.15.6:0/4039063762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc928009b30 con 0x7fc9300aafe0 2023-07-21T07:36:12.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.281+0000 7fc9363bf700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300aafe0 0x7fc9301510b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc92000e810 tx=0x7fc92000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:12.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.282+0000 7fc926ffd700 1 -- 172.21.15.6:0/4039063762 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920004230 con 0x7fc9300aafe0 2023-07-21T07:36:12.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.282+0000 7fc926ffd700 1 -- 172.21.15.6:0/4039063762 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc920004390 con 0x7fc9300aafe0 2023-07-21T07:36:12.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.282+0000 7fc938623700 1 -- 172.21.15.6:0/4039063762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93014cc50 con 0x7fc9300aafe0 2023-07-21T07:36:12.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.282+0000 7fc926ffd700 1 -- 172.21.15.6:0/4039063762 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9200036a0 con 0x7fc9300aafe0 2023-07-21T07:36:12.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.282+0000 7fc938623700 1 -- 172.21.15.6:0/4039063762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93014d210 con 0x7fc9300aafe0 2023-07-21T07:36:12.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.283+0000 7fc938623700 1 -- 172.21.15.6:0/4039063762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc930074500 con 0x7fc9300aafe0 2023-07-21T07:36:12.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.283+0000 7fc926ffd700 1 -- 172.21.15.6:0/4039063762 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc920003800 con 0x7fc9300aafe0 2023-07-21T07:36:12.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.283+0000 7fc926ffd700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc91406ace0 0x7fc91406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.283+0000 7fc926ffd700 1 -- 172.21.15.6:0/4039063762 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fc920088f60 con 0x7fc9300aafe0 2023-07-21T07:36:12.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.284+0000 7fc935bbe700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc91406ace0 0x7fc91406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.284+0000 7fc935bbe700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc91406ace0 0x7fc91406d1a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc930146730 tx=0x7fc92c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:12.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.288+0000 7fc926ffd700 1 -- 172.21.15.6:0/4039063762 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc920054040 con 0x7fc9300aafe0 2023-07-21T07:36:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.483+0000 7fc938623700 1 -- 172.21.15.6:0/4039063762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc9301ea850 con 0x7fc9300aafe0 2023-07-21T07:36:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.484+0000 7fc926ffd700 1 -- 172.21.15.6:0/4039063762 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc920057660 con 0x7fc9300aafe0 2023-07-21T07:36:12.538 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:36:12.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.486+0000 7fc938623700 1 -- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc91406ace0 msgr2=0x7fc91406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.486+0000 7fc938623700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc91406ace0 0x7fc91406d1a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc930146730 tx=0x7fc92c009040 comp rx=0 tx=0).stop 2023-07-21T07:36:12.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.486+0000 7fc938623700 1 -- 172.21.15.6:0/4039063762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300aafe0 msgr2=0x7fc9301510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.486+0000 7fc938623700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300aafe0 0x7fc9301510b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc92000e810 tx=0x7fc92000ebd0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.486+0000 7fc938623700 1 -- 172.21.15.6:0/4039063762 shutdown_connections 2023-07-21T07:36:12.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.486+0000 7fc938623700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc91406ace0 0x7fc91406d1a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.486+0000 7fc938623700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc93014c580 0x7fc93014f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.486+0000 7fc938623700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300aafe0 0x7fc9301510b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.486+0000 7fc938623700 1 --2- 172.21.15.6:0/4039063762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9300c2260 0x7fc9301483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.486+0000 7fc938623700 1 -- 172.21.15.6:0/4039063762 >> 172.21.15.6:0/4039063762 conn(0x7fc9300c2c20 msgr2=0x7fc9300c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:12.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.486+0000 7fc938623700 1 -- 172.21.15.6:0/4039063762 shutdown_connections 2023-07-21T07:36:12.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.486+0000 7fc938623700 1 -- 172.21.15.6:0/4039063762 wait complete. 2023-07-21T07:36:12.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-21T07:36:12.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.625+0000 7f76c8f0b700 1 Processor -- start 2023-07-21T07:36:12.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.625+0000 7f76c8f0b700 1 -- start start 2023-07-21T07:36:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c8f0b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76c414fb30 0x7f76c415dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c8f0b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c40c3c90 con 0x7f76c40a6f80 2023-07-21T07:36:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c8f0b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c40c3680 con 0x7f76c4072160 2023-07-21T07:36:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c8f0b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40c26e0 con 0x7f76c414fb30 2023-07-21T07:36:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f76c40a6f80 0x7f76c4152380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43474/0 (socket says 172.21.15.6:43474) 2023-07-21T07:36:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c259c700 1 -- 172.21.15.6:0/4192835134 learned_addr learned my addr 172.21.15.6:0/4192835134 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/4192835134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76c414fb30 0x7f76c415dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545884794 0 0) 0x7f76c40c3c90 con 0x7f76c40a6f80 2023-07-21T07:36:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76ac0035b0 con 0x7f76c40a6f80 2023-07-21T07:36:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697103670 0 0) 0x7f76c40c3680 con 0x7f76c4072160 2023-07-21T07:36:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c40c3c90 con 0x7f76c4072160 2023-07-21T07:36:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163990438 0 0) 0x7f76ac0035b0 con 0x7f76c40a6f80 2023-07-21T07:36:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76c414fb30 msgr2=0x7f76c415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c159a700 1 --2- 172.21.15.6:0/4192835134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76c414fb30 0x7f76c415dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 >> v1:172.21.15.86:6789/0 conn(0x7f76c4072160 legacy=0x7f76c414f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c40c6fe0 con 0x7f76c40a6f80 2023-07-21T07:36:12.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f76b4001670 con 0x7f76c40a6f80 2023-07-21T07:36:12.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 >> v1:172.21.15.6:6789/0 conn(0x7f76c40a6f80 legacy=0x7f76c4152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.626+0000 7f76c159a700 1 --2- 172.21.15.6:0/4192835134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ac003bc0 0x7f76ac003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c159a700 1 --2- 172.21.15.6:0/4192835134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76c414fb30 0x7f76ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c159a700 1 --2- 172.21.15.6:0/4192835134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76ac004d90 0x7f76ac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40c26e0 con 0x7f76ac004d90 2023-07-21T07:36:12.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac00bb10 con 0x7f76ac003bc0 2023-07-21T07:36:12.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac00bcd0 con 0x7f76c414fb30 2023-07-21T07:36:12.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/4192835134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76ac004d90 0x7f76ac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c259c700 1 --2- 172.21.15.6:0/4192835134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ac003bc0 0x7f76ac003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c1d9b700 1 --2- 172.21.15.6:0/4192835134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76c414fb30 0x7f76ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c2d9d700 1 -- 172.21.15.6:0/4192835134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76c414fb30 msgr2=0x7f76ac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:12.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/4192835134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76c414fb30 0x7f76ac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c2d9d700 1 -- 172.21.15.6:0/4192835134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ac003bc0 msgr2=0x7f76ac003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:12.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/4192835134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ac003bc0 0x7f76ac003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c2d9d700 1 -- 172.21.15.6:0/4192835134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac0035b0 con 0x7f76ac004d90 2023-07-21T07:36:12.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c259c700 1 --2- 172.21.15.6:0/4192835134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ac003bc0 0x7f76ac003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:12.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/4192835134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76ac004d90 0x7f76ac005210 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f76c4070150 tx=0x7f76ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b4f10cdba7c02a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:12.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc00ebd0 con 0x7f76ac004d90 2023-07-21T07:36:12.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc00f040 con 0x7f76ac004d90 2023-07-21T07:36:12.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.627+0000 7f76c159a700 1 -- 172.21.15.6:0/4192835134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc014480 con 0x7f76ac004d90 2023-07-21T07:36:12.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.628+0000 7f76c8f0b700 1 -- 172.21.15.6:0/4192835134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76ac004d90 msgr2=0x7f76ac005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.628+0000 7f76c8f0b700 1 --2- 172.21.15.6:0/4192835134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76ac004d90 0x7f76ac005210 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f76c4070150 tx=0x7f76ac005880 comp rx=0 tx=0).stop 2023-07-21T07:36:12.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.628+0000 7f76c2d9d700 1 -- 172.21.15.6:0/4192835134 reap_dead start 2023-07-21T07:36:12.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.628+0000 7f76c8f0b700 1 -- 172.21.15.6:0/4192835134 shutdown_connections 2023-07-21T07:36:12.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.628+0000 7f76c8f0b700 1 -- 172.21.15.6:0/4192835134 >> 172.21.15.6:0/4192835134 conn(0x7f76c40c7b50 msgr2=0x7f76c40c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:12.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.628+0000 7f76c8f0b700 1 -- 172.21.15.6:0/4192835134 shutdown_connections 2023-07-21T07:36:12.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.628+0000 7f76c8f0b700 1 -- 172.21.15.6:0/4192835134 wait complete. 2023-07-21T07:36:12.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.629+0000 7f76c8f0b700 1 Processor -- start 2023-07-21T07:36:12.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.629+0000 7f76c8f0b700 1 -- start start 2023-07-21T07:36:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c8f0b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ac004d90 0x7f76c4154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c8f0b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76c4151bc0 0x7f76c41eb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c8f0b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c41ebb90 0x7f76c4147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c8f0b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40aaf40 con 0x7f76c41ebb90 2023-07-21T07:36:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c8f0b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c41517a0 con 0x7f76ac004d90 2023-07-21T07:36:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c8f0b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c4153a10 con 0x7f76c4151bc0 2023-07-21T07:36:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c41ebb90 0x7f76c4147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c41ebb90 0x7f76c4147910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35470/0 (socket says 172.21.15.6:35470) 2023-07-21T07:36:12.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c2d9d700 1 -- 172.21.15.6:0/626813408 learned_addr learned my addr 172.21.15.6:0/626813408 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:12.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c1d9b700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76c4151bc0 0x7f76c41eb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c259c700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ac004d90 0x7f76c4154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c2d9d700 1 -- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76c4151bc0 msgr2=0x7f76c41eb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76c4151bc0 0x7f76c41eb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c2d9d700 1 -- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ac004d90 msgr2=0x7f76c4154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ac004d90 0x7f76c4154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c2d9d700 1 -- 172.21.15.6:0/626813408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4153cf0 con 0x7f76c41ebb90 2023-07-21T07:36:12.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.630+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c41ebb90 0x7f76c4147910 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00e700 tx=0x7f76bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:12.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.631+0000 7f76b2ffd700 1 -- 172.21.15.6:0/626813408 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc007000 con 0x7f76c41ebb90 2023-07-21T07:36:12.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.631+0000 7f76b2ffd700 1 -- 172.21.15.6:0/626813408 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc022070 con 0x7f76c41ebb90 2023-07-21T07:36:12.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.631+0000 7f76c8f0b700 1 -- 172.21.15.6:0/626813408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c41513c0 con 0x7f76c41ebb90 2023-07-21T07:36:12.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.631+0000 7f76b2ffd700 1 -- 172.21.15.6:0/626813408 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc003e80 con 0x7f76c41ebb90 2023-07-21T07:36:12.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.631+0000 7f76c8f0b700 1 -- 172.21.15.6:0/626813408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c41ec010 con 0x7f76c41ebb90 2023-07-21T07:36:12.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.632+0000 7f76c8f0b700 1 -- 172.21.15.6:0/626813408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c4070fb0 con 0x7f76c41ebb90 2023-07-21T07:36:12.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.632+0000 7f76b2ffd700 1 -- 172.21.15.6:0/626813408 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76bc024030 con 0x7f76c41ebb90 2023-07-21T07:36:12.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.633+0000 7f76b2ffd700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f76a406ace0 0x7f76a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:12.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.633+0000 7f76b2ffd700 1 -- 172.21.15.6:0/626813408 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f76bc08ae40 con 0x7f76c41ebb90 2023-07-21T07:36:12.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.633+0000 7f76c259c700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f76a406ace0 0x7f76a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:12.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.633+0000 7f76c259c700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f76a406ace0 0x7f76a406d1a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f76b4001eb0 tx=0x7f76b4001c10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:12.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.637+0000 7f76b2ffd700 1 -- 172.21.15.6:0/626813408 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f76bc059ad0 con 0x7f76c41ebb90 2023-07-21T07:36:12.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.832+0000 7f76c8f0b700 1 -- 172.21.15.6:0/626813408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f76c4068190 con 0x7f76c41ebb90 2023-07-21T07:36:12.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.832+0000 7f76b2ffd700 1 -- 172.21.15.6:0/626813408 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v43) v1 ==== 105+0+11 (secure 0 0 0) 0x7f76bc018020 con 0x7f76c41ebb90 2023-07-21T07:36:12.886 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:36:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.834+0000 7f76c8f0b700 1 -- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f76a406ace0 msgr2=0x7f76a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.834+0000 7f76c8f0b700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f76a406ace0 0x7f76a406d1a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f76b4001eb0 tx=0x7f76b4001c10 comp rx=0 tx=0).stop 2023-07-21T07:36:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.834+0000 7f76c8f0b700 1 -- 172.21.15.6:0/626813408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c41ebb90 msgr2=0x7f76c4147910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.834+0000 7f76c8f0b700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c41ebb90 0x7f76c4147910 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00e700 tx=0x7f76bc009750 comp rx=0 tx=0).stop 2023-07-21T07:36:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.834+0000 7f76c8f0b700 1 -- 172.21.15.6:0/626813408 shutdown_connections 2023-07-21T07:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.834+0000 7f76c8f0b700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f76a406ace0 0x7f76a406d1a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.834+0000 7f76c8f0b700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c41ebb90 0x7f76c4147910 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.834+0000 7f76c8f0b700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76ac004d90 0x7f76c4154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.834+0000 7f76c8f0b700 1 --2- 172.21.15.6:0/626813408 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76c4151bc0 0x7f76c41eb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.834+0000 7f76c8f0b700 1 -- 172.21.15.6:0/626813408 >> 172.21.15.6:0/626813408 conn(0x7f76c40c7b50 msgr2=0x7f76c4149080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.834+0000 7f76c8f0b700 1 -- 172.21.15.6:0/626813408 shutdown_connections 2023-07-21T07:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.834+0000 7f76c8f0b700 1 -- 172.21.15.6:0/626813408 wait complete. 2023-07-21T07:36:12.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-21T07:36:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.974+0000 7f4e80fce700 1 Processor -- start 2023-07-21T07:36:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.974+0000 7f4e80fce700 1 -- start start 2023-07-21T07:36:13.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.975+0000 7f4e80fce700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4e7c0abc30 0x7f4e7c14e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.975+0000 7f4e80fce700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4e7c06ff90 0x7f4e7c14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.975+0000 7f4e80fce700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7c0664e0 con 0x7f4e7c0704e0 2023-07-21T07:36:13.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.975+0000 7f4e80fce700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7c071ba0 con 0x7f4e7c0abc30 2023-07-21T07:36:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.975+0000 7f4e80fce700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7c06b760 con 0x7f4e7c06ff90 2023-07-21T07:36:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.975+0000 7f4e7a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4e7c0abc30 0x7f4e7c14e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.975+0000 7f4e7ad9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4e7c0704e0 0x7f4e7c151720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43496/0 (socket says 172.21.15.6:43496) 2023-07-21T07:36:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.975+0000 7f4e7ad9d700 1 -- 172.21.15.6:0/1652606574 learned_addr learned my addr 172.21.15.6:0/1652606574 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.976+0000 7f4e79d9b700 1 --2- 172.21.15.6:0/1652606574 >> v2:172.21.15.86:3300/0 conn(0x7f4e7c06ff90 0x7f4e7c14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.976+0000 7f4e7a59c700 1 -- 172.21.15.6:0/1652606574 >> v2:172.21.15.86:3300/0 conn(0x7f4e7c06ff90 msgr2=0x7f4e7c14eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:13.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.976+0000 7f4e7a59c700 1 --2- 172.21.15.6:0/1652606574 >> v2:172.21.15.86:3300/0 conn(0x7f4e7c06ff90 0x7f4e7c14eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.976+0000 7f4e7a59c700 1 -- 172.21.15.6:0/1652606574 >> v1:172.21.15.6:6789/0 conn(0x7f4e7c0704e0 legacy=0x7f4e7c151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.976+0000 7f4e7959a700 1 -- 172.21.15.6:0/1652606574 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643472189 0 0) 0x7f4e7c0664e0 con 0x7f4e7c0704e0 2023-07-21T07:36:13.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.976+0000 7f4e7a59c700 1 -- 172.21.15.6:0/1652606574 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c065f60 con 0x7f4e7c0abc30 2023-07-21T07:36:13.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.976+0000 7f4e7a59c700 1 --2- 172.21.15.6:0/1652606574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0abc30 0x7f4e7c14e650 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0c7220 tx=0x7f4e7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ccf2f581929800 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:13.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.976+0000 7f4e7959a700 1 -- 172.21.15.6:0/1652606574 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7400e070 con 0x7f4e7c0abc30 2023-07-21T07:36:13.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.976+0000 7f4e7959a700 1 -- 172.21.15.6:0/1652606574 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7400bbd0 con 0x7f4e7c0abc30 2023-07-21T07:36:13.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.976+0000 7f4e7959a700 1 -- 172.21.15.6:0/1652606574 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74012430 con 0x7f4e7c0abc30 2023-07-21T07:36:13.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.976+0000 7f4e80fce700 1 -- 172.21.15.6:0/1652606574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0abc30 msgr2=0x7f4e7c14e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.977+0000 7f4e80fce700 1 --2- 172.21.15.6:0/1652606574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0abc30 0x7f4e7c14e650 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0c7220 tx=0x7f4e7400b330 comp rx=0 tx=0).stop 2023-07-21T07:36:13.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.977+0000 7f4e80fce700 1 -- 172.21.15.6:0/1652606574 shutdown_connections 2023-07-21T07:36:13.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.977+0000 7f4e80fce700 1 --2- 172.21.15.6:0/1652606574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0abc30 0x7f4e7c14e650 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.977+0000 7f4e80fce700 1 --2- 172.21.15.6:0/1652606574 >> v2:172.21.15.86:3300/0 conn(0x7f4e7c06ff90 0x7f4e7c14eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.977+0000 7f4e80fce700 1 -- 172.21.15.6:0/1652606574 >> 172.21.15.6:0/1652606574 conn(0x7f4e7c0c2c20 msgr2=0x7f4e7c0c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:13.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.977+0000 7f4e80fce700 1 -- 172.21.15.6:0/1652606574 shutdown_connections 2023-07-21T07:36:13.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.977+0000 7f4e80fce700 1 -- 172.21.15.6:0/1652606574 wait complete. 2023-07-21T07:36:13.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.978+0000 7f4e80fce700 1 Processor -- start 2023-07-21T07:36:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.978+0000 7f4e80fce700 1 -- start start 2023-07-21T07:36:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e80fce700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e7c06ff90 0x7f4e7c0c2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e80fce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0704e0 0x7f4e7c0bf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e80fce700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e7c0abc30 0x7f4e7c141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e80fce700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c1455f0 con 0x7f4e7c0704e0 2023-07-21T07:36:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e80fce700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c142ed0 con 0x7f4e7c06ff90 2023-07-21T07:36:13.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e80fce700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c145310 con 0x7f4e7c0abc30 2023-07-21T07:36:13.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e79d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0704e0 0x7f4e7c0bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e79d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0704e0 0x7f4e7c0bf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35480/0 (socket says 172.21.15.6:35480) 2023-07-21T07:36:13.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e79d9b700 1 -- 172.21.15.6:0/1195977894 learned_addr learned my addr 172.21.15.6:0/1195977894 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:13.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e7ad9d700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e7c0abc30 0x7f4e7c141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e7a59c700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e7c06ff90 0x7f4e7c0c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e79d9b700 1 -- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e7c0abc30 msgr2=0x7f4e7c141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e79d9b700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e7c0abc30 0x7f4e7c141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e79d9b700 1 -- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e7c06ff90 msgr2=0x7f4e7c0c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e79d9b700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e7c06ff90 0x7f4e7c0c2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e79d9b700 1 -- 172.21.15.6:0/1195977894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e74009a70 con 0x7f4e7c0704e0 2023-07-21T07:36:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e7a59c700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e7c06ff90 0x7f4e7c0c2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e79d9b700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0704e0 0x7f4e7c0bf720 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000d7d0 tx=0x7f4e7000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e6affd700 1 -- 172.21.15.6:0/1195977894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e700125f0 con 0x7f4e7c0704e0 2023-07-21T07:36:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e6affd700 1 -- 172.21.15.6:0/1195977894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e70012750 con 0x7f4e7c0704e0 2023-07-21T07:36:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.979+0000 7f4e80fce700 1 -- 172.21.15.6:0/1195977894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7c143170 con 0x7f4e7c0704e0 2023-07-21T07:36:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.980+0000 7f4e6affd700 1 -- 172.21.15.6:0/1195977894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70012ae0 con 0x7f4e7c0704e0 2023-07-21T07:36:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.980+0000 7f4e80fce700 1 -- 172.21.15.6:0/1195977894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7c144fa0 con 0x7f4e7c0704e0 2023-07-21T07:36:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.981+0000 7f4e80fce700 1 -- 172.21.15.6:0/1195977894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7c0c0e80 con 0x7f4e7c0704e0 2023-07-21T07:36:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.981+0000 7f4e6affd700 1 -- 172.21.15.6:0/1195977894 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4e70012c40 con 0x7f4e7c0704e0 2023-07-21T07:36:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.982+0000 7f4e6affd700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4e5c06ace0 0x7f4e5c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.982+0000 7f4e6affd700 1 -- 172.21.15.6:0/1195977894 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f4e700895a0 con 0x7f4e7c0704e0 2023-07-21T07:36:13.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.982+0000 7f4e7a59c700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4e5c06ace0 0x7f4e5c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.982+0000 7f4e7a59c700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4e5c06ace0 0x7f4e5c06d1a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4e74014040 tx=0x7f4e74011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:13.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:12.986+0000 7f4e6affd700 1 -- 172.21.15.6:0/1195977894 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4e700545e0 con 0x7f4e7c0704e0 2023-07-21T07:36:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.183+0000 7f4e80fce700 1 -- 172.21.15.6:0/1195977894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f4e7c074500 con 0x7f4e7c0704e0 2023-07-21T07:36:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.184+0000 7f4e6affd700 1 -- 172.21.15.6:0/1195977894 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v43) v1 ==== 101+0+11 (secure 0 0 0) 0x7f4e70057c00 con 0x7f4e7c0704e0 2023-07-21T07:36:13.237 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:36:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.186+0000 7f4e80fce700 1 -- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4e5c06ace0 msgr2=0x7f4e5c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.186+0000 7f4e80fce700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4e5c06ace0 0x7f4e5c06d1a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4e74014040 tx=0x7f4e74011000 comp rx=0 tx=0).stop 2023-07-21T07:36:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.186+0000 7f4e80fce700 1 -- 172.21.15.6:0/1195977894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0704e0 msgr2=0x7f4e7c0bf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.186+0000 7f4e80fce700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0704e0 0x7f4e7c0bf720 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000d7d0 tx=0x7f4e7000dae0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.186+0000 7f4e80fce700 1 -- 172.21.15.6:0/1195977894 shutdown_connections 2023-07-21T07:36:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.186+0000 7f4e80fce700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4e5c06ace0 0x7f4e5c06d1a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.186+0000 7f4e80fce700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e7c0abc30 0x7f4e7c141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.186+0000 7f4e80fce700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e7c06ff90 0x7f4e7c0c2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.186+0000 7f4e80fce700 1 --2- 172.21.15.6:0/1195977894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0704e0 0x7f4e7c0bf720 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.186+0000 7f4e80fce700 1 -- 172.21.15.6:0/1195977894 >> 172.21.15.6:0/1195977894 conn(0x7f4e7c0c2c20 msgr2=0x7f4e7c14e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.186+0000 7f4e80fce700 1 -- 172.21.15.6:0/1195977894 shutdown_connections 2023-07-21T07:36:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.186+0000 7f4e80fce700 1 -- 172.21.15.6:0/1195977894 wait complete. 2023-07-21T07:36:13.251 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:36:13.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.322+0000 7f8207ce8700 1 Processor -- start 2023-07-21T07:36:13.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.323+0000 7f8207ce8700 1 -- start start 2023-07-21T07:36:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8207ce8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82000c3f70 0x7f8200152f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8207ce8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8200153470 con 0x7f820006beb0 2023-07-21T07:36:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8207ce8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82000c4400 con 0x7f820006a300 2023-07-21T07:36:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8207ce8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82000ba3f0 con 0x7f82000c3f70 2023-07-21T07:36:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8205283700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f820006beb0 0x7f82000c4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43508/0 (socket says 172.21.15.6:43508) 2023-07-21T07:36:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8205283700 1 -- 172.21.15.6:0/517179988 learned_addr learned my addr 172.21.15.6:0/517179988 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8206285700 1 --2- 172.21.15.6:0/517179988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82000c3f70 0x7f8200152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677429995 0 0) 0x7f81f4001110 con 0x7f820006beb0 2023-07-21T07:36:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81ec0035b0 con 0x7f820006beb0 2023-07-21T07:36:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2478419614 0 0) 0x7f81ec0035b0 con 0x7f820006beb0 2023-07-21T07:36:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82000c3f70 msgr2=0x7f8200152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8204a82700 1 --2- 172.21.15.6:0/517179988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82000c3f70 0x7f8200152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 >> v1:172.21.15.86:6789/0 conn(0x7f820006a300 legacy=0x7f82000c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820006d930 con 0x7f820006beb0 2023-07-21T07:36:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f81f4001800 con 0x7f820006beb0 2023-07-21T07:36:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 >> v1:172.21.15.6:6789/0 conn(0x7f820006beb0 legacy=0x7f82000c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8204a82700 1 --2- 172.21.15.6:0/517179988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82000c3f70 0x7f81ec003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8204a82700 1 --2- 172.21.15.6:0/517179988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81ec003f70 0x7f81ec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8204a82700 1 --2- 172.21.15.6:0/517179988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81ec004d90 0x7f81ec005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.324+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000ba3f0 con 0x7f81ec003f70 2023-07-21T07:36:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec00bbd0 con 0x7f81ec004d90 2023-07-21T07:36:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec00bd90 con 0x7f82000c3f70 2023-07-21T07:36:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8205283700 1 --2- 172.21.15.6:0/517179988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81ec003f70 0x7f81ec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8205a84700 1 --2- 172.21.15.6:0/517179988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82000c3f70 0x7f81ec003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8206285700 1 --2- 172.21.15.6:0/517179988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81ec004d90 0x7f81ec005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8205283700 1 -- 172.21.15.6:0/517179988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82000c3f70 msgr2=0x7f81ec003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8205283700 1 --2- 172.21.15.6:0/517179988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82000c3f70 0x7f81ec003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8205283700 1 -- 172.21.15.6:0/517179988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81ec004d90 msgr2=0x7f81ec005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8205283700 1 --2- 172.21.15.6:0/517179988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81ec004d90 0x7f81ec005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8205283700 1 -- 172.21.15.6:0/517179988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec0035b0 con 0x7f81ec003f70 2023-07-21T07:36:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8205283700 1 --2- 172.21.15.6:0/517179988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81ec003f70 0x7f81ec004850 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f81f400c240 tx=0x7f81ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945ddc256acb3712 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4007db0 con 0x7f81ec003f70 2023-07-21T07:36:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f400ce00 con 0x7f81ec003f70 2023-07-21T07:36:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.325+0000 7f8204a82700 1 -- 172.21.15.6:0/517179988 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4005ba0 con 0x7f81ec003f70 2023-07-21T07:36:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.326+0000 7f8207ce8700 1 -- 172.21.15.6:0/517179988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81ec003f70 msgr2=0x7f81ec004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.326+0000 7f8207ce8700 1 --2- 172.21.15.6:0/517179988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81ec003f70 0x7f81ec004850 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f81f400c240 tx=0x7f81ec005880 comp rx=0 tx=0).stop 2023-07-21T07:36:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.326+0000 7f8206285700 1 -- 172.21.15.6:0/517179988 reap_dead start 2023-07-21T07:36:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.326+0000 7f8207ce8700 1 -- 172.21.15.6:0/517179988 shutdown_connections 2023-07-21T07:36:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.326+0000 7f8207ce8700 1 -- 172.21.15.6:0/517179988 >> 172.21.15.6:0/517179988 conn(0x7f82000a8c90 msgr2=0x7f820006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.326+0000 7f8207ce8700 1 -- 172.21.15.6:0/517179988 shutdown_connections 2023-07-21T07:36:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.326+0000 7f8207ce8700 1 -- 172.21.15.6:0/517179988 wait complete. 2023-07-21T07:36:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.327+0000 7f8207ce8700 1 Processor -- start 2023-07-21T07:36:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.327+0000 7f8207ce8700 1 -- start start 2023-07-21T07:36:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8207ce8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81ec003f70 0x7f8200153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8207ce8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82001502b0 0x7f82000bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8207ce8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8200150730 0x7f82000bbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8207ce8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000bba40 con 0x7f81ec003f70 2023-07-21T07:36:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8207ce8700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000baf00 con 0x7f82001502b0 2023-07-21T07:36:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8207ce8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8200154810 con 0x7f8200150730 2023-07-21T07:36:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8205a84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81ec003f70 0x7f8200153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8205a84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81ec003f70 0x7f8200153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35498/0 (socket says 172.21.15.6:35498) 2023-07-21T07:36:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8205a84700 1 -- 172.21.15.6:0/4100641927 learned_addr learned my addr 172.21.15.6:0/4100641927 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8206285700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8200150730 0x7f82000bbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8205283700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82001502b0 0x7f82000bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8205a84700 1 -- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8200150730 msgr2=0x7f82000bbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8205a84700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8200150730 0x7f82000bbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8205a84700 1 -- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82001502b0 msgr2=0x7f82000bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8205a84700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82001502b0 0x7f82000bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8205a84700 1 -- 172.21.15.6:0/4100641927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82000ba5d0 con 0x7f81ec003f70 2023-07-21T07:36:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8205283700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82001502b0 0x7f82000bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8206285700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8200150730 0x7f82000bbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8205a84700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81ec003f70 0x7f8200153f10 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00f820 tx=0x7f81fc00fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f81f27fc700 1 -- 172.21.15.6:0/4100641927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0052e0 con 0x7f81ec003f70 2023-07-21T07:36:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f81f27fc700 1 -- 172.21.15.6:0/4100641927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc005460 con 0x7f81ec003f70 2023-07-21T07:36:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f8207ce8700 1 -- 172.21.15.6:0/4100641927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82000ba8b0 con 0x7f81ec003f70 2023-07-21T07:36:13.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.328+0000 7f81f27fc700 1 -- 172.21.15.6:0/4100641927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0038c0 con 0x7f81ec003f70 2023-07-21T07:36:13.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.329+0000 7f8207ce8700 1 -- 172.21.15.6:0/4100641927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8200070ba0 con 0x7f81ec003f70 2023-07-21T07:36:13.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.329+0000 7f8207ce8700 1 -- 172.21.15.6:0/4100641927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8200074500 con 0x7f81ec003f70 2023-07-21T07:36:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.330+0000 7f81f27fc700 1 -- 172.21.15.6:0/4100641927 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f81fc003a20 con 0x7f81ec003f70 2023-07-21T07:36:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.330+0000 7f81f27fc700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f81e406ad10 0x7f81e406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.330+0000 7f81f27fc700 1 -- 172.21.15.6:0/4100641927 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f81fc089450 con 0x7f81ec003f70 2023-07-21T07:36:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.331+0000 7f8205283700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f81e406ad10 0x7f81e406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.331+0000 7f8205283700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f81e406ad10 0x7f81e406d1d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f82000a5240 tx=0x7f81f4007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.335+0000 7f81f27fc700 1 -- 172.21.15.6:0/4100641927 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f81fc054400 con 0x7f81ec003f70 2023-07-21T07:36:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.582+0000 7f8207ce8700 1 -- 172.21.15.6:0/4100641927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82000c1d90 con 0x7f81ec003f70 2023-07-21T07:36:13.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.582+0000 7f81f27fc700 1 -- 172.21.15.6:0/4100641927 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4664 (secure 0 0 0) 0x7f81fc057a20 con 0x7f81ec003f70 2023-07-21T07:36:13.636 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:13.636 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1808819585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1808819585},{"type":"v1","addr":"172.21.15.6:6834","nonce":1808819585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/422116109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":422116109},{"type":"v1","addr":"172.21.15.86:6836","nonce":422116109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2436536706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2436536706},{"type":"v1","addr":"172.21.15.6:6835","nonce":2436536706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:45.299013+0000","modified":"2023-07-21T07:35:48.891082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.86:6837/3328348149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3328348149},{"type":"v1","addr":"172.21.15.86:6837","nonce":3328348149}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T07:36:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.584+0000 7f8207ce8700 1 -- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f81e406ad10 msgr2=0x7f81e406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.584+0000 7f8207ce8700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f81e406ad10 0x7f81e406d1d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f82000a5240 tx=0x7f81f4007000 comp rx=0 tx=0).stop 2023-07-21T07:36:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.584+0000 7f8207ce8700 1 -- 172.21.15.6:0/4100641927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81ec003f70 msgr2=0x7f8200153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.584+0000 7f8207ce8700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81ec003f70 0x7f8200153f10 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00f820 tx=0x7f81fc00fbe0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.584+0000 7f8207ce8700 1 -- 172.21.15.6:0/4100641927 shutdown_connections 2023-07-21T07:36:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.584+0000 7f8207ce8700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f81e406ad10 0x7f81e406d1d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.584+0000 7f8207ce8700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8200150730 0x7f82000bbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.584+0000 7f8207ce8700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81ec003f70 0x7f8200153f10 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.584+0000 7f8207ce8700 1 --2- 172.21.15.6:0/4100641927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82001502b0 0x7f82000bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.584+0000 7f8207ce8700 1 -- 172.21.15.6:0/4100641927 >> 172.21.15.6:0/4100641927 conn(0x7f82000a8c90 msgr2=0x7f82000a7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.584+0000 7f8207ce8700 1 -- 172.21.15.6:0/4100641927 shutdown_connections 2023-07-21T07:36:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.584+0000 7f8207ce8700 1 -- 172.21.15.6:0/4100641927 wait complete. 2023-07-21T07:36:13.640 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2023-07-21T07:36:13.650 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:13.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.721+0000 7f26ce52a700 1 Processor -- start 2023-07-21T07:36:13.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.721+0000 7f26ce52a700 1 -- start start 2023-07-21T07:36:13.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26ce52a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f26c8151b50 0x7f26c81550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26ce52a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26c80c0f60 0x7f26c80c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26ce52a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c80664d0 con 0x7f26c80c19f0 2023-07-21T07:36:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26ce52a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c8155600 con 0x7f26c8151b50 2023-07-21T07:36:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26ce52a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c80bf550 con 0x7f26c80c0f60 2023-07-21T07:36:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26c77fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26c80c0f60 0x7f26c80c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26c7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f26c8151b50 0x7f26c81550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26c77fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26c80c0f60 0x7f26c80c14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:32900/0 (socket says 172.21.15.6:32900) 2023-07-21T07:36:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26c77fe700 1 -- 172.21.15.6:0/3587494488 learned_addr learned my addr 172.21.15.6:0/3587494488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26c7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f26c8151b50 0x7f26c81550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:57310/0 (socket says 172.21.15.6:57310) 2023-07-21T07:36:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26c6ffd700 1 -- 172.21.15.6:0/3587494488 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241252327 0 0) 0x7f26c80664d0 con 0x7f26c80c19f0 2023-07-21T07:36:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26c6ffd700 1 -- 172.21.15.6:0/3587494488 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26b00035b0 con 0x7f26c80c19f0 2023-07-21T07:36:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26c77fe700 1 -- 172.21.15.6:0/3587494488 >> v2:172.21.15.86:3300/0 conn(0x7f26c8151b50 msgr2=0x7f26c81550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26c77fe700 1 --2- 172.21.15.6:0/3587494488 >> v2:172.21.15.86:3300/0 conn(0x7f26c8151b50 0x7f26c81550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26c77fe700 1 -- 172.21.15.6:0/3587494488 >> v1:172.21.15.86:6789/0 conn(0x7f26c80c19f0 legacy=0x7f26c806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26c77fe700 1 -- 172.21.15.6:0/3587494488 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c80bf830 con 0x7f26c80c0f60 2023-07-21T07:36:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.722+0000 7f26c7fff700 1 --2- 172.21.15.6:0/3587494488 >> v2:172.21.15.86:3300/0 conn(0x7f26c8151b50 0x7f26c81550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.723+0000 7f26c77fe700 1 --2- 172.21.15.6:0/3587494488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26c80c0f60 0x7f26c80c14b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f26b80098f0 tx=0x7f26b8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d39a3d94181bf252 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.723+0000 7f26c6ffd700 1 -- 172.21.15.6:0/3587494488 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8011830 con 0x7f26c80c0f60 2023-07-21T07:36:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.723+0000 7f26c6ffd700 1 -- 172.21.15.6:0/3587494488 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b8011990 con 0x7f26c80c0f60 2023-07-21T07:36:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.723+0000 7f26c6ffd700 1 -- 172.21.15.6:0/3587494488 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8011d20 con 0x7f26c80c0f60 2023-07-21T07:36:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.723+0000 7f26ce52a700 1 -- 172.21.15.6:0/3587494488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26c80c0f60 msgr2=0x7f26c80c14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.723+0000 7f26ce52a700 1 --2- 172.21.15.6:0/3587494488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26c80c0f60 0x7f26c80c14b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f26b80098f0 tx=0x7f26b8009c00 comp rx=0 tx=0).stop 2023-07-21T07:36:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.723+0000 7f26ce52a700 1 -- 172.21.15.6:0/3587494488 shutdown_connections 2023-07-21T07:36:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.723+0000 7f26ce52a700 1 --2- 172.21.15.6:0/3587494488 >> v2:172.21.15.86:3300/0 conn(0x7f26c8151b50 0x7f26c81550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.723+0000 7f26ce52a700 1 --2- 172.21.15.6:0/3587494488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26c80c0f60 0x7f26c80c14b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.723+0000 7f26ce52a700 1 -- 172.21.15.6:0/3587494488 >> 172.21.15.6:0/3587494488 conn(0x7f26c80c6140 msgr2=0x7f26c80c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.723+0000 7f26ce52a700 1 -- 172.21.15.6:0/3587494488 shutdown_connections 2023-07-21T07:36:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.723+0000 7f26ce52a700 1 -- 172.21.15.6:0/3587494488 wait complete. 2023-07-21T07:36:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.725+0000 7f26ce52a700 1 Processor -- start 2023-07-21T07:36:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.725+0000 7f26ce52a700 1 -- start start 2023-07-21T07:36:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.725+0000 7f26ce52a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26c80c0f60 0x7f26c8071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.725+0000 7f26ce52a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26c80c19f0 0x7f26c8145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.725+0000 7f26ce52a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8151b50 0x7f26c8145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.725+0000 7f26ce52a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c8157a50 con 0x7f26c8151b50 2023-07-21T07:36:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.725+0000 7f26ce52a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c80ab870 con 0x7f26c80c19f0 2023-07-21T07:36:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.725+0000 7f26ce52a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c8158a10 con 0x7f26c80c0f60 2023-07-21T07:36:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26ccac7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8151b50 0x7f26c8145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26ccac7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8151b50 0x7f26c8145f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35512/0 (socket says 172.21.15.6:35512) 2023-07-21T07:36:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26ccac7700 1 -- 172.21.15.6:0/2456862887 learned_addr learned my addr 172.21.15.6:0/2456862887 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26c7fff700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26c80c0f60 0x7f26c8071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26c77fe700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26c80c19f0 0x7f26c8145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26ccac7700 1 -- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26c80c0f60 msgr2=0x7f26c8071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26ccac7700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26c80c0f60 0x7f26c8071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26ccac7700 1 -- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26c80c19f0 msgr2=0x7f26c8145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26ccac7700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26c80c19f0 0x7f26c8145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26ccac7700 1 -- 172.21.15.6:0/2456862887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc0094a0 con 0x7f26c8151b50 2023-07-21T07:36:13.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26c77fe700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26c80c19f0 0x7f26c8145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:13.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26ccac7700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8151b50 0x7f26c8145f80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f26c000cbf0 tx=0x7f26c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:13.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26c4ff9700 1 -- 172.21.15.6:0/2456862887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0003c00 con 0x7f26c8151b50 2023-07-21T07:36:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26c4ff9700 1 -- 172.21.15.6:0/2456862887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c0003d60 con 0x7f26c8151b50 2023-07-21T07:36:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26ce52a700 1 -- 172.21.15.6:0/2456862887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b8009550 con 0x7f26c8151b50 2023-07-21T07:36:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26c4ff9700 1 -- 172.21.15.6:0/2456862887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c000abe0 con 0x7f26c8151b50 2023-07-21T07:36:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.726+0000 7f26ce52a700 1 -- 172.21.15.6:0/2456862887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c81edeb0 con 0x7f26c8151b50 2023-07-21T07:36:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.727+0000 7f26ce52a700 1 -- 172.21.15.6:0/2456862887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c806dec0 con 0x7f26c8151b50 2023-07-21T07:36:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.728+0000 7f26c4ff9700 1 -- 172.21.15.6:0/2456862887 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f26c000ad40 con 0x7f26c8151b50 2023-07-21T07:36:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.728+0000 7f26c4ff9700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f26b406ace0 0x7f26b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.728+0000 7f26c4ff9700 1 -- 172.21.15.6:0/2456862887 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f26c0089570 con 0x7f26c8151b50 2023-07-21T07:36:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.728+0000 7f26c7fff700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f26b406ace0 0x7f26b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.729+0000 7f26c7fff700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f26b406ace0 0x7f26b406d1a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009d00 tx=0x7f26bc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.732+0000 7f26c4ff9700 1 -- 172.21.15.6:0/2456862887 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f26c0054650 con 0x7f26c8151b50 2023-07-21T07:36:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.930+0000 7f26ce52a700 1 -- 172.21.15.6:0/2456862887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26c80c3d10 con 0x7f26c8151b50 2023-07-21T07:36:13.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.931+0000 7f26c4ff9700 1 -- 172.21.15.6:0/2456862887 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18372 (secure 0 0 0) 0x7f26c0057c70 con 0x7f26c8151b50 2023-07-21T07:36:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:13.986 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:36:11.401679+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:35:43.052752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:35:44.270260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/459917011":"2023-07-22T07:36:08.389211+0000","172.21.15.6:6832/459917011":"2023-07-22T07:36:08.389211+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.934+0000 7f26ce52a700 1 -- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f26b406ace0 msgr2=0x7f26b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.934+0000 7f26ce52a700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f26b406ace0 0x7f26b406d1a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009d00 tx=0x7f26bc008040 comp rx=0 tx=0).stop 2023-07-21T07:36:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.934+0000 7f26ce52a700 1 -- 172.21.15.6:0/2456862887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8151b50 msgr2=0x7f26c8145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.934+0000 7f26ce52a700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8151b50 0x7f26c8145f80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f26c000cbf0 tx=0x7f26c000a060 comp rx=0 tx=0).stop 2023-07-21T07:36:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.934+0000 7f26ce52a700 1 -- 172.21.15.6:0/2456862887 shutdown_connections 2023-07-21T07:36:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.934+0000 7f26ce52a700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f26b406ace0 0x7f26b406d1a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.934+0000 7f26ce52a700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8151b50 0x7f26c8145f80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.934+0000 7f26ce52a700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26c80c0f60 0x7f26c8071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.934+0000 7f26ce52a700 1 --2- 172.21.15.6:0/2456862887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26c80c19f0 0x7f26c8145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.934+0000 7f26ce52a700 1 -- 172.21.15.6:0/2456862887 >> 172.21.15.6:0/2456862887 conn(0x7f26c80c6140 msgr2=0x7f26c80c3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.934+0000 7f26ce52a700 1 -- 172.21.15.6:0/2456862887 shutdown_connections 2023-07-21T07:36:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:13.934+0000 7f26ce52a700 1 -- 172.21.15.6:0/2456862887 wait complete. 2023-07-21T07:36:14.000 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-07-21T07:36:14.000 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:36:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.071+0000 7fda3f3ef700 1 Processor -- start 2023-07-21T07:36:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.072+0000 7fda3f3ef700 1 -- start start 2023-07-21T07:36:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.072+0000 7fda3f3ef700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fda3814fa10 0x7fda3806a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.072+0000 7fda3f3ef700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda38066210 0x7fda380ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.072+0000 7fda3f3ef700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda380c6cc0 con 0x7fda380abdb0 2023-07-21T07:36:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.072+0000 7fda3f3ef700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda38152df0 con 0x7fda38066210 2023-07-21T07:36:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.072+0000 7fda3f3ef700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda381530d0 con 0x7fda3814fa10 2023-07-21T07:36:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.073+0000 7fda3d98c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda38066210 0x7fda380ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.073+0000 7fda3d98c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda38066210 0x7fda380ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35520/0 (socket says 172.21.15.6:35520) 2023-07-21T07:36:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.073+0000 7fda3d98c700 1 -- 172.21.15.6:0/3564329240 learned_addr learned my addr 172.21.15.6:0/3564329240 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.073+0000 7fda3d18b700 1 --2- 172.21.15.6:0/3564329240 >> v2:172.21.15.86:3300/0 conn(0x7fda3814fa10 0x7fda3806a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.073+0000 7fda3d98c700 1 -- 172.21.15.6:0/3564329240 >> v2:172.21.15.86:3300/0 conn(0x7fda3814fa10 msgr2=0x7fda3806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.073+0000 7fda3d98c700 1 --2- 172.21.15.6:0/3564329240 >> v2:172.21.15.86:3300/0 conn(0x7fda3814fa10 0x7fda3806a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.073+0000 7fda3d98c700 1 -- 172.21.15.6:0/3564329240 >> v1:172.21.15.86:6789/0 conn(0x7fda380abdb0 legacy=0x7fda380aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.073+0000 7fda3d98c700 1 -- 172.21.15.6:0/3564329240 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda380c6f10 con 0x7fda38066210 2023-07-21T07:36:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.073+0000 7fda3d98c700 1 --2- 172.21.15.6:0/3564329240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38066210 0x7fda380ab0e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fda380c3cc0 tx=0x7fda3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5382e89520dcd654 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.073+0000 7fda2ffff700 1 -- 172.21.15.6:0/3564329240 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000e070 con 0x7fda38066210 2023-07-21T07:36:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.073+0000 7fda2ffff700 1 -- 172.21.15.6:0/3564329240 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3000b9c0 con 0x7fda38066210 2023-07-21T07:36:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.073+0000 7fda2ffff700 1 -- 172.21.15.6:0/3564329240 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000bd70 con 0x7fda38066210 2023-07-21T07:36:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.074+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3564329240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38066210 msgr2=0x7fda380ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.074+0000 7fda3f3ef700 1 --2- 172.21.15.6:0/3564329240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38066210 0x7fda380ab0e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fda380c3cc0 tx=0x7fda3000b330 comp rx=0 tx=0).stop 2023-07-21T07:36:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.074+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3564329240 shutdown_connections 2023-07-21T07:36:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.074+0000 7fda3f3ef700 1 --2- 172.21.15.6:0/3564329240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda38066210 0x7fda380ab0e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.074+0000 7fda3f3ef700 1 --2- 172.21.15.6:0/3564329240 >> v2:172.21.15.86:3300/0 conn(0x7fda3814fa10 0x7fda3806a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.074+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3564329240 >> 172.21.15.6:0/3564329240 conn(0x7fda380c6140 msgr2=0x7fda380c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.074+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3564329240 shutdown_connections 2023-07-21T07:36:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.074+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3564329240 wait complete. 2023-07-21T07:36:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.075+0000 7fda3f3ef700 1 Processor -- start 2023-07-21T07:36:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.075+0000 7fda3f3ef700 1 -- start start 2023-07-21T07:36:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3f3ef700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda38066210 0x7fda3813dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3f3ef700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fda380abdb0 0x7fda38151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3f3ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda3814fa10 0x7fda380bf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3f3ef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda381eacc0 con 0x7fda3814fa10 2023-07-21T07:36:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3f3ef700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3813db30 con 0x7fda38066210 2023-07-21T07:36:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3f3ef700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda381ed4d0 con 0x7fda380abdb0 2023-07-21T07:36:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3d98c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda3814fa10 0x7fda380bf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3d98c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda3814fa10 0x7fda380bf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35526/0 (socket says 172.21.15.6:35526) 2023-07-21T07:36:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3d98c700 1 -- 172.21.15.6:0/3243002381 learned_addr learned my addr 172.21.15.6:0/3243002381 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3c98a700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fda380abdb0 0x7fda38151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3d18b700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda38066210 0x7fda3813dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3d98c700 1 -- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fda380abdb0 msgr2=0x7fda38151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3d98c700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fda380abdb0 0x7fda38151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3d98c700 1 -- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda38066210 msgr2=0x7fda3813dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3d98c700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda38066210 0x7fda3813dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3d98c700 1 -- 172.21.15.6:0/3243002381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda30009b30 con 0x7fda3814fa10 2023-07-21T07:36:14.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3d18b700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda38066210 0x7fda3813dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:14.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.076+0000 7fda3d98c700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda3814fa10 0x7fda380bf4b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fda3806de90 tx=0x7fda30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.077+0000 7fda2dffb700 1 -- 172.21.15.6:0/3243002381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300092e0 con 0x7fda3814fa10 2023-07-21T07:36:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.077+0000 7fda2dffb700 1 -- 172.21.15.6:0/3243002381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda300099b0 con 0x7fda3814fa10 2023-07-21T07:36:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.077+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3243002381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda381ed7b0 con 0x7fda3814fa10 2023-07-21T07:36:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.077+0000 7fda2dffb700 1 -- 172.21.15.6:0/3243002381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3001c680 con 0x7fda3814fa10 2023-07-21T07:36:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.077+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3243002381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda381edd70 con 0x7fda3814fa10 2023-07-21T07:36:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.078+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3243002381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda381edf90 con 0x7fda3814fa10 2023-07-21T07:36:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.078+0000 7fda2dffb700 1 -- 172.21.15.6:0/3243002381 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda3001c7e0 con 0x7fda3814fa10 2023-07-21T07:36:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.079+0000 7fda2dffb700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fda1c06ace0 0x7fda1c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.079+0000 7fda2dffb700 1 -- 172.21.15.6:0/3243002381 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fda3008b1d0 con 0x7fda3814fa10 2023-07-21T07:36:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.079+0000 7fda3d18b700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fda1c06ace0 0x7fda1c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.079+0000 7fda3d18b700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fda1c06ace0 0x7fda1c06d1a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fda38147b30 tx=0x7fda34008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.083+0000 7fda2dffb700 1 -- 172.21.15.6:0/3243002381 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fda30056210 con 0x7fda3814fa10 2023-07-21T07:36:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.325+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3243002381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda38074500 con 0x7fda3814fa10 2023-07-21T07:36:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.326+0000 7fda2dffb700 1 -- 172.21.15.6:0/3243002381 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4664 (secure 0 0 0) 0x7fda30059830 con 0x7fda3814fa10 2023-07-21T07:36:14.380 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:14.380 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1808819585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1808819585},{"type":"v1","addr":"172.21.15.6:6834","nonce":1808819585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/422116109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":422116109},{"type":"v1","addr":"172.21.15.86:6836","nonce":422116109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2436536706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2436536706},{"type":"v1","addr":"172.21.15.6:6835","nonce":2436536706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:45.299013+0000","modified":"2023-07-21T07:35:48.891082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.86:6837/3328348149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3328348149},{"type":"v1","addr":"172.21.15.86:6837","nonce":3328348149}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T07:36:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.328+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fda1c06ace0 msgr2=0x7fda1c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.328+0000 7fda3f3ef700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fda1c06ace0 0x7fda1c06d1a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fda38147b30 tx=0x7fda34008040 comp rx=0 tx=0).stop 2023-07-21T07:36:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.328+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3243002381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda3814fa10 msgr2=0x7fda380bf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.328+0000 7fda3f3ef700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda3814fa10 0x7fda380bf4b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fda3806de90 tx=0x7fda30004ad0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.328+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3243002381 shutdown_connections 2023-07-21T07:36:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.328+0000 7fda3f3ef700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fda1c06ace0 0x7fda1c06d1a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.328+0000 7fda3f3ef700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda3814fa10 0x7fda380bf4b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.328+0000 7fda3f3ef700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda38066210 0x7fda3813dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.328+0000 7fda3f3ef700 1 --2- 172.21.15.6:0/3243002381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fda380abdb0 0x7fda38151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.328+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3243002381 >> 172.21.15.6:0/3243002381 conn(0x7fda380c6140 msgr2=0x7fda38147bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.328+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3243002381 shutdown_connections 2023-07-21T07:36:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.328+0000 7fda3f3ef700 1 -- 172.21.15.6:0/3243002381 wait complete. 2023-07-21T07:36:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2023-07-21T07:36:14.394 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:36:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.465+0000 7f558145a700 1 Processor -- start 2023-07-21T07:36:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.465+0000 7f558145a700 1 -- start start 2023-07-21T07:36:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f558145a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f557c0c4c50 0x7f557c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f558145a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c155390 con 0x7f557c0c47d0 2023-07-21T07:36:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f558145a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c154780 con 0x7f557c151ac0 2023-07-21T07:36:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f558145a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557c0bd7b0 con 0x7f557c0c4c50 2023-07-21T07:36:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f557b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f557c0c4c50 0x7f557c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f557a7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f557c0c47d0 0x7f557c0c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43552/0 (socket says 172.21.15.6:43552) 2023-07-21T07:36:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f557a7fc700 1 -- 172.21.15.6:0/2980203385 learned_addr learned my addr 172.21.15.6:0/2980203385 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f557b7fe700 1 -- 172.21.15.6:0/2980203385 >> v1:172.21.15.86:6789/0 conn(0x7f557c151ac0 legacy=0x7f557c0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f557b7fe700 1 -- 172.21.15.6:0/2980203385 >> v1:172.21.15.6:6789/0 conn(0x7f557c0c47d0 legacy=0x7f557c0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f557b7fe700 1 -- 172.21.15.6:0/2980203385 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c154a60 con 0x7f557c0c4c50 2023-07-21T07:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f5579ffb700 1 -- 172.21.15.6:0/2980203385 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300833033 0 0) 0x7f557c155390 con 0x7f557c0c47d0 2023-07-21T07:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f557b7fe700 1 --2- 172.21.15.6:0/2980203385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f557c0c4c50 0x7f557c0c6ee0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5574009d90 tx=0x7f557400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aad9ad5ac6bb7e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f5579ffb700 1 -- 172.21.15.6:0/2980203385 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557400e070 con 0x7f557c0c4c50 2023-07-21T07:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f5579ffb700 1 -- 172.21.15.6:0/2980203385 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557400bb90 con 0x7f557c0c4c50 2023-07-21T07:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.466+0000 7f5579ffb700 1 -- 172.21.15.6:0/2980203385 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574003a20 con 0x7f557c0c4c50 2023-07-21T07:36:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.467+0000 7f558145a700 1 -- 172.21.15.6:0/2980203385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f557c0c4c50 msgr2=0x7f557c0c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.467+0000 7f558145a700 1 --2- 172.21.15.6:0/2980203385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f557c0c4c50 0x7f557c0c6ee0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5574009d90 tx=0x7f557400b330 comp rx=0 tx=0).stop 2023-07-21T07:36:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.467+0000 7f558145a700 1 -- 172.21.15.6:0/2980203385 shutdown_connections 2023-07-21T07:36:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.467+0000 7f558145a700 1 --2- 172.21.15.6:0/2980203385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f557c0c4c50 0x7f557c0c6ee0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.467+0000 7f558145a700 1 -- 172.21.15.6:0/2980203385 >> 172.21.15.6:0/2980203385 conn(0x7f557c0717c0 msgr2=0x7f557c071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.467+0000 7f558145a700 1 -- 172.21.15.6:0/2980203385 shutdown_connections 2023-07-21T07:36:14.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.467+0000 7f558145a700 1 -- 172.21.15.6:0/2980203385 wait complete. 2023-07-21T07:36:14.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.468+0000 7f558145a700 1 Processor -- start 2023-07-21T07:36:14.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.468+0000 7f558145a700 1 -- start start 2023-07-21T07:36:14.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f558145a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c0c47d0 0x7f557c14d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f558145a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0c4c50 0x7f557c0bd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f558145a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f557c151ac0 0x7f557c149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f558145a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0c2ed0 con 0x7f557c151ac0 2023-07-21T07:36:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f558145a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0be1d0 con 0x7f557c0c47d0 2023-07-21T07:36:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f558145a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0c23f0 con 0x7f557c0c4c50 2023-07-21T07:36:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f557b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f557c151ac0 0x7f557c149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f557b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f557c151ac0 0x7f557c149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35540/0 (socket says 172.21.15.6:35540) 2023-07-21T07:36:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f557b7fe700 1 -- 172.21.15.6:0/1278985054 learned_addr learned my addr 172.21.15.6:0/1278985054 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f557a7fc700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0c4c50 0x7f557c0bd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f557affd700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c0c47d0 0x7f557c14d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f557b7fe700 1 -- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0c4c50 msgr2=0x7f557c0bd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f557b7fe700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0c4c50 0x7f557c0bd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f557b7fe700 1 -- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c0c47d0 msgr2=0x7f557c14d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f557b7fe700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c0c47d0 0x7f557c14d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.469+0000 7f557b7fe700 1 -- 172.21.15.6:0/1278985054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5574009a70 con 0x7f557c151ac0 2023-07-21T07:36:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.470+0000 7f557b7fe700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f557c151ac0 0x7f557c149310 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f557c0c79d0 tx=0x7f5574004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.470+0000 7f55637fe700 1 -- 172.21.15.6:0/1278985054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574012630 con 0x7f557c151ac0 2023-07-21T07:36:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.470+0000 7f55637fe700 1 -- 172.21.15.6:0/1278985054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55740127b0 con 0x7f557c151ac0 2023-07-21T07:36:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.470+0000 7f558145a700 1 -- 172.21.15.6:0/1278985054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c0c26d0 con 0x7f557c151ac0 2023-07-21T07:36:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.470+0000 7f55637fe700 1 -- 172.21.15.6:0/1278985054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574012b60 con 0x7f557c151ac0 2023-07-21T07:36:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.470+0000 7f558145a700 1 -- 172.21.15.6:0/1278985054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c14dac0 con 0x7f557c151ac0 2023-07-21T07:36:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.471+0000 7f558145a700 1 -- 172.21.15.6:0/1278985054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557c0c2bf0 con 0x7f557c151ac0 2023-07-21T07:36:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.471+0000 7f55637fe700 1 -- 172.21.15.6:0/1278985054 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5574012cc0 con 0x7f557c151ac0 2023-07-21T07:36:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.472+0000 7f55637fe700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f556806ace0 0x7f556806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.472+0000 7f55637fe700 1 -- 172.21.15.6:0/1278985054 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f557408b8d0 con 0x7f557c151ac0 2023-07-21T07:36:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.472+0000 7f557affd700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f556806ace0 0x7f556806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.472+0000 7f557affd700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f556806ace0 0x7f556806d1a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f556c00a7d0 tx=0x7f556c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.476+0000 7f55637fe700 1 -- 172.21.15.6:0/1278985054 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f557c0c2bf0 con 0x7f557c151ac0 2023-07-21T07:36:14.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.717+0000 7f558145a700 1 -- 172.21.15.6:0/1278985054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f557c0c2bf0 con 0x7f557c151ac0 2023-07-21T07:36:14.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.717+0000 7f55637fe700 1 -- 172.21.15.6:0/1278985054 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4664 (secure 0 0 0) 0x7f557c0c2bf0 con 0x7f557c151ac0 2023-07-21T07:36:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:14.771 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1808819585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1808819585},{"type":"v1","addr":"172.21.15.6:6834","nonce":1808819585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/422116109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":422116109},{"type":"v1","addr":"172.21.15.86:6836","nonce":422116109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2436536706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2436536706},{"type":"v1","addr":"172.21.15.6:6835","nonce":2436536706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:35:45.299013+0000","modified":"2023-07-21T07:35:48.891082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.86:6837/3328348149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3328348149},{"type":"v1","addr":"172.21.15.86:6837","nonce":3328348149}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T07:36:14.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.719+0000 7f558145a700 1 -- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f556806ace0 msgr2=0x7f556806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.719+0000 7f558145a700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f556806ace0 0x7f556806d1a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f556c00a7d0 tx=0x7f556c008040 comp rx=0 tx=0).stop 2023-07-21T07:36:14.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.719+0000 7f558145a700 1 -- 172.21.15.6:0/1278985054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f557c151ac0 msgr2=0x7f557c149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.719+0000 7f558145a700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f557c151ac0 0x7f557c149310 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f557c0c79d0 tx=0x7f5574004ad0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.719+0000 7f558145a700 1 -- 172.21.15.6:0/1278985054 shutdown_connections 2023-07-21T07:36:14.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.719+0000 7f558145a700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f556806ace0 0x7f556806d1a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.719+0000 7f558145a700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f557c151ac0 0x7f557c149310 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.719+0000 7f558145a700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c0c47d0 0x7f557c14d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.719+0000 7f558145a700 1 --2- 172.21.15.6:0/1278985054 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0c4c50 0x7f557c0bd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.719+0000 7f558145a700 1 -- 172.21.15.6:0/1278985054 >> 172.21.15.6:0/1278985054 conn(0x7f557c0717c0 msgr2=0x7f557c071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.719+0000 7f558145a700 1 -- 172.21.15.6:0/1278985054 shutdown_connections 2023-07-21T07:36:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.719+0000 7f558145a700 1 -- 172.21.15.6:0/1278985054 wait complete. 2023-07-21T07:36:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2023-07-21T07:36:14.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.856+0000 7feb1919d700 1 Processor -- start 2023-07-21T07:36:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.857+0000 7feb1919d700 1 -- start start 2023-07-21T07:36:14.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.857+0000 7feb1919d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb1414f9a0 0x7feb141523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.857+0000 7feb1919d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb1406f620 0x7feb14156240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.857+0000 7feb1919d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb141528f0 con 0x7feb1414fd80 2023-07-21T07:36:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.857+0000 7feb1919d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb140c2a10 con 0x7feb1406f620 2023-07-21T07:36:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.857+0000 7feb1919d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb14155db0 con 0x7feb1414f9a0 2023-07-21T07:36:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.857+0000 7feb1259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb1406f620 0x7feb14156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.857+0000 7feb1359e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7feb1414fd80 0x7feb140c8080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43568/0 (socket says 172.21.15.6:43568) 2023-07-21T07:36:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.857+0000 7feb1359e700 1 -- 172.21.15.6:0/1582456645 learned_addr learned my addr 172.21.15.6:0/1582456645 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.857+0000 7feb1259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb1406f620 0x7feb14156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35546/0 (socket says 172.21.15.6:35546) 2023-07-21T07:36:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.858+0000 7feb12d9d700 1 --2- 172.21.15.6:0/1582456645 >> v2:172.21.15.86:3300/0 conn(0x7feb1414f9a0 0x7feb141523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.858+0000 7feb1259c700 1 -- 172.21.15.6:0/1582456645 >> v2:172.21.15.86:3300/0 conn(0x7feb1414f9a0 msgr2=0x7feb141523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.858+0000 7feb1259c700 1 --2- 172.21.15.6:0/1582456645 >> v2:172.21.15.86:3300/0 conn(0x7feb1414f9a0 0x7feb141523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.858+0000 7feb1259c700 1 -- 172.21.15.6:0/1582456645 >> v1:172.21.15.6:6789/0 conn(0x7feb1414fd80 legacy=0x7feb140c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.858+0000 7feb1259c700 1 -- 172.21.15.6:0/1582456645 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1406e8c0 con 0x7feb1406f620 2023-07-21T07:36:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.858+0000 7feb11d9b700 1 -- 172.21.15.6:0/1582456645 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614925852 0 0) 0x7feb141528f0 con 0x7feb1414fd80 2023-07-21T07:36:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.858+0000 7feb1259c700 1 --2- 172.21.15.6:0/1582456645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1406f620 0x7feb14156240 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7feb14071c50 tx=0x7feb08009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b71cfad0c2de996 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.858+0000 7feb11d9b700 1 -- 172.21.15.6:0/1582456645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08011830 con 0x7feb1406f620 2023-07-21T07:36:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.858+0000 7feb11d9b700 1 -- 172.21.15.6:0/1582456645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb08011990 con 0x7feb1406f620 2023-07-21T07:36:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.858+0000 7feb11d9b700 1 -- 172.21.15.6:0/1582456645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08011d20 con 0x7feb1406f620 2023-07-21T07:36:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.859+0000 7feb1919d700 1 -- 172.21.15.6:0/1582456645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1406f620 msgr2=0x7feb14156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.859+0000 7feb1919d700 1 --2- 172.21.15.6:0/1582456645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1406f620 0x7feb14156240 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7feb14071c50 tx=0x7feb08009b20 comp rx=0 tx=0).stop 2023-07-21T07:36:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.859+0000 7feb1919d700 1 -- 172.21.15.6:0/1582456645 shutdown_connections 2023-07-21T07:36:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.859+0000 7feb1919d700 1 --2- 172.21.15.6:0/1582456645 >> v2:172.21.15.86:3300/0 conn(0x7feb1414f9a0 0x7feb141523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.859+0000 7feb1919d700 1 --2- 172.21.15.6:0/1582456645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1406f620 0x7feb14156240 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.859+0000 7feb1919d700 1 -- 172.21.15.6:0/1582456645 >> 172.21.15.6:0/1582456645 conn(0x7feb1406a480 msgr2=0x7feb1406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.859+0000 7feb1919d700 1 -- 172.21.15.6:0/1582456645 shutdown_connections 2023-07-21T07:36:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.859+0000 7feb1919d700 1 -- 172.21.15.6:0/1582456645 wait complete. 2023-07-21T07:36:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.860+0000 7feb1919d700 1 Processor -- start 2023-07-21T07:36:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.860+0000 7feb1919d700 1 -- start start 2023-07-21T07:36:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1919d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb1406f620 0x7feb140a7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1919d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb1414f9a0 0x7feb140a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1919d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1414fd80 0x7feb141490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1919d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140a7d60 con 0x7feb1414fd80 2023-07-21T07:36:14.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1919d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb141509c0 con 0x7feb1406f620 2023-07-21T07:36:14.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1919d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1406bdc0 con 0x7feb1414f9a0 2023-07-21T07:36:14.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1414fd80 0x7feb141490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1414fd80 0x7feb141490b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35554/0 (socket says 172.21.15.6:35554) 2023-07-21T07:36:14.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1359e700 1 -- 172.21.15.6:0/1799763861 learned_addr learned my addr 172.21.15.6:0/1799763861 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:14.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1259c700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb1414f9a0 0x7feb140a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1359e700 1 -- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb1414f9a0 msgr2=0x7feb140a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1359e700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb1414f9a0 0x7feb140a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb12d9d700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb1406f620 0x7feb140a7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1359e700 1 -- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb1406f620 msgr2=0x7feb140a7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:14.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1359e700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb1406f620 0x7feb140a7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:14.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1359e700 1 -- 172.21.15.6:0/1799763861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb080094a0 con 0x7feb1414fd80 2023-07-21T07:36:14.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.861+0000 7feb1359e700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1414fd80 0x7feb141490b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00cbd0 tx=0x7feb0c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:14.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.862+0000 7feafb7fe700 1 -- 172.21.15.6:0/1799763861 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c00ab70 con 0x7feb1414fd80 2023-07-21T07:36:14.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.862+0000 7feafb7fe700 1 -- 172.21.15.6:0/1799763861 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c00acf0 con 0x7feb1414fd80 2023-07-21T07:36:14.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.862+0000 7feafb7fe700 1 -- 172.21.15.6:0/1799763861 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c007310 con 0x7feb1414fd80 2023-07-21T07:36:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.862+0000 7feb1919d700 1 -- 172.21.15.6:0/1799763861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb140a7280 con 0x7feb1414fd80 2023-07-21T07:36:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.862+0000 7feb1919d700 1 -- 172.21.15.6:0/1799763861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb140a7540 con 0x7feb1414fd80 2023-07-21T07:36:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.863+0000 7feb1919d700 1 -- 172.21.15.6:0/1799763861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb14074500 con 0x7feb1414fd80 2023-07-21T07:36:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.863+0000 7feafb7fe700 1 -- 172.21.15.6:0/1799763861 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb0c007470 con 0x7feb1414fd80 2023-07-21T07:36:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.864+0000 7feafb7fe700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7feb0006ace0 0x7feb0006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.864+0000 7feafb7fe700 1 -- 172.21.15.6:0/1799763861 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6152+0+0 (secure 0 0 0) 0x7feb0c088f70 con 0x7feb1414fd80 2023-07-21T07:36:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.864+0000 7feb12d9d700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7feb0006ace0 0x7feb0006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.864+0000 7feb12d9d700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7feb0006ace0 0x7feb0006d1a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7feb04009ab0 tx=0x7feb04008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:14.868+0000 7feafb7fe700 1 -- 172.21.15.6:0/1799763861 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feb0c0bb310 con 0x7feb1414fd80 2023-07-21T07:36:15.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.068+0000 7feb1919d700 1 -- 172.21.15.6:0/1799763861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb1406bf00 con 0x7feb1414fd80 2023-07-21T07:36:15.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.069+0000 7feafb7fe700 1 -- 172.21.15.6:0/1799763861 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18372 (secure 0 0 0) 0x7feb0c018090 con 0x7feb1414fd80 2023-07-21T07:36:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:15.123 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:36:11.401679+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:35:43.052752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:35:44.270260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/459917011":"2023-07-22T07:36:08.389211+0000","172.21.15.6:6832/459917011":"2023-07-22T07:36:08.389211+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:15.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.071+0000 7feb1919d700 1 -- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7feb0006ace0 msgr2=0x7feb0006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:15.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.071+0000 7feb1919d700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7feb0006ace0 0x7feb0006d1a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7feb04009ab0 tx=0x7feb04008040 comp rx=0 tx=0).stop 2023-07-21T07:36:15.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.071+0000 7feb1919d700 1 -- 172.21.15.6:0/1799763861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1414fd80 msgr2=0x7feb141490b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:15.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.071+0000 7feb1919d700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1414fd80 0x7feb141490b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00cbd0 tx=0x7feb0c00cf90 comp rx=0 tx=0).stop 2023-07-21T07:36:15.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.071+0000 7feb1919d700 1 -- 172.21.15.6:0/1799763861 shutdown_connections 2023-07-21T07:36:15.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.071+0000 7feb1919d700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7feb0006ace0 0x7feb0006d1a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.071+0000 7feb1919d700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1414fd80 0x7feb141490b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.071+0000 7feb1919d700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb1406f620 0x7feb140a7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.071+0000 7feb1919d700 1 --2- 172.21.15.6:0/1799763861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb1414f9a0 0x7feb140a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.071+0000 7feb1919d700 1 -- 172.21.15.6:0/1799763861 >> 172.21.15.6:0/1799763861 conn(0x7feb1406a480 msgr2=0x7feb140bcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:15.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.071+0000 7feb1919d700 1 -- 172.21.15.6:0/1799763861 shutdown_connections 2023-07-21T07:36:15.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.072+0000 7feb1919d700 1 -- 172.21.15.6:0/1799763861 wait complete. 2023-07-21T07:36:15.137 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-07-21T07:36:15.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.211+0000 7f42c0228700 1 Processor -- start 2023-07-21T07:36:15.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.211+0000 7f42c0228700 1 -- start start 2023-07-21T07:36:15.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.211+0000 7f42c0228700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42b8155370 0x7f42b80c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.211+0000 7f42c0228700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42b80c48b0 0x7f42b806a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.211+0000 7f42c0228700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b80c54e0 con 0x7f42b806a640 2023-07-21T07:36:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42c0228700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b8154710 con 0x7f42b8155370 2023-07-21T07:36:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42c0228700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b80c5730 con 0x7f42b80c48b0 2023-07-21T07:36:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42bdfc4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42b8155370 0x7f42b80c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42be7c5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f42b806a640 0x7f42b8158020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43580/0 (socket says 172.21.15.6:43580) 2023-07-21T07:36:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42bdfc4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42b8155370 0x7f42b80c4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35558/0 (socket says 172.21.15.6:35558) 2023-07-21T07:36:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42be7c5700 1 -- 172.21.15.6:0/4017657508 learned_addr learned my addr 172.21.15.6:0/4017657508 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42bd7c3700 1 --2- 172.21.15.6:0/4017657508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42b80c48b0 0x7f42b806a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42bdfc4700 1 -- 172.21.15.6:0/4017657508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42b80c48b0 msgr2=0x7f42b806a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42bdfc4700 1 --2- 172.21.15.6:0/4017657508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42b80c48b0 0x7f42b806a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42bdfc4700 1 -- 172.21.15.6:0/4017657508 >> v1:172.21.15.6:6789/0 conn(0x7f42b806a640 legacy=0x7f42b8158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42bdfc4700 1 -- 172.21.15.6:0/4017657508 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b80c5a10 con 0x7f42b8155370 2023-07-21T07:36:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42bcfc2700 1 -- 172.21.15.6:0/4017657508 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472790168 0 0) 0x7f42b80c54e0 con 0x7f42b806a640 2023-07-21T07:36:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42bdfc4700 1 --2- 172.21.15.6:0/4017657508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8155370 0x7f42b80c4ed0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009840 tx=0x7f42b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76945b08317bfc6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42bcfc2700 1 -- 172.21.15.6:0/4017657508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4011830 con 0x7f42b8155370 2023-07-21T07:36:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42bcfc2700 1 -- 172.21.15.6:0/4017657508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b4011990 con 0x7f42b8155370 2023-07-21T07:36:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.212+0000 7f42bcfc2700 1 -- 172.21.15.6:0/4017657508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4011d20 con 0x7f42b8155370 2023-07-21T07:36:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.213+0000 7f42c0228700 1 -- 172.21.15.6:0/4017657508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8155370 msgr2=0x7f42b80c4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.213+0000 7f42c0228700 1 --2- 172.21.15.6:0/4017657508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8155370 0x7f42b80c4ed0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009840 tx=0x7f42b4009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.213+0000 7f42c0228700 1 -- 172.21.15.6:0/4017657508 shutdown_connections 2023-07-21T07:36:15.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.213+0000 7f42c0228700 1 --2- 172.21.15.6:0/4017657508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8155370 0x7f42b80c4ed0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.213+0000 7f42c0228700 1 --2- 172.21.15.6:0/4017657508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42b80c48b0 0x7f42b806a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.213+0000 7f42c0228700 1 -- 172.21.15.6:0/4017657508 >> 172.21.15.6:0/4017657508 conn(0x7f42b806b1a0 msgr2=0x7f42b806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:15.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.213+0000 7f42c0228700 1 -- 172.21.15.6:0/4017657508 shutdown_connections 2023-07-21T07:36:15.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.213+0000 7f42c0228700 1 -- 172.21.15.6:0/4017657508 wait complete. 2023-07-21T07:36:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.214+0000 7f42c0228700 1 Processor -- start 2023-07-21T07:36:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.214+0000 7f42c0228700 1 -- start start 2023-07-21T07:36:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42c0228700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b806a640 0x7f42b814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42c0228700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42b80c48b0 0x7f42b81ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42c0228700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8155370 0x7f42b81ed480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42c0228700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b81ed9c0 con 0x7f42b8155370 2023-07-21T07:36:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42c0228700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b80c0480 con 0x7f42b806a640 2023-07-21T07:36:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42c0228700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b80bff00 con 0x7f42b80c48b0 2023-07-21T07:36:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42be7c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8155370 0x7f42b81ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42be7c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8155370 0x7f42b81ed480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35566/0 (socket says 172.21.15.6:35566) 2023-07-21T07:36:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42be7c5700 1 -- 172.21.15.6:0/3317820469 learned_addr learned my addr 172.21.15.6:0/3317820469 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42bd7c3700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42b80c48b0 0x7f42b81ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42bdfc4700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b806a640 0x7f42b814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42be7c5700 1 -- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42b80c48b0 msgr2=0x7f42b81ecf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42be7c5700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42b80c48b0 0x7f42b81ecf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42be7c5700 1 -- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b806a640 msgr2=0x7f42b814ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42be7c5700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b806a640 0x7f42b814ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.215+0000 7f42be7c5700 1 -- 172.21.15.6:0/3317820469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b40094a0 con 0x7f42b8155370 2023-07-21T07:36:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.216+0000 7f42be7c5700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8155370 0x7f42b81ed480 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f42b0002230 tx=0x7f42b000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.216+0000 7f42aa7fc700 1 -- 172.21.15.6:0/3317820469 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b000aa60 con 0x7f42b8155370 2023-07-21T07:36:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.216+0000 7f42aa7fc700 1 -- 172.21.15.6:0/3317820469 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b000abe0 con 0x7f42b8155370 2023-07-21T07:36:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.216+0000 7f42c0228700 1 -- 172.21.15.6:0/3317820469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b80c01a0 con 0x7f42b8155370 2023-07-21T07:36:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.216+0000 7f42aa7fc700 1 -- 172.21.15.6:0/3317820469 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b00070d0 con 0x7f42b8155370 2023-07-21T07:36:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.216+0000 7f42c0228700 1 -- 172.21.15.6:0/3317820469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b80a65f0 con 0x7f42b8155370 2023-07-21T07:36:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.217+0000 7f42c0228700 1 -- 172.21.15.6:0/3317820469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b80be490 con 0x7f42b8155370 2023-07-21T07:36:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.217+0000 7f42aa7fc700 1 -- 172.21.15.6:0/3317820469 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f42b0007230 con 0x7f42b8155370 2023-07-21T07:36:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.218+0000 7f42aa7fc700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f429c06ace0 0x7f429c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.218+0000 7f42aa7fc700 1 -- 172.21.15.6:0/3317820469 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f42b00891e0 con 0x7f42b8155370 2023-07-21T07:36:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.218+0000 7f42bdfc4700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f429c06ace0 0x7f429c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.218+0000 7f42bdfc4700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f429c06ace0 0x7f429c06d1a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f42b40090b0 tx=0x7f42b401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.222+0000 7f42aa7fc700 1 -- 172.21.15.6:0/3317820469 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f42b80be490 con 0x7f42b8155370 2023-07-21T07:36:15.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.466+0000 7f42c0228700 1 -- 172.21.15.6:0/3317820469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f42b80be870 con 0x7f42b8155370 2023-07-21T07:36:15.520 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T07:36:15.467+0000 7f4b07aab700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T07:36:15.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.470+0000 7f42aa7fc700 1 -- 172.21.15.6:0/3317820469 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 163+0+0 (secure 0 0 0) 0x7f42b80be870 con 0x7f42b8155370 2023-07-21T07:36:15.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.472+0000 7f42c0228700 1 -- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f429c06ace0 msgr2=0x7f429c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:15.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.472+0000 7f42c0228700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f429c06ace0 0x7f429c06d1a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f42b40090b0 tx=0x7f42b401c040 comp rx=0 tx=0).stop 2023-07-21T07:36:15.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.472+0000 7f42c0228700 1 -- 172.21.15.6:0/3317820469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8155370 msgr2=0x7f42b81ed480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:15.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.472+0000 7f42c0228700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8155370 0x7f42b81ed480 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f42b0002230 tx=0x7f42b000cf50 comp rx=0 tx=0).stop 2023-07-21T07:36:15.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.472+0000 7f42c0228700 1 -- 172.21.15.6:0/3317820469 shutdown_connections 2023-07-21T07:36:15.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.472+0000 7f42c0228700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f429c06ace0 0x7f429c06d1a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.472+0000 7f42c0228700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b8155370 0x7f42b81ed480 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.472+0000 7f42c0228700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42b806a640 0x7f42b814ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.473+0000 7f42c0228700 1 --2- 172.21.15.6:0/3317820469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42b80c48b0 0x7f42b81ecf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.473+0000 7f42c0228700 1 -- 172.21.15.6:0/3317820469 >> 172.21.15.6:0/3317820469 conn(0x7f42b806b1a0 msgr2=0x7f42b806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:15.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.473+0000 7f42c0228700 1 -- 172.21.15.6:0/3317820469 shutdown_connections 2023-07-21T07:36:15.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.473+0000 7f42c0228700 1 -- 172.21.15.6:0/3317820469 wait complete. 2023-07-21T07:36:15.528 INFO:tasks.ceph.mds.b.smithi086.stderr: -3194> 2023-07-21T07:35:50.515+0000 7f3415ad5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T07:36:15.528 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T07:36:15.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-07-21T07:36:15.557 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2023-07-21T07:36:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.612+0000 7f37d9ada700 1 Processor -- start 2023-07-21T07:36:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.612+0000 7f37d9ada700 1 -- start start 2023-07-21T07:36:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.613+0000 7f37d9ada700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37d406d680 0x7f37d41561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.613+0000 7f37d9ada700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f37d414f4b0 0x7f37d414f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.613+0000 7f37d9ada700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d4155d20 con 0x7f37d40abee0 2023-07-21T07:36:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.613+0000 7f37d9ada700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d40c5de0 con 0x7f37d414f4b0 2023-07-21T07:36:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.613+0000 7f37d9ada700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d406db00 con 0x7f37d406d680 2023-07-21T07:36:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.613+0000 7f37d3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f37d414f4b0 0x7f37d414f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.613+0000 7f37d3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f37d414f4b0 0x7f37d414f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35574/0 (socket says 172.21.15.6:35574) 2023-07-21T07:36:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.613+0000 7f37d3fff700 1 -- 172.21.15.6:0/3661491878 learned_addr learned my addr 172.21.15.6:0/3661491878 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.613+0000 7f37d2ffd700 1 --2- 172.21.15.6:0/3661491878 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37d406d680 0x7f37d41561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.613+0000 7f37d3fff700 1 -- 172.21.15.6:0/3661491878 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37d406d680 msgr2=0x7f37d41561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.613+0000 7f37d3fff700 1 --2- 172.21.15.6:0/3661491878 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37d406d680 0x7f37d41561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.613+0000 7f37d3fff700 1 -- 172.21.15.6:0/3661491878 >> v1:172.21.15.86:6789/0 conn(0x7f37d40abee0 legacy=0x7f37d4152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d3fff700 1 -- 172.21.15.6:0/3661491878 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d40c4ce0 con 0x7f37d414f4b0 2023-07-21T07:36:15.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d2ffd700 1 --2- 172.21.15.6:0/3661491878 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37d406d680 0x7f37d41561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:15.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d3fff700 1 --2- 172.21.15.6:0/3661491878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37d414f4b0 0x7f37d414f940 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f37cc009e50 tx=0x7f37cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29d0e02df940836 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d27fc700 1 -- 172.21.15.6:0/3661491878 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00e070 con 0x7f37d414f4b0 2023-07-21T07:36:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d27fc700 1 -- 172.21.15.6:0/3661491878 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37cc00b9c0 con 0x7f37d414f4b0 2023-07-21T07:36:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d27fc700 1 -- 172.21.15.6:0/3661491878 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00bd70 con 0x7f37d414f4b0 2023-07-21T07:36:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d9ada700 1 -- 172.21.15.6:0/3661491878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37d414f4b0 msgr2=0x7f37d414f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d9ada700 1 --2- 172.21.15.6:0/3661491878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37d414f4b0 0x7f37d414f940 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f37cc009e50 tx=0x7f37cc00b330 comp rx=0 tx=0).stop 2023-07-21T07:36:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d9ada700 1 -- 172.21.15.6:0/3661491878 shutdown_connections 2023-07-21T07:36:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d9ada700 1 --2- 172.21.15.6:0/3661491878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37d414f4b0 0x7f37d414f940 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d9ada700 1 --2- 172.21.15.6:0/3661491878 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37d406d680 0x7f37d41561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d9ada700 1 -- 172.21.15.6:0/3661491878 >> 172.21.15.6:0/3661491878 conn(0x7f37d40a8660 msgr2=0x7f37d40a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:15.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d9ada700 1 -- 172.21.15.6:0/3661491878 shutdown_connections 2023-07-21T07:36:15.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.614+0000 7f37d9ada700 1 -- 172.21.15.6:0/3661491878 wait complete. 2023-07-21T07:36:15.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.616+0000 7f37d9ada700 1 Processor -- start 2023-07-21T07:36:15.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.616+0000 7f37d9ada700 1 -- start start 2023-07-21T07:36:15.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.616+0000 7f37d9ada700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37d406d680 0x7f37d40ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.616+0000 7f37d9ada700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d40abee0 0x7f37d41ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.616+0000 7f37d9ada700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37d414f4b0 0x7f37d41deb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.616+0000 7f37d9ada700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40a5440 con 0x7f37d406d680 2023-07-21T07:36:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.616+0000 7f37d9ada700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40aad30 con 0x7f37d40abee0 2023-07-21T07:36:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.616+0000 7f37d9ada700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40a9c00 con 0x7f37d414f4b0 2023-07-21T07:36:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37d37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37d406d680 0x7f37d40ab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37d37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37d406d680 0x7f37d40ab6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35576/0 (socket says 172.21.15.6:35576) 2023-07-21T07:36:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37d37fe700 1 -- 172.21.15.6:0/1411015643 learned_addr learned my addr 172.21.15.6:0/1411015643 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37d2ffd700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d40abee0 0x7f37d41ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37d3fff700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37d414f4b0 0x7f37d41deb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37d37fe700 1 -- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37d414f4b0 msgr2=0x7f37d41deb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37d37fe700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37d414f4b0 0x7f37d41deb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37d37fe700 1 -- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d40abee0 msgr2=0x7f37d41ecc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:15.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37d37fe700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d40abee0 0x7f37d41ecc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:15.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37d37fe700 1 -- 172.21.15.6:0/1411015643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37cc009b30 con 0x7f37d406d680 2023-07-21T07:36:15.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37d37fe700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37d406d680 0x7f37d40ab6f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f37c400c4e0 tx=0x7f37c400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:15.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37cbfff700 1 -- 172.21.15.6:0/1411015643 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c40052d0 con 0x7f37d406d680 2023-07-21T07:36:15.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37cbfff700 1 -- 172.21.15.6:0/1411015643 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c4005430 con 0x7f37d406d680 2023-07-21T07:36:15.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37d9ada700 1 -- 172.21.15.6:0/1411015643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d41ed5a0 con 0x7f37d406d680 2023-07-21T07:36:15.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37cbfff700 1 -- 172.21.15.6:0/1411015643 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c40038c0 con 0x7f37d406d680 2023-07-21T07:36:15.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.617+0000 7f37d9ada700 1 -- 172.21.15.6:0/1411015643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d41ed880 con 0x7f37d406d680 2023-07-21T07:36:15.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.618+0000 7f37d9ada700 1 -- 172.21.15.6:0/1411015643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d4074500 con 0x7f37d406d680 2023-07-21T07:36:15.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.619+0000 7f37cbfff700 1 -- 172.21.15.6:0/1411015643 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f37c4003a20 con 0x7f37d406d680 2023-07-21T07:36:15.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.619+0000 7f37cbfff700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f37b406ad10 0x7f37b406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:15.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.619+0000 7f37cbfff700 1 -- 172.21.15.6:0/1411015643 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f37c4088840 con 0x7f37d406d680 2023-07-21T07:36:15.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.619+0000 7f37d2ffd700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f37b406ad10 0x7f37b406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:15.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.620+0000 7f37d2ffd700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f37b406ad10 0x7f37b406d1d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f37d4154cd0 tx=0x7f37bc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:15.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.624+0000 7f37cbfff700 1 -- 172.21.15.6:0/1411015643 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f37c40538d0 con 0x7f37d406d680 2023-07-21T07:36:15.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:15.873+0000 7f37d9ada700 1 -- 172.21.15.6:0/1411015643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f37d40a8440 con 0x7f37d406d680 2023-07-21T07:36:16.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.471+0000 7f37cbfff700 1 -- 172.21.15.6:0/1411015643 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 105+0+0 (secure 0 0 0) 0x7f37c4056ef0 con 0x7f37d406d680 2023-07-21T07:36:16.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.474+0000 7f37d9ada700 1 -- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f37b406ad10 msgr2=0x7f37b406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.474+0000 7f37d9ada700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f37b406ad10 0x7f37b406d1d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f37d4154cd0 tx=0x7f37bc008040 comp rx=0 tx=0).stop 2023-07-21T07:36:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.474+0000 7f37d9ada700 1 -- 172.21.15.6:0/1411015643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37d406d680 msgr2=0x7f37d40ab6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.474+0000 7f37d9ada700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37d406d680 0x7f37d40ab6f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f37c400c4e0 tx=0x7f37c400c7f0 comp rx=0 tx=0).stop 2023-07-21T07:36:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.474+0000 7f37d9ada700 1 -- 172.21.15.6:0/1411015643 shutdown_connections 2023-07-21T07:36:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.474+0000 7f37d9ada700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f37b406ad10 0x7f37b406d1d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.474+0000 7f37d9ada700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37d414f4b0 0x7f37d41deb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.474+0000 7f37d9ada700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37d406d680 0x7f37d40ab6f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.474+0000 7f37d9ada700 1 --2- 172.21.15.6:0/1411015643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37d40abee0 0x7f37d41ecc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.474+0000 7f37d9ada700 1 -- 172.21.15.6:0/1411015643 >> 172.21.15.6:0/1411015643 conn(0x7f37d40a8660 msgr2=0x7f37d41524b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.474+0000 7f37d9ada700 1 -- 172.21.15.6:0/1411015643 shutdown_connections 2023-07-21T07:36:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.474+0000 7f37d9ada700 1 -- 172.21.15.6:0/1411015643 wait complete. 2023-07-21T07:36:16.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-07-21T07:36:16.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.624+0000 7fbf2d86f700 1 Processor -- start 2023-07-21T07:36:16.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.624+0000 7fbf2d86f700 1 -- start start 2023-07-21T07:36:16.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.625+0000 7fbf2d86f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf28151b20 0x7fbf2806a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:16.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.625+0000 7fbf2d86f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf280ba0d0 0x7fbf28154690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.625+0000 7fbf2d86f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf280c2270 con 0x7fbf280c3450 2023-07-21T07:36:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.625+0000 7fbf2d86f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf28151f00 con 0x7fbf280ba0d0 2023-07-21T07:36:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.625+0000 7fbf2d86f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280c24a0 con 0x7fbf28151b20 2023-07-21T07:36:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.625+0000 7fbf267fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf280ba0d0 0x7fbf28154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.625+0000 7fbf267fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf280ba0d0 0x7fbf28154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35586/0 (socket says 172.21.15.6:35586) 2023-07-21T07:36:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.625+0000 7fbf267fc700 1 -- 172.21.15.6:0/2449109749 learned_addr learned my addr 172.21.15.6:0/2449109749 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:16.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.625+0000 7fbf277fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbf280c3450 0x7fbf28154bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43608/0 (socket says 172.21.15.6:43608) 2023-07-21T07:36:16.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.625+0000 7fbf26ffd700 1 --2- 172.21.15.6:0/2449109749 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf28151b20 0x7fbf2806a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:16.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.625+0000 7fbf267fc700 1 -- 172.21.15.6:0/2449109749 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf28151b20 msgr2=0x7fbf2806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:16.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.625+0000 7fbf267fc700 1 --2- 172.21.15.6:0/2449109749 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf28151b20 0x7fbf2806a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:16.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.625+0000 7fbf267fc700 1 -- 172.21.15.6:0/2449109749 >> v1:172.21.15.6:6789/0 conn(0x7fbf280c3450 legacy=0x7fbf28154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:16.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.626+0000 7fbf267fc700 1 -- 172.21.15.6:0/2449109749 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf280c2780 con 0x7fbf280ba0d0 2023-07-21T07:36:16.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.626+0000 7fbf25ffb700 1 -- 172.21.15.6:0/2449109749 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562499953 0 0) 0x7fbf280c2270 con 0x7fbf280c3450 2023-07-21T07:36:16.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.626+0000 7fbf267fc700 1 --2- 172.21.15.6:0/2449109749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf280ba0d0 0x7fbf28154690 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbf180098f0 tx=0x7fbf18009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87b800c463cd7a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:16.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.626+0000 7fbf25ffb700 1 -- 172.21.15.6:0/2449109749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1800b8a0 con 0x7fbf280ba0d0 2023-07-21T07:36:16.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.626+0000 7fbf25ffb700 1 -- 172.21.15.6:0/2449109749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1800ba00 con 0x7fbf280ba0d0 2023-07-21T07:36:16.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.626+0000 7fbf25ffb700 1 -- 172.21.15.6:0/2449109749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1800bd90 con 0x7fbf280ba0d0 2023-07-21T07:36:16.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.626+0000 7fbf2d86f700 1 -- 172.21.15.6:0/2449109749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf280ba0d0 msgr2=0x7fbf28154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:16.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.626+0000 7fbf2d86f700 1 --2- 172.21.15.6:0/2449109749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf280ba0d0 0x7fbf28154690 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbf180098f0 tx=0x7fbf18009c00 comp rx=0 tx=0).stop 2023-07-21T07:36:16.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.626+0000 7fbf2d86f700 1 -- 172.21.15.6:0/2449109749 shutdown_connections 2023-07-21T07:36:16.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.626+0000 7fbf2d86f700 1 --2- 172.21.15.6:0/2449109749 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf28151b20 0x7fbf2806a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:16.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.626+0000 7fbf2d86f700 1 --2- 172.21.15.6:0/2449109749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf280ba0d0 0x7fbf28154690 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:16.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.626+0000 7fbf2d86f700 1 -- 172.21.15.6:0/2449109749 >> 172.21.15.6:0/2449109749 conn(0x7fbf280a85f0 msgr2=0x7fbf280a8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:16.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.626+0000 7fbf2d86f700 1 -- 172.21.15.6:0/2449109749 shutdown_connections 2023-07-21T07:36:16.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.627+0000 7fbf2d86f700 1 -- 172.21.15.6:0/2449109749 wait complete. 2023-07-21T07:36:16.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.628+0000 7fbf2d86f700 1 Processor -- start 2023-07-21T07:36:16.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.628+0000 7fbf2d86f700 1 -- start start 2023-07-21T07:36:16.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.628+0000 7fbf2d86f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf280ba0d0 0x7fbf280ba8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:16.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.628+0000 7fbf2d86f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf280c3450 0x7fbf280badf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:16.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.628+0000 7fbf2d86f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf28151b20 0x7fbf280a7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:16.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.628+0000 7fbf2d86f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280bb330 con 0x7fbf28151b20 2023-07-21T07:36:16.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.628+0000 7fbf2d86f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280bb540 con 0x7fbf280ba0d0 2023-07-21T07:36:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.628+0000 7fbf2d86f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf281ede20 con 0x7fbf280c3450 2023-07-21T07:36:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf28151b20 0x7fbf280a7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf28151b20 0x7fbf280a7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35594/0 (socket says 172.21.15.6:35594) 2023-07-21T07:36:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf277fe700 1 -- 172.21.15.6:0/1395997789 learned_addr learned my addr 172.21.15.6:0/1395997789 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf267fc700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf280c3450 0x7fbf280badf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf26ffd700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf280ba0d0 0x7fbf280ba8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf277fe700 1 -- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf280c3450 msgr2=0x7fbf280badf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:16.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf277fe700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf280c3450 0x7fbf280badf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf277fe700 1 -- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf280ba0d0 msgr2=0x7fbf280ba8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf277fe700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf280ba0d0 0x7fbf280ba8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf277fe700 1 -- 172.21.15.6:0/1395997789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf18009550 con 0x7fbf28151b20 2023-07-21T07:36:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf26ffd700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf280ba0d0 0x7fbf280ba8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf277fe700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf28151b20 0x7fbf280a7100 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbf20002230 tx=0x7fbf2000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf0ffff700 1 -- 172.21.15.6:0/1395997789 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2000ab70 con 0x7fbf28151b20 2023-07-21T07:36:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf0ffff700 1 -- 172.21.15.6:0/1395997789 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2000acf0 con 0x7fbf28151b20 2023-07-21T07:36:16.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf2d86f700 1 -- 172.21.15.6:0/1395997789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf281566e0 con 0x7fbf28151b20 2023-07-21T07:36:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf0ffff700 1 -- 172.21.15.6:0/1395997789 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20007310 con 0x7fbf28151b20 2023-07-21T07:36:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.629+0000 7fbf2d86f700 1 -- 172.21.15.6:0/1395997789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf28156ca0 con 0x7fbf28151b20 2023-07-21T07:36:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.630+0000 7fbf2d86f700 1 -- 172.21.15.6:0/1395997789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf28074500 con 0x7fbf28151b20 2023-07-21T07:36:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.631+0000 7fbf0ffff700 1 -- 172.21.15.6:0/1395997789 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf20007470 con 0x7fbf28151b20 2023-07-21T07:36:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.631+0000 7fbf0ffff700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbf1406ace0 0x7fbf1406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.631+0000 7fbf0ffff700 1 -- 172.21.15.6:0/1395997789 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fbf20089300 con 0x7fbf28151b20 2023-07-21T07:36:16.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.631+0000 7fbf26ffd700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbf1406ace0 0x7fbf1406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.632+0000 7fbf26ffd700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbf1406ace0 0x7fbf1406d1a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c007a50 tx=0x7fbf1c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:16.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.636+0000 7fbf0ffff700 1 -- 172.21.15.6:0/1395997789 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbf20054390 con 0x7fbf28151b20 2023-07-21T07:36:16.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:16.834+0000 7fbf2d86f700 1 -- 172.21.15.6:0/1395997789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbf280c6360 con 0x7fbf28151b20 2023-07-21T07:36:17.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.477+0000 7fbf0ffff700 1 -- 172.21.15.6:0/1395997789 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v45) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbf2000ae60 con 0x7fbf28151b20 2023-07-21T07:36:17.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.481+0000 7fbf2d86f700 1 -- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbf1406ace0 msgr2=0x7fbf1406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:17.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.481+0000 7fbf2d86f700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbf1406ace0 0x7fbf1406d1a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c007a50 tx=0x7fbf1c008040 comp rx=0 tx=0).stop 2023-07-21T07:36:17.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.481+0000 7fbf2d86f700 1 -- 172.21.15.6:0/1395997789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf28151b20 msgr2=0x7fbf280a7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:17.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.481+0000 7fbf2d86f700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf28151b20 0x7fbf280a7100 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbf20002230 tx=0x7fbf2000cf50 comp rx=0 tx=0).stop 2023-07-21T07:36:17.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.481+0000 7fbf2d86f700 1 -- 172.21.15.6:0/1395997789 shutdown_connections 2023-07-21T07:36:17.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.481+0000 7fbf2d86f700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbf1406ace0 0x7fbf1406d1a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:17.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.481+0000 7fbf2d86f700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf28151b20 0x7fbf280a7100 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:17.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.481+0000 7fbf2d86f700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf280ba0d0 0x7fbf280ba8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:17.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.481+0000 7fbf2d86f700 1 --2- 172.21.15.6:0/1395997789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf280c3450 0x7fbf280badf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:17.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.481+0000 7fbf2d86f700 1 -- 172.21.15.6:0/1395997789 >> 172.21.15.6:0/1395997789 conn(0x7fbf280a85f0 msgr2=0x7fbf280c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:17.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.481+0000 7fbf2d86f700 1 -- 172.21.15.6:0/1395997789 shutdown_connections 2023-07-21T07:36:17.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.481+0000 7fbf2d86f700 1 -- 172.21.15.6:0/1395997789 wait complete. 2023-07-21T07:36:17.537 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs2_metadata' removed 2023-07-21T07:36:17.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-07-21T07:36:17.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.631+0000 7fd6bd267700 1 Processor -- start 2023-07-21T07:36:17.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.631+0000 7fd6bd267700 1 -- start start 2023-07-21T07:36:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.632+0000 7fd6bd267700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b8151b20 0x7fd6b806a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.632+0000 7fd6bd267700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b80c2270 con 0x7fd6b80c3450 2023-07-21T07:36:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.632+0000 7fd6bd267700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b8151f00 con 0x7fd6b80ba0d0 2023-07-21T07:36:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.632+0000 7fd6bd267700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80c24a0 con 0x7fd6b8151b20 2023-07-21T07:36:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.632+0000 7fd6b77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd6b80c3450 0x7fd6b8154da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43622/0 (socket says 172.21.15.6:43622) 2023-07-21T07:36:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.632+0000 7fd6b77fe700 1 -- 172.21.15.6:0/588418809 learned_addr learned my addr 172.21.15.6:0/588418809 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346780826 0 0) 0x7fd6b80c2270 con 0x7fd6b80c3450 2023-07-21T07:36:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b6ffd700 1 --2- 172.21.15.6:0/588418809 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b8151b20 0x7fd6b806a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6a00035b0 con 0x7fd6b80c3450 2023-07-21T07:36:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1738487580 0 0) 0x7fd6a00035b0 con 0x7fd6b80c3450 2023-07-21T07:36:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b8151b20 msgr2=0x7fd6b806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 --2- 172.21.15.6:0/588418809 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b8151b20 0x7fd6b806a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 >> v1:172.21.15.86:6789/0 conn(0x7fd6b80ba0d0 legacy=0x7fd6b8154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b80c2780 con 0x7fd6b80c3450 2023-07-21T07:36:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7fd6b00019f0 con 0x7fd6b80c3450 2023-07-21T07:36:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 >> v1:172.21.15.6:6789/0 conn(0x7fd6b80c3450 legacy=0x7fd6b8154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 --2- 172.21.15.6:0/588418809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a0003a30 0x7fd6a0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 --2- 172.21.15.6:0/588418809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0004850 0x7fd6a0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 --2- 172.21.15.6:0/588418809 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b8151b20 0x7fd6a0005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80c24a0 con 0x7fd6a0003a30 2023-07-21T07:36:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a000bb40 con 0x7fd6a0004850 2023-07-21T07:36:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a000bd00 con 0x7fd6b8151b20 2023-07-21T07:36:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b6ffd700 1 --2- 172.21.15.6:0/588418809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a0003a30 0x7fd6a0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b77fe700 1 --2- 172.21.15.6:0/588418809 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b8151b20 0x7fd6a0005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b67fc700 1 --2- 172.21.15.6:0/588418809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0004850 0x7fd6a0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b6ffd700 1 -- 172.21.15.6:0/588418809 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b8151b20 msgr2=0x7fd6a0005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b6ffd700 1 --2- 172.21.15.6:0/588418809 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b8151b20 0x7fd6a0005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b6ffd700 1 -- 172.21.15.6:0/588418809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0004850 msgr2=0x7fd6a0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b6ffd700 1 --2- 172.21.15.6:0/588418809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0004850 0x7fd6a0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.633+0000 7fd6b6ffd700 1 -- 172.21.15.6:0/588418809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a00035b0 con 0x7fd6a0003a30 2023-07-21T07:36:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.634+0000 7fd6b6ffd700 1 --2- 172.21.15.6:0/588418809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a0003a30 0x7fd6a0003e50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009b60 tx=0x7fd6a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1d4257856a5d6b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.634+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00e6c0 con 0x7fd6a0003a30 2023-07-21T07:36:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.634+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac00e820 con 0x7fd6a0003a30 2023-07-21T07:36:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.634+0000 7fd6b5ffb700 1 -- 172.21.15.6:0/588418809 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00eb90 con 0x7fd6a0003a30 2023-07-21T07:36:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.634+0000 7fd6bd267700 1 -- 172.21.15.6:0/588418809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a0003a30 msgr2=0x7fd6a0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.634+0000 7fd6bd267700 1 --2- 172.21.15.6:0/588418809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6a0003a30 0x7fd6a0003e50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009b60 tx=0x7fd6a0005880 comp rx=0 tx=0).stop 2023-07-21T07:36:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.634+0000 7fd6b77fe700 1 -- 172.21.15.6:0/588418809 reap_dead start 2023-07-21T07:36:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.634+0000 7fd6bd267700 1 -- 172.21.15.6:0/588418809 shutdown_connections 2023-07-21T07:36:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.634+0000 7fd6bd267700 1 -- 172.21.15.6:0/588418809 >> 172.21.15.6:0/588418809 conn(0x7fd6b80a85f0 msgr2=0x7fd6b80a8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.634+0000 7fd6bd267700 1 -- 172.21.15.6:0/588418809 shutdown_connections 2023-07-21T07:36:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.634+0000 7fd6bd267700 1 -- 172.21.15.6:0/588418809 wait complete. 2023-07-21T07:36:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.636+0000 7fd6bd267700 1 Processor -- start 2023-07-21T07:36:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.636+0000 7fd6bd267700 1 -- start start 2023-07-21T07:36:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6bd267700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0003a30 0x7fd6b81ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6bd267700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b814f5d0 0x7fd6b814fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6bd267700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b80bc940 0x7fd6b80bcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6bd267700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80badc0 con 0x7fd6b814f5d0 2023-07-21T07:36:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6bd267700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8156270 con 0x7fd6a0003a30 2023-07-21T07:36:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6bd267700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8155f20 con 0x7fd6b80bc940 2023-07-21T07:36:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6b67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b814f5d0 0x7fd6b814fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6b67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b814f5d0 0x7fd6b814fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35612/0 (socket says 172.21.15.6:35612) 2023-07-21T07:36:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6b67fc700 1 -- 172.21.15.6:0/486256417 learned_addr learned my addr 172.21.15.6:0/486256417 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6b77fe700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b80bc940 0x7fd6b80bcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6b6ffd700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0003a30 0x7fd6b81ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6b67fc700 1 -- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b80bc940 msgr2=0x7fd6b80bcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6b67fc700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b80bc940 0x7fd6b80bcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6b67fc700 1 -- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0003a30 msgr2=0x7fd6b81ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6b67fc700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0003a30 0x7fd6b81ed7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.637+0000 7fd6b67fc700 1 -- 172.21.15.6:0/486256417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b81edff0 con 0x7fd6b814f5d0 2023-07-21T07:36:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.638+0000 7fd6b67fc700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b814f5d0 0x7fd6b814fa50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800f640 tx=0x7fd6a800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.638+0000 7fd69f7fe700 1 -- 172.21.15.6:0/486256417 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a80052e0 con 0x7fd6b814f5d0 2023-07-21T07:36:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.638+0000 7fd69f7fe700 1 -- 172.21.15.6:0/486256417 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a8005440 con 0x7fd6b814f5d0 2023-07-21T07:36:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.638+0000 7fd69f7fe700 1 -- 172.21.15.6:0/486256417 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a80038a0 con 0x7fd6b814f5d0 2023-07-21T07:36:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.638+0000 7fd6bd267700 1 -- 172.21.15.6:0/486256417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b8156690 con 0x7fd6b814f5d0 2023-07-21T07:36:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.638+0000 7fd6bd267700 1 -- 172.21.15.6:0/486256417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b81edcf0 con 0x7fd6b814f5d0 2023-07-21T07:36:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.639+0000 7fd6bd267700 1 -- 172.21.15.6:0/486256417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b80a8ef0 con 0x7fd6b814f5d0 2023-07-21T07:36:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.639+0000 7fd69f7fe700 1 -- 172.21.15.6:0/486256417 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6a8003a00 con 0x7fd6b814f5d0 2023-07-21T07:36:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.640+0000 7fd69f7fe700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd6a406ace0 0x7fd6a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.640+0000 7fd69f7fe700 1 -- 172.21.15.6:0/486256417 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5798+0+0 (secure 0 0 0) 0x7fd6a80890f0 con 0x7fd6b814f5d0 2023-07-21T07:36:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.640+0000 7fd6b6ffd700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd6a406ace0 0x7fd6a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.640+0000 7fd6b6ffd700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd6a406ace0 0x7fd6a406d1a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac000c00 tx=0x7fd6ac008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:17.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.644+0000 7fd69f7fe700 1 -- 172.21.15.6:0/486256417 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd6a8054290 con 0x7fd6b814f5d0 2023-07-21T07:36:17.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:17.842+0000 7fd6bd267700 1 -- 172.21.15.6:0/486256417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd6b8153340 con 0x7fd6b814f5d0 2023-07-21T07:36:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.492+0000 7fd69f7fe700 1 -- 172.21.15.6:0/486256417 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v46) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd6a801a310 con 0x7fd6b814f5d0 2023-07-21T07:36:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.496+0000 7fd6bd267700 1 -- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd6a406ace0 msgr2=0x7fd6a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.496+0000 7fd6bd267700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd6a406ace0 0x7fd6a406d1a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac000c00 tx=0x7fd6ac008030 comp rx=0 tx=0).stop 2023-07-21T07:36:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.496+0000 7fd6bd267700 1 -- 172.21.15.6:0/486256417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b814f5d0 msgr2=0x7fd6b814fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.496+0000 7fd6bd267700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b814f5d0 0x7fd6b814fa50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800f640 tx=0x7fd6a800fa00 comp rx=0 tx=0).stop 2023-07-21T07:36:18.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.497+0000 7fd6bd267700 1 -- 172.21.15.6:0/486256417 shutdown_connections 2023-07-21T07:36:18.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.497+0000 7fd6bd267700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd6a406ace0 0x7fd6a406d1a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.497+0000 7fd6bd267700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b80bc940 0x7fd6b80bcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.497+0000 7fd6bd267700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0003a30 0x7fd6b81ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.497+0000 7fd6bd267700 1 --2- 172.21.15.6:0/486256417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b814f5d0 0x7fd6b814fa50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.497+0000 7fd6bd267700 1 -- 172.21.15.6:0/486256417 >> 172.21.15.6:0/486256417 conn(0x7fd6b80a85f0 msgr2=0x7fd6b8152a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:18.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.497+0000 7fd6bd267700 1 -- 172.21.15.6:0/486256417 shutdown_connections 2023-07-21T07:36:18.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.497+0000 7fd6bd267700 1 -- 172.21.15.6:0/486256417 wait complete. 2023-07-21T07:36:18.552 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs2_data' removed 2023-07-21T07:36:18.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-21T07:36:18.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.643+0000 7f7b29a2b700 1 Processor -- start 2023-07-21T07:36:18.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.643+0000 7f7b29a2b700 1 -- start start 2023-07-21T07:36:18.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.644+0000 7f7b29a2b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b240c1860 0x7f7b24151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:18.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.644+0000 7f7b29a2b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b240c3f80 0x7f7b240c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:18.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.644+0000 7f7b29a2b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b241517c0 con 0x7f7b240c5260 2023-07-21T07:36:18.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.644+0000 7f7b29a2b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b240c4e50 con 0x7f7b240c1860 2023-07-21T07:36:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.644+0000 7f7b29a2b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b241519f0 con 0x7f7b240c3f80 2023-07-21T07:36:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.644+0000 7f7b22ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b240c1860 0x7f7b24151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.644+0000 7f7b22ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b240c1860 0x7f7b24151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35618/0 (socket says 172.21.15.6:35618) 2023-07-21T07:36:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.644+0000 7f7b22ffd700 1 -- 172.21.15.6:0/495515425 learned_addr learned my addr 172.21.15.6:0/495515425 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.644+0000 7f7b237fe700 1 --2- 172.21.15.6:0/495515425 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b240c3f80 0x7f7b240c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.644+0000 7f7b22ffd700 1 -- 172.21.15.6:0/495515425 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b240c3f80 msgr2=0x7f7b240c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.644+0000 7f7b22ffd700 1 --2- 172.21.15.6:0/495515425 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b240c3f80 0x7f7b240c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.644+0000 7f7b22ffd700 1 -- 172.21.15.6:0/495515425 >> v1:172.21.15.86:6789/0 conn(0x7f7b240c5260 legacy=0x7f7b2406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:18.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.644+0000 7f7b22ffd700 1 -- 172.21.15.6:0/495515425 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b24151cd0 con 0x7f7b240c1860 2023-07-21T07:36:18.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.645+0000 7f7b22ffd700 1 --2- 172.21.15.6:0/495515425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240c1860 0x7f7b24151280 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800bb90 tx=0x7f7b1800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ba13fe2a071729 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:18.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.645+0000 7f7b21ffb700 1 -- 172.21.15.6:0/495515425 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1800dd50 con 0x7f7b240c1860 2023-07-21T07:36:18.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.645+0000 7f7b21ffb700 1 -- 172.21.15.6:0/495515425 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18010470 con 0x7f7b240c1860 2023-07-21T07:36:18.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.645+0000 7f7b21ffb700 1 -- 172.21.15.6:0/495515425 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18010800 con 0x7f7b240c1860 2023-07-21T07:36:18.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.645+0000 7f7b29a2b700 1 -- 172.21.15.6:0/495515425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240c1860 msgr2=0x7f7b24151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.645+0000 7f7b29a2b700 1 --2- 172.21.15.6:0/495515425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240c1860 0x7f7b24151280 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800bb90 tx=0x7f7b1800bea0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.645+0000 7f7b29a2b700 1 -- 172.21.15.6:0/495515425 shutdown_connections 2023-07-21T07:36:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.645+0000 7f7b29a2b700 1 --2- 172.21.15.6:0/495515425 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b240c3f80 0x7f7b240c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.645+0000 7f7b29a2b700 1 --2- 172.21.15.6:0/495515425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240c1860 0x7f7b24151280 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.645+0000 7f7b29a2b700 1 -- 172.21.15.6:0/495515425 >> 172.21.15.6:0/495515425 conn(0x7f7b240a8660 msgr2=0x7f7b240a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.645+0000 7f7b29a2b700 1 -- 172.21.15.6:0/495515425 shutdown_connections 2023-07-21T07:36:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.645+0000 7f7b29a2b700 1 -- 172.21.15.6:0/495515425 wait complete. 2023-07-21T07:36:18.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.647+0000 7f7b29a2b700 1 Processor -- start 2023-07-21T07:36:18.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.647+0000 7f7b29a2b700 1 -- start start 2023-07-21T07:36:18.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.647+0000 7f7b29a2b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b240c1860 0x7f7b240bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:18.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.647+0000 7f7b29a2b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b240c3f80 0x7f7b240ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:18.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.647+0000 7f7b29a2b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240c5260 0x7f7b240c0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:18.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.647+0000 7f7b29a2b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b241e9840 con 0x7f7b240c5260 2023-07-21T07:36:18.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.647+0000 7f7b29a2b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b241ea810 con 0x7f7b240c3f80 2023-07-21T07:36:18.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.647+0000 7f7b29a2b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b241e9a50 con 0x7f7b240c1860 2023-07-21T07:36:18.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240c5260 0x7f7b240c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:18.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240c5260 0x7f7b240c0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35628/0 (socket says 172.21.15.6:35628) 2023-07-21T07:36:18.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b237fe700 1 -- 172.21.15.6:0/3873374601 learned_addr learned my addr 172.21.15.6:0/3873374601 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:18.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b22ffd700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b240c1860 0x7f7b240bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:18.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b227fc700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b240c3f80 0x7f7b240ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:18.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b237fe700 1 -- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b240c1860 msgr2=0x7f7b240bceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:18.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b237fe700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b240c1860 0x7f7b240bceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b237fe700 1 -- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b240c3f80 msgr2=0x7f7b240ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:18.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b237fe700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b240c3f80 0x7f7b240ab310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b237fe700 1 -- 172.21.15.6:0/3873374601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1800b7f0 con 0x7f7b240c5260 2023-07-21T07:36:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b237fe700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240c5260 0x7f7b240c0490 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c007e70 tx=0x7f7b1c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b0bfff700 1 -- 172.21.15.6:0/3873374601 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c00ed30 con 0x7f7b240c5260 2023-07-21T07:36:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b0bfff700 1 -- 172.21.15.6:0/3873374601 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c00eeb0 con 0x7f7b240c5260 2023-07-21T07:36:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b29a2b700 1 -- 172.21.15.6:0/3873374601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b241e9d30 con 0x7f7b240c5260 2023-07-21T07:36:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b0bfff700 1 -- 172.21.15.6:0/3873374601 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c014640 con 0x7f7b240c5260 2023-07-21T07:36:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.648+0000 7f7b29a2b700 1 -- 172.21.15.6:0/3873374601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b241ea2f0 con 0x7f7b240c5260 2023-07-21T07:36:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.649+0000 7f7b29a2b700 1 -- 172.21.15.6:0/3873374601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b24074500 con 0x7f7b240c5260 2023-07-21T07:36:18.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.650+0000 7f7b0bfff700 1 -- 172.21.15.6:0/3873374601 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b1c0147a0 con 0x7f7b240c5260 2023-07-21T07:36:18.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.650+0000 7f7b0bfff700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7b1006ad10 0x7f7b1006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:18.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.650+0000 7f7b0bfff700 1 -- 172.21.15.6:0/3873374601 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7b1c089720 con 0x7f7b240c5260 2023-07-21T07:36:18.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.650+0000 7f7b22ffd700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7b1006ad10 0x7f7b1006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:18.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.651+0000 7f7b22ffd700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7b1006ad10 0x7f7b1006d1d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800bee0 tx=0x7f7b18013000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:18.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.655+0000 7f7b0bfff700 1 -- 172.21.15.6:0/3873374601 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7b1c058590 con 0x7f7b240c5260 2023-07-21T07:36:18.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.855+0000 7f7b29a2b700 1 -- 172.21.15.6:0/3873374601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7b240c0000 con 0x7f7b240c5260 2023-07-21T07:36:18.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.859+0000 7f7b0bfff700 1 -- 172.21.15.6:0/3873374601 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7b1c058120 con 0x7f7b240c5260 2023-07-21T07:36:18.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.861+0000 7f7b29a2b700 1 -- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7b1006ad10 msgr2=0x7f7b1006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:18.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.861+0000 7f7b29a2b700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7b1006ad10 0x7f7b1006d1d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800bee0 tx=0x7f7b18013000 comp rx=0 tx=0).stop 2023-07-21T07:36:18.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.861+0000 7f7b29a2b700 1 -- 172.21.15.6:0/3873374601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240c5260 msgr2=0x7f7b240c0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:18.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.861+0000 7f7b29a2b700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240c5260 0x7f7b240c0490 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c007e70 tx=0x7f7b1c00e3c0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.861+0000 7f7b29a2b700 1 -- 172.21.15.6:0/3873374601 shutdown_connections 2023-07-21T07:36:18.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.861+0000 7f7b29a2b700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7b1006ad10 0x7f7b1006d1d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.861+0000 7f7b29a2b700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240c5260 0x7f7b240c0490 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.861+0000 7f7b29a2b700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b240c1860 0x7f7b240bceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.861+0000 7f7b29a2b700 1 --2- 172.21.15.6:0/3873374601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b240c3f80 0x7f7b240ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:18.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.861+0000 7f7b29a2b700 1 -- 172.21.15.6:0/3873374601 >> 172.21.15.6:0/3873374601 conn(0x7f7b240a8660 msgr2=0x7f7b24071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:18.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.861+0000 7f7b29a2b700 1 -- 172.21.15.6:0/3873374601 shutdown_connections 2023-07-21T07:36:18.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.861+0000 7f7b29a2b700 1 -- 172.21.15.6:0/3873374601 wait complete. 2023-07-21T07:36:18.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-07-21T07:36:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.999+0000 7f802c036700 1 Processor -- start 2023-07-21T07:36:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.999+0000 7f802c036700 1 -- start start 2023-07-21T07:36:19.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:18.999+0000 7f802c036700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f802414aee0 0x7f80240c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f802c036700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f80240c4d60 0x7f80240bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f802c036700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8024154ef0 con 0x7f802406e050 2023-07-21T07:36:19.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f802c036700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80241545c0 con 0x7f80240c4d60 2023-07-21T07:36:19.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f802c036700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80241548a0 con 0x7f802414aee0 2023-07-21T07:36:19.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f80295d1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f80240c4d60 0x7f80240bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:19.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f802a5d3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f802406e050 0x7f8024157aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43656/0 (socket says 172.21.15.6:43656) 2023-07-21T07:36:19.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f802a5d3700 1 -- 172.21.15.6:0/1338416821 learned_addr learned my addr 172.21.15.6:0/1338416821 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:19.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f8029dd2700 1 --2- 172.21.15.6:0/1338416821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f802414aee0 0x7f80240c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:19.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f8028dd0700 1 -- 172.21.15.6:0/1338416821 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992152041 0 0) 0x7f8024154ef0 con 0x7f802406e050 2023-07-21T07:36:19.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f8028dd0700 1 -- 172.21.15.6:0/1338416821 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80100035b0 con 0x7f802406e050 2023-07-21T07:36:19.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f80295d1700 1 -- 172.21.15.6:0/1338416821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f802414aee0 msgr2=0x7f80240c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:19.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f80295d1700 1 --2- 172.21.15.6:0/1338416821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f802414aee0 0x7f80240c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f80295d1700 1 -- 172.21.15.6:0/1338416821 >> v1:172.21.15.6:6789/0 conn(0x7f802406e050 legacy=0x7f8024157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:19.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f80295d1700 1 -- 172.21.15.6:0/1338416821 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8024154b80 con 0x7f80240c4d60 2023-07-21T07:36:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f80295d1700 1 --2- 172.21.15.6:0/1338416821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80240c4d60 0x7f80240bfc70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8014009840 tx=0x7f8014009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb7e98709ab4dc9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f8028dd0700 1 -- 172.21.15.6:0/1338416821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014011830 con 0x7f80240c4d60 2023-07-21T07:36:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f8028dd0700 1 -- 172.21.15.6:0/1338416821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8014011990 con 0x7f80240c4d60 2023-07-21T07:36:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.000+0000 7f8028dd0700 1 -- 172.21.15.6:0/1338416821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014011d20 con 0x7f80240c4d60 2023-07-21T07:36:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.001+0000 7f802c036700 1 -- 172.21.15.6:0/1338416821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80240c4d60 msgr2=0x7f80240bfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.001+0000 7f802c036700 1 --2- 172.21.15.6:0/1338416821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80240c4d60 0x7f80240bfc70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8014009840 tx=0x7f8014009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.001+0000 7f802c036700 1 -- 172.21.15.6:0/1338416821 shutdown_connections 2023-07-21T07:36:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.001+0000 7f802c036700 1 --2- 172.21.15.6:0/1338416821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f802414aee0 0x7f80240c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.001+0000 7f802c036700 1 --2- 172.21.15.6:0/1338416821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80240c4d60 0x7f80240bfc70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.001+0000 7f802c036700 1 -- 172.21.15.6:0/1338416821 >> 172.21.15.6:0/1338416821 conn(0x7f80240a85f0 msgr2=0x7f80240a89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.001+0000 7f802c036700 1 -- 172.21.15.6:0/1338416821 shutdown_connections 2023-07-21T07:36:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.001+0000 7f802c036700 1 -- 172.21.15.6:0/1338416821 wait complete. 2023-07-21T07:36:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.002+0000 7f802c036700 1 Processor -- start 2023-07-21T07:36:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.002+0000 7f802c036700 1 -- start start 2023-07-21T07:36:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f802c036700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f802406e050 0x7f80241e9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f802c036700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80240c4d60 0x7f8024070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f802c036700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f802414aee0 0x7f8024145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f802c036700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80241e9780 con 0x7f80240c4d60 2023-07-21T07:36:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f802c036700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80241dc520 con 0x7f802414aee0 2023-07-21T07:36:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f802c036700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80241ed2f0 con 0x7f802406e050 2023-07-21T07:36:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f80295d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80240c4d60 0x7f8024070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f80295d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80240c4d60 0x7f8024070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35640/0 (socket says 172.21.15.6:35640) 2023-07-21T07:36:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f80295d1700 1 -- 172.21.15.6:0/3665548210 learned_addr learned my addr 172.21.15.6:0/3665548210 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f80295d1700 1 -- 172.21.15.6:0/3665548210 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f802406e050 msgr2=0x7f80241e9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f80295d1700 1 --2- 172.21.15.6:0/3665548210 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f802406e050 0x7f80241e9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f802a5d3700 1 --2- 172.21.15.6:0/3665548210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f802414aee0 0x7f8024145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f80295d1700 1 -- 172.21.15.6:0/3665548210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f802414aee0 msgr2=0x7f8024145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f80295d1700 1 --2- 172.21.15.6:0/3665548210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f802414aee0 0x7f8024145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.003+0000 7f80295d1700 1 -- 172.21.15.6:0/3665548210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80140094a0 con 0x7f80240c4d60 2023-07-21T07:36:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.004+0000 7f80295d1700 1 --2- 172.21.15.6:0/3665548210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80240c4d60 0x7f8024070630 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8014000c00 tx=0x7f8014004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.004+0000 7f801a7fc700 1 -- 172.21.15.6:0/3665548210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140036a0 con 0x7f80240c4d60 2023-07-21T07:36:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.004+0000 7f801a7fc700 1 -- 172.21.15.6:0/3665548210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801401f070 con 0x7f80240c4d60 2023-07-21T07:36:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.004+0000 7f802c036700 1 -- 172.21.15.6:0/3665548210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80241ed5d0 con 0x7f80240c4d60 2023-07-21T07:36:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.004+0000 7f801a7fc700 1 -- 172.21.15.6:0/3665548210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014003a40 con 0x7f80240c4d60 2023-07-21T07:36:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.004+0000 7f802c036700 1 -- 172.21.15.6:0/3665548210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8024072640 con 0x7f80240c4d60 2023-07-21T07:36:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.005+0000 7f802c036700 1 -- 172.21.15.6:0/3665548210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80240727d0 con 0x7f80240c4d60 2023-07-21T07:36:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.005+0000 7f801a7fc700 1 -- 172.21.15.6:0/3665548210 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8014003ba0 con 0x7f80240c4d60 2023-07-21T07:36:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.006+0000 7f801a7fc700 1 --2- 172.21.15.6:0/3665548210 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f800806ace0 0x7f800806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.006+0000 7f801a7fc700 1 -- 172.21.15.6:0/3665548210 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f8014021070 con 0x7f80240c4d60 2023-07-21T07:36:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.006+0000 7f8029dd2700 1 --2- 172.21.15.6:0/3665548210 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f800806ace0 0x7f800806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.006+0000 7f8029dd2700 1 --2- 172.21.15.6:0/3665548210 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f800806ace0 0x7f800806d1a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8020006b20 tx=0x7f8020006ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.010+0000 7f801a7fc700 1 -- 172.21.15.6:0/3665548210 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8014055e10 con 0x7f80240c4d60 2023-07-21T07:36:19.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.297+0000 7f802c036700 1 -- 172.21.15.6:0/3665548210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f8024074500 con 0x7f80240c4d60 2023-07-21T07:36:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.493+0000 7f801a7fc700 1 -- 172.21.15.6:0/3665548210 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v118) v1 ==== 159+0+0 (secure 0 0 0) 0x7f80140150e0 con 0x7f80240c4d60 2023-07-21T07:36:19.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.495+0000 7f802c036700 1 -- 172.21.15.6:0/3665548210 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f800806ace0 msgr2=0x7f800806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.495+0000 7f802c036700 1 --2- 172.21.15.6:0/3665548210 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f800806ace0 0x7f800806d1a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8020006b20 tx=0x7f8020006ab0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.495+0000 7f802c036700 1 -- 172.21.15.6:0/3665548210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80240c4d60 msgr2=0x7f8024070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.495+0000 7f802c036700 1 --2- 172.21.15.6:0/3665548210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80240c4d60 0x7f8024070630 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8014000c00 tx=0x7f8014004750 comp rx=0 tx=0).stop 2023-07-21T07:36:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.495+0000 7f802c036700 1 -- 172.21.15.6:0/3665548210 shutdown_connections 2023-07-21T07:36:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.495+0000 7f802c036700 1 --2- 172.21.15.6:0/3665548210 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f800806ace0 0x7f800806d1a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.495+0000 7f802c036700 1 --2- 172.21.15.6:0/3665548210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f802414aee0 0x7f8024145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.495+0000 7f802c036700 1 --2- 172.21.15.6:0/3665548210 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f802406e050 0x7f80241e9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.495+0000 7f802c036700 1 --2- 172.21.15.6:0/3665548210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80240c4d60 0x7f8024070630 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.495+0000 7f802c036700 1 -- 172.21.15.6:0/3665548210 >> 172.21.15.6:0/3665548210 conn(0x7f80240a85f0 msgr2=0x7f8024148a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.495+0000 7f802c036700 1 -- 172.21.15.6:0/3665548210 shutdown_connections 2023-07-21T07:36:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.496+0000 7f802c036700 1 -- 172.21.15.6:0/3665548210 wait complete. 2023-07-21T07:36:19.561 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-07-21T07:36:19.562 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-07-21T07:36:19.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-07-21T07:36:19.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.634+0000 7fbaa1ec8700 1 Processor -- start 2023-07-21T07:36:19.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.634+0000 7fbaa1ec8700 1 -- start start 2023-07-21T07:36:19.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.634+0000 7fbaa1ec8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fba9c1516a0 0x7fba9c151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.634+0000 7fbaa1ec8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba9c157b00 0x7fba9c157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.634+0000 7fbaa1ec8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9c1584d0 con 0x7fba9c06a300 2023-07-21T07:36:19.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.634+0000 7fbaa1ec8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9c0c1e60 con 0x7fba9c1516a0 2023-07-21T07:36:19.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.634+0000 7fbaa1ec8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c0c3120 con 0x7fba9c157b00 2023-07-21T07:36:19.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fba9c06a300 0x7fba9c0c26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43666/0 (socket says 172.21.15.6:43666) 2023-07-21T07:36:19.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9b7fe700 1 -- 172.21.15.6:0/4137798045 learned_addr learned my addr 172.21.15.6:0/4137798045 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:19.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9bfff700 1 --2- 172.21.15.6:0/4137798045 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba9c157b00 0x7fba9c157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:19.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9affd700 1 --2- 172.21.15.6:0/4137798045 >> v2:172.21.15.86:3300/0 conn(0x7fba9c1516a0 0x7fba9c151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:19.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717131054 0 0) 0x7fba9c1584d0 con 0x7fba9c06a300 2023-07-21T07:36:19.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba880035b0 con 0x7fba9c06a300 2023-07-21T07:36:19.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 761853760 0 0) 0x7fba880035b0 con 0x7fba9c06a300 2023-07-21T07:36:19.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba9c157b00 msgr2=0x7fba9c157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:19.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 --2- 172.21.15.6:0/4137798045 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba9c157b00 0x7fba9c157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 >> v2:172.21.15.86:3300/0 conn(0x7fba9c1516a0 msgr2=0x7fba9c151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:19.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 --2- 172.21.15.6:0/4137798045 >> v2:172.21.15.86:3300/0 conn(0x7fba9c1516a0 0x7fba9c151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c154860 con 0x7fba9c06a300 2023-07-21T07:36:19.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7fba940019f0 con 0x7fba9c06a300 2023-07-21T07:36:19.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 >> v1:172.21.15.6:6789/0 conn(0x7fba9c06a300 legacy=0x7fba9c0c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:19.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 --2- 172.21.15.6:0/4137798045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba88003a00 0x7fba88003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 --2- 172.21.15.6:0/4137798045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004850 0x7fba88004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 --2- 172.21.15.6:0/4137798045 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba9c157b00 0x7fba88005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c0c3120 con 0x7fba88004850 2023-07-21T07:36:19.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8800ba10 con 0x7fba88003a00 2023-07-21T07:36:19.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8800bb50 con 0x7fba9c157b00 2023-07-21T07:36:19.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9affd700 1 --2- 172.21.15.6:0/4137798045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004850 0x7fba88004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:19.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9b7fe700 1 --2- 172.21.15.6:0/4137798045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba88003a00 0x7fba88003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:19.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.635+0000 7fba9bfff700 1 --2- 172.21.15.6:0/4137798045 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba9c157b00 0x7fba88005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:19.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fba9affd700 1 -- 172.21.15.6:0/4137798045 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba9c157b00 msgr2=0x7fba88005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:19.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fba9affd700 1 --2- 172.21.15.6:0/4137798045 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba9c157b00 0x7fba88005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fba9affd700 1 -- 172.21.15.6:0/4137798045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba88003a00 msgr2=0x7fba88003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:19.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fba9affd700 1 --2- 172.21.15.6:0/4137798045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba88003a00 0x7fba88003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fba9affd700 1 -- 172.21.15.6:0/4137798045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba880035b0 con 0x7fba88004850 2023-07-21T07:36:19.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fba9affd700 1 --2- 172.21.15.6:0/4137798045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004850 0x7fba88004cd0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fba84009b60 tx=0x7fba88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77d77ed1ea6b118 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:19.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8400e6c0 con 0x7fba88004850 2023-07-21T07:36:19.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8400e820 con 0x7fba88004850 2023-07-21T07:36:19.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fba9a7fc700 1 -- 172.21.15.6:0/4137798045 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8400eb90 con 0x7fba88004850 2023-07-21T07:36:19.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/4137798045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004850 msgr2=0x7fba88004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:19.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fbaa1ec8700 1 --2- 172.21.15.6:0/4137798045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004850 0x7fba88004cd0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fba84009b60 tx=0x7fba88005880 comp rx=0 tx=0).stop 2023-07-21T07:36:19.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fba9bfff700 1 -- 172.21.15.6:0/4137798045 reap_dead start 2023-07-21T07:36:19.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/4137798045 shutdown_connections 2023-07-21T07:36:19.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.636+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/4137798045 >> 172.21.15.6:0/4137798045 conn(0x7fba9c0a8c90 msgr2=0x7fba9c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:19.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.637+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/4137798045 shutdown_connections 2023-07-21T07:36:19.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.637+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/4137798045 wait complete. 2023-07-21T07:36:19.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.638+0000 7fbaa1ec8700 1 Processor -- start 2023-07-21T07:36:19.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.638+0000 7fbaa1ec8700 1 -- start start 2023-07-21T07:36:19.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.638+0000 7fbaa1ec8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004850 0x7fba9c14ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fbaa1ec8700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba9c1eaa30 0x7fba9c1eaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fbaa1ec8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba9c070500 0x7fba9c070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fbaa1ec8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c1e95c0 con 0x7fba88004850 2023-07-21T07:36:19.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fbaa1ec8700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c1eb3f0 con 0x7fba9c1eaa30 2023-07-21T07:36:19.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fbaa1ec8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c1ecb30 con 0x7fba9c070500 2023-07-21T07:36:19.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fba9b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004850 0x7fba9c14ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:19.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fba9b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004850 0x7fba9c14ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35658/0 (socket says 172.21.15.6:35658) 2023-07-21T07:36:19.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fba9b7fe700 1 -- 172.21.15.6:0/3513549037 learned_addr learned my addr 172.21.15.6:0/3513549037 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:19.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fba9b7fe700 1 -- 172.21.15.6:0/3513549037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba9c070500 msgr2=0x7fba9c070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:19.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fba9b7fe700 1 --2- 172.21.15.6:0/3513549037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba9c070500 0x7fba9c070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fba9b7fe700 1 -- 172.21.15.6:0/3513549037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba9c1eaa30 msgr2=0x7fba9c1eaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fba9b7fe700 1 --2- 172.21.15.6:0/3513549037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba9c1eaa30 0x7fba9c1eaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fba9b7fe700 1 -- 172.21.15.6:0/3513549037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c1e9840 con 0x7fba88004850 2023-07-21T07:36:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fba9b7fe700 1 --2- 172.21.15.6:0/3513549037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004850 0x7fba9c14ffd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fba94001e20 tx=0x7fba9400a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fba93fff700 1 -- 172.21.15.6:0/3513549037 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba940133f0 con 0x7fba88004850 2023-07-21T07:36:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fba93fff700 1 -- 172.21.15.6:0/3513549037 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba94013570 con 0x7fba88004850 2023-07-21T07:36:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/3513549037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9c1ecdf0 con 0x7fba88004850 2023-07-21T07:36:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fba93fff700 1 -- 172.21.15.6:0/3513549037 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94013920 con 0x7fba88004850 2023-07-21T07:36:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.639+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/3513549037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9c1ed3b0 con 0x7fba88004850 2023-07-21T07:36:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.640+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/3513549037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9c074500 con 0x7fba88004850 2023-07-21T07:36:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.641+0000 7fba93fff700 1 -- 172.21.15.6:0/3513549037 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba94013a80 con 0x7fba88004850 2023-07-21T07:36:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.641+0000 7fba93fff700 1 --2- 172.21.15.6:0/3513549037 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fba7c06ad10 0x7fba7c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.641+0000 7fba93fff700 1 -- 172.21.15.6:0/3513549037 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fba94089ff0 con 0x7fba88004850 2023-07-21T07:36:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.641+0000 7fba9affd700 1 --2- 172.21.15.6:0/3513549037 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fba7c06ad10 0x7fba7c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:19.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.642+0000 7fba9affd700 1 --2- 172.21.15.6:0/3513549037 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fba7c06ad10 0x7fba7c06d1d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0c65c0 tx=0x7fba84013000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:19.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.645+0000 7fba93fff700 1 -- 172.21.15.6:0/3513549037 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fba940553d0 con 0x7fba88004850 2023-07-21T07:36:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:19.926+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/3513549037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fba9c06d780 con 0x7fba88004850 2023-07-21T07:36:20.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.495+0000 7fba93fff700 1 -- 172.21.15.6:0/3513549037 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v119) v1 ==== 187+0+0 (secure 0 0 0) 0x7fba94017020 con 0x7fba88004850 2023-07-21T07:36:20.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.498+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/3513549037 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fba7c06ad10 msgr2=0x7fba7c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:20.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.498+0000 7fbaa1ec8700 1 --2- 172.21.15.6:0/3513549037 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fba7c06ad10 0x7fba7c06d1d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0c65c0 tx=0x7fba84013000 comp rx=0 tx=0).stop 2023-07-21T07:36:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.498+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/3513549037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004850 msgr2=0x7fba9c14ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.498+0000 7fbaa1ec8700 1 --2- 172.21.15.6:0/3513549037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004850 0x7fba9c14ffd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fba94001e20 tx=0x7fba9400a6f0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.498+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/3513549037 shutdown_connections 2023-07-21T07:36:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.498+0000 7fbaa1ec8700 1 --2- 172.21.15.6:0/3513549037 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fba7c06ad10 0x7fba7c06d1d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.498+0000 7fbaa1ec8700 1 --2- 172.21.15.6:0/3513549037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba9c070500 0x7fba9c070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.498+0000 7fbaa1ec8700 1 --2- 172.21.15.6:0/3513549037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004850 0x7fba9c14ffd0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.498+0000 7fbaa1ec8700 1 --2- 172.21.15.6:0/3513549037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba9c1eaa30 0x7fba9c1eaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.498+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/3513549037 >> 172.21.15.6:0/3513549037 conn(0x7fba9c0a8c90 msgr2=0x7fba9c0c7140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.498+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/3513549037 shutdown_connections 2023-07-21T07:36:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.499+0000 7fbaa1ec8700 1 -- 172.21.15.6:0/3513549037 wait complete. 2023-07-21T07:36:20.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:20.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.646+0000 7f9fbe272700 1 Processor -- start 2023-07-21T07:36:20.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.647+0000 7f9fbe272700 1 -- start start 2023-07-21T07:36:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.647+0000 7f9fbe272700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9fb814ed60 0x7f9fb80c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.647+0000 7f9fbe272700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb80ba440 con 0x7f9fb80c3750 2023-07-21T07:36:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.647+0000 7f9fbe272700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb80c15d0 con 0x7f9fb80c6170 2023-07-21T07:36:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.647+0000 7f9fbe272700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb814f140 con 0x7f9fb814ed60 2023-07-21T07:36:20.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.647+0000 7f9fb7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9fb80c3750 0x7f9fb814e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43686/0 (socket says 172.21.15.6:43686) 2023-07-21T07:36:20.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.647+0000 7f9fb7fff700 1 -- 172.21.15.6:0/538378682 learned_addr learned my addr 172.21.15.6:0/538378682 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:20.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fbc80f700 1 --2- 172.21.15.6:0/538378682 >> v2:172.21.15.86:3300/0 conn(0x7f9fb814ed60 0x7f9fb80c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:20.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460236021 0 0) 0x7f9fb80ba440 con 0x7f9fb80c3750 2023-07-21T07:36:20.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fa00035b0 con 0x7f9fb80c3750 2023-07-21T07:36:20.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4075924399 0 0) 0x7f9fa00035b0 con 0x7f9fb80c3750 2023-07-21T07:36:20.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 >> v2:172.21.15.86:3300/0 conn(0x7f9fb814ed60 msgr2=0x7f9fb80c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:20.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 --2- 172.21.15.6:0/538378682 >> v2:172.21.15.86:3300/0 conn(0x7f9fb814ed60 0x7f9fb80c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 >> v1:172.21.15.86:6789/0 conn(0x7f9fb80c6170 legacy=0x7f9fb8154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:20.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb80c18b0 con 0x7f9fb80c3750 2023-07-21T07:36:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f9fa8001670 con 0x7f9fb80c3750 2023-07-21T07:36:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 >> v1:172.21.15.6:6789/0 conn(0x7f9fb80c3750 legacy=0x7f9fb814e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 --2- 172.21.15.6:0/538378682 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa0003a00 0x7f9fa0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 --2- 172.21.15.6:0/538378682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0004850 0x7f9fa0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:20.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 --2- 172.21.15.6:0/538378682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fa0005210 0x7f9fa000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:20.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb814f140 con 0x7f9fa0005210 2023-07-21T07:36:20.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa000c0b0 con 0x7f9fa0004850 2023-07-21T07:36:20.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa000c270 con 0x7f9fa0003a00 2023-07-21T07:36:20.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fbc80f700 1 --2- 172.21.15.6:0/538378682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fa0005210 0x7f9fa000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:20.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb77fe700 1 --2- 172.21.15.6:0/538378682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0004850 0x7f9fa0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:20.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb7fff700 1 --2- 172.21.15.6:0/538378682 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa0003a00 0x7f9fa0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:20.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fbc80f700 1 -- 172.21.15.6:0/538378682 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa0003a00 msgr2=0x7f9fa0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:20.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fbc80f700 1 --2- 172.21.15.6:0/538378682 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa0003a00 0x7f9fa0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fbc80f700 1 -- 172.21.15.6:0/538378682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0004850 msgr2=0x7f9fa0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:20.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fbc80f700 1 --2- 172.21.15.6:0/538378682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0004850 0x7f9fa0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fbc80f700 1 -- 172.21.15.6:0/538378682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa00035b0 con 0x7f9fa0005210 2023-07-21T07:36:20.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fb77fe700 1 --2- 172.21.15.6:0/538378682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa0004850 0x7f9fa0004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:20.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.648+0000 7f9fbc80f700 1 -- 172.21.15.6:0/538378682 reap_dead start 2023-07-21T07:36:20.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.649+0000 7f9fbc80f700 1 --2- 172.21.15.6:0/538378682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fa0005210 0x7f9fa000ba10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009fc0 tx=0x7f9fa0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c504f9a481757b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:20.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.649+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0003a20 con 0x7f9fa0005210 2023-07-21T07:36:20.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.649+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb000f040 con 0x7f9fa0005210 2023-07-21T07:36:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.649+0000 7f9fb6ffd700 1 -- 172.21.15.6:0/538378682 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0003da0 con 0x7f9fa0005210 2023-07-21T07:36:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.649+0000 7f9fbe272700 1 -- 172.21.15.6:0/538378682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fa0005210 msgr2=0x7f9fa000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.649+0000 7f9fbe272700 1 --2- 172.21.15.6:0/538378682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fa0005210 0x7f9fa000ba10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009fc0 tx=0x7f9fa0005880 comp rx=0 tx=0).stop 2023-07-21T07:36:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.649+0000 7f9fbe272700 1 -- 172.21.15.6:0/538378682 shutdown_connections 2023-07-21T07:36:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.649+0000 7f9fbe272700 1 --2- 172.21.15.6:0/538378682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fa0005210 0x7f9fa000ba10 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.649+0000 7f9fbe272700 1 -- 172.21.15.6:0/538378682 >> 172.21.15.6:0/538378682 conn(0x7f9fb80a8c90 msgr2=0x7f9fb806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.649+0000 7f9fbe272700 1 -- 172.21.15.6:0/538378682 shutdown_connections 2023-07-21T07:36:20.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.649+0000 7f9fbe272700 1 -- 172.21.15.6:0/538378682 wait complete. 2023-07-21T07:36:20.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.650+0000 7f9fbe272700 1 Processor -- start 2023-07-21T07:36:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.651+0000 7f9fbe272700 1 -- start start 2023-07-21T07:36:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.651+0000 7f9fbe272700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa0005210 0x7f9fb8151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.651+0000 7f9fbe272700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fb80bdba0 0x7f9fb80bd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:20.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.651+0000 7f9fbe272700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fb80bd550 0x7f9fb80bc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:20.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.651+0000 7f9fbe272700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb814f770 con 0x7f9fb80bdba0 2023-07-21T07:36:20.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.651+0000 7f9fbe272700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb81e6610 con 0x7f9fb80bd550 2023-07-21T07:36:20.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.651+0000 7f9fbe272700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb81e6b40 con 0x7f9fa0005210 2023-07-21T07:36:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.651+0000 7f9fb77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fb80bdba0 0x7f9fb80bd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.651+0000 7f9fb77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fb80bdba0 0x7f9fb80bd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35680/0 (socket says 172.21.15.6:35680) 2023-07-21T07:36:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.651+0000 7f9fb77fe700 1 -- 172.21.15.6:0/3786169112 learned_addr learned my addr 172.21.15.6:0/3786169112 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:20.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.652+0000 7f9fbc80f700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fb80bd550 0x7f9fb80bc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:20.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.652+0000 7f9fb7fff700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa0005210 0x7f9fb8151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:20.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.652+0000 7f9fb77fe700 1 -- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa0005210 msgr2=0x7f9fb8151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:20.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.652+0000 7f9fb77fe700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa0005210 0x7f9fb8151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.652+0000 7f9fb77fe700 1 -- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fb80bd550 msgr2=0x7f9fb80bc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:20.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.652+0000 7f9fb77fe700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fb80bd550 0x7f9fb80bc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.652+0000 7f9fb77fe700 1 -- 172.21.15.6:0/3786169112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb814f3d0 con 0x7f9fb80bdba0 2023-07-21T07:36:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.652+0000 7f9fb77fe700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fb80bdba0 0x7f9fb80bd010 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00e550 tx=0x7f9fac00e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.652+0000 7f9fb4ff9700 1 -- 172.21.15.6:0/3786169112 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0052e0 con 0x7f9fb80bdba0 2023-07-21T07:36:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.652+0000 7f9fb4ff9700 1 -- 172.21.15.6:0/3786169112 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac005440 con 0x7f9fb80bdba0 2023-07-21T07:36:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.652+0000 7f9fbe272700 1 -- 172.21.15.6:0/3786169112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb81e6860 con 0x7f9fb80bdba0 2023-07-21T07:36:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.652+0000 7f9fb4ff9700 1 -- 172.21.15.6:0/3786169112 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0038a0 con 0x7f9fb80bdba0 2023-07-21T07:36:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.652+0000 7f9fbe272700 1 -- 172.21.15.6:0/3786169112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb80bc830 con 0x7f9fb80bdba0 2023-07-21T07:36:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.653+0000 7f9fbe272700 1 -- 172.21.15.6:0/3786169112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb814f8b0 con 0x7f9fb80bdba0 2023-07-21T07:36:20.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.654+0000 7f9fb4ff9700 1 -- 172.21.15.6:0/3786169112 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9fac003a00 con 0x7f9fb80bdba0 2023-07-21T07:36:20.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.654+0000 7f9fb4ff9700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9fa406ace0 0x7f9fa406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:20.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.654+0000 7f9fb4ff9700 1 -- 172.21.15.6:0/3786169112 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f9fac0887c0 con 0x7f9fb80bdba0 2023-07-21T07:36:20.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.654+0000 7f9fb7fff700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9fa406ace0 0x7f9fa406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:20.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.655+0000 7f9fb7fff700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9fa406ace0 0x7f9fa406d1a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8001050 tx=0x7f9fa8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:20.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.658+0000 7f9fb4ff9700 1 -- 172.21.15.6:0/3786169112 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9fb814f8b0 con 0x7f9fb80bdba0 2023-07-21T07:36:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.857+0000 7f9fbe272700 1 -- 172.21.15.6:0/3786169112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fb814f8b0 con 0x7f9fb80bdba0 2023-07-21T07:36:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.858+0000 7f9fb4ff9700 1 -- 172.21.15.6:0/3786169112 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14786 (secure 0 0 0) 0x7f9fb814f8b0 con 0x7f9fb80bdba0 2023-07-21T07:36:20.912 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:20.912 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":46,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:36:18.485387+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.86:6835/3328348149":"2023-07-22T07:36:15.468261+0000","172.21.15.86:6837/3328348149":"2023-07-22T07:36:15.468261+0000","172.21.15.6:6832/459917011":"2023-07-22T07:36:08.389211+0000","172.21.15.6:6835/459917011":"2023-07-22T07:36:08.389211+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:20.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.860+0000 7f9fbe272700 1 -- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9fa406ace0 msgr2=0x7f9fa406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:20.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.860+0000 7f9fbe272700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9fa406ace0 0x7f9fa406d1a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8001050 tx=0x7f9fa8009040 comp rx=0 tx=0).stop 2023-07-21T07:36:20.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.860+0000 7f9fbe272700 1 -- 172.21.15.6:0/3786169112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fb80bdba0 msgr2=0x7f9fb80bd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:20.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.860+0000 7f9fbe272700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fb80bdba0 0x7f9fb80bd010 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00e550 tx=0x7f9fac00e910 comp rx=0 tx=0).stop 2023-07-21T07:36:20.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.860+0000 7f9fbe272700 1 -- 172.21.15.6:0/3786169112 shutdown_connections 2023-07-21T07:36:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.860+0000 7f9fbe272700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9fa406ace0 0x7f9fa406d1a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.860+0000 7f9fbe272700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fb80bd550 0x7f9fb80bc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.860+0000 7f9fbe272700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa0005210 0x7f9fb8151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.860+0000 7f9fbe272700 1 --2- 172.21.15.6:0/3786169112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fb80bdba0 0x7f9fb80bd010 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.860+0000 7f9fbe272700 1 -- 172.21.15.6:0/3786169112 >> 172.21.15.6:0/3786169112 conn(0x7f9fb80a8c90 msgr2=0x7f9fb80a78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.860+0000 7f9fbe272700 1 -- 172.21.15.6:0/3786169112 shutdown_connections 2023-07-21T07:36:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:20.860+0000 7f9fbe272700 1 -- 172.21.15.6:0/3786169112 wait complete. 2023-07-21T07:36:20.926 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:36:20.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:36:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.001+0000 7f07916bc700 1 Processor -- start 2023-07-21T07:36:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.001+0000 7f07916bc700 1 -- start start 2023-07-21T07:36:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f07916bc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f078c151d80 0x7f078c0c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f07916bc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f078c0c7bd0 0x7f078c06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f07916bc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c154dc0 con 0x7f078c0bd360 2023-07-21T07:36:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f07916bc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c06ad50 con 0x7f078c151d80 2023-07-21T07:36:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f07916bc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c1552f0 con 0x7f078c0c7bd0 2023-07-21T07:36:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f078affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f078c151d80 0x7f078c0c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f078b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f078c0bd360 0x7f078c06b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43710/0 (socket says 172.21.15.6:43710) 2023-07-21T07:36:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f078b7fe700 1 -- 172.21.15.6:0/4231554367 learned_addr learned my addr 172.21.15.6:0/4231554367 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f078a7fc700 1 --2- 172.21.15.6:0/4231554367 >> v2:172.21.15.86:3300/0 conn(0x7f078c0c7bd0 0x7f078c06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f078affd700 1 -- 172.21.15.6:0/4231554367 >> v2:172.21.15.86:3300/0 conn(0x7f078c0c7bd0 msgr2=0x7f078c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f078affd700 1 --2- 172.21.15.6:0/4231554367 >> v2:172.21.15.86:3300/0 conn(0x7f078c0c7bd0 0x7f078c06b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f078affd700 1 -- 172.21.15.6:0/4231554367 >> v1:172.21.15.6:6789/0 conn(0x7f078c0bd360 legacy=0x7f078c06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f0789ffb700 1 -- 172.21.15.6:0/4231554367 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988293369 0 0) 0x7f078c154dc0 con 0x7f078c0bd360 2023-07-21T07:36:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f078affd700 1 -- 172.21.15.6:0/4231554367 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c155010 con 0x7f078c151d80 2023-07-21T07:36:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f078affd700 1 --2- 172.21.15.6:0/4231554367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c151d80 0x7f078c0c4650 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f078c06c320 tx=0x7f077c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818b15141dffa434 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f0789ffb700 1 -- 172.21.15.6:0/4231554367 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c011830 con 0x7f078c151d80 2023-07-21T07:36:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f0789ffb700 1 -- 172.21.15.6:0/4231554367 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c011990 con 0x7f078c151d80 2023-07-21T07:36:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.002+0000 7f0789ffb700 1 -- 172.21.15.6:0/4231554367 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c011d20 con 0x7f078c151d80 2023-07-21T07:36:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.003+0000 7f07916bc700 1 -- 172.21.15.6:0/4231554367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c151d80 msgr2=0x7f078c0c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.003+0000 7f07916bc700 1 --2- 172.21.15.6:0/4231554367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c151d80 0x7f078c0c4650 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f078c06c320 tx=0x7f077c009b20 comp rx=0 tx=0).stop 2023-07-21T07:36:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.003+0000 7f07916bc700 1 -- 172.21.15.6:0/4231554367 shutdown_connections 2023-07-21T07:36:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.003+0000 7f07916bc700 1 --2- 172.21.15.6:0/4231554367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c151d80 0x7f078c0c4650 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.003+0000 7f07916bc700 1 --2- 172.21.15.6:0/4231554367 >> v2:172.21.15.86:3300/0 conn(0x7f078c0c7bd0 0x7f078c06b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.003+0000 7f07916bc700 1 -- 172.21.15.6:0/4231554367 >> 172.21.15.6:0/4231554367 conn(0x7f078c0c9cd0 msgr2=0x7f078c0ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:21.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.003+0000 7f07916bc700 1 -- 172.21.15.6:0/4231554367 shutdown_connections 2023-07-21T07:36:21.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.003+0000 7f07916bc700 1 -- 172.21.15.6:0/4231554367 wait complete. 2023-07-21T07:36:21.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.004+0000 7f07916bc700 1 Processor -- start 2023-07-21T07:36:21.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.004+0000 7f07916bc700 1 -- start start 2023-07-21T07:36:21.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.005+0000 7f07916bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c0bd360 0x7f078c1ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.005+0000 7f07916bc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f078c0c7bd0 0x7f078c0be1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.005+0000 7f07916bc700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c151d80 0x7f078c0be710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.005+0000 7f07916bc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c158240 con 0x7f078c0bd360 2023-07-21T07:36:21.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.005+0000 7f07916bc700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c14e520 con 0x7f078c151d80 2023-07-21T07:36:21.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.005+0000 7f07916bc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c14e240 con 0x7f078c0c7bd0 2023-07-21T07:36:21.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.005+0000 7f078affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c0bd360 0x7f078c1ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.005+0000 7f078affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c0bd360 0x7f078c1ed300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35692/0 (socket says 172.21.15.6:35692) 2023-07-21T07:36:21.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.005+0000 7f078affd700 1 -- 172.21.15.6:0/3952258095 learned_addr learned my addr 172.21.15.6:0/3952258095 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:21.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.005+0000 7f078affd700 1 -- 172.21.15.6:0/3952258095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f078c0c7bd0 msgr2=0x7f078c0be1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.005+0000 7f078affd700 1 --2- 172.21.15.6:0/3952258095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f078c0c7bd0 0x7f078c0be1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.005+0000 7f078affd700 1 -- 172.21.15.6:0/3952258095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c151d80 msgr2=0x7f078c0be710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.005+0000 7f078affd700 1 --2- 172.21.15.6:0/3952258095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c151d80 0x7f078c0be710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.006+0000 7f078affd700 1 -- 172.21.15.6:0/3952258095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0094a0 con 0x7f078c0bd360 2023-07-21T07:36:21.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.006+0000 7f078affd700 1 --2- 172.21.15.6:0/3952258095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c0bd360 0x7f078c1ed300 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f077c009b60 tx=0x7f077c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:21.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.006+0000 7f07737fe700 1 -- 172.21.15.6:0/3952258095 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c0038a0 con 0x7f078c0bd360 2023-07-21T07:36:21.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.006+0000 7f07737fe700 1 -- 172.21.15.6:0/3952258095 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c01f070 con 0x7f078c0bd360 2023-07-21T07:36:21.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.006+0000 7f07916bc700 1 -- 172.21.15.6:0/3952258095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c1edb40 con 0x7f078c0bd360 2023-07-21T07:36:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.006+0000 7f07737fe700 1 -- 172.21.15.6:0/3952258095 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c003c20 con 0x7f078c0bd360 2023-07-21T07:36:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.006+0000 7f07916bc700 1 -- 172.21.15.6:0/3952258095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c1ed840 con 0x7f078c0bd360 2023-07-21T07:36:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.007+0000 7f07916bc700 1 -- 172.21.15.6:0/3952258095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c074500 con 0x7f078c0bd360 2023-07-21T07:36:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.007+0000 7f07737fe700 1 -- 172.21.15.6:0/3952258095 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f077c01a430 con 0x7f078c0bd360 2023-07-21T07:36:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.008+0000 7f07737fe700 1 --2- 172.21.15.6:0/3952258095 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f077806ace0 0x7f077806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.008+0000 7f07737fe700 1 -- 172.21.15.6:0/3952258095 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f077c021070 con 0x7f078c0bd360 2023-07-21T07:36:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.008+0000 7f078a7fc700 1 --2- 172.21.15.6:0/3952258095 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f077806ace0 0x7f077806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.008+0000 7f078a7fc700 1 --2- 172.21.15.6:0/3952258095 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f077806ace0 0x7f077806d1a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f078c0c0c00 tx=0x7f0780008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:21.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.012+0000 7f07737fe700 1 -- 172.21.15.6:0/3952258095 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f077c055f30 con 0x7f078c0bd360 2023-07-21T07:36:21.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.207+0000 7f07916bc700 1 -- 172.21.15.6:0/3952258095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f078c154c70 con 0x7f078c0bd360 2023-07-21T07:36:21.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.207+0000 7f07737fe700 1 -- 172.21.15.6:0/3952258095 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f077c0150a0 con 0x7f078c0bd360 2023-07-21T07:36:21.261 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:36:21.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.209+0000 7f07916bc700 1 -- 172.21.15.6:0/3952258095 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f077806ace0 msgr2=0x7f077806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.209+0000 7f07916bc700 1 --2- 172.21.15.6:0/3952258095 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f077806ace0 0x7f077806d1a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f078c0c0c00 tx=0x7f0780008040 comp rx=0 tx=0).stop 2023-07-21T07:36:21.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.209+0000 7f07916bc700 1 -- 172.21.15.6:0/3952258095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c0bd360 msgr2=0x7f078c1ed300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.209+0000 7f07916bc700 1 --2- 172.21.15.6:0/3952258095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c0bd360 0x7f078c1ed300 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f077c009b60 tx=0x7f077c004750 comp rx=0 tx=0).stop 2023-07-21T07:36:21.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.209+0000 7f07916bc700 1 -- 172.21.15.6:0/3952258095 shutdown_connections 2023-07-21T07:36:21.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.209+0000 7f07916bc700 1 --2- 172.21.15.6:0/3952258095 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f077806ace0 0x7f077806d1a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.209+0000 7f07916bc700 1 --2- 172.21.15.6:0/3952258095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c151d80 0x7f078c0be710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.209+0000 7f07916bc700 1 --2- 172.21.15.6:0/3952258095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c0bd360 0x7f078c1ed300 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.209+0000 7f07916bc700 1 --2- 172.21.15.6:0/3952258095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f078c0c7bd0 0x7f078c0be1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.209+0000 7f07916bc700 1 -- 172.21.15.6:0/3952258095 >> 172.21.15.6:0/3952258095 conn(0x7f078c0c9cd0 msgr2=0x7f078c0ae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.209+0000 7f07916bc700 1 -- 172.21.15.6:0/3952258095 shutdown_connections 2023-07-21T07:36:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.209+0000 7f07916bc700 1 -- 172.21.15.6:0/3952258095 wait complete. 2023-07-21T07:36:21.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:36:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.350+0000 7f04b7992700 1 Processor -- start 2023-07-21T07:36:21.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.350+0000 7f04b7992700 1 -- start start 2023-07-21T07:36:21.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b7992700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f04b00c5260 0x7f04b0151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b7992700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04b00c3f80 0x7f04b00c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b7992700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b01517c0 con 0x7f04b00c1860 2023-07-21T07:36:21.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b7992700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b00c4e50 con 0x7f04b00c5260 2023-07-21T07:36:21.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b7992700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b01519f0 con 0x7f04b00c3f80 2023-07-21T07:36:21.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b572e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f04b00c1860 0x7f04b006dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43720/0 (socket says 172.21.15.6:43720) 2023-07-21T07:36:21.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b572e700 1 -- 172.21.15.6:0/417076794 learned_addr learned my addr 172.21.15.6:0/417076794 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:21.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b5f2f700 1 --2- 172.21.15.6:0/417076794 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04b00c3f80 0x7f04b00c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b4f2d700 1 --2- 172.21.15.6:0/417076794 >> v2:172.21.15.86:3300/0 conn(0x7f04b00c5260 0x7f04b0151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04a7fff700 1 -- 172.21.15.6:0/417076794 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99522045 0 0) 0x7f04b01517c0 con 0x7f04b00c1860 2023-07-21T07:36:21.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04a7fff700 1 -- 172.21.15.6:0/417076794 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f049c0035b0 con 0x7f04b00c1860 2023-07-21T07:36:21.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b4f2d700 1 -- 172.21.15.6:0/417076794 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04b00c3f80 msgr2=0x7f04b00c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:21.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b4f2d700 1 --2- 172.21.15.6:0/417076794 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04b00c3f80 0x7f04b00c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b4f2d700 1 -- 172.21.15.6:0/417076794 >> v1:172.21.15.6:6789/0 conn(0x7f04b00c1860 legacy=0x7f04b006dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b4f2d700 1 -- 172.21.15.6:0/417076794 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b0151cd0 con 0x7f04b00c5260 2023-07-21T07:36:21.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b5f2f700 1 --2- 172.21.15.6:0/417076794 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04b00c3f80 0x7f04b00c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:21.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.351+0000 7f04b4f2d700 1 --2- 172.21.15.6:0/417076794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04b00c5260 0x7f04b0151280 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009840 tx=0x7f04a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9b348ef8c29031d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:21.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.352+0000 7f04a7fff700 1 -- 172.21.15.6:0/417076794 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0011830 con 0x7f04b00c5260 2023-07-21T07:36:21.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.352+0000 7f04a7fff700 1 -- 172.21.15.6:0/417076794 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a0011990 con 0x7f04b00c5260 2023-07-21T07:36:21.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.352+0000 7f04a7fff700 1 -- 172.21.15.6:0/417076794 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0011d20 con 0x7f04b00c5260 2023-07-21T07:36:21.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.352+0000 7f04b7992700 1 -- 172.21.15.6:0/417076794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04b00c5260 msgr2=0x7f04b0151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.352+0000 7f04b7992700 1 --2- 172.21.15.6:0/417076794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04b00c5260 0x7f04b0151280 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009840 tx=0x7f04a0009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:21.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.352+0000 7f04b7992700 1 -- 172.21.15.6:0/417076794 shutdown_connections 2023-07-21T07:36:21.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.352+0000 7f04b7992700 1 --2- 172.21.15.6:0/417076794 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04b00c3f80 0x7f04b00c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.352+0000 7f04b7992700 1 --2- 172.21.15.6:0/417076794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04b00c5260 0x7f04b0151280 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.352+0000 7f04b7992700 1 -- 172.21.15.6:0/417076794 >> 172.21.15.6:0/417076794 conn(0x7f04b00a8660 msgr2=0x7f04b00a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:21.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.352+0000 7f04b7992700 1 -- 172.21.15.6:0/417076794 shutdown_connections 2023-07-21T07:36:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.352+0000 7f04b7992700 1 -- 172.21.15.6:0/417076794 wait complete. 2023-07-21T07:36:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.353+0000 7f04b7992700 1 Processor -- start 2023-07-21T07:36:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.353+0000 7f04b7992700 1 -- start start 2023-07-21T07:36:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.354+0000 7f04b7992700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b00c1860 0x7f04b00c0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.354+0000 7f04b7992700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04b00c3f80 0x7f04b00c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.354+0000 7f04b7992700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04b00c5260 0x7f04b01e89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.354+0000 7f04b7992700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00bed50 con 0x7f04b00c1860 2023-07-21T07:36:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.354+0000 7f04b7992700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00bdcb0 con 0x7f04b00c3f80 2023-07-21T07:36:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.354+0000 7f04b7992700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00bea70 con 0x7f04b00c5260 2023-07-21T07:36:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.354+0000 7f04b572e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b00c1860 0x7f04b00c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.354+0000 7f04b572e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b00c1860 0x7f04b00c0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35706/0 (socket says 172.21.15.6:35706) 2023-07-21T07:36:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.354+0000 7f04b572e700 1 -- 172.21.15.6:0/3242686570 learned_addr learned my addr 172.21.15.6:0/3242686570 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.354+0000 7f04b5f2f700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04b00c5260 0x7f04b01e89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.354+0000 7f04b4f2d700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04b00c3f80 0x7f04b00c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.355+0000 7f04b572e700 1 -- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04b00c5260 msgr2=0x7f04b01e89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.355+0000 7f04b572e700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04b00c5260 0x7f04b01e89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.355+0000 7f04b572e700 1 -- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04b00c3f80 msgr2=0x7f04b00c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.355+0000 7f04b572e700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04b00c3f80 0x7f04b00c05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.355+0000 7f04b572e700 1 -- 172.21.15.6:0/3242686570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a8009a70 con 0x7f04b00c1860 2023-07-21T07:36:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.355+0000 7f04b572e700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b00c1860 0x7f04b00c0070 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00c700 tx=0x7f04ac00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.355+0000 7f04a5ffb700 1 -- 172.21.15.6:0/3242686570 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac005d70 con 0x7f04b00c1860 2023-07-21T07:36:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.355+0000 7f04a5ffb700 1 -- 172.21.15.6:0/3242686570 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ac0070d0 con 0x7f04b00c1860 2023-07-21T07:36:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.355+0000 7f04b7992700 1 -- 172.21.15.6:0/3242686570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a00094a0 con 0x7f04b00c1860 2023-07-21T07:36:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.355+0000 7f04a5ffb700 1 -- 172.21.15.6:0/3242686570 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac007460 con 0x7f04b00c1860 2023-07-21T07:36:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.355+0000 7f04b7992700 1 -- 172.21.15.6:0/3242686570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b00be230 con 0x7f04b00c1860 2023-07-21T07:36:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.356+0000 7f04b7992700 1 -- 172.21.15.6:0/3242686570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b00c4680 con 0x7f04b00c1860 2023-07-21T07:36:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.357+0000 7f04a5ffb700 1 -- 172.21.15.6:0/3242686570 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f04ac0075c0 con 0x7f04b00c1860 2023-07-21T07:36:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.357+0000 7f04a5ffb700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f049406ace0 0x7f049406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.357+0000 7f04a5ffb700 1 -- 172.21.15.6:0/3242686570 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f04ac088630 con 0x7f04b00c1860 2023-07-21T07:36:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.357+0000 7f04b4f2d700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f049406ace0 0x7f049406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.358+0000 7f04b4f2d700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f049406ace0 0x7f049406d1a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f04a0000c00 tx=0x7f04a001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:21.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.361+0000 7f04a5ffb700 1 -- 172.21.15.6:0/3242686570 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f04ac053a10 con 0x7f04b00c1860 2023-07-21T07:36:21.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.561+0000 7f04b7992700 1 -- 172.21.15.6:0/3242686570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f04b0074500 con 0x7f04b00c1860 2023-07-21T07:36:21.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.561+0000 7f04a5ffb700 1 -- 172.21.15.6:0/3242686570 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7f04ac057030 con 0x7f04b00c1860 2023-07-21T07:36:21.615 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:36:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.563+0000 7f04b7992700 1 -- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f049406ace0 msgr2=0x7f049406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.563+0000 7f04b7992700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f049406ace0 0x7f049406d1a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f04a0000c00 tx=0x7f04a001c040 comp rx=0 tx=0).stop 2023-07-21T07:36:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.563+0000 7f04b7992700 1 -- 172.21.15.6:0/3242686570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b00c1860 msgr2=0x7f04b00c0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.563+0000 7f04b7992700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b00c1860 0x7f04b00c0070 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00c700 tx=0x7f04ac00ca10 comp rx=0 tx=0).stop 2023-07-21T07:36:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.563+0000 7f04b7992700 1 -- 172.21.15.6:0/3242686570 shutdown_connections 2023-07-21T07:36:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.563+0000 7f04b7992700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f049406ace0 0x7f049406d1a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.563+0000 7f04b7992700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04b00c5260 0x7f04b01e89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.563+0000 7f04b7992700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b00c1860 0x7f04b00c0070 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.563+0000 7f04b7992700 1 --2- 172.21.15.6:0/3242686570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04b00c3f80 0x7f04b00c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.563+0000 7f04b7992700 1 -- 172.21.15.6:0/3242686570 >> 172.21.15.6:0/3242686570 conn(0x7f04b00a8660 msgr2=0x7f04b0151100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.563+0000 7f04b7992700 1 -- 172.21.15.6:0/3242686570 shutdown_connections 2023-07-21T07:36:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.563+0000 7f04b7992700 1 -- 172.21.15.6:0/3242686570 wait complete. 2023-07-21T07:36:21.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T07:36:21.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.703+0000 7fc535b64700 1 Processor -- start 2023-07-21T07:36:21.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.703+0000 7fc535b64700 1 -- start start 2023-07-21T07:36:21.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.704+0000 7fc535b64700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5300c1860 0x7fc530151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.704+0000 7fc535b64700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5300c5260 0x7fc53006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.704+0000 7fc535b64700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5301517c0 con 0x7fc5300c3f80 2023-07-21T07:36:21.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.704+0000 7fc535b64700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5300c4e50 con 0x7fc5300c1860 2023-07-21T07:36:21.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.704+0000 7fc535b64700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5301519f0 con 0x7fc5300c5260 2023-07-21T07:36:21.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.704+0000 7fc52effd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5300c5260 0x7fc53006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.704+0000 7fc52ffff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc5300c3f80 0x7fc5300c3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:46980/0 (socket says 172.21.15.6:46980) 2023-07-21T07:36:21.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.704+0000 7fc52ffff700 1 -- 172.21.15.6:0/3143877670 learned_addr learned my addr 172.21.15.6:0/3143877670 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:21.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.704+0000 7fc52f7fe700 1 --2- 172.21.15.6:0/3143877670 >> v2:172.21.15.86:3300/0 conn(0x7fc5300c1860 0x7fc530151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.705+0000 7fc52f7fe700 1 -- 172.21.15.6:0/3143877670 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5300c5260 msgr2=0x7fc53006dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:21.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.705+0000 7fc52f7fe700 1 --2- 172.21.15.6:0/3143877670 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5300c5260 0x7fc53006dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.705+0000 7fc52f7fe700 1 -- 172.21.15.6:0/3143877670 >> v1:172.21.15.86:6789/0 conn(0x7fc5300c3f80 legacy=0x7fc5300c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.705+0000 7fc52f7fe700 1 -- 172.21.15.6:0/3143877670 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc530151cd0 con 0x7fc5300c1860 2023-07-21T07:36:21.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.705+0000 7fc52f7fe700 1 --2- 172.21.15.6:0/3143877670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5300c1860 0x7fc530151280 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc520009840 tx=0x7fc520009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80134c6d65b22d6c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:21.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.705+0000 7fc52e7fc700 1 -- 172.21.15.6:0/3143877670 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520011830 con 0x7fc5300c1860 2023-07-21T07:36:21.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.705+0000 7fc52e7fc700 1 -- 172.21.15.6:0/3143877670 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc520011990 con 0x7fc5300c1860 2023-07-21T07:36:21.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.705+0000 7fc52e7fc700 1 -- 172.21.15.6:0/3143877670 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520011d20 con 0x7fc5300c1860 2023-07-21T07:36:21.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.706+0000 7fc535b64700 1 -- 172.21.15.6:0/3143877670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5300c1860 msgr2=0x7fc530151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.706+0000 7fc535b64700 1 --2- 172.21.15.6:0/3143877670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5300c1860 0x7fc530151280 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc520009840 tx=0x7fc520009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:21.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.706+0000 7fc535b64700 1 -- 172.21.15.6:0/3143877670 shutdown_connections 2023-07-21T07:36:21.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.706+0000 7fc535b64700 1 --2- 172.21.15.6:0/3143877670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5300c1860 0x7fc530151280 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.706+0000 7fc535b64700 1 --2- 172.21.15.6:0/3143877670 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5300c5260 0x7fc53006dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.706+0000 7fc535b64700 1 -- 172.21.15.6:0/3143877670 >> 172.21.15.6:0/3143877670 conn(0x7fc5300a8660 msgr2=0x7fc5300a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.706+0000 7fc535b64700 1 -- 172.21.15.6:0/3143877670 shutdown_connections 2023-07-21T07:36:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.706+0000 7fc535b64700 1 -- 172.21.15.6:0/3143877670 wait complete. 2023-07-21T07:36:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.707+0000 7fc535b64700 1 Processor -- start 2023-07-21T07:36:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.707+0000 7fc535b64700 1 -- start start 2023-07-21T07:36:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc535b64700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5300c1860 0x7fc5301def60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc535b64700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5300c3f80 0x7fc53014a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc535b64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5300c5260 0x7fc53014ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc535b64700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5300bb260 con 0x7fc5300c5260 2023-07-21T07:36:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc535b64700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5300bacc0 con 0x7fc5300c1860 2023-07-21T07:36:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc535b64700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53014fc00 con 0x7fc5300c3f80 2023-07-21T07:36:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc52ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5300c5260 0x7fc53014ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc52ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5300c5260 0x7fc53014ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35724/0 (socket says 172.21.15.6:35724) 2023-07-21T07:36:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc52ffff700 1 -- 172.21.15.6:0/1535142611 learned_addr learned my addr 172.21.15.6:0/1535142611 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc52effd700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5300c3f80 0x7fc53014a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc52f7fe700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5300c1860 0x7fc5301def60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc52ffff700 1 -- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5300c3f80 msgr2=0x7fc53014a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc52ffff700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5300c3f80 0x7fc53014a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc52ffff700 1 -- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5300c1860 msgr2=0x7fc5301def60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc52ffff700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5300c1860 0x7fc5301def60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc52ffff700 1 -- 172.21.15.6:0/1535142611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200094a0 con 0x7fc5300c5260 2023-07-21T07:36:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc52f7fe700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5300c1860 0x7fc5301def60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc52ffff700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5300c5260 0x7fc53014ac50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc52800caf0 tx=0x7fc52800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.708+0000 7fc527fff700 1 -- 172.21.15.6:0/1535142611 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52800aad0 con 0x7fc5300c5260 2023-07-21T07:36:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.709+0000 7fc527fff700 1 -- 172.21.15.6:0/1535142611 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52800ac30 con 0x7fc5300c5260 2023-07-21T07:36:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.709+0000 7fc535b64700 1 -- 172.21.15.6:0/1535142611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53014fee0 con 0x7fc5300c5260 2023-07-21T07:36:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.709+0000 7fc527fff700 1 -- 172.21.15.6:0/1535142611 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528012400 con 0x7fc5300c5260 2023-07-21T07:36:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.709+0000 7fc535b64700 1 -- 172.21.15.6:0/1535142611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5300ba950 con 0x7fc5300c5260 2023-07-21T07:36:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.709+0000 7fc535b64700 1 -- 172.21.15.6:0/1535142611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5300a7230 con 0x7fc5300c5260 2023-07-21T07:36:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.710+0000 7fc527fff700 1 -- 172.21.15.6:0/1535142611 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc52801b3b0 con 0x7fc5300c5260 2023-07-21T07:36:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.710+0000 7fc527fff700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc51006ace0 0x7fc51006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.710+0000 7fc527fff700 1 -- 172.21.15.6:0/1535142611 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc528088d60 con 0x7fc5300c5260 2023-07-21T07:36:21.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.711+0000 7fc52f7fe700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc51006ace0 0x7fc51006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:21.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.711+0000 7fc52f7fe700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc51006ace0 0x7fc51006d1a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc520000c00 tx=0x7fc520008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:21.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.715+0000 7fc527fff700 1 -- 172.21.15.6:0/1535142611 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc5280541f0 con 0x7fc5300c5260 2023-07-21T07:36:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.914+0000 7fc535b64700 1 -- 172.21.15.6:0/1535142611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc5300bae70 con 0x7fc5300c5260 2023-07-21T07:36:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.918+0000 7fc527fff700 1 -- 172.21.15.6:0/1535142611 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc5280170c0 con 0x7fc5300c5260 2023-07-21T07:36:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.920+0000 7fc535b64700 1 -- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc51006ace0 msgr2=0x7fc51006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.920+0000 7fc535b64700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc51006ace0 0x7fc51006d1a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc520000c00 tx=0x7fc520008030 comp rx=0 tx=0).stop 2023-07-21T07:36:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.920+0000 7fc535b64700 1 -- 172.21.15.6:0/1535142611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5300c5260 msgr2=0x7fc53014ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.920+0000 7fc535b64700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5300c5260 0x7fc53014ac50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc52800caf0 tx=0x7fc52800ceb0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.921+0000 7fc535b64700 1 -- 172.21.15.6:0/1535142611 shutdown_connections 2023-07-21T07:36:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.921+0000 7fc535b64700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc51006ace0 0x7fc51006d1a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.921+0000 7fc535b64700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5300c5260 0x7fc53014ac50 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.921+0000 7fc535b64700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5300c1860 0x7fc5301def60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.921+0000 7fc535b64700 1 --2- 172.21.15.6:0/1535142611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5300c3f80 0x7fc53014a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.921+0000 7fc535b64700 1 -- 172.21.15.6:0/1535142611 >> 172.21.15.6:0/1535142611 conn(0x7fc5300a8660 msgr2=0x7fc5300a6560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.921+0000 7fc535b64700 1 -- 172.21.15.6:0/1535142611 shutdown_connections 2023-07-21T07:36:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:21.921+0000 7fc535b64700 1 -- 172.21.15.6:0/1535142611 wait complete. 2023-07-21T07:36:21.986 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T07:36:21.987 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T07:36:22.039 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T07:36:22.083 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T07:36:22.083 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:36:22.084 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:36:22.101 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18692 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-07-21T07:36:22.102 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:36:22.102 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:36:22.142 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15810 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-07-21T07:36:22.143 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-07-21T07:36:22.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:36:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.215+0000 7f78efe2e700 1 Processor -- start 2023-07-21T07:36:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.215+0000 7f78efe2e700 1 -- start start 2023-07-21T07:36:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78efe2e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78e806a300 0x7f78e806da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78efe2e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f78e8155050 0x7f78e80c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78efe2e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e80c2be0 con 0x7f78e80c6470 2023-07-21T07:36:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78efe2e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e806e6e0 con 0x7f78e8155050 2023-07-21T07:36:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78efe2e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e806e120 con 0x7f78e806a300 2023-07-21T07:36:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78ed3c9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f78e8155050 0x7f78e80c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78ee3cb700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f78e80c6470 0x7f78e80c3070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43752/0 (socket says 172.21.15.6:43752) 2023-07-21T07:36:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78ed3c9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f78e8155050 0x7f78e80c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35730/0 (socket says 172.21.15.6:35730) 2023-07-21T07:36:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78ee3cb700 1 -- 172.21.15.6:0/3801408593 learned_addr learned my addr 172.21.15.6:0/3801408593 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78edbca700 1 --2- 172.21.15.6:0/3801408593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78e806a300 0x7f78e806da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78ed3c9700 1 -- 172.21.15.6:0/3801408593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78e806a300 msgr2=0x7f78e806da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78ed3c9700 1 --2- 172.21.15.6:0/3801408593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78e806a300 0x7f78e806da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78ed3c9700 1 -- 172.21.15.6:0/3801408593 >> v1:172.21.15.6:6789/0 conn(0x7f78e80c6470 legacy=0x7f78e80c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78ed3c9700 1 -- 172.21.15.6:0/3801408593 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e806e400 con 0x7f78e8155050 2023-07-21T07:36:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.216+0000 7f78ecbc8700 1 -- 172.21.15.6:0/3801408593 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533065243 0 0) 0x7f78e80c2be0 con 0x7f78e80c6470 2023-07-21T07:36:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.217+0000 7f78ed3c9700 1 --2- 172.21.15.6:0/3801408593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e8155050 0x7f78e80c5f30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009840 tx=0x7f78e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6c036108f824a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.217+0000 7f78ecbc8700 1 -- 172.21.15.6:0/3801408593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e4011830 con 0x7f78e8155050 2023-07-21T07:36:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.217+0000 7f78ecbc8700 1 -- 172.21.15.6:0/3801408593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e4011990 con 0x7f78e8155050 2023-07-21T07:36:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.217+0000 7f78ecbc8700 1 -- 172.21.15.6:0/3801408593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e4011d20 con 0x7f78e8155050 2023-07-21T07:36:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.217+0000 7f78efe2e700 1 -- 172.21.15.6:0/3801408593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e8155050 msgr2=0x7f78e80c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.217+0000 7f78efe2e700 1 --2- 172.21.15.6:0/3801408593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e8155050 0x7f78e80c5f30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009840 tx=0x7f78e4009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.217+0000 7f78efe2e700 1 -- 172.21.15.6:0/3801408593 shutdown_connections 2023-07-21T07:36:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.217+0000 7f78efe2e700 1 --2- 172.21.15.6:0/3801408593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78e806a300 0x7f78e806da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.217+0000 7f78efe2e700 1 --2- 172.21.15.6:0/3801408593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e8155050 0x7f78e80c5f30 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.217+0000 7f78efe2e700 1 -- 172.21.15.6:0/3801408593 >> 172.21.15.6:0/3801408593 conn(0x7f78e80a8c90 msgr2=0x7f78e806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:22.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.217+0000 7f78efe2e700 1 -- 172.21.15.6:0/3801408593 shutdown_connections 2023-07-21T07:36:22.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.217+0000 7f78efe2e700 1 -- 172.21.15.6:0/3801408593 wait complete. 2023-07-21T07:36:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.219+0000 7f78efe2e700 1 Processor -- start 2023-07-21T07:36:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.219+0000 7f78efe2e700 1 -- start start 2023-07-21T07:36:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.219+0000 7f78efe2e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e806a300 0x7f78e80bca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.219+0000 7f78efe2e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78e80c6470 0x7f78e81508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.219+0000 7f78efe2e700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78e8155050 0x7f78e8155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.219+0000 7f78efe2e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e8157530 con 0x7f78e806a300 2023-07-21T07:36:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.219+0000 7f78efe2e700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80c0b00 con 0x7f78e8155050 2023-07-21T07:36:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.219+0000 7f78efe2e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80bf4f0 con 0x7f78e80c6470 2023-07-21T07:36:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.219+0000 7f78edbca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e806a300 0x7f78e80bca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.219+0000 7f78edbca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e806a300 0x7f78e80bca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35734/0 (socket says 172.21.15.6:35734) 2023-07-21T07:36:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.219+0000 7f78edbca700 1 -- 172.21.15.6:0/3573177337 learned_addr learned my addr 172.21.15.6:0/3573177337 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78ed3c9700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78e80c6470 0x7f78e81508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78ee3cb700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78e8155050 0x7f78e8155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78edbca700 1 -- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78e80c6470 msgr2=0x7f78e81508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78edbca700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78e80c6470 0x7f78e81508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78edbca700 1 -- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78e8155050 msgr2=0x7f78e8155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78edbca700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78e8155050 0x7f78e8155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78edbca700 1 -- 172.21.15.6:0/3573177337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e40094a0 con 0x7f78e806a300 2023-07-21T07:36:22.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78ee3cb700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78e8155050 0x7f78e8155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:22.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78edbca700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e806a300 0x7f78e80bca40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00e840 tx=0x7f78dc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:22.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78da7fc700 1 -- 172.21.15.6:0/3573177337 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc013610 con 0x7f78e806a300 2023-07-21T07:36:22.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78da7fc700 1 -- 172.21.15.6:0/3573177337 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc013770 con 0x7f78e806a300 2023-07-21T07:36:22.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78da7fc700 1 -- 172.21.15.6:0/3573177337 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc013b20 con 0x7f78e806a300 2023-07-21T07:36:22.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78efe2e700 1 -- 172.21.15.6:0/3573177337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e80b9d30 con 0x7f78e806a300 2023-07-21T07:36:22.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.220+0000 7f78efe2e700 1 -- 172.21.15.6:0/3573177337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e80c0540 con 0x7f78e806a300 2023-07-21T07:36:22.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.221+0000 7f78efe2e700 1 -- 172.21.15.6:0/3573177337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e80bf7d0 con 0x7f78e806a300 2023-07-21T07:36:22.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.221+0000 7f78da7fc700 1 -- 172.21.15.6:0/3573177337 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f78dc013c80 con 0x7f78e806a300 2023-07-21T07:36:22.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.222+0000 7f78da7fc700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f78cc06ace0 0x7f78cc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:22.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.222+0000 7f78da7fc700 1 -- 172.21.15.6:0/3573177337 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f78dc088dd0 con 0x7f78e806a300 2023-07-21T07:36:22.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.222+0000 7f78ed3c9700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f78cc06ace0 0x7f78cc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:22.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.223+0000 7f78ed3c9700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f78cc06ace0 0x7f78cc06d1a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f78e4000c00 tx=0x7f78e4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.226+0000 7f78da7fc700 1 -- 172.21.15.6:0/3573177337 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f78dc0541b0 con 0x7f78e806a300 2023-07-21T07:36:22.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.472+0000 7f78efe2e700 1 -- 172.21.15.6:0/3573177337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78e8074500 con 0x7f78e806a300 2023-07-21T07:36:22.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.473+0000 7f78da7fc700 1 -- 172.21.15.6:0/3573177337 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3520 (secure 0 0 0) 0x7f78dc08add0 con 0x7f78e806a300 2023-07-21T07:36:22.527 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:22.527 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1808819585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1808819585},{"type":"v1","addr":"172.21.15.6:6834","nonce":1808819585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/422116109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":422116109},{"type":"v1","addr":"172.21.15.86:6836","nonce":422116109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5081,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2436536706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2436536706},{"type":"v1","addr":"172.21.15.6:6835","nonce":2436536706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5527,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3759739434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":3759739434},{"type":"v1","addr":"172.21.15.86:6837","nonce":3759739434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-07-21T07:36:22.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.475+0000 7f78efe2e700 1 -- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f78cc06ace0 msgr2=0x7f78cc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:22.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.475+0000 7f78efe2e700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f78cc06ace0 0x7f78cc06d1a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f78e4000c00 tx=0x7f78e4008030 comp rx=0 tx=0).stop 2023-07-21T07:36:22.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.475+0000 7f78efe2e700 1 -- 172.21.15.6:0/3573177337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e806a300 msgr2=0x7f78e80bca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:22.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.475+0000 7f78efe2e700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e806a300 0x7f78e80bca40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00e840 tx=0x7f78dc00ec00 comp rx=0 tx=0).stop 2023-07-21T07:36:22.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.475+0000 7f78efe2e700 1 -- 172.21.15.6:0/3573177337 shutdown_connections 2023-07-21T07:36:22.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.475+0000 7f78efe2e700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f78cc06ace0 0x7f78cc06d1a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.475+0000 7f78efe2e700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78e8155050 0x7f78e8155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.475+0000 7f78efe2e700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e806a300 0x7f78e80bca40 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.475+0000 7f78efe2e700 1 --2- 172.21.15.6:0/3573177337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78e80c6470 0x7f78e81508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.475+0000 7f78efe2e700 1 -- 172.21.15.6:0/3573177337 >> 172.21.15.6:0/3573177337 conn(0x7f78e80a8c90 msgr2=0x7f78e8070710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:22.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.475+0000 7f78efe2e700 1 -- 172.21.15.6:0/3573177337 shutdown_connections 2023-07-21T07:36:22.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.475+0000 7f78efe2e700 1 -- 172.21.15.6:0/3573177337 wait complete. 2023-07-21T07:36:22.531 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-07-21T07:36:22.541 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T07:36:22.541 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T07:36:22.542 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T07:36:22.542 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T07:36:22.542 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T07:36:22.542 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T07:36:22.542 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T07:36:22.543 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T07:36:22.543 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T07:36:22.543 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T07:36:22.543 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T07:36:22.543 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T07:36:22.544 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T07:36:22.544 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T07:36:22.544 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T07:36:22.544 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T07:36:22.550 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T07:36:22.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T07:36:22.551 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T07:36:22.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T07:36:22.555 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T07:36:22.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T07:36:22.556 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T07:36:22.557 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T07:36:22.593 INFO:tasks.ceph.mds.a:Started 2023-07-21T07:36:22.593 DEBUG:teuthology.parallel:result is None 2023-07-21T07:36:22.594 INFO:tasks.ceph.mds.c:Started 2023-07-21T07:36:22.595 DEBUG:teuthology.parallel:result is None 2023-07-21T07:36:22.598 INFO:tasks.ceph.mds.b:Started 2023-07-21T07:36:22.598 DEBUG:teuthology.parallel:result is None 2023-07-21T07:36:22.599 INFO:tasks.ceph.mds.d:Started 2023-07-21T07:36:22.599 DEBUG:teuthology.parallel:result is None 2023-07-21T07:36:22.600 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T07:36:22.675 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T07:36:22.675 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T07:36:22.683 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2023-07-21T07:36:22.683 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2023-07-21T07:36:22.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.679+0000 7f7a64157700 1 Processor -- start 2023-07-21T07:36:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.679+0000 7f7a64157700 1 -- start start 2023-07-21T07:36:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a64157700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7a5c155370 0x7f7a5c0c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a64157700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a5c158020 0x7f7a5c1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a64157700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5c0c54e0 con 0x7f7a5c0c48b0 2023-07-21T07:36:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a64157700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c154710 con 0x7f7a5c155370 2023-07-21T07:36:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a64157700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0c5730 con 0x7f7a5c158020 2023-07-21T07:36:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a626f4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a5c158020 0x7f7a5c1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a61ef3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7a5c155370 0x7f7a5c0c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a616f2700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7a5c0c48b0 0x7f7a5c06a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:47028/0 (socket says 172.21.15.6:47028) 2023-07-21T07:36:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a616f2700 1 -- 172.21.15.6:0/1048681087 learned_addr learned my addr 172.21.15.6:0/1048681087 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a626f4700 1 -- 172.21.15.6:0/1048681087 >> v2:172.21.15.86:3300/0 conn(0x7f7a5c155370 msgr2=0x7f7a5c0c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a626f4700 1 --2- 172.21.15.6:0/1048681087 >> v2:172.21.15.86:3300/0 conn(0x7f7a5c155370 0x7f7a5c0c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a626f4700 1 -- 172.21.15.6:0/1048681087 >> v1:172.21.15.86:6789/0 conn(0x7f7a5c0c48b0 legacy=0x7f7a5c06a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a626f4700 1 -- 172.21.15.6:0/1048681087 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0c5a10 con 0x7f7a5c158020 2023-07-21T07:36:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.680+0000 7f7a626f4700 1 --2- 172.21.15.6:0/1048681087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a5c158020 0x7f7a5c1584b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a54009d90 tx=0x7f7a5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f82e7b3a06821d79 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.681+0000 7f7a60ef1700 1 -- 172.21.15.6:0/1048681087 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5400e070 con 0x7f7a5c158020 2023-07-21T07:36:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.681+0000 7f7a60ef1700 1 -- 172.21.15.6:0/1048681087 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5400bb20 con 0x7f7a5c158020 2023-07-21T07:36:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.681+0000 7f7a60ef1700 1 -- 172.21.15.6:0/1048681087 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54012430 con 0x7f7a5c158020 2023-07-21T07:36:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.681+0000 7f7a64157700 1 -- 172.21.15.6:0/1048681087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a5c158020 msgr2=0x7f7a5c1584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.681+0000 7f7a64157700 1 --2- 172.21.15.6:0/1048681087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a5c158020 0x7f7a5c1584b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a54009d90 tx=0x7f7a5400b330 comp rx=0 tx=0).stop 2023-07-21T07:36:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.681+0000 7f7a64157700 1 -- 172.21.15.6:0/1048681087 shutdown_connections 2023-07-21T07:36:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.681+0000 7f7a64157700 1 --2- 172.21.15.6:0/1048681087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a5c158020 0x7f7a5c1584b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.681+0000 7f7a64157700 1 --2- 172.21.15.6:0/1048681087 >> v2:172.21.15.86:3300/0 conn(0x7f7a5c155370 0x7f7a5c0c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.681+0000 7f7a64157700 1 -- 172.21.15.6:0/1048681087 >> 172.21.15.6:0/1048681087 conn(0x7f7a5c06b1a0 msgr2=0x7f7a5c06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.681+0000 7f7a64157700 1 -- 172.21.15.6:0/1048681087 shutdown_connections 2023-07-21T07:36:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.681+0000 7f7a64157700 1 -- 172.21.15.6:0/1048681087 wait complete. 2023-07-21T07:36:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.682+0000 7f7a64157700 1 Processor -- start 2023-07-21T07:36:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.682+0000 7f7a64157700 1 -- start start 2023-07-21T07:36:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.683+0000 7f7a64157700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a5c0c48b0 0x7f7a5c156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.683+0000 7f7a64157700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a5c155370 0x7f7a5c14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.683+0000 7f7a64157700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c158020 0x7f7a5c14ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.683+0000 7f7a64157700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0bf570 con 0x7f7a5c158020 2023-07-21T07:36:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.683+0000 7f7a64157700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c1edba0 con 0x7f7a5c0c48b0 2023-07-21T07:36:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.683+0000 7f7a64157700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c1ee030 con 0x7f7a5c155370 2023-07-21T07:36:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.683+0000 7f7a626f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c158020 0x7f7a5c14ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.683+0000 7f7a626f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c158020 0x7f7a5c14ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35774/0 (socket says 172.21.15.6:35774) 2023-07-21T07:36:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.683+0000 7f7a626f4700 1 -- 172.21.15.6:0/190784033 learned_addr learned my addr 172.21.15.6:0/190784033 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.683+0000 7f7a61ef3700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a5c0c48b0 0x7f7a5c156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.683+0000 7f7a616f2700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a5c155370 0x7f7a5c14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.684+0000 7f7a616f2700 1 -- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a5c0c48b0 msgr2=0x7f7a5c156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.684+0000 7f7a616f2700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a5c0c48b0 0x7f7a5c156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.684+0000 7f7a616f2700 1 -- 172.21.15.6:0/190784033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c158020 msgr2=0x7f7a5c14ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.684+0000 7f7a616f2700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c158020 0x7f7a5c14ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.684+0000 7f7a616f2700 1 -- 172.21.15.6:0/190784033 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a54009a70 con 0x7f7a5c155370 2023-07-21T07:36:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.684+0000 7f7a626f4700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c158020 0x7f7a5c14ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.684+0000 7f7a61ef3700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a5c0c48b0 0x7f7a5c156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.684+0000 7f7a616f2700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a5c155370 0x7f7a5c14e7f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00c530 tx=0x7f7a4c00c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.684+0000 7f7a527fc700 1 -- 172.21.15.6:0/190784033 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c00cea0 con 0x7f7a5c155370 2023-07-21T07:36:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.684+0000 7f7a527fc700 1 -- 172.21.15.6:0/190784033 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c005d70 con 0x7f7a5c155370 2023-07-21T07:36:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.684+0000 7f7a64157700 1 -- 172.21.15.6:0/190784033 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c1576f0 con 0x7f7a5c155370 2023-07-21T07:36:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.684+0000 7f7a527fc700 1 -- 172.21.15.6:0/190784033 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0072d0 con 0x7f7a5c155370 2023-07-21T07:36:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.684+0000 7f7a64157700 1 -- 172.21.15.6:0/190784033 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c1ed550 con 0x7f7a5c155370 2023-07-21T07:36:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.685+0000 7f7a64157700 1 -- 172.21.15.6:0/190784033 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c1edd10 con 0x7f7a5c155370 2023-07-21T07:36:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.685+0000 7f7a527fc700 1 -- 172.21.15.6:0/190784033 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a4c007430 con 0x7f7a5c155370 2023-07-21T07:36:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.686+0000 7f7a527fc700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7a4006ace0 0x7f7a4006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.686+0000 7f7a527fc700 1 -- 172.21.15.6:0/190784033 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7a4c088350 con 0x7f7a5c155370 2023-07-21T07:36:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.686+0000 7f7a61ef3700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7a4006ace0 0x7f7a4006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.686+0000 7f7a61ef3700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7a4006ace0 0x7f7a4006d1a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009fd0 tx=0x7f7a58009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.690+0000 7f7a527fc700 1 -- 172.21.15.6:0/190784033 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a4c0537e0 con 0x7f7a5c155370 2023-07-21T07:36:22.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:22.904+0000 7f7a64157700 1 -- 172.21.15.6:0/190784033 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7a5c04ecc0 con 0x7f7a5c155370 2023-07-21T07:36:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.517+0000 7f7a527fc700 1 -- 172.21.15.6:0/190784033 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7a4c056e00 con 0x7f7a5c155370 2023-07-21T07:36:23.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.520+0000 7f7a64157700 1 -- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7a4006ace0 msgr2=0x7f7a4006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:23.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.520+0000 7f7a64157700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7a4006ace0 0x7f7a4006d1a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009fd0 tx=0x7f7a58009210 comp rx=0 tx=0).stop 2023-07-21T07:36:23.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.520+0000 7f7a64157700 1 -- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a5c155370 msgr2=0x7f7a5c14e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:23.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.520+0000 7f7a64157700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a5c155370 0x7f7a5c14e7f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00c530 tx=0x7f7a4c00c840 comp rx=0 tx=0).stop 2023-07-21T07:36:23.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.520+0000 7f7a64157700 1 -- 172.21.15.6:0/190784033 shutdown_connections 2023-07-21T07:36:23.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.520+0000 7f7a64157700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7a4006ace0 0x7f7a4006d1a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:23.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.520+0000 7f7a64157700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c158020 0x7f7a5c14ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:23.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.520+0000 7f7a64157700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a5c0c48b0 0x7f7a5c156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:23.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.520+0000 7f7a64157700 1 --2- 172.21.15.6:0/190784033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a5c155370 0x7f7a5c14e7f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:23.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.520+0000 7f7a64157700 1 -- 172.21.15.6:0/190784033 >> 172.21.15.6:0/190784033 conn(0x7f7a5c06b1a0 msgr2=0x7f7a5c1537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:23.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.521+0000 7f7a64157700 1 -- 172.21.15.6:0/190784033 shutdown_connections 2023-07-21T07:36:23.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.521+0000 7f7a64157700 1 -- 172.21.15.6:0/190784033 wait complete. 2023-07-21T07:36:23.576 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-07-21T07:36:23.591 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T07:36:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.669+0000 7f6ef8258700 1 Processor -- start 2023-07-21T07:36:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.669+0000 7f6ef8258700 1 -- start start 2023-07-21T07:36:23.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.670+0000 7f6ef8258700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ef00c6c70 0x7f6ef0151840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:23.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.670+0000 7f6ef8258700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef00c5a60 0x7f6ef0151d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:23.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.670+0000 7f6ef8258700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ef00c5ed0 0x7f6ef0157b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:23.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.670+0000 7f6ef8258700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef01522c0 con 0x7f6ef00c6c70 2023-07-21T07:36:23.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.670+0000 7f6ef8258700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef006b0c0 con 0x7f6ef00c5ed0 2023-07-21T07:36:23.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.670+0000 7f6ef8258700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef00c45a0 con 0x7f6ef00c5a60 2023-07-21T07:36:23.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.670+0000 7f6ef5ff4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ef00c6c70 0x7f6ef0151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:23.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.670+0000 7f6ef5ff4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ef00c6c70 0x7f6ef0151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35780/0 (socket says 172.21.15.6:35780) 2023-07-21T07:36:23.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.670+0000 7f6ef5ff4700 1 -- 172.21.15.6:0/1391098633 learned_addr learned my addr 172.21.15.6:0/1391098633 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:23.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.670+0000 7f6ef67f5700 1 --2- 172.21.15.6:0/1391098633 >> v2:172.21.15.86:3300/0 conn(0x7f6ef00c5ed0 0x7f6ef0157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:23.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.670+0000 7f6ef57f3700 1 --2- 172.21.15.6:0/1391098633 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef00c5a60 0x7f6ef0151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:23.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.671+0000 7f6ef5ff4700 1 -- 172.21.15.6:0/1391098633 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef00c5a60 msgr2=0x7f6ef0151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:23.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.671+0000 7f6ef5ff4700 1 --2- 172.21.15.6:0/1391098633 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef00c5a60 0x7f6ef0151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:23.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.671+0000 7f6ef5ff4700 1 -- 172.21.15.6:0/1391098633 >> v2:172.21.15.86:3300/0 conn(0x7f6ef00c5ed0 msgr2=0x7f6ef0157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:23.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.671+0000 7f6ef5ff4700 1 --2- 172.21.15.6:0/1391098633 >> v2:172.21.15.86:3300/0 conn(0x7f6ef00c5ed0 0x7f6ef0157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:23.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.671+0000 7f6ef5ff4700 1 -- 172.21.15.6:0/1391098633 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef00c5150 con 0x7f6ef00c6c70 2023-07-21T07:36:23.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.671+0000 7f6ef67f5700 1 --2- 172.21.15.6:0/1391098633 >> v2:172.21.15.86:3300/0 conn(0x7f6ef00c5ed0 0x7f6ef0157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:23.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.671+0000 7f6ef57f3700 1 --2- 172.21.15.6:0/1391098633 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef00c5a60 0x7f6ef0151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:23.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.671+0000 7f6ef5ff4700 1 --2- 172.21.15.6:0/1391098633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef00c6c70 0x7f6ef0151840 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00bd2c0 tx=0x7f6ee0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67e4694bea11c65 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:23.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.671+0000 7f6ef4ff2700 1 -- 172.21.15.6:0/1391098633 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000b870 con 0x7f6ef00c6c70 2023-07-21T07:36:23.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.671+0000 7f6ef4ff2700 1 -- 172.21.15.6:0/1391098633 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee000b9d0 con 0x7f6ef00c6c70 2023-07-21T07:36:23.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.671+0000 7f6ef4ff2700 1 -- 172.21.15.6:0/1391098633 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000bd60 con 0x7f6ef00c6c70 2023-07-21T07:36:23.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.672+0000 7f6ef8258700 1 -- 172.21.15.6:0/1391098633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef00c6c70 msgr2=0x7f6ef0151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:23.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.672+0000 7f6ef8258700 1 --2- 172.21.15.6:0/1391098633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef00c6c70 0x7f6ef0151840 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00bd2c0 tx=0x7f6ee0009bd0 comp rx=0 tx=0).stop 2023-07-21T07:36:23.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.672+0000 7f6ef8258700 1 -- 172.21.15.6:0/1391098633 shutdown_connections 2023-07-21T07:36:23.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.672+0000 7f6ef8258700 1 --2- 172.21.15.6:0/1391098633 >> v2:172.21.15.86:3300/0 conn(0x7f6ef00c5ed0 0x7f6ef0157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.672+0000 7f6ef8258700 1 --2- 172.21.15.6:0/1391098633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef00c6c70 0x7f6ef0151840 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.672+0000 7f6ef8258700 1 --2- 172.21.15.6:0/1391098633 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef00c5a60 0x7f6ef0151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.672+0000 7f6ef8258700 1 -- 172.21.15.6:0/1391098633 >> 172.21.15.6:0/1391098633 conn(0x7f6ef00ca040 msgr2=0x7f6ef00ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.672+0000 7f6ef8258700 1 -- 172.21.15.6:0/1391098633 shutdown_connections 2023-07-21T07:36:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.672+0000 7f6ef8258700 1 -- 172.21.15.6:0/1391098633 wait complete. 2023-07-21T07:36:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.673+0000 7f6ef8258700 1 Processor -- start 2023-07-21T07:36:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.673+0000 7f6ef8258700 1 -- start start 2023-07-21T07:36:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef8258700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef00c5a60 0x7f6ef0146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef8258700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef00c5ed0 0x7f6ef014f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef8258700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef00c6c70 0x7f6ef014f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef8258700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef014bff0 con 0x7f6ef00c5ed0 2023-07-21T07:36:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef8258700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef014de00 con 0x7f6ef00c6c70 2023-07-21T07:36:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef8258700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef014c540 con 0x7f6ef00c5a60 2023-07-21T07:36:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef57f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef00c5ed0 0x7f6ef014f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef57f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef00c5ed0 0x7f6ef014f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35786/0 (socket says 172.21.15.6:35786) 2023-07-21T07:36:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef57f3700 1 -- 172.21.15.6:0/2704548112 learned_addr learned my addr 172.21.15.6:0/2704548112 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef5ff4700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef00c5a60 0x7f6ef0146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef67f5700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef00c6c70 0x7f6ef014f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef57f3700 1 -- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef00c5a60 msgr2=0x7f6ef0146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef57f3700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef00c5a60 0x7f6ef0146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef57f3700 1 -- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef00c6c70 msgr2=0x7f6ef014f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef57f3700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef00c6c70 0x7f6ef014f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef57f3700 1 -- 172.21.15.6:0/2704548112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0009550 con 0x7f6ef00c5ed0 2023-07-21T07:36:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef57f3700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef00c5ed0 0x7f6ef014f2d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00d7d0 tx=0x7f6eec00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ee67fc700 1 -- 172.21.15.6:0/2704548112 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec004030 con 0x7f6ef00c5ed0 2023-07-21T07:36:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ee67fc700 1 -- 172.21.15.6:0/2704548112 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec004190 con 0x7f6ef00c5ed0 2023-07-21T07:36:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ef8258700 1 -- 172.21.15.6:0/2704548112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef014c820 con 0x7f6ef00c5ed0 2023-07-21T07:36:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.674+0000 7f6ee67fc700 1 -- 172.21.15.6:0/2704548112 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec004500 con 0x7f6ef00c5ed0 2023-07-21T07:36:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.675+0000 7f6ef8258700 1 -- 172.21.15.6:0/2704548112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef014cde0 con 0x7f6ef00c5ed0 2023-07-21T07:36:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.675+0000 7f6ef8258700 1 -- 172.21.15.6:0/2704548112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef00c55c0 con 0x7f6ef00c5ed0 2023-07-21T07:36:23.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.676+0000 7f6ee67fc700 1 -- 172.21.15.6:0/2704548112 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6eec0036a0 con 0x7f6ef00c5ed0 2023-07-21T07:36:23.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.676+0000 7f6ee67fc700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6ed406ace0 0x7f6ed406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:23.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.677+0000 7f6ee67fc700 1 -- 172.21.15.6:0/2704548112 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6eec088f80 con 0x7f6ef00c5ed0 2023-07-21T07:36:23.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.677+0000 7f6ef5ff4700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6ed406ace0 0x7f6ed406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:23.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.677+0000 7f6ef5ff4700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6ed406ace0 0x7f6ed406d1a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0014040 tx=0x7f6ee0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:23.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.681+0000 7f6ee67fc700 1 -- 172.21.15.6:0/2704548112 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6eec0bb310 con 0x7f6ef00c5ed0 2023-07-21T07:36:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.959+0000 7f6ef8258700 1 -- 172.21.15.6:0/2704548112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6ef0074500 con 0x7f6ef00c5ed0 2023-07-21T07:36:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.959+0000 7f6ee67fc700 1 -- 172.21.15.6:0/2704548112 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5021 (secure 0 0 0) 0x7f6ef00c55c0 con 0x7f6ef00c5ed0 2023-07-21T07:36:24.013 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:24.014 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T07:36:24.014 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-07-21T07:36:24.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.014 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-07-21T07:36:24.014 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpk0z4rHBAAYud3Yf8vYEhpCM6Z6VgXHA==", 2023-07-21T07:36:24.014 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.015 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T07:36:24.015 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T07:36:24.015 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T07:36:24.015 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.015 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.015 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-07-21T07:36:24.016 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpku4+LKBAAxi3bH3yBdtlwmeTikK80bg==", 2023-07-21T07:36:24.016 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.016 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T07:36:24.016 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T07:36:24.016 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T07:36:24.016 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.016 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.017 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-07-21T07:36:24.017 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpkNSGcIxAARuNmmUnW9ym/xs6LvW8IbQ==", 2023-07-21T07:36:24.017 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.017 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T07:36:24.017 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T07:36:24.017 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T07:36:24.018 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.018 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.018 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-07-21T07:36:24.018 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpkU+XALxAAxJNRVW7qFMskSDxzL3C/cA==", 2023-07-21T07:36:24.018 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.018 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T07:36:24.019 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T07:36:24.019 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T07:36:24.019 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.019 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.019 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-07-21T07:36:24.020 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDZNLpk1HKJDRAAA7k2o/9a+6cPD25oW+dzFw==", 2023-07-21T07:36:24.020 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.020 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:36:24.020 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:36:24.020 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.020 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.021 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-07-21T07:36:24.021 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDcNLpk8USEDRAAyEhBUafsvjZmS1ohCCTVmA==", 2023-07-21T07:36:24.021 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.021 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:36:24.021 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:36:24.021 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.021 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.022 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-07-21T07:36:24.022 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDfNLpkDEVIDRAAGx/lupvJ0CwjQw78KGvrKA==", 2023-07-21T07:36:24.022 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.022 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:36:24.022 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:36:24.022 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.023 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.023 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.023 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-07-21T07:36:24.023 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDiNLpkdwQ7DRAAbkOprHrWx2EJ6xPNKv7QDQ==", 2023-07-21T07:36:24.023 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.023 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:36:24.023 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:36:24.024 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.024 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.024 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-07-21T07:36:24.024 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDoNLpkdOldEhAAhUmrtb4x6TODMTc92laajg==", 2023-07-21T07:36:24.024 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.024 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:36:24.025 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:36:24.025 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.025 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.025 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-07-21T07:36:24.025 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDrNLpk/+5CEhAA1WwlM+hQhnRj1Z2e8XC95A==", 2023-07-21T07:36:24.025 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.026 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:36:24.026 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:36:24.026 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.026 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.026 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-07-21T07:36:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDuNLpkIN+YERAAze6JtDcxO3PCh12/2nVF+g==", 2023-07-21T07:36:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:36:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:36:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.028 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-07-21T07:36:24.028 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDxNLpkU2LGEBAAY6RKoHI1Qo2NK7L2/gWtNw==", 2023-07-21T07:36:24.028 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.029 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T07:36:24.029 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T07:36:24.029 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.029 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.029 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.029 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-07-21T07:36:24.030 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpkoWkHNxAAuz8SyrpFX/iEiqy/znfHAQ==", 2023-07-21T07:36:24.030 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.030 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T07:36:24.030 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-07-21T07:36:24.030 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-21T07:36:24.030 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.031 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-07-21T07:36:24.031 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpkvOxjOhAA2c1WuwU8rO+o7NzkpQOe0w==", 2023-07-21T07:36:24.031 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.031 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T07:36:24.031 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-07-21T07:36:24.031 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw pool=cephfs2_data" 2023-07-21T07:36:24.031 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.032 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.032 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-07-21T07:36:24.032 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDUNLpkkhwvOxAAOO0R75hmjBUOe/whPA2prQ==", 2023-07-21T07:36:24.032 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.032 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T07:36:24.032 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T07:36:24.032 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T07:36:24.033 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.033 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.033 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.testuser", 2023-07-21T07:36:24.033 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQBbNbpkkI0AHxAAxb3qXU0Dc8Jxrc2w5FHegw==", 2023-07-21T07:36:24.033 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.034 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow rw fsname=cephfs", 2023-07-21T07:36:24.034 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r fsname=cephfs", 2023-07-21T07:36:24.034 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-21T07:36:24.034 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.034 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-07-21T07:36:24.034 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpkWv2zGBAADpiO2+8RH3B7PbW3GZ5ndw==", 2023-07-21T07:36:24.035 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.035 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T07:36:24.035 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T07:36:24.035 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.035 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:24.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:24.035 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-07-21T07:36:24.036 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDVNLpkkOYAFRAAxh0V44ESZiIEES+3GWKyAQ==", 2023-07-21T07:36:24.036 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T07:36:24.036 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T07:36:24.036 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T07:36:24.036 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T07:36:24.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:24.036 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-07-21T07:36:24.037 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T07:36:24.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.961+0000 7f6ef8258700 1 -- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6ed406ace0 msgr2=0x7f6ed406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.961+0000 7f6ef8258700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6ed406ace0 0x7f6ed406d1a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0014040 tx=0x7f6ee0008030 comp rx=0 tx=0).stop 2023-07-21T07:36:24.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.961+0000 7f6ef8258700 1 -- 172.21.15.6:0/2704548112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef00c5ed0 msgr2=0x7f6ef014f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.961+0000 7f6ef8258700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef00c5ed0 0x7f6ef014f2d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00d7d0 tx=0x7f6eec00dae0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.961+0000 7f6ef8258700 1 -- 172.21.15.6:0/2704548112 shutdown_connections 2023-07-21T07:36:24.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.961+0000 7f6ef8258700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f6ed406ace0 0x7f6ed406d1a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.961+0000 7f6ef8258700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef00c6c70 0x7f6ef014f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.961+0000 7f6ef8258700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef00c5a60 0x7f6ef0146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.961+0000 7f6ef8258700 1 --2- 172.21.15.6:0/2704548112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef00c5ed0 0x7f6ef014f2d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.961+0000 7f6ef8258700 1 -- 172.21.15.6:0/2704548112 >> 172.21.15.6:0/2704548112 conn(0x7f6ef00ca040 msgr2=0x7f6ef014a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:24.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.962+0000 7f6ef8258700 1 -- 172.21.15.6:0/2704548112 shutdown_connections 2023-07-21T07:36:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:23.962+0000 7f6ef8258700 1 -- 172.21.15.6:0/2704548112 wait complete. 2023-07-21T07:36:24.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-07-21T07:36:24.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.112+0000 7f337da55700 1 Processor -- start 2023-07-21T07:36:24.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.112+0000 7f337da55700 1 -- start start 2023-07-21T07:36:24.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f337da55700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3378151b70 0x7f33780bea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f337da55700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3378158660 0x7f337815ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f337da55700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33781581d0 con 0x7f33780c7260 2023-07-21T07:36:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f337da55700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33780c98e0 con 0x7f3378158660 2023-07-21T07:36:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f337da55700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3378155360 con 0x7f3378151b70 2023-07-21T07:36:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f33777fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3378158660 0x7f337815ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f33777fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3378158660 0x7f337815ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35796/0 (socket says 172.21.15.6:35796) 2023-07-21T07:36:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f33777fe700 1 -- 172.21.15.6:0/2651993616 learned_addr learned my addr 172.21.15.6:0/2651993616 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f3376ffd700 1 --2- 172.21.15.6:0/2651993616 >> v2:172.21.15.86:3300/0 conn(0x7f3378151b70 0x7f33780bea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f33777fe700 1 -- 172.21.15.6:0/2651993616 >> v2:172.21.15.86:3300/0 conn(0x7f3378151b70 msgr2=0x7f33780bea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f33777fe700 1 --2- 172.21.15.6:0/2651993616 >> v2:172.21.15.86:3300/0 conn(0x7f3378151b70 0x7f33780bea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f33777fe700 1 -- 172.21.15.6:0/2651993616 >> v1:172.21.15.86:6789/0 conn(0x7f33780c7260 legacy=0x7f33780c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f33777fe700 1 -- 172.21.15.6:0/2651993616 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3378155080 con 0x7f3378158660 2023-07-21T07:36:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.113+0000 7f3376ffd700 1 --2- 172.21.15.6:0/2651993616 >> v2:172.21.15.86:3300/0 conn(0x7f3378151b70 0x7f33780bea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.114+0000 7f33777fe700 1 --2- 172.21.15.6:0/2651993616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3378158660 0x7f337815ede0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f337808b9e0 tx=0x7f337000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b003a070bc28b3c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.114+0000 7f3375ffb700 1 -- 172.21.15.6:0/2651993616 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337000e070 con 0x7f3378158660 2023-07-21T07:36:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.114+0000 7f3375ffb700 1 -- 172.21.15.6:0/2651993616 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3370003a20 con 0x7f3378158660 2023-07-21T07:36:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.114+0000 7f3375ffb700 1 -- 172.21.15.6:0/2651993616 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3370003dd0 con 0x7f3378158660 2023-07-21T07:36:24.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.114+0000 7f337da55700 1 -- 172.21.15.6:0/2651993616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3378158660 msgr2=0x7f337815ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.114+0000 7f337da55700 1 --2- 172.21.15.6:0/2651993616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3378158660 0x7f337815ede0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f337808b9e0 tx=0x7f337000b330 comp rx=0 tx=0).stop 2023-07-21T07:36:24.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.114+0000 7f337da55700 1 -- 172.21.15.6:0/2651993616 shutdown_connections 2023-07-21T07:36:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.114+0000 7f337da55700 1 --2- 172.21.15.6:0/2651993616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3378158660 0x7f337815ede0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.114+0000 7f337da55700 1 --2- 172.21.15.6:0/2651993616 >> v2:172.21.15.86:3300/0 conn(0x7f3378151b70 0x7f33780bea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.114+0000 7f337da55700 1 -- 172.21.15.6:0/2651993616 >> 172.21.15.6:0/2651993616 conn(0x7f33780c6620 msgr2=0x7f33780c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.114+0000 7f337da55700 1 -- 172.21.15.6:0/2651993616 shutdown_connections 2023-07-21T07:36:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.114+0000 7f337da55700 1 -- 172.21.15.6:0/2651993616 wait complete. 2023-07-21T07:36:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.116+0000 7f337da55700 1 Processor -- start 2023-07-21T07:36:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.116+0000 7f337da55700 1 -- start start 2023-07-21T07:36:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.116+0000 7f337da55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33780c7260 0x7f337806bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.116+0000 7f337da55700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3378151b70 0x7f337814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.116+0000 7f337da55700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3378158660 0x7f3378152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.116+0000 7f337da55700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33780ae640 con 0x7f33780c7260 2023-07-21T07:36:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.116+0000 7f337da55700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33781527c0 con 0x7f3378151b70 2023-07-21T07:36:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.116+0000 7f337da55700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3378154480 con 0x7f3378158660 2023-07-21T07:36:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f3376ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33780c7260 0x7f337806bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f3376ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33780c7260 0x7f337806bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35798/0 (socket says 172.21.15.6:35798) 2023-07-21T07:36:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f3376ffd700 1 -- 172.21.15.6:0/3654283755 learned_addr learned my addr 172.21.15.6:0/3654283755 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f33767fc700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3378151b70 0x7f337814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f33777fe700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3378158660 0x7f3378152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f3376ffd700 1 -- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3378158660 msgr2=0x7f3378152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f3376ffd700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3378158660 0x7f3378152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f3376ffd700 1 -- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3378151b70 msgr2=0x7f337814c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f3376ffd700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3378151b70 0x7f337814c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f3376ffd700 1 -- 172.21.15.6:0/3654283755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3370009b30 con 0x7f33780c7260 2023-07-21T07:36:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f3376ffd700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33780c7260 0x7f337806bcf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f336c00c750 tx=0x7f336c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f335ffff700 1 -- 172.21.15.6:0/3654283755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c011800 con 0x7f33780c7260 2023-07-21T07:36:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f335ffff700 1 -- 172.21.15.6:0/3654283755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c011960 con 0x7f33780c7260 2023-07-21T07:36:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f337da55700 1 -- 172.21.15.6:0/3654283755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33781541a0 con 0x7f33780c7260 2023-07-21T07:36:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f335ffff700 1 -- 172.21.15.6:0/3654283755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c011cd0 con 0x7f33780c7260 2023-07-21T07:36:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.117+0000 7f337da55700 1 -- 172.21.15.6:0/3654283755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3378152450 con 0x7f33780c7260 2023-07-21T07:36:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.118+0000 7f337da55700 1 -- 172.21.15.6:0/3654283755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33781e9e70 con 0x7f33780c7260 2023-07-21T07:36:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.119+0000 7f335ffff700 1 -- 172.21.15.6:0/3654283755 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f336c021350 con 0x7f33780c7260 2023-07-21T07:36:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.119+0000 7f335ffff700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f336406ace0 0x7f336406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.119+0000 7f335ffff700 1 -- 172.21.15.6:0/3654283755 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f336c088fa0 con 0x7f33780c7260 2023-07-21T07:36:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.119+0000 7f33767fc700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f336406ace0 0x7f336406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.120+0000 7f33767fc700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f336406ace0 0x7f336406d1a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3378153f20 tx=0x7f33680090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.123+0000 7f335ffff700 1 -- 172.21.15.6:0/3654283755 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f336c0bb310 con 0x7f33780c7260 2023-07-21T07:36:24.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.405+0000 7f337da55700 1 -- 172.21.15.6:0/3654283755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f3378152aa0 con 0x7f33780c7260 2023-07-21T07:36:24.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.408+0000 7f335ffff700 1 -- 172.21.15.6:0/3654283755 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v12) v1 ==== 85+0+0 (secure 0 0 0) 0x7f33781e9e70 con 0x7f33780c7260 2023-07-21T07:36:24.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.410+0000 7f337da55700 1 -- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f336406ace0 msgr2=0x7f336406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.410+0000 7f337da55700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f336406ace0 0x7f336406d1a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3378153f20 tx=0x7f33680090e0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.410+0000 7f337da55700 1 -- 172.21.15.6:0/3654283755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33780c7260 msgr2=0x7f337806bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.410+0000 7f337da55700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33780c7260 0x7f337806bcf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f336c00c750 tx=0x7f336c00ca60 comp rx=0 tx=0).stop 2023-07-21T07:36:24.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.410+0000 7f337da55700 1 -- 172.21.15.6:0/3654283755 shutdown_connections 2023-07-21T07:36:24.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.410+0000 7f337da55700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f336406ace0 0x7f336406d1a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.410+0000 7f337da55700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3378158660 0x7f3378152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.410+0000 7f337da55700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33780c7260 0x7f337806bcf0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.410+0000 7f337da55700 1 --2- 172.21.15.6:0/3654283755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3378151b70 0x7f337814c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.410+0000 7f337da55700 1 -- 172.21.15.6:0/3654283755 >> 172.21.15.6:0/3654283755 conn(0x7f33780c6620 msgr2=0x7f3378155a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:24.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.410+0000 7f337da55700 1 -- 172.21.15.6:0/3654283755 shutdown_connections 2023-07-21T07:36:24.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.410+0000 7f337da55700 1 -- 172.21.15.6:0/3654283755 wait complete. 2023-07-21T07:36:24.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:24.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.549+0000 7f222e38f700 1 Processor -- start 2023-07-21T07:36:24.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.549+0000 7f222e38f700 1 -- start start 2023-07-21T07:36:24.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.549+0000 7f222e38f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f222806da20 0x7f2228151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.549+0000 7f222e38f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2228151c50 0x7f22280c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.549+0000 7f222e38f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22280c2ab0 con 0x7f222806a300 2023-07-21T07:36:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.549+0000 7f222e38f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222806e000 con 0x7f222806da20 2023-07-21T07:36:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.549+0000 7f222e38f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222806e2e0 con 0x7f2228151c50 2023-07-21T07:36:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.550+0000 7f22277fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f222806da20 0x7f2228151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.550+0000 7f222c92c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2228151c50 0x7f22280c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.550+0000 7f2227fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f222806a300 0x7f2228155050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:47070/0 (socket says 172.21.15.6:47070) 2023-07-21T07:36:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.550+0000 7f2227fff700 1 -- 172.21.15.6:0/1044318739 learned_addr learned my addr 172.21.15.6:0/1044318739 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:24.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.550+0000 7f22277fe700 1 -- 172.21.15.6:0/1044318739 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2228151c50 msgr2=0x7f22280c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:24.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.550+0000 7f22277fe700 1 --2- 172.21.15.6:0/1044318739 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2228151c50 0x7f22280c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.550+0000 7f22277fe700 1 -- 172.21.15.6:0/1044318739 >> v1:172.21.15.86:6789/0 conn(0x7f222806a300 legacy=0x7f2228155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.550+0000 7f22277fe700 1 -- 172.21.15.6:0/1044318739 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222806e5c0 con 0x7f222806da20 2023-07-21T07:36:24.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.550+0000 7f2226ffd700 1 -- 172.21.15.6:0/1044318739 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132351206 0 0) 0x7f22280c2ab0 con 0x7f222806a300 2023-07-21T07:36:24.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.550+0000 7f222c92c700 1 --2- 172.21.15.6:0/1044318739 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2228151c50 0x7f22280c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:24.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.550+0000 7f22277fe700 1 --2- 172.21.15.6:0/1044318739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f222806da20 0x7f2228151710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2210009870 tx=0x7f2210009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a90b1b458c2d2d2d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:24.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.551+0000 7f2226ffd700 1 -- 172.21.15.6:0/1044318739 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210011830 con 0x7f222806da20 2023-07-21T07:36:24.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.551+0000 7f2226ffd700 1 -- 172.21.15.6:0/1044318739 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2210011990 con 0x7f222806da20 2023-07-21T07:36:24.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.551+0000 7f2226ffd700 1 -- 172.21.15.6:0/1044318739 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210011d20 con 0x7f222806da20 2023-07-21T07:36:24.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.551+0000 7f222e38f700 1 -- 172.21.15.6:0/1044318739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f222806da20 msgr2=0x7f2228151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.551+0000 7f222e38f700 1 --2- 172.21.15.6:0/1044318739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f222806da20 0x7f2228151710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2210009870 tx=0x7f2210009b80 comp rx=0 tx=0).stop 2023-07-21T07:36:24.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.551+0000 7f222e38f700 1 -- 172.21.15.6:0/1044318739 shutdown_connections 2023-07-21T07:36:24.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.551+0000 7f222e38f700 1 --2- 172.21.15.6:0/1044318739 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2228151c50 0x7f22280c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.551+0000 7f222e38f700 1 --2- 172.21.15.6:0/1044318739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f222806da20 0x7f2228151710 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.551+0000 7f222e38f700 1 -- 172.21.15.6:0/1044318739 >> 172.21.15.6:0/1044318739 conn(0x7f22280a8c90 msgr2=0x7f222806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:24.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.551+0000 7f222e38f700 1 -- 172.21.15.6:0/1044318739 shutdown_connections 2023-07-21T07:36:24.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.551+0000 7f222e38f700 1 -- 172.21.15.6:0/1044318739 wait complete. 2023-07-21T07:36:24.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.552+0000 7f222e38f700 1 Processor -- start 2023-07-21T07:36:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.553+0000 7f222e38f700 1 -- start start 2023-07-21T07:36:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.553+0000 7f222e38f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222806a300 0x7f22280c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.553+0000 7f222e38f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f222806da20 0x7f22281edbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.553+0000 7f222e38f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2228151c50 0x7f2228071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.553+0000 7f222e38f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22280c6d80 con 0x7f222806a300 2023-07-21T07:36:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.553+0000 7f222e38f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22281e9c60 con 0x7f222806da20 2023-07-21T07:36:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.553+0000 7f222e38f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22281ee170 con 0x7f2228151c50 2023-07-21T07:36:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.553+0000 7f2227fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222806a300 0x7f22280c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.553+0000 7f2227fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222806a300 0x7f22280c6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35814/0 (socket says 172.21.15.6:35814) 2023-07-21T07:36:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.553+0000 7f2227fff700 1 -- 172.21.15.6:0/2045561480 learned_addr learned my addr 172.21.15.6:0/2045561480 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.553+0000 7f22277fe700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f222806da20 0x7f22281edbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.554+0000 7f222c92c700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2228151c50 0x7f2228071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.554+0000 7f2227fff700 1 -- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2228151c50 msgr2=0x7f2228071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.554+0000 7f2227fff700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2228151c50 0x7f2228071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.554+0000 7f2227fff700 1 -- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f222806da20 msgr2=0x7f22281edbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.554+0000 7f2227fff700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f222806da20 0x7f22281edbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.554+0000 7f2227fff700 1 -- 172.21.15.6:0/2045561480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2220009a70 con 0x7f222806a300 2023-07-21T07:36:24.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.554+0000 7f2227fff700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222806a300 0x7f22280c6030 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f221800c550 tx=0x7f221800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.554+0000 7f2224ff9700 1 -- 172.21.15.6:0/2045561480 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2218004c80 con 0x7f222806a300 2023-07-21T07:36:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.554+0000 7f2224ff9700 1 -- 172.21.15.6:0/2045561480 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2218004e00 con 0x7f222806a300 2023-07-21T07:36:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.554+0000 7f2224ff9700 1 -- 172.21.15.6:0/2045561480 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2218007310 con 0x7f222806a300 2023-07-21T07:36:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.554+0000 7f222e38f700 1 -- 172.21.15.6:0/2045561480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22100094a0 con 0x7f222806a300 2023-07-21T07:36:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.554+0000 7f222e38f700 1 -- 172.21.15.6:0/2045561480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22281ea110 con 0x7f222806a300 2023-07-21T07:36:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.555+0000 7f222e38f700 1 -- 172.21.15.6:0/2045561480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2228074500 con 0x7f222806a300 2023-07-21T07:36:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.556+0000 7f2224ff9700 1 -- 172.21.15.6:0/2045561480 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2218007470 con 0x7f222806a300 2023-07-21T07:36:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.556+0000 7f2224ff9700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f220806ace0 0x7f220806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.556+0000 7f2224ff9700 1 -- 172.21.15.6:0/2045561480 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2218088c60 con 0x7f222806a300 2023-07-21T07:36:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.556+0000 7f22277fe700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f220806ace0 0x7f220806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.557+0000 7f22277fe700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f220806ace0 0x7f220806d1a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2210009840 tx=0x7f2210008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.561+0000 7f2224ff9700 1 -- 172.21.15.6:0/2045561480 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f22180540f0 con 0x7f222806a300 2023-07-21T07:36:24.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.759+0000 7f222e38f700 1 -- 172.21.15.6:0/2045561480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22280c7a00 con 0x7f222806a300 2023-07-21T07:36:24.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.760+0000 7f2224ff9700 1 -- 172.21.15.6:0/2045561480 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+14531 (secure 0 0 0) 0x7f2218057710 con 0x7f222806a300 2023-07-21T07:36:24.814 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:24.814 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":50,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:36:23.525063+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:24.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.762+0000 7f222e38f700 1 -- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f220806ace0 msgr2=0x7f220806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.762+0000 7f222e38f700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f220806ace0 0x7f220806d1a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2210009840 tx=0x7f2210008030 comp rx=0 tx=0).stop 2023-07-21T07:36:24.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.762+0000 7f222e38f700 1 -- 172.21.15.6:0/2045561480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222806a300 msgr2=0x7f22280c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.762+0000 7f222e38f700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222806a300 0x7f22280c6030 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f221800c550 tx=0x7f221800c860 comp rx=0 tx=0).stop 2023-07-21T07:36:24.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.762+0000 7f222e38f700 1 -- 172.21.15.6:0/2045561480 shutdown_connections 2023-07-21T07:36:24.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.762+0000 7f222e38f700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f220806ace0 0x7f220806d1a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.762+0000 7f222e38f700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2228151c50 0x7f2228071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.762+0000 7f222e38f700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f222806a300 0x7f22280c6030 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.762+0000 7f222e38f700 1 --2- 172.21.15.6:0/2045561480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f222806da20 0x7f22281edbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.762+0000 7f222e38f700 1 -- 172.21.15.6:0/2045561480 >> 172.21.15.6:0/2045561480 conn(0x7f22280a8c90 msgr2=0x7f22281decb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:24.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.763+0000 7f222e38f700 1 -- 172.21.15.6:0/2045561480 shutdown_connections 2023-07-21T07:36:24.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.763+0000 7f222e38f700 1 -- 172.21.15.6:0/2045561480 wait complete. 2023-07-21T07:36:24.829 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:36:24.829 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:36:24.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.904+0000 7f38604fa700 1 Processor -- start 2023-07-21T07:36:24.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.904+0000 7f38604fa700 1 -- start start 2023-07-21T07:36:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f38604fa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f38580ba140 0x7f38580c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f38604fa700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3858155530 con 0x7f385806a300 2023-07-21T07:36:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f38604fa700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580c5690 con 0x7f385806d8a0 2023-07-21T07:36:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f38604fa700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38580c1a30 con 0x7f38580ba140 2023-07-21T07:36:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f385da95700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f38580ba140 0x7f38580c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f385da95700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f38580ba140 0x7f38580c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35824/0 (socket says 172.21.15.6:35824) 2023-07-21T07:36:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f385e296700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f385806a300 0x7f38581519b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43842/0 (socket says 172.21.15.6:43842) 2023-07-21T07:36:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f385da95700 1 -- 172.21.15.6:0/3737402094 learned_addr learned my addr 172.21.15.6:0/3737402094 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f385da95700 1 -- 172.21.15.6:0/3737402094 >> v1:172.21.15.86:6789/0 conn(0x7f385806d8a0 legacy=0x7f38580c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f385da95700 1 -- 172.21.15.6:0/3737402094 >> v1:172.21.15.6:6789/0 conn(0x7f385806a300 legacy=0x7f38581519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f385da95700 1 -- 172.21.15.6:0/3737402094 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3858154920 con 0x7f38580ba140 2023-07-21T07:36:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f385da95700 1 --2- 172.21.15.6:0/3737402094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38580ba140 0x7f38580c4a40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f38480098f0 tx=0x7f3848009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108c523916a3421a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:24.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f385d294700 1 -- 172.21.15.6:0/3737402094 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848004230 con 0x7f38580ba140 2023-07-21T07:36:24.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f385d294700 1 -- 172.21.15.6:0/3737402094 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3848004390 con 0x7f38580ba140 2023-07-21T07:36:24.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.905+0000 7f385d294700 1 -- 172.21.15.6:0/3737402094 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480036a0 con 0x7f38580ba140 2023-07-21T07:36:24.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.906+0000 7f38604fa700 1 -- 172.21.15.6:0/3737402094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38580ba140 msgr2=0x7f38580c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.906+0000 7f38604fa700 1 --2- 172.21.15.6:0/3737402094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38580ba140 0x7f38580c4a40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f38480098f0 tx=0x7f3848009c00 comp rx=0 tx=0).stop 2023-07-21T07:36:24.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.906+0000 7f38604fa700 1 -- 172.21.15.6:0/3737402094 shutdown_connections 2023-07-21T07:36:24.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.906+0000 7f38604fa700 1 --2- 172.21.15.6:0/3737402094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38580ba140 0x7f38580c4a40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.906+0000 7f38604fa700 1 -- 172.21.15.6:0/3737402094 >> 172.21.15.6:0/3737402094 conn(0x7f38580a8660 msgr2=0x7f38580a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:24.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.906+0000 7f38604fa700 1 -- 172.21.15.6:0/3737402094 shutdown_connections 2023-07-21T07:36:24.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.906+0000 7f38604fa700 1 -- 172.21.15.6:0/3737402094 wait complete. 2023-07-21T07:36:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.907+0000 7f38604fa700 1 Processor -- start 2023-07-21T07:36:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.907+0000 7f38604fa700 1 -- start start 2023-07-21T07:36:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f38604fa700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f385806a300 0x7f385814c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f38604fa700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f385806d8a0 0x7f3858070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f38604fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38580ba140 0x7f3858071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f38604fa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3858071980 con 0x7f38580ba140 2023-07-21T07:36:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f38604fa700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38581ead60 con 0x7f385806d8a0 2023-07-21T07:36:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f38604fa700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38581ed4a0 con 0x7f385806a300 2023-07-21T07:36:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f385ea97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38580ba140 0x7f3858071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f385ea97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38580ba140 0x7f3858071440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35832/0 (socket says 172.21.15.6:35832) 2023-07-21T07:36:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f385ea97700 1 -- 172.21.15.6:0/2833769398 learned_addr learned my addr 172.21.15.6:0/2833769398 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f385da95700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f385806d8a0 0x7f3858070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f385e296700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f385806a300 0x7f385814c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f385ea97700 1 -- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f385806a300 msgr2=0x7f385814c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f385ea97700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f385806a300 0x7f385814c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f385ea97700 1 -- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f385806d8a0 msgr2=0x7f3858070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f385ea97700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f385806d8a0 0x7f3858070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:24.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.908+0000 7f385ea97700 1 -- 172.21.15.6:0/2833769398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3848009550 con 0x7f38580ba140 2023-07-21T07:36:24.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.909+0000 7f385ea97700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38580ba140 0x7f3858071440 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f385000cc10 tx=0x7f385000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:24.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.909+0000 7f384effd700 1 -- 172.21.15.6:0/2833769398 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385000abb0 con 0x7f38580ba140 2023-07-21T07:36:24.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.909+0000 7f384effd700 1 -- 172.21.15.6:0/2833769398 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385000ad10 con 0x7f38580ba140 2023-07-21T07:36:24.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.909+0000 7f38604fa700 1 -- 172.21.15.6:0/2833769398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38581ed780 con 0x7f38580ba140 2023-07-21T07:36:24.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.909+0000 7f384effd700 1 -- 172.21.15.6:0/2833769398 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850012660 con 0x7f38580ba140 2023-07-21T07:36:24.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.909+0000 7f38604fa700 1 -- 172.21.15.6:0/2833769398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38581edd40 con 0x7f38580ba140 2023-07-21T07:36:24.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.910+0000 7f38604fa700 1 -- 172.21.15.6:0/2833769398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38581edf30 con 0x7f38580ba140 2023-07-21T07:36:24.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.910+0000 7f384effd700 1 -- 172.21.15.6:0/2833769398 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38500127c0 con 0x7f38580ba140 2023-07-21T07:36:24.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.910+0000 7f384effd700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f383c06ace0 0x7f383c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:24.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.911+0000 7f384effd700 1 -- 172.21.15.6:0/2833769398 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3850089880 con 0x7f38580ba140 2023-07-21T07:36:24.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.911+0000 7f385e296700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f383c06ace0 0x7f383c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:24.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.911+0000 7f385e296700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f383c06ace0 0x7f383c06d1a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3854000f60 tx=0x7f3854009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:24.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:24.915+0000 7f384effd700 1 -- 172.21.15.6:0/2833769398 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3850054d10 con 0x7f38580ba140 2023-07-21T07:36:25.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.113+0000 7f38604fa700 1 -- 172.21.15.6:0/2833769398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3858074500 con 0x7f38580ba140 2023-07-21T07:36:25.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.113+0000 7f384effd700 1 -- 172.21.15.6:0/2833769398 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3850016020 con 0x7f38580ba140 2023-07-21T07:36:25.168 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:36:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.115+0000 7f38604fa700 1 -- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f383c06ace0 msgr2=0x7f383c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.115+0000 7f38604fa700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f383c06ace0 0x7f383c06d1a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3854000f60 tx=0x7f3854009040 comp rx=0 tx=0).stop 2023-07-21T07:36:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.115+0000 7f38604fa700 1 -- 172.21.15.6:0/2833769398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38580ba140 msgr2=0x7f3858071440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.115+0000 7f38604fa700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38580ba140 0x7f3858071440 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f385000cc10 tx=0x7f385000a060 comp rx=0 tx=0).stop 2023-07-21T07:36:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.115+0000 7f38604fa700 1 -- 172.21.15.6:0/2833769398 shutdown_connections 2023-07-21T07:36:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.115+0000 7f38604fa700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f383c06ace0 0x7f383c06d1a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.115+0000 7f38604fa700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38580ba140 0x7f3858071440 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.115+0000 7f38604fa700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f385806a300 0x7f385814c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.115+0000 7f38604fa700 1 --2- 172.21.15.6:0/2833769398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f385806d8a0 0x7f3858070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.115+0000 7f38604fa700 1 -- 172.21.15.6:0/2833769398 >> 172.21.15.6:0/2833769398 conn(0x7f38580a8660 msgr2=0x7f38580c3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.115+0000 7f38604fa700 1 -- 172.21.15.6:0/2833769398 shutdown_connections 2023-07-21T07:36:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.116+0000 7f38604fa700 1 -- 172.21.15.6:0/2833769398 wait complete. 2023-07-21T07:36:25.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:36:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.255+0000 7fc170003700 1 Processor -- start 2023-07-21T07:36:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.256+0000 7fc170003700 1 -- start start 2023-07-21T07:36:25.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.256+0000 7fc170003700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc1680c3f80 0x7fc168151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.256+0000 7fc170003700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1681517c0 con 0x7fc1680c1860 2023-07-21T07:36:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.256+0000 7fc170003700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1680c4e50 con 0x7fc1680c5260 2023-07-21T07:36:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.256+0000 7fc170003700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1681519f0 con 0x7fc1680c3f80 2023-07-21T07:36:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.256+0000 7fc16dd9f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc1680c1860 0x7fc16806dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43856/0 (socket says 172.21.15.6:43856) 2023-07-21T07:36:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16dd9f700 1 -- 172.21.15.6:0/2694284812 learned_addr learned my addr 172.21.15.6:0/2694284812 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16e5a0700 1 --2- 172.21.15.6:0/2694284812 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc1680c3f80 0x7fc168151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150635931 0 0) 0x7fc1681517c0 con 0x7fc1680c1860 2023-07-21T07:36:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1540035b0 con 0x7fc1680c1860 2023-07-21T07:36:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 519369681 0 0) 0x7fc1540035b0 con 0x7fc1680c1860 2023-07-21T07:36:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc1680c3f80 msgr2=0x7fc168151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 --2- 172.21.15.6:0/2694284812 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc1680c3f80 0x7fc168151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 >> v1:172.21.15.86:6789/0 conn(0x7fc1680c5260 legacy=0x7fc1680c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc168151cd0 con 0x7fc1680c1860 2023-07-21T07:36:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7fc164001670 con 0x7fc1680c1860 2023-07-21T07:36:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 >> v1:172.21.15.6:6789/0 conn(0x7fc1680c1860 legacy=0x7fc16806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 --2- 172.21.15.6:0/2694284812 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc1680c3f80 0x7fc154003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 --2- 172.21.15.6:0/2694284812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc154003fb0 0x7fc154004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 --2- 172.21.15.6:0/2694284812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc154004d90 0x7fc154005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1681519f0 con 0x7fc154003fb0 2023-07-21T07:36:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15400baf0 con 0x7fc154004d90 2023-07-21T07:36:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15400dec0 con 0x7fc1680c3f80 2023-07-21T07:36:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16d59e700 1 --2- 172.21.15.6:0/2694284812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc154003fb0 0x7fc154004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16dd9f700 1 --2- 172.21.15.6:0/2694284812 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc1680c3f80 0x7fc154003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.257+0000 7fc16e5a0700 1 --2- 172.21.15.6:0/2694284812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc154004d90 0x7fc154005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc16d59e700 1 -- 172.21.15.6:0/2694284812 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc1680c3f80 msgr2=0x7fc154003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc16d59e700 1 --2- 172.21.15.6:0/2694284812 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc1680c3f80 0x7fc154003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc16d59e700 1 -- 172.21.15.6:0/2694284812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc154004d90 msgr2=0x7fc154005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:25.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc16d59e700 1 --2- 172.21.15.6:0/2694284812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc154004d90 0x7fc154005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc16d59e700 1 -- 172.21.15.6:0/2694284812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1540035b0 con 0x7fc154003fb0 2023-07-21T07:36:25.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc16e5a0700 1 --2- 172.21.15.6:0/2694284812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc154004d90 0x7fc154005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:25.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc16d59e700 1 --2- 172.21.15.6:0/2694284812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc154003fb0 0x7fc154004850 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc15c001800 tx=0x7fc154005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c99671a0455d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:25.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0012f0 con 0x7fc154003fb0 2023-07-21T07:36:25.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c0052f0 con 0x7fc154003fb0 2023-07-21T07:36:25.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc16cd9d700 1 -- 172.21.15.6:0/2694284812 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c006860 con 0x7fc154003fb0 2023-07-21T07:36:25.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc170003700 1 -- 172.21.15.6:0/2694284812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc154003fb0 msgr2=0x7fc154004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc170003700 1 --2- 172.21.15.6:0/2694284812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc154003fb0 0x7fc154004850 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc15c001800 tx=0x7fc154005880 comp rx=0 tx=0).stop 2023-07-21T07:36:25.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc16e5a0700 1 -- 172.21.15.6:0/2694284812 reap_dead start 2023-07-21T07:36:25.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc170003700 1 -- 172.21.15.6:0/2694284812 shutdown_connections 2023-07-21T07:36:25.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.258+0000 7fc170003700 1 -- 172.21.15.6:0/2694284812 >> 172.21.15.6:0/2694284812 conn(0x7fc1680a8660 msgr2=0x7fc1680a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:25.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.259+0000 7fc170003700 1 -- 172.21.15.6:0/2694284812 shutdown_connections 2023-07-21T07:36:25.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.259+0000 7fc170003700 1 -- 172.21.15.6:0/2694284812 wait complete. 2023-07-21T07:36:25.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.260+0000 7fc170003700 1 Processor -- start 2023-07-21T07:36:25.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.260+0000 7fc170003700 1 -- start start 2023-07-21T07:36:25.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.260+0000 7fc170003700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc154003fb0 0x7fc1680bca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.260+0000 7fc170003700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1681e6790 0x7fc1680b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.260+0000 7fc170003700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1680bf720 0x7fc1680bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.260+0000 7fc170003700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1680ab4f0 con 0x7fc1680bf720 2023-07-21T07:36:25.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.260+0000 7fc170003700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1681e6c20 con 0x7fc1681e6790 2023-07-21T07:36:25.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.260+0000 7fc170003700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1680bfde0 con 0x7fc154003fb0 2023-07-21T07:36:25.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc16e5a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1680bf720 0x7fc1680bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc16e5a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1680bf720 0x7fc1680bdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35852/0 (socket says 172.21.15.6:35852) 2023-07-21T07:36:25.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc16e5a0700 1 -- 172.21.15.6:0/1357347950 learned_addr learned my addr 172.21.15.6:0/1357347950 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:25.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc16dd9f700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc154003fb0 0x7fc1680bca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc16d59e700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1681e6790 0x7fc1680b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc16e5a0700 1 -- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc154003fb0 msgr2=0x7fc1680bca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc16e5a0700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc154003fb0 0x7fc1680bca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc16e5a0700 1 -- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1681e6790 msgr2=0x7fc1680b93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc16e5a0700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1681e6790 0x7fc1680b93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc16e5a0700 1 -- 172.21.15.6:0/1357347950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1680c00c0 con 0x7fc1680bf720 2023-07-21T07:36:25.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc16e5a0700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1680bf720 0x7fc1680bdb80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc1680ba560 tx=0x7fc1600104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:25.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc15a7fc700 1 -- 172.21.15.6:0/1357347950 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16000e050 con 0x7fc1680bf720 2023-07-21T07:36:25.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc15a7fc700 1 -- 172.21.15.6:0/1357347950 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16000f040 con 0x7fc1680bf720 2023-07-21T07:36:25.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc170003700 1 -- 172.21.15.6:0/1357347950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1680c03a0 con 0x7fc1680bf720 2023-07-21T07:36:25.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc15a7fc700 1 -- 172.21.15.6:0/1357347950 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc160007ea0 con 0x7fc1680bf720 2023-07-21T07:36:25.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.261+0000 7fc170003700 1 -- 172.21.15.6:0/1357347950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1680bcf60 con 0x7fc1680bf720 2023-07-21T07:36:25.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.262+0000 7fc170003700 1 -- 172.21.15.6:0/1357347950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1680bf440 con 0x7fc1680bf720 2023-07-21T07:36:25.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.263+0000 7fc15a7fc700 1 -- 172.21.15.6:0/1357347950 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc160003a20 con 0x7fc1680bf720 2023-07-21T07:36:25.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.263+0000 7fc15a7fc700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc14c06ace0 0x7fc14c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.263+0000 7fc15a7fc700 1 -- 172.21.15.6:0/1357347950 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc1600893b0 con 0x7fc1680bf720 2023-07-21T07:36:25.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.263+0000 7fc16dd9f700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc14c06ace0 0x7fc14c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.264+0000 7fc16dd9f700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc14c06ace0 0x7fc14c06d1a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc164000c00 tx=0x7fc164000ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:25.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.267+0000 7fc15a7fc700 1 -- 172.21.15.6:0/1357347950 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc160054840 con 0x7fc1680bf720 2023-07-21T07:36:25.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.465+0000 7fc170003700 1 -- 172.21.15.6:0/1357347950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc168074500 con 0x7fc1680bf720 2023-07-21T07:36:25.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.465+0000 7fc15a7fc700 1 -- 172.21.15.6:0/1357347950 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc160057e60 con 0x7fc1680bf720 2023-07-21T07:36:25.520 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:36:25.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.468+0000 7fc170003700 1 -- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc14c06ace0 msgr2=0x7fc14c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.468+0000 7fc170003700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc14c06ace0 0x7fc14c06d1a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc164000c00 tx=0x7fc164000ed0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.468+0000 7fc170003700 1 -- 172.21.15.6:0/1357347950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1680bf720 msgr2=0x7fc1680bdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.468+0000 7fc170003700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1680bf720 0x7fc1680bdb80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc1680ba560 tx=0x7fc1600104a0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.468+0000 7fc170003700 1 -- 172.21.15.6:0/1357347950 shutdown_connections 2023-07-21T07:36:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.468+0000 7fc170003700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc14c06ace0 0x7fc14c06d1a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.468+0000 7fc170003700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1680bf720 0x7fc1680bdb80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.468+0000 7fc170003700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc154003fb0 0x7fc1680bca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.468+0000 7fc170003700 1 --2- 172.21.15.6:0/1357347950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1681e6790 0x7fc1680b93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.468+0000 7fc170003700 1 -- 172.21.15.6:0/1357347950 >> 172.21.15.6:0/1357347950 conn(0x7fc1680a8660 msgr2=0x7fc168150bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.468+0000 7fc170003700 1 -- 172.21.15.6:0/1357347950 shutdown_connections 2023-07-21T07:36:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.468+0000 7fc170003700 1 -- 172.21.15.6:0/1357347950 wait complete. 2023-07-21T07:36:25.533 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T07:36:25.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.606+0000 7f648526b700 1 Processor -- start 2023-07-21T07:36:25.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.606+0000 7f648526b700 1 -- start start 2023-07-21T07:36:25.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.607+0000 7f648526b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64800c6170 0x7f648014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.607+0000 7f648526b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64800c53e0 0x7f6480154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.607+0000 7f648526b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64800ba440 con 0x7f64800c3750 2023-07-21T07:36:25.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.607+0000 7f648526b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64800c15d0 con 0x7f64800c53e0 2023-07-21T07:36:25.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.607+0000 7f648526b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64800c18b0 con 0x7f64800c6170 2023-07-21T07:36:25.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.607+0000 7f647e7fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64800c6170 0x7f648014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.607+0000 7f647f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64800c53e0 0x7f6480154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.608+0000 7f647e7fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64800c6170 0x7f648014ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:33252/0 (socket says 172.21.15.6:33252) 2023-07-21T07:36:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.608+0000 7f647f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64800c53e0 0x7f6480154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:57664/0 (socket says 172.21.15.6:57664) 2023-07-21T07:36:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.608+0000 7f647e7fc700 1 -- 172.21.15.6:0/372071411 learned_addr learned my addr 172.21.15.6:0/372071411 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.608+0000 7f647effd700 1 --1- 172.21.15.6:0/372071411 >> v1:172.21.15.86:6789/0 conn(0x7f64800c3750 0x7f648014e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:47118/0 (socket says 172.21.15.6:47118) 2023-07-21T07:36:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.608+0000 7f647e7fc700 1 -- 172.21.15.6:0/372071411 >> v2:172.21.15.86:3300/0 conn(0x7f64800c53e0 msgr2=0x7f6480154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.608+0000 7f647e7fc700 1 --2- 172.21.15.6:0/372071411 >> v2:172.21.15.86:3300/0 conn(0x7f64800c53e0 0x7f6480154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.608+0000 7f647e7fc700 1 -- 172.21.15.6:0/372071411 >> v1:172.21.15.86:6789/0 conn(0x7f64800c3750 legacy=0x7f648014e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.608+0000 7f647e7fc700 1 -- 172.21.15.6:0/372071411 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64800c1b90 con 0x7f64800c6170 2023-07-21T07:36:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.608+0000 7f647f7fe700 1 --2- 172.21.15.6:0/372071411 >> v2:172.21.15.86:3300/0 conn(0x7f64800c53e0 0x7f6480154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.608+0000 7f647e7fc700 1 --2- 172.21.15.6:0/372071411 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64800c6170 0x7f648014ed60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64700098f0 tx=0x7f6470009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7739d9cd11601d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.608+0000 7f647dffb700 1 -- 172.21.15.6:0/372071411 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470011830 con 0x7f64800c6170 2023-07-21T07:36:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.608+0000 7f647dffb700 1 -- 172.21.15.6:0/372071411 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6470011990 con 0x7f64800c6170 2023-07-21T07:36:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.608+0000 7f647dffb700 1 -- 172.21.15.6:0/372071411 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470011d20 con 0x7f64800c6170 2023-07-21T07:36:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.609+0000 7f648526b700 1 -- 172.21.15.6:0/372071411 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64800c6170 msgr2=0x7f648014ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.609+0000 7f648526b700 1 --2- 172.21.15.6:0/372071411 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64800c6170 0x7f648014ed60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64700098f0 tx=0x7f6470009c00 comp rx=0 tx=0).stop 2023-07-21T07:36:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.609+0000 7f648526b700 1 -- 172.21.15.6:0/372071411 shutdown_connections 2023-07-21T07:36:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.609+0000 7f648526b700 1 --2- 172.21.15.6:0/372071411 >> v2:172.21.15.86:3300/0 conn(0x7f64800c53e0 0x7f6480154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.609+0000 7f648526b700 1 --2- 172.21.15.6:0/372071411 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64800c6170 0x7f648014ed60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.609+0000 7f648526b700 1 -- 172.21.15.6:0/372071411 >> 172.21.15.6:0/372071411 conn(0x7f64800a8c90 msgr2=0x7f648006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.609+0000 7f648526b700 1 -- 172.21.15.6:0/372071411 shutdown_connections 2023-07-21T07:36:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.609+0000 7f648526b700 1 -- 172.21.15.6:0/372071411 wait complete. 2023-07-21T07:36:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.610+0000 7f648526b700 1 Processor -- start 2023-07-21T07:36:25.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.610+0000 7f648526b700 1 -- start start 2023-07-21T07:36:25.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f648526b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64800c3750 0x7f6480152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f648526b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64800c53e0 0x7f64801e2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f648526b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64800c6170 0x7f64801e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f648526b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64800ac670 con 0x7f64800c3750 2023-07-21T07:36:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f648526b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648014c150 con 0x7f64800c53e0 2023-07-21T07:36:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f648526b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64800ac8c0 con 0x7f64800c6170 2023-07-21T07:36:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f647effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64800c3750 0x7f6480152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f647effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64800c3750 0x7f6480152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35862/0 (socket says 172.21.15.6:35862) 2023-07-21T07:36:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f647effd700 1 -- 172.21.15.6:0/1738905815 learned_addr learned my addr 172.21.15.6:0/1738905815 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f647f7fe700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64800c6170 0x7f64801e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f647e7fc700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64800c53e0 0x7f64801e2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f647effd700 1 -- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64800c6170 msgr2=0x7f64801e32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f647effd700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64800c6170 0x7f64801e32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f647effd700 1 -- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64800c53e0 msgr2=0x7f64801e2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f647effd700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64800c53e0 0x7f64801e2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.611+0000 7f647effd700 1 -- 172.21.15.6:0/1738905815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6478009a70 con 0x7f64800c3750 2023-07-21T07:36:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.612+0000 7f647effd700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64800c3750 0x7f6480152600 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f647400c490 tx=0x7f647400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.612+0000 7f64677fe700 1 -- 172.21.15.6:0/1738905815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474005cb0 con 0x7f64800c3750 2023-07-21T07:36:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.612+0000 7f64677fe700 1 -- 172.21.15.6:0/1738905815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647400ce90 con 0x7f64800c3750 2023-07-21T07:36:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.612+0000 7f648526b700 1 -- 172.21.15.6:0/1738905815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6470009550 con 0x7f64800c3750 2023-07-21T07:36:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.612+0000 7f64677fe700 1 -- 172.21.15.6:0/1738905815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64740072d0 con 0x7f64800c3750 2023-07-21T07:36:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.612+0000 7f648526b700 1 -- 172.21.15.6:0/1738905815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6480154660 con 0x7f64800c3750 2023-07-21T07:36:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.613+0000 7f648526b700 1 -- 172.21.15.6:0/1738905815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6480154850 con 0x7f64800c3750 2023-07-21T07:36:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.613+0000 7f64677fe700 1 -- 172.21.15.6:0/1738905815 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6474007430 con 0x7f64800c3750 2023-07-21T07:36:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.613+0000 7f64677fe700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f646c06ace0 0x7f646c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.614+0000 7f64677fe700 1 -- 172.21.15.6:0/1738905815 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6474088360 con 0x7f64800c3750 2023-07-21T07:36:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.614+0000 7f647e7fc700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f646c06ace0 0x7f646c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.614+0000 7f647e7fc700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f646c06ace0 0x7f646c06d1a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6470009c40 tx=0x7f6470008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.618+0000 7f64677fe700 1 -- 172.21.15.6:0/1738905815 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f64740538a0 con 0x7f64800c3750 2023-07-21T07:36:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.817+0000 7f648526b700 1 -- 172.21.15.6:0/1738905815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6480074500 con 0x7f64800c3750 2023-07-21T07:36:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.817+0000 7f64677fe700 1 -- 172.21.15.6:0/1738905815 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+126 (secure 0 0 0) 0x7f6474056ec0 con 0x7f64800c3750 2023-07-21T07:36:25.871 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:25.871 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T07:36:25.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:25.872 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T07:36:25.872 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T07:36:25.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:25.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:25.872 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T07:36:25.872 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T07:36:25.872 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:25.873 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T07:36:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.819+0000 7f648526b700 1 -- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f646c06ace0 msgr2=0x7f646c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.819+0000 7f648526b700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f646c06ace0 0x7f646c06d1a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6470009c40 tx=0x7f6470008030 comp rx=0 tx=0).stop 2023-07-21T07:36:25.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.819+0000 7f648526b700 1 -- 172.21.15.6:0/1738905815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64800c3750 msgr2=0x7f6480152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:25.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.819+0000 7f648526b700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64800c3750 0x7f6480152600 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f647400c490 tx=0x7f647400c7a0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.819+0000 7f648526b700 1 -- 172.21.15.6:0/1738905815 shutdown_connections 2023-07-21T07:36:25.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.819+0000 7f648526b700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f646c06ace0 0x7f646c06d1a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.819+0000 7f648526b700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64800c6170 0x7f64801e32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.819+0000 7f648526b700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64800c3750 0x7f6480152600 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.819+0000 7f648526b700 1 --2- 172.21.15.6:0/1738905815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64800c53e0 0x7f64801e2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.819+0000 7f648526b700 1 -- 172.21.15.6:0/1738905815 >> 172.21.15.6:0/1738905815 conn(0x7f64800a8c90 msgr2=0x7f648006b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.819+0000 7f648526b700 1 -- 172.21.15.6:0/1738905815 shutdown_connections 2023-07-21T07:36:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.819+0000 7f648526b700 1 -- 172.21.15.6:0/1738905815 wait complete. 2023-07-21T07:36:25.885 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T07:36:25.885 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T07:36:26.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.961+0000 7fa05d728700 1 Processor -- start 2023-07-21T07:36:26.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.961+0000 7fa05d728700 1 -- start start 2023-07-21T07:36:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa05d728700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa05814afd0 0x7fa0580c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa05d728700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa0580c7bd0 0x7fa05806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa05d728700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0580c4b90 0x7fa05806bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa05d728700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0580a9480 con 0x7fa05814afd0 2023-07-21T07:36:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa05d728700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa058154470 con 0x7fa0580c7bd0 2023-07-21T07:36:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa05d728700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05806a8b0 con 0x7fa0580c4b90 2023-07-21T07:36:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa056ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa05814afd0 0x7fa0580c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa056ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa05814afd0 0x7fa0580c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35870/0 (socket says 172.21.15.6:35870) 2023-07-21T07:36:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa056ffd700 1 -- 172.21.15.6:0/3429864615 learned_addr learned my addr 172.21.15.6:0/3429864615 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:26.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa0577fe700 1 --2- 172.21.15.6:0/3429864615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0580c4b90 0x7fa05806bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa056ffd700 1 -- 172.21.15.6:0/3429864615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0580c4b90 msgr2=0x7fa05806bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa056ffd700 1 --2- 172.21.15.6:0/3429864615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0580c4b90 0x7fa05806bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa0567fc700 1 --2- 172.21.15.6:0/3429864615 >> v2:172.21.15.86:3300/0 conn(0x7fa0580c7bd0 0x7fa05806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa056ffd700 1 -- 172.21.15.6:0/3429864615 >> v2:172.21.15.86:3300/0 conn(0x7fa0580c7bd0 msgr2=0x7fa05806b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa056ffd700 1 --2- 172.21.15.6:0/3429864615 >> v2:172.21.15.86:3300/0 conn(0x7fa0580c7bd0 0x7fa05806b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa056ffd700 1 -- 172.21.15.6:0/3429864615 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05814b3b0 con 0x7fa05814afd0 2023-07-21T07:36:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.962+0000 7fa0577fe700 1 --2- 172.21.15.6:0/3429864615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0580c4b90 0x7fa05806bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.963+0000 7fa056ffd700 1 --2- 172.21.15.6:0/3429864615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05814afd0 0x7fa0580c4650 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa05806a1b0 tx=0x7fa04c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49aeeaaa4ea62551 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.963+0000 7fa055ffb700 1 -- 172.21.15.6:0/3429864615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c00b870 con 0x7fa05814afd0 2023-07-21T07:36:26.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.963+0000 7fa055ffb700 1 -- 172.21.15.6:0/3429864615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c00b9d0 con 0x7fa05814afd0 2023-07-21T07:36:26.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.963+0000 7fa055ffb700 1 -- 172.21.15.6:0/3429864615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c00bd60 con 0x7fa05814afd0 2023-07-21T07:36:26.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.963+0000 7fa05d728700 1 -- 172.21.15.6:0/3429864615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05814afd0 msgr2=0x7fa0580c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:26.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.963+0000 7fa05d728700 1 --2- 172.21.15.6:0/3429864615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05814afd0 0x7fa0580c4650 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa05806a1b0 tx=0x7fa04c009bd0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.963+0000 7fa05d728700 1 -- 172.21.15.6:0/3429864615 shutdown_connections 2023-07-21T07:36:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.963+0000 7fa05d728700 1 --2- 172.21.15.6:0/3429864615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0580c4b90 0x7fa05806bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.963+0000 7fa05d728700 1 --2- 172.21.15.6:0/3429864615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa05814afd0 0x7fa0580c4650 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.963+0000 7fa05d728700 1 --2- 172.21.15.6:0/3429864615 >> v2:172.21.15.86:3300/0 conn(0x7fa0580c7bd0 0x7fa05806b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.963+0000 7fa05d728700 1 -- 172.21.15.6:0/3429864615 >> 172.21.15.6:0/3429864615 conn(0x7fa0580c9cd0 msgr2=0x7fa0580ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.963+0000 7fa05d728700 1 -- 172.21.15.6:0/3429864615 shutdown_connections 2023-07-21T07:36:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.963+0000 7fa05d728700 1 -- 172.21.15.6:0/3429864615 wait complete. 2023-07-21T07:36:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.965+0000 7fa05d728700 1 Processor -- start 2023-07-21T07:36:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.965+0000 7fa05d728700 1 -- start start 2023-07-21T07:36:26.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.965+0000 7fa05d728700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0580c4b90 0x7fa0580ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:26.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.965+0000 7fa05d728700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0580c7bd0 0x7fa0581e11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:26.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.965+0000 7fa05d728700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa05814afd0 0x7fa0580c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:26.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.965+0000 7fa05d728700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0581eb480 con 0x7fa0580c7bd0 2023-07-21T07:36:26.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.965+0000 7fa05d728700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0581eb130 con 0x7fa05814afd0 2023-07-21T07:36:26.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.965+0000 7fa05d728700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580aec90 con 0x7fa0580c4b90 2023-07-21T07:36:26.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.965+0000 7fa0567fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0580c7bd0 0x7fa0581e11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:26.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.965+0000 7fa0567fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0580c7bd0 0x7fa0581e11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35878/0 (socket says 172.21.15.6:35878) 2023-07-21T07:36:26.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.965+0000 7fa0567fc700 1 -- 172.21.15.6:0/229839983 learned_addr learned my addr 172.21.15.6:0/229839983 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:26.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa056ffd700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0580c4b90 0x7fa0580ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:26.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa0577fe700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa05814afd0 0x7fa0580c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:26.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa0567fc700 1 -- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0580c4b90 msgr2=0x7fa0580ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:26.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa0567fc700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0580c4b90 0x7fa0580ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa0567fc700 1 -- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa05814afd0 msgr2=0x7fa0580c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:26.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa0567fc700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa05814afd0 0x7fa0580c0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa0567fc700 1 -- 172.21.15.6:0/229839983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c009550 con 0x7fa0580c7bd0 2023-07-21T07:36:26.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa056ffd700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0580c4b90 0x7fa0580ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:26.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa0567fc700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0580c7bd0 0x7fa0581e11d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa04800c7f0 tx=0x7fa04800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:26.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa03f7fe700 1 -- 172.21.15.6:0/229839983 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048011800 con 0x7fa0580c7bd0 2023-07-21T07:36:26.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa03f7fe700 1 -- 172.21.15.6:0/229839983 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa048011960 con 0x7fa0580c7bd0 2023-07-21T07:36:26.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa05d728700 1 -- 172.21.15.6:0/229839983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0580aef70 con 0x7fa0580c7bd0 2023-07-21T07:36:26.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa03f7fe700 1 -- 172.21.15.6:0/229839983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048011cf0 con 0x7fa0580c7bd0 2023-07-21T07:36:26.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.966+0000 7fa05d728700 1 -- 172.21.15.6:0/229839983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0580ae8d0 con 0x7fa0580c7bd0 2023-07-21T07:36:26.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.967+0000 7fa05d728700 1 -- 172.21.15.6:0/229839983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa058074500 con 0x7fa0580c7bd0 2023-07-21T07:36:26.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.968+0000 7fa03f7fe700 1 -- 172.21.15.6:0/229839983 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa048018360 con 0x7fa0580c7bd0 2023-07-21T07:36:26.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.968+0000 7fa03f7fe700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa04406ace0 0x7fa04406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:26.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.968+0000 7fa03f7fe700 1 -- 172.21.15.6:0/229839983 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa048089000 con 0x7fa0580c7bd0 2023-07-21T07:36:26.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.968+0000 7fa056ffd700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa04406ace0 0x7fa04406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:26.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.969+0000 7fa056ffd700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa04406ace0 0x7fa04406d1a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa04c014040 tx=0x7fa04c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:26.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:25.972+0000 7fa03f7fe700 1 -- 172.21.15.6:0/229839983 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa048054490 con 0x7fa0580c7bd0 2023-07-21T07:36:26.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.173+0000 7fa05d728700 1 -- 172.21.15.6:0/229839983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa0580c4970 con 0x7fa0580c7bd0 2023-07-21T07:36:26.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.521+0000 7fa03f7fe700 1 -- 172.21.15.6:0/229839983 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa048057ab0 con 0x7fa0580c7bd0 2023-07-21T07:36:26.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.525+0000 7fa05d728700 1 -- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa04406ace0 msgr2=0x7fa04406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:26.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.525+0000 7fa05d728700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa04406ace0 0x7fa04406d1a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa04c014040 tx=0x7fa04c008030 comp rx=0 tx=0).stop 2023-07-21T07:36:26.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.525+0000 7fa05d728700 1 -- 172.21.15.6:0/229839983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0580c7bd0 msgr2=0x7fa0581e11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:26.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.525+0000 7fa05d728700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0580c7bd0 0x7fa0581e11d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa04800c7f0 tx=0x7fa04800cbb0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.525+0000 7fa05d728700 1 -- 172.21.15.6:0/229839983 shutdown_connections 2023-07-21T07:36:26.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.525+0000 7fa05d728700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa04406ace0 0x7fa04406d1a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.525+0000 7fa05d728700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa05814afd0 0x7fa0580c0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.525+0000 7fa05d728700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0580c4b90 0x7fa0580ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.525+0000 7fa05d728700 1 --2- 172.21.15.6:0/229839983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0580c7bd0 0x7fa0581e11d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.525+0000 7fa05d728700 1 -- 172.21.15.6:0/229839983 >> 172.21.15.6:0/229839983 conn(0x7fa0580c9cd0 msgr2=0x7fa05806b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:26.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.525+0000 7fa05d728700 1 -- 172.21.15.6:0/229839983 shutdown_connections 2023-07-21T07:36:26.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.525+0000 7fa05d728700 1 -- 172.21.15.6:0/229839983 wait complete. 2023-07-21T07:36:26.582 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T07:36:26.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T07:36:26.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.674+0000 7f53218d7700 1 Processor -- start 2023-07-21T07:36:26.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.675+0000 7f53218d7700 1 -- start start 2023-07-21T07:36:26.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.675+0000 7f53218d7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f531c0abd40 0x7f531c0aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:26.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.675+0000 7f53218d7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f531c0aae10 0x7f531c0ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:26.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.675+0000 7f53218d7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531c066050 con 0x7f531c14c580 2023-07-21T07:36:26.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.675+0000 7f53218d7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531c066580 con 0x7f531c0aae10 2023-07-21T07:36:26.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.675+0000 7f53218d7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c152f50 con 0x7f531c0abd40 2023-07-21T07:36:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.675+0000 7f531b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f531c0aae10 0x7f531c0ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.675+0000 7f531affd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f531c14c580 0x7f531c0c2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43904/0 (socket says 172.21.15.6:43904) 2023-07-21T07:36:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.675+0000 7f531affd700 1 -- 172.21.15.6:0/599864378 learned_addr learned my addr 172.21.15.6:0/599864378 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.676+0000 7f531a7fc700 1 --2- 172.21.15.6:0/599864378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f531c0abd40 0x7f531c0aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.676+0000 7f531b7fe700 1 -- 172.21.15.6:0/599864378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f531c0abd40 msgr2=0x7f531c0aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.676+0000 7f531b7fe700 1 --2- 172.21.15.6:0/599864378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f531c0abd40 0x7f531c0aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.676+0000 7f531b7fe700 1 -- 172.21.15.6:0/599864378 >> v1:172.21.15.6:6789/0 conn(0x7f531c14c580 legacy=0x7f531c0c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.676+0000 7f531b7fe700 1 -- 172.21.15.6:0/599864378 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c14c960 con 0x7f531c0aae10 2023-07-21T07:36:26.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.676+0000 7f5319ffb700 1 -- 172.21.15.6:0/599864378 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402499542 0 0) 0x7f531c066050 con 0x7f531c14c580 2023-07-21T07:36:26.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.676+0000 7f531b7fe700 1 --2- 172.21.15.6:0/599864378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531c0aae10 0x7f531c0ab2a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5314009d90 tx=0x7f531400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89c14931ba7e5a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:26.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.676+0000 7f5319ffb700 1 -- 172.21.15.6:0/599864378 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531400e070 con 0x7f531c0aae10 2023-07-21T07:36:26.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.676+0000 7f5319ffb700 1 -- 172.21.15.6:0/599864378 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531400bb20 con 0x7f531c0aae10 2023-07-21T07:36:26.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.676+0000 7f5319ffb700 1 -- 172.21.15.6:0/599864378 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314012430 con 0x7f531c0aae10 2023-07-21T07:36:26.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.677+0000 7f53218d7700 1 -- 172.21.15.6:0/599864378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531c0aae10 msgr2=0x7f531c0ab2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:26.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.677+0000 7f53218d7700 1 --2- 172.21.15.6:0/599864378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531c0aae10 0x7f531c0ab2a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5314009d90 tx=0x7f531400b330 comp rx=0 tx=0).stop 2023-07-21T07:36:26.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.677+0000 7f53218d7700 1 -- 172.21.15.6:0/599864378 shutdown_connections 2023-07-21T07:36:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.677+0000 7f53218d7700 1 --2- 172.21.15.6:0/599864378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531c0aae10 0x7f531c0ab2a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.677+0000 7f53218d7700 1 --2- 172.21.15.6:0/599864378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f531c0abd40 0x7f531c0aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.677+0000 7f53218d7700 1 -- 172.21.15.6:0/599864378 >> 172.21.15.6:0/599864378 conn(0x7f531c0c2c20 msgr2=0x7f531c0c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.677+0000 7f53218d7700 1 -- 172.21.15.6:0/599864378 shutdown_connections 2023-07-21T07:36:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.677+0000 7f53218d7700 1 -- 172.21.15.6:0/599864378 wait complete. 2023-07-21T07:36:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.678+0000 7f53218d7700 1 Processor -- start 2023-07-21T07:36:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.678+0000 7f53218d7700 1 -- start start 2023-07-21T07:36:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f53218d7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f531c0aae10 0x7f531c151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f53218d7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f531c0abd40 0x7f531c13fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f53218d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531c14c580 0x7f531c1e8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f53218d7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c14e4c0 con 0x7f531c14c580 2023-07-21T07:36:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f53218d7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c151d20 con 0x7f531c0abd40 2023-07-21T07:36:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f53218d7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c14d0f0 con 0x7f531c0aae10 2023-07-21T07:36:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f531b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531c14c580 0x7f531c1e8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f531b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531c14c580 0x7f531c1e8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35894/0 (socket says 172.21.15.6:35894) 2023-07-21T07:36:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f531b7fe700 1 -- 172.21.15.6:0/2267656803 learned_addr learned my addr 172.21.15.6:0/2267656803 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f531affd700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f531c0aae10 0x7f531c151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f531b7fe700 1 -- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f531c0aae10 msgr2=0x7f531c151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f531a7fc700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f531c0abd40 0x7f531c13fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f531b7fe700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f531c0aae10 0x7f531c151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f531b7fe700 1 -- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f531c0abd40 msgr2=0x7f531c13fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f531b7fe700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f531c0abd40 0x7f531c13fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f531b7fe700 1 -- 172.21.15.6:0/2267656803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5314009a70 con 0x7f531c14c580 2023-07-21T07:36:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.679+0000 7f531b7fe700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531c14c580 0x7f531c1e8020 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f531c06f9e0 tx=0x7f5314004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.680+0000 7f5303fff700 1 -- 172.21.15.6:0/2267656803 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314012430 con 0x7f531c14c580 2023-07-21T07:36:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.680+0000 7f5303fff700 1 -- 172.21.15.6:0/2267656803 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5314020070 con 0x7f531c14c580 2023-07-21T07:36:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.680+0000 7f53218d7700 1 -- 172.21.15.6:0/2267656803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531c14d3d0 con 0x7f531c14c580 2023-07-21T07:36:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.680+0000 7f5303fff700 1 -- 172.21.15.6:0/2267656803 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314004280 con 0x7f531c14c580 2023-07-21T07:36:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.680+0000 7f53218d7700 1 -- 172.21.15.6:0/2267656803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c14d990 con 0x7f531c14c580 2023-07-21T07:36:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.681+0000 7f53218d7700 1 -- 172.21.15.6:0/2267656803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531c074500 con 0x7f531c14c580 2023-07-21T07:36:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.681+0000 7f5303fff700 1 -- 172.21.15.6:0/2267656803 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53140043e0 con 0x7f531c14c580 2023-07-21T07:36:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.682+0000 7f5303fff700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530806ace0 0x7f530806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.682+0000 7f5303fff700 1 -- 172.21.15.6:0/2267656803 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f5314022070 con 0x7f531c14c580 2023-07-21T07:36:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.682+0000 7f531affd700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530806ace0 0x7f530806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.683+0000 7f531affd700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530806ace0 0x7f530806d1a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5310000f60 tx=0x7f5310009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.686+0000 7f5303fff700 1 -- 172.21.15.6:0/2267656803 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5314056990 con 0x7f531c14c580 2023-07-21T07:36:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:26.885+0000 7f53218d7700 1 -- 172.21.15.6:0/2267656803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f531c14fe80 con 0x7f531c14c580 2023-07-21T07:36:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.530+0000 7f5303fff700 1 -- 172.21.15.6:0/2267656803 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) v1 ==== 170+0+0 (secure 0 0 0) 0x7f53140263e0 con 0x7f531c14c580 2023-07-21T07:36:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.534+0000 7f53218d7700 1 -- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530806ace0 msgr2=0x7f530806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.534+0000 7f53218d7700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530806ace0 0x7f530806d1a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5310000f60 tx=0x7f5310009040 comp rx=0 tx=0).stop 2023-07-21T07:36:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.534+0000 7f53218d7700 1 -- 172.21.15.6:0/2267656803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531c14c580 msgr2=0x7f531c1e8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.534+0000 7f53218d7700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531c14c580 0x7f531c1e8020 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f531c06f9e0 tx=0x7f5314004ad0 comp rx=0 tx=0).stop 2023-07-21T07:36:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.535+0000 7f53218d7700 1 -- 172.21.15.6:0/2267656803 shutdown_connections 2023-07-21T07:36:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.535+0000 7f53218d7700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f530806ace0 0x7f530806d1a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.535+0000 7f53218d7700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531c14c580 0x7f531c1e8020 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.535+0000 7f53218d7700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f531c0aae10 0x7f531c151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.535+0000 7f53218d7700 1 --2- 172.21.15.6:0/2267656803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f531c0abd40 0x7f531c13fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.535+0000 7f53218d7700 1 -- 172.21.15.6:0/2267656803 >> 172.21.15.6:0/2267656803 conn(0x7f531c0c2c20 msgr2=0x7f531c06b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.535+0000 7f53218d7700 1 -- 172.21.15.6:0/2267656803 shutdown_connections 2023-07-21T07:36:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.535+0000 7f53218d7700 1 -- 172.21.15.6:0/2267656803 wait complete. 2023-07-21T07:36:27.599 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T07:36:27.613 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T07:36:27.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.693+0000 7f1bc15c9700 1 Processor -- start 2023-07-21T07:36:27.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.693+0000 7f1bc15c9700 1 -- start start 2023-07-21T07:36:27.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.693+0000 7f1bc15c9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1bbc06a300 0x7f1bbc1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:27.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.693+0000 7f1bc15c9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1bbc0ba140 0x7f1bbc151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:27.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.693+0000 7f1bc15c9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bbc155530 con 0x7f1bbc06d8a0 2023-07-21T07:36:27.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.693+0000 7f1bc15c9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bbc0c1a30 con 0x7f1bbc06a300 2023-07-21T07:36:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.693+0000 7f1bc15c9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bbc154920 con 0x7f1bbc0ba140 2023-07-21T07:36:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.694+0000 7f1bbaffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1bbc06a300 0x7f1bbc1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.694+0000 7f1bbb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1bbc06d8a0 0x7f1bbc0c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43922/0 (socket says 172.21.15.6:43922) 2023-07-21T07:36:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.694+0000 7f1bbb7fe700 1 -- 172.21.15.6:0/3343631933 learned_addr learned my addr 172.21.15.6:0/3343631933 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.694+0000 7f1bba7fc700 1 --2- 172.21.15.6:0/3343631933 >> v2:172.21.15.86:3300/0 conn(0x7f1bbc0ba140 0x7f1bbc151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.694+0000 7f1bbaffd700 1 -- 172.21.15.6:0/3343631933 >> v2:172.21.15.86:3300/0 conn(0x7f1bbc0ba140 msgr2=0x7f1bbc151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.694+0000 7f1bbaffd700 1 --2- 172.21.15.6:0/3343631933 >> v2:172.21.15.86:3300/0 conn(0x7f1bbc0ba140 0x7f1bbc151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.694+0000 7f1bbaffd700 1 -- 172.21.15.6:0/3343631933 >> v1:172.21.15.6:6789/0 conn(0x7f1bbc06d8a0 legacy=0x7f1bbc0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.694+0000 7f1bbaffd700 1 -- 172.21.15.6:0/3343631933 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc154c00 con 0x7f1bbc06a300 2023-07-21T07:36:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.694+0000 7f1bb9ffb700 1 -- 172.21.15.6:0/3343631933 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606769551 0 0) 0x7f1bbc155530 con 0x7f1bbc06d8a0 2023-07-21T07:36:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.694+0000 7f1bbaffd700 1 --2- 172.21.15.6:0/3343631933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bbc06a300 0x7f1bbc1519b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0c1f00 tx=0x7f1bac009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf55e28641fc5ca server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.694+0000 7f1bb9ffb700 1 -- 172.21.15.6:0/3343631933 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac011830 con 0x7f1bbc06a300 2023-07-21T07:36:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.694+0000 7f1bb9ffb700 1 -- 172.21.15.6:0/3343631933 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac011990 con 0x7f1bbc06a300 2023-07-21T07:36:27.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.694+0000 7f1bb9ffb700 1 -- 172.21.15.6:0/3343631933 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac011d20 con 0x7f1bbc06a300 2023-07-21T07:36:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.695+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3343631933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bbc06a300 msgr2=0x7f1bbc1519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.695+0000 7f1bc15c9700 1 --2- 172.21.15.6:0/3343631933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bbc06a300 0x7f1bbc1519b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0c1f00 tx=0x7f1bac009b20 comp rx=0 tx=0).stop 2023-07-21T07:36:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.695+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3343631933 shutdown_connections 2023-07-21T07:36:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.695+0000 7f1bc15c9700 1 --2- 172.21.15.6:0/3343631933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bbc06a300 0x7f1bbc1519b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.695+0000 7f1bc15c9700 1 --2- 172.21.15.6:0/3343631933 >> v2:172.21.15.86:3300/0 conn(0x7f1bbc0ba140 0x7f1bbc151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.695+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3343631933 >> 172.21.15.6:0/3343631933 conn(0x7f1bbc0a8660 msgr2=0x7f1bbc0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.695+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3343631933 shutdown_connections 2023-07-21T07:36:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.695+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3343631933 wait complete. 2023-07-21T07:36:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.696+0000 7f1bc15c9700 1 Processor -- start 2023-07-21T07:36:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.696+0000 7f1bc15c9700 1 -- start start 2023-07-21T07:36:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bc15c9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bbc06a300 0x7f1bbc0bbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bc15c9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1bbc06d8a0 0x7f1bbc153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bc15c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bbc0ba140 0x7f1bbc1ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bc15c9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc1e9dc0 con 0x7f1bbc0ba140 2023-07-21T07:36:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bc15c9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc0bc990 con 0x7f1bbc06a300 2023-07-21T07:36:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bc15c9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc06e540 con 0x7f1bbc06d8a0 2023-07-21T07:36:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bbb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bbc0ba140 0x7f1bbc1ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bbb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bbc0ba140 0x7f1bbc1ed300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35908/0 (socket says 172.21.15.6:35908) 2023-07-21T07:36:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bbb7fe700 1 -- 172.21.15.6:0/3703138444 learned_addr learned my addr 172.21.15.6:0/3703138444 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bba7fc700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1bbc06d8a0 0x7f1bbc153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bbaffd700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bbc06a300 0x7f1bbc0bbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bbb7fe700 1 -- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1bbc06d8a0 msgr2=0x7f1bbc153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bbb7fe700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1bbc06d8a0 0x7f1bbc153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bbb7fe700 1 -- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bbc06a300 msgr2=0x7f1bbc0bbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:27.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bbb7fe700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bbc06a300 0x7f1bbc0bbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:27.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bbb7fe700 1 -- 172.21.15.6:0/3703138444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac0094a0 con 0x7f1bbc0ba140 2023-07-21T07:36:27.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bba7fc700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1bbc06d8a0 0x7f1bbc153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:27.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.697+0000 7f1bbaffd700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bbc06a300 0x7f1bbc0bbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:27.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.698+0000 7f1bbb7fe700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bbc0ba140 0x7f1bbc1ed300 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4002230 tx=0x7f1bb400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:27.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.698+0000 7f1ba37fe700 1 -- 172.21.15.6:0/3703138444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb400ac20 con 0x7f1bbc0ba140 2023-07-21T07:36:27.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.698+0000 7f1ba37fe700 1 -- 172.21.15.6:0/3703138444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb400ada0 con 0x7f1bbc0ba140 2023-07-21T07:36:27.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.698+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3703138444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bbc1e9fd0 con 0x7f1bbc0ba140 2023-07-21T07:36:27.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.698+0000 7f1ba37fe700 1 -- 172.21.15.6:0/3703138444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4007310 con 0x7f1bbc0ba140 2023-07-21T07:36:27.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.698+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3703138444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bbc1ea270 con 0x7f1bbc0ba140 2023-07-21T07:36:27.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.699+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3703138444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bbc04e470 con 0x7f1bbc0ba140 2023-07-21T07:36:27.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.699+0000 7f1ba37fe700 1 -- 172.21.15.6:0/3703138444 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1bb4007470 con 0x7f1bbc0ba140 2023-07-21T07:36:27.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.700+0000 7f1ba37fe700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1ba806ace0 0x7f1ba806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:27.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.700+0000 7f1ba37fe700 1 -- 172.21.15.6:0/3703138444 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f1bb40892b0 con 0x7f1bbc0ba140 2023-07-21T07:36:27.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.700+0000 7f1bbaffd700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1ba806ace0 0x7f1ba806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:27.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.701+0000 7f1bbaffd700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1ba806ace0 0x7f1ba806d1a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0090b0 tx=0x7f1bac008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:27.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.704+0000 7f1ba37fe700 1 -- 172.21.15.6:0/3703138444 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1bb4054450 con 0x7f1bbc0ba140 2023-07-21T07:36:28.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:27.948+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3703138444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1bbc074500 con 0x7f1bbc0ba140 2023-07-21T07:36:28.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.533+0000 7f1ba37fe700 1 -- 172.21.15.6:0/3703138444 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v29) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1bb4057a70 con 0x7f1bbc0ba140 2023-07-21T07:36:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.542+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1ba806ace0 msgr2=0x7f1ba806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.542+0000 7f1bc15c9700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1ba806ace0 0x7f1ba806d1a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0090b0 tx=0x7f1bac008030 comp rx=0 tx=0).stop 2023-07-21T07:36:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.542+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3703138444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bbc0ba140 msgr2=0x7f1bbc1ed300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.542+0000 7f1bc15c9700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bbc0ba140 0x7f1bbc1ed300 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4002230 tx=0x7f1bb400a060 comp rx=0 tx=0).stop 2023-07-21T07:36:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.542+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3703138444 shutdown_connections 2023-07-21T07:36:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.542+0000 7f1bc15c9700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f1ba806ace0 0x7f1ba806d1a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.542+0000 7f1bc15c9700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bbc0ba140 0x7f1bbc1ed300 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.542+0000 7f1bc15c9700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bbc06a300 0x7f1bbc0bbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.542+0000 7f1bc15c9700 1 --2- 172.21.15.6:0/3703138444 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1bbc06d8a0 0x7f1bbc153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.542+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3703138444 >> 172.21.15.6:0/3703138444 conn(0x7f1bbc0a8660 msgr2=0x7f1bbc150c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.543+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3703138444 shutdown_connections 2023-07-21T07:36:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.543+0000 7f1bc15c9700 1 -- 172.21.15.6:0/3703138444 wait complete. 2023-07-21T07:36:28.611 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 9 and data pool 10 2023-07-21T07:36:28.622 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:28.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.698+0000 7f6062847700 1 Processor -- start 2023-07-21T07:36:28.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.698+0000 7f6062847700 1 -- start start 2023-07-21T07:36:28.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f6062847700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f605c0c6640 0x7f605c06da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:28.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f6062847700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f605c155050 0x7f605c0c3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:28.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f6062847700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605c0c2be0 con 0x7f605c06a300 2023-07-21T07:36:28.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f6062847700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605c06e6e0 con 0x7f605c0c6640 2023-07-21T07:36:28.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f6062847700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c06e120 con 0x7f605c155050 2023-07-21T07:36:28.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f605b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f605c0c6640 0x7f605c06da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:28.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f605bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f605c06a300 0x7f605c0c5f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43944/0 (socket says 172.21.15.6:43944) 2023-07-21T07:36:28.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f605bfff700 1 -- 172.21.15.6:0/2999383709 learned_addr learned my addr 172.21.15.6:0/2999383709 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f6060de4700 1 --2- 172.21.15.6:0/2999383709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f605c155050 0x7f605c0c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f605b7fe700 1 -- 172.21.15.6:0/2999383709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f605c155050 msgr2=0x7f605c0c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f605b7fe700 1 --2- 172.21.15.6:0/2999383709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f605c155050 0x7f605c0c3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f605b7fe700 1 -- 172.21.15.6:0/2999383709 >> v1:172.21.15.6:6789/0 conn(0x7f605c06a300 legacy=0x7f605c0c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f605affd700 1 -- 172.21.15.6:0/2999383709 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827353647 0 0) 0x7f605c0c2be0 con 0x7f605c06a300 2023-07-21T07:36:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f605b7fe700 1 -- 172.21.15.6:0/2999383709 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c06e400 con 0x7f605c0c6640 2023-07-21T07:36:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.699+0000 7f605b7fe700 1 --2- 172.21.15.6:0/2999383709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c0c6640 0x7f605c06da20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6050009840 tx=0x7f6050009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203e5c48bb406ad4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.700+0000 7f605affd700 1 -- 172.21.15.6:0/2999383709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050011830 con 0x7f605c0c6640 2023-07-21T07:36:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.700+0000 7f605affd700 1 -- 172.21.15.6:0/2999383709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6050011990 con 0x7f605c0c6640 2023-07-21T07:36:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.700+0000 7f605affd700 1 -- 172.21.15.6:0/2999383709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050011d20 con 0x7f605c0c6640 2023-07-21T07:36:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.700+0000 7f6062847700 1 -- 172.21.15.6:0/2999383709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c0c6640 msgr2=0x7f605c06da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.700+0000 7f6062847700 1 --2- 172.21.15.6:0/2999383709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c0c6640 0x7f605c06da20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6050009840 tx=0x7f6050009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.700+0000 7f6062847700 1 -- 172.21.15.6:0/2999383709 shutdown_connections 2023-07-21T07:36:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.700+0000 7f6062847700 1 --2- 172.21.15.6:0/2999383709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f605c155050 0x7f605c0c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.700+0000 7f6062847700 1 --2- 172.21.15.6:0/2999383709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c0c6640 0x7f605c06da20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.700+0000 7f6062847700 1 -- 172.21.15.6:0/2999383709 >> 172.21.15.6:0/2999383709 conn(0x7f605c0a8c90 msgr2=0x7f605c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.700+0000 7f6062847700 1 -- 172.21.15.6:0/2999383709 shutdown_connections 2023-07-21T07:36:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.700+0000 7f6062847700 1 -- 172.21.15.6:0/2999383709 wait complete. 2023-07-21T07:36:28.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.701+0000 7f6062847700 1 Processor -- start 2023-07-21T07:36:28.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.702+0000 7f6062847700 1 -- start start 2023-07-21T07:36:28.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.702+0000 7f6062847700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c06a300 0x7f605c1eace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.702+0000 7f6062847700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f605c155050 0x7f605c0c0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.702+0000 7f6062847700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f605c0bf020 0x7f605c1ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.702+0000 7f6062847700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c0bdf80 con 0x7f605c06a300 2023-07-21T07:36:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.702+0000 7f6062847700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c0be260 con 0x7f605c0bf020 2023-07-21T07:36:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.702+0000 7f6062847700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c0be540 con 0x7f605c155050 2023-07-21T07:36:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.702+0000 7f605bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c06a300 0x7f605c1eace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.702+0000 7f605bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c06a300 0x7f605c1eace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35930/0 (socket says 172.21.15.6:35930) 2023-07-21T07:36:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.702+0000 7f605bfff700 1 -- 172.21.15.6:0/3823887141 learned_addr learned my addr 172.21.15.6:0/3823887141 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f605b7fe700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f605c155050 0x7f605c0c0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f605bfff700 1 -- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f605c155050 msgr2=0x7f605c0c0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f605bfff700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f605c155050 0x7f605c0c0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f605bfff700 1 -- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f605c0bf020 msgr2=0x7f605c1ecde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f6060de4700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f605c0bf020 0x7f605c1ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f605bfff700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f605c0bf020 0x7f605c1ecde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f605bfff700 1 -- 172.21.15.6:0/3823887141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60500094a0 con 0x7f605c06a300 2023-07-21T07:36:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f6060de4700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f605c0bf020 0x7f605c1ecde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f605bfff700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c06a300 0x7f605c1eace0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f604c0011e0 tx=0x7f604c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f6058ff9700 1 -- 172.21.15.6:0/3823887141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c004c80 con 0x7f605c06a300 2023-07-21T07:36:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f6058ff9700 1 -- 172.21.15.6:0/3823887141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c004e00 con 0x7f605c06a300 2023-07-21T07:36:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f6062847700 1 -- 172.21.15.6:0/3823887141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605c0be820 con 0x7f605c06a300 2023-07-21T07:36:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f6058ff9700 1 -- 172.21.15.6:0/3823887141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c007310 con 0x7f605c06a300 2023-07-21T07:36:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.703+0000 7f6062847700 1 -- 172.21.15.6:0/3823887141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605c0c0a70 con 0x7f605c06a300 2023-07-21T07:36:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.704+0000 7f6062847700 1 -- 172.21.15.6:0/3823887141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605c074500 con 0x7f605c06a300 2023-07-21T07:36:28.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.704+0000 7f6058ff9700 1 -- 172.21.15.6:0/3823887141 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f604c007470 con 0x7f605c06a300 2023-07-21T07:36:28.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.705+0000 7f6058ff9700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f604806ad10 0x7f604806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:28.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.705+0000 7f6058ff9700 1 -- 172.21.15.6:0/3823887141 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f604c0891c0 con 0x7f605c06a300 2023-07-21T07:36:28.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.705+0000 7f605b7fe700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f604806ad10 0x7f604806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:28.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.705+0000 7f605b7fe700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f604806ad10 0x7f604806d1d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6050000c00 tx=0x7f6050008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:28.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.709+0000 7f6058ff9700 1 -- 172.21.15.6:0/3823887141 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f604c054300 con 0x7f605c06a300 2023-07-21T07:36:28.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.906+0000 7f6062847700 1 -- 172.21.15.6:0/3823887141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f605c0c16c0 con 0x7f605c06a300 2023-07-21T07:36:28.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.907+0000 7f6058ff9700 1 -- 172.21.15.6:0/3823887141 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18198 (secure 0 0 0) 0x7f604c057920 con 0x7f605c06a300 2023-07-21T07:36:28.962 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:28.962 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":53,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:36:27.950150+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:36:26.204826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T07:36:26.916497+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:28.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.910+0000 7f6062847700 1 -- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f604806ad10 msgr2=0x7f604806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:28.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.910+0000 7f6062847700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f604806ad10 0x7f604806d1d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6050000c00 tx=0x7f6050008030 comp rx=0 tx=0).stop 2023-07-21T07:36:28.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.910+0000 7f6062847700 1 -- 172.21.15.6:0/3823887141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c06a300 msgr2=0x7f605c1eace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:28.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.910+0000 7f6062847700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c06a300 0x7f605c1eace0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f604c0011e0 tx=0x7f604c00cae0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.910+0000 7f6062847700 1 -- 172.21.15.6:0/3823887141 shutdown_connections 2023-07-21T07:36:28.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.910+0000 7f6062847700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f604806ad10 0x7f604806d1d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.910+0000 7f6062847700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f605c0bf020 0x7f605c1ecde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.910+0000 7f6062847700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c06a300 0x7f605c1eace0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.910+0000 7f6062847700 1 --2- 172.21.15.6:0/3823887141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f605c155050 0x7f605c0c0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:28.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.910+0000 7f6062847700 1 -- 172.21.15.6:0/3823887141 >> 172.21.15.6:0/3823887141 conn(0x7f605c0a8c90 msgr2=0x7f605c0c3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:28.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.910+0000 7f6062847700 1 -- 172.21.15.6:0/3823887141 shutdown_connections 2023-07-21T07:36:28.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:28.910+0000 7f6062847700 1 -- 172.21.15.6:0/3823887141 wait complete. 2023-07-21T07:36:28.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:29.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.047+0000 7eff95220700 1 Processor -- start 2023-07-21T07:36:29.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.048+0000 7eff95220700 1 -- start start 2023-07-21T07:36:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.048+0000 7eff95220700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff9006da20 0x7eff90151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.048+0000 7eff95220700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff900c2ab0 con 0x7eff90151c50 2023-07-21T07:36:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.048+0000 7eff95220700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9006e000 con 0x7eff9006a300 2023-07-21T07:36:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.048+0000 7eff95220700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9006e2e0 con 0x7eff9006da20 2023-07-21T07:36:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.048+0000 7eff8f59e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7eff90151c50 0x7eff900c2f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43962/0 (socket says 172.21.15.6:43962) 2023-07-21T07:36:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.048+0000 7eff8f59e700 1 -- 172.21.15.6:0/3961501744 learned_addr learned my addr 172.21.15.6:0/3961501744 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.049+0000 7eff8e59c700 1 --2- 172.21.15.6:0/3961501744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff9006da20 0x7eff90151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.049+0000 7eff8dd9b700 1 -- 172.21.15.6:0/3961501744 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565736483 0 0) 0x7eff900c2ab0 con 0x7eff90151c50 2023-07-21T07:36:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.049+0000 7eff8dd9b700 1 -- 172.21.15.6:0/3961501744 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff7c0035b0 con 0x7eff90151c50 2023-07-21T07:36:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.049+0000 7eff8dd9b700 1 -- 172.21.15.6:0/3961501744 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338875859 0 0) 0x7eff9006e000 con 0x7eff9006a300 2023-07-21T07:36:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.049+0000 7eff8e59c700 1 -- 172.21.15.6:0/3961501744 >> v1:172.21.15.86:6789/0 conn(0x7eff9006a300 legacy=0x7eff90155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.049+0000 7eff8e59c700 1 -- 172.21.15.6:0/3961501744 >> v1:172.21.15.6:6789/0 conn(0x7eff90151c50 legacy=0x7eff900c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.049+0000 7eff8e59c700 1 -- 172.21.15.6:0/3961501744 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9006e5c0 con 0x7eff9006da20 2023-07-21T07:36:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.049+0000 7eff8e59c700 1 --2- 172.21.15.6:0/3961501744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff9006da20 0x7eff90151710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7eff78009870 tx=0x7eff78009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e590a934626a42a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.049+0000 7eff8dd9b700 1 -- 172.21.15.6:0/3961501744 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff78011830 con 0x7eff9006da20 2023-07-21T07:36:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.049+0000 7eff8dd9b700 1 -- 172.21.15.6:0/3961501744 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff78011990 con 0x7eff9006da20 2023-07-21T07:36:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.049+0000 7eff8dd9b700 1 -- 172.21.15.6:0/3961501744 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff78011d00 con 0x7eff9006da20 2023-07-21T07:36:29.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.050+0000 7eff95220700 1 -- 172.21.15.6:0/3961501744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff9006da20 msgr2=0x7eff90151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:29.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.050+0000 7eff95220700 1 --2- 172.21.15.6:0/3961501744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff9006da20 0x7eff90151710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7eff78009870 tx=0x7eff78009b80 comp rx=0 tx=0).stop 2023-07-21T07:36:29.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.050+0000 7eff95220700 1 -- 172.21.15.6:0/3961501744 shutdown_connections 2023-07-21T07:36:29.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.050+0000 7eff95220700 1 --2- 172.21.15.6:0/3961501744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff9006da20 0x7eff90151710 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.050+0000 7eff95220700 1 -- 172.21.15.6:0/3961501744 >> 172.21.15.6:0/3961501744 conn(0x7eff900a8c90 msgr2=0x7eff9006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.050+0000 7eff95220700 1 -- 172.21.15.6:0/3961501744 shutdown_connections 2023-07-21T07:36:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.050+0000 7eff95220700 1 -- 172.21.15.6:0/3961501744 wait complete. 2023-07-21T07:36:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.052+0000 7eff95220700 1 Processor -- start 2023-07-21T07:36:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.052+0000 7eff95220700 1 -- start start 2023-07-21T07:36:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff95220700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff9006a300 0x7eff901e9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff95220700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9006da20 0x7eff900c0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff95220700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff90151c50 0x7eff900beda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff95220700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff90157f40 con 0x7eff90151c50 2023-07-21T07:36:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff95220700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff900bdd40 con 0x7eff9006da20 2023-07-21T07:36:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff95220700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff900bdfe0 con 0x7eff9006a300 2023-07-21T07:36:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff8f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff90151c50 0x7eff900beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff8f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff90151c50 0x7eff900beda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35948/0 (socket says 172.21.15.6:35948) 2023-07-21T07:36:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff8f59e700 1 -- 172.21.15.6:0/729387453 learned_addr learned my addr 172.21.15.6:0/729387453 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff8ed9d700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff9006a300 0x7eff901e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff8e59c700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9006da20 0x7eff900c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff8f59e700 1 -- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff9006a300 msgr2=0x7eff901e9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff8f59e700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff9006a300 0x7eff901e9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff8f59e700 1 -- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9006da20 msgr2=0x7eff900c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff8f59e700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9006da20 0x7eff900c0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff8f59e700 1 -- 172.21.15.6:0/729387453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff780094a0 con 0x7eff90151c50 2023-07-21T07:36:29.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff8ed9d700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff9006a300 0x7eff901e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:29.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff8e59c700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9006da20 0x7eff900c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:29.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff8f59e700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff90151c50 0x7eff900beda0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7eff8800caa0 tx=0x7eff8800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:29.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.053+0000 7eff877fe700 1 -- 172.21.15.6:0/729387453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8800aa80 con 0x7eff90151c50 2023-07-21T07:36:29.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.054+0000 7eff877fe700 1 -- 172.21.15.6:0/729387453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8800abe0 con 0x7eff90151c50 2023-07-21T07:36:29.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.054+0000 7eff877fe700 1 -- 172.21.15.6:0/729387453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88012400 con 0x7eff90151c50 2023-07-21T07:36:29.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.054+0000 7eff95220700 1 -- 172.21.15.6:0/729387453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff900be2c0 con 0x7eff90151c50 2023-07-21T07:36:29.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.054+0000 7eff95220700 1 -- 172.21.15.6:0/729387453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff900be880 con 0x7eff90151c50 2023-07-21T07:36:29.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.054+0000 7eff95220700 1 -- 172.21.15.6:0/729387453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff900bea70 con 0x7eff90151c50 2023-07-21T07:36:29.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.055+0000 7eff877fe700 1 -- 172.21.15.6:0/729387453 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff8801b3b0 con 0x7eff90151c50 2023-07-21T07:36:29.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.055+0000 7eff877fe700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff7006ace0 0x7eff7006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:29.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.056+0000 7eff877fe700 1 -- 172.21.15.6:0/729387453 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff880891c0 con 0x7eff90151c50 2023-07-21T07:36:29.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.056+0000 7eff8ed9d700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff7006ace0 0x7eff7006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:29.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.056+0000 7eff8ed9d700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff7006ace0 0x7eff7006d1a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7eff80007fd0 tx=0x7eff80009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:29.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.060+0000 7eff877fe700 1 -- 172.21.15.6:0/729387453 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7eff88054300 con 0x7eff90151c50 2023-07-21T07:36:29.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.258+0000 7eff95220700 1 -- 172.21.15.6:0/729387453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff90074500 con 0x7eff90151c50 2023-07-21T07:36:29.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.260+0000 7eff877fe700 1 -- 172.21.15.6:0/729387453 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18198 (secure 0 0 0) 0x7eff88057920 con 0x7eff90151c50 2023-07-21T07:36:29.314 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:29.314 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":53,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:36:27.950150+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:36:26.204826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T07:36:26.916497+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:29.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.262+0000 7eff95220700 1 -- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff7006ace0 msgr2=0x7eff7006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.262+0000 7eff95220700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff7006ace0 0x7eff7006d1a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7eff80007fd0 tx=0x7eff80009040 comp rx=0 tx=0).stop 2023-07-21T07:36:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.262+0000 7eff95220700 1 -- 172.21.15.6:0/729387453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff90151c50 msgr2=0x7eff900beda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.262+0000 7eff95220700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff90151c50 0x7eff900beda0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7eff8800caa0 tx=0x7eff8800ce60 comp rx=0 tx=0).stop 2023-07-21T07:36:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.262+0000 7eff95220700 1 -- 172.21.15.6:0/729387453 shutdown_connections 2023-07-21T07:36:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.262+0000 7eff95220700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff7006ace0 0x7eff7006d1a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.262+0000 7eff95220700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff90151c50 0x7eff900beda0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:29.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.262+0000 7eff95220700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff9006a300 0x7eff901e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:29.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.262+0000 7eff95220700 1 --2- 172.21.15.6:0/729387453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff9006da20 0x7eff900c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:29.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.262+0000 7eff95220700 1 -- 172.21.15.6:0/729387453 >> 172.21.15.6:0/729387453 conn(0x7eff900a8c90 msgr2=0x7eff900a7070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:29.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.262+0000 7eff95220700 1 -- 172.21.15.6:0/729387453 shutdown_connections 2023-07-21T07:36:29.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.262+0000 7eff95220700 1 -- 172.21.15.6:0/729387453 wait complete. 2023-07-21T07:36:29.328 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T07:36:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.403+0000 7f333f316700 1 Processor -- start 2023-07-21T07:36:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.403+0000 7f333f316700 1 -- start start 2023-07-21T07:36:29.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333f316700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f333806a300 0x7f33381519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:29.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333f316700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f333806d8a0 0x7f3338151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:29.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333f316700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3338155530 con 0x7f33380ba140 2023-07-21T07:36:29.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333f316700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33380c1a30 con 0x7f333806d8a0 2023-07-21T07:36:29.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333f316700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3338154920 con 0x7f333806a300 2023-07-21T07:36:29.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333d8b3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f333806d8a0 0x7f3338151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333c8b1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f33380ba140 0x7f33380c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43974/0 (socket says 172.21.15.6:43974) 2023-07-21T07:36:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333c8b1700 1 -- 172.21.15.6:0/3336622696 learned_addr learned my addr 172.21.15.6:0/3336622696 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333d0b2700 1 --2- 172.21.15.6:0/3336622696 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f333806a300 0x7f33381519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333d8b3700 1 -- 172.21.15.6:0/3336622696 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f333806a300 msgr2=0x7f33381519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333d8b3700 1 --2- 172.21.15.6:0/3336622696 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f333806a300 0x7f33381519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333d8b3700 1 -- 172.21.15.6:0/3336622696 >> v1:172.21.15.6:6789/0 conn(0x7f33380ba140 legacy=0x7f33380c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333d8b3700 1 -- 172.21.15.6:0/3336622696 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338154c00 con 0x7f333806d8a0 2023-07-21T07:36:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f332ffff700 1 -- 172.21.15.6:0/3336622696 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420149540 0 0) 0x7f3338155530 con 0x7f33380ba140 2023-07-21T07:36:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333d0b2700 1 --2- 172.21.15.6:0/3336622696 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f333806a300 0x7f33381519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f333d8b3700 1 --2- 172.21.15.6:0/3336622696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333806d8a0 0x7f3338151ef0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3330009d90 tx=0x7f333000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bcd200540b4b8b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.404+0000 7f332ffff700 1 -- 172.21.15.6:0/3336622696 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333000e070 con 0x7f333806d8a0 2023-07-21T07:36:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.405+0000 7f332ffff700 1 -- 172.21.15.6:0/3336622696 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333000bbd0 con 0x7f333806d8a0 2023-07-21T07:36:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.405+0000 7f332ffff700 1 -- 172.21.15.6:0/3336622696 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3330012430 con 0x7f333806d8a0 2023-07-21T07:36:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.405+0000 7f333f316700 1 -- 172.21.15.6:0/3336622696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333806d8a0 msgr2=0x7f3338151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:29.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.405+0000 7f333f316700 1 --2- 172.21.15.6:0/3336622696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333806d8a0 0x7f3338151ef0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3330009d90 tx=0x7f333000b330 comp rx=0 tx=0).stop 2023-07-21T07:36:29.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.405+0000 7f333f316700 1 -- 172.21.15.6:0/3336622696 shutdown_connections 2023-07-21T07:36:29.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.405+0000 7f333f316700 1 --2- 172.21.15.6:0/3336622696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333806d8a0 0x7f3338151ef0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:29.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.405+0000 7f333f316700 1 --2- 172.21.15.6:0/3336622696 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f333806a300 0x7f33381519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:29.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.405+0000 7f333f316700 1 -- 172.21.15.6:0/3336622696 >> 172.21.15.6:0/3336622696 conn(0x7f33380a8660 msgr2=0x7f33380a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:29.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.405+0000 7f333f316700 1 -- 172.21.15.6:0/3336622696 shutdown_connections 2023-07-21T07:36:29.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.405+0000 7f333f316700 1 -- 172.21.15.6:0/3336622696 wait complete. 2023-07-21T07:36:29.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.406+0000 7f333f316700 1 Processor -- start 2023-07-21T07:36:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.406+0000 7f333f316700 1 -- start start 2023-07-21T07:36:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333f316700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333806a300 0x7f3338153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333f316700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f333806d8a0 0x7f333814be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333f316700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33380ba140 0x7f3338070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333f316700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3338154710 con 0x7f333806a300 2023-07-21T07:36:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333f316700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3338152e70 con 0x7f333806d8a0 2023-07-21T07:36:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333f316700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3338153a60 con 0x7f33380ba140 2023-07-21T07:36:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333d0b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333806a300 0x7f3338153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333d0b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333806a300 0x7f3338153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35958/0 (socket says 172.21.15.6:35958) 2023-07-21T07:36:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333d0b2700 1 -- 172.21.15.6:0/4123728182 learned_addr learned my addr 172.21.15.6:0/4123728182 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333c8b1700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f333806d8a0 0x7f333814be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333d8b3700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33380ba140 0x7f3338070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333d0b2700 1 -- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33380ba140 msgr2=0x7f3338070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333d0b2700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33380ba140 0x7f3338070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333d0b2700 1 -- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f333806d8a0 msgr2=0x7f333814be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333d0b2700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f333806d8a0 0x7f333814be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333d0b2700 1 -- 172.21.15.6:0/4123728182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3330009a70 con 0x7f333806a300 2023-07-21T07:36:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.407+0000 7f333d8b3700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33380ba140 0x7f3338070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.408+0000 7f333d0b2700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333806a300 0x7f3338153520 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f333400e810 tx=0x7f333400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.408+0000 7f332dffb700 1 -- 172.21.15.6:0/4123728182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400c020 con 0x7f333806a300 2023-07-21T07:36:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.408+0000 7f332dffb700 1 -- 172.21.15.6:0/4123728182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3334004250 con 0x7f333806a300 2023-07-21T07:36:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.408+0000 7f332dffb700 1 -- 172.21.15.6:0/4123728182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340036a0 con 0x7f333806a300 2023-07-21T07:36:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.408+0000 7f333f316700 1 -- 172.21.15.6:0/4123728182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33380a8400 con 0x7f333806a300 2023-07-21T07:36:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.408+0000 7f333f316700 1 -- 172.21.15.6:0/4123728182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33380a8120 con 0x7f333806a300 2023-07-21T07:36:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.409+0000 7f333f316700 1 -- 172.21.15.6:0/4123728182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33380c52c0 con 0x7f333806a300 2023-07-21T07:36:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.409+0000 7f332dffb700 1 -- 172.21.15.6:0/4123728182 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3334003800 con 0x7f333806a300 2023-07-21T07:36:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.410+0000 7f332dffb700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f331c06ace0 0x7f331c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.410+0000 7f332dffb700 1 -- 172.21.15.6:0/4123728182 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3334088fb0 con 0x7f333806a300 2023-07-21T07:36:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.410+0000 7f333c8b1700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f331c06ace0 0x7f331c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.410+0000 7f333c8b1700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f331c06ace0 0x7f331c06d1a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f33380c1640 tx=0x7f3328007be0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:29.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.414+0000 7f332dffb700 1 -- 172.21.15.6:0/4123728182 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f33340540f0 con 0x7f333806a300 2023-07-21T07:36:29.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:29.661+0000 7f333f316700 1 -- 172.21.15.6:0/4123728182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f33380a8400 con 0x7f333806a300 2023-07-21T07:36:30.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.548+0000 7f332dffb700 1 -- 172.21.15.6:0/4123728182 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f33380a8400 con 0x7f333806a300 2023-07-21T07:36:30.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.551+0000 7f333f316700 1 -- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f331c06ace0 msgr2=0x7f331c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:30.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.551+0000 7f333f316700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f331c06ace0 0x7f331c06d1a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f33380c1640 tx=0x7f3328007be0 comp rx=0 tx=0).stop 2023-07-21T07:36:30.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.551+0000 7f333f316700 1 -- 172.21.15.6:0/4123728182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333806a300 msgr2=0x7f3338153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:30.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.551+0000 7f333f316700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333806a300 0x7f3338153520 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f333400e810 tx=0x7f333400ebd0 comp rx=0 tx=0).stop 2023-07-21T07:36:30.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.551+0000 7f333f316700 1 -- 172.21.15.6:0/4123728182 shutdown_connections 2023-07-21T07:36:30.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.551+0000 7f333f316700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f331c06ace0 0x7f331c06d1a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:30.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.551+0000 7f333f316700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33380ba140 0x7f3338070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:30.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.551+0000 7f333f316700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f333806a300 0x7f3338153520 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:30.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.551+0000 7f333f316700 1 --2- 172.21.15.6:0/4123728182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f333806d8a0 0x7f333814be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:30.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.551+0000 7f333f316700 1 -- 172.21.15.6:0/4123728182 >> 172.21.15.6:0/4123728182 conn(0x7f33380a8660 msgr2=0x7f33380c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:30.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.551+0000 7f333f316700 1 -- 172.21.15.6:0/4123728182 shutdown_connections 2023-07-21T07:36:30.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.552+0000 7f333f316700 1 -- 172.21.15.6:0/4123728182 wait complete. 2023-07-21T07:36:30.620 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T07:36:30.620 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T07:36:30.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.702+0000 7f889f4e7700 1 Processor -- start 2023-07-21T07:36:30.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.702+0000 7f889f4e7700 1 -- start start 2023-07-21T07:36:30.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889f4e7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f88980ba140 0x7f88980c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:30.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889f4e7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f889806d8a0 0x7f88980c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:30.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889f4e7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8898155530 con 0x7f889806a300 2023-07-21T07:36:30.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889f4e7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88980c1a30 con 0x7f889806d8a0 2023-07-21T07:36:30.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889f4e7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8898154920 con 0x7f88980ba140 2023-07-21T07:36:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889da84700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f889806d8a0 0x7f88980c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889da84700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f889806d8a0 0x7f88980c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35970/0 (socket says 172.21.15.6:35970) 2023-07-21T07:36:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889da84700 1 -- 172.21.15.6:0/3102019230 learned_addr learned my addr 172.21.15.6:0/3102019230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889ca82700 1 --2- 172.21.15.6:0/3102019230 >> v2:172.21.15.86:3300/0 conn(0x7f88980ba140 0x7f88980c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889da84700 1 -- 172.21.15.6:0/3102019230 >> v2:172.21.15.86:3300/0 conn(0x7f88980ba140 msgr2=0x7f88980c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889da84700 1 --2- 172.21.15.6:0/3102019230 >> v2:172.21.15.86:3300/0 conn(0x7f88980ba140 0x7f88980c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:30.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889da84700 1 -- 172.21.15.6:0/3102019230 >> v1:172.21.15.86:6789/0 conn(0x7f889806a300 legacy=0x7f88981519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:30.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889da84700 1 -- 172.21.15.6:0/3102019230 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8898154c00 con 0x7f889806d8a0 2023-07-21T07:36:30.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f889da84700 1 --2- 172.21.15.6:0/3102019230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889806d8a0 0x7f88980c4f80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f889806c510 tx=0x7f889000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbb9432290f104d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:30.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.703+0000 7f888ffff700 1 -- 172.21.15.6:0/3102019230 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889000e070 con 0x7f889806d8a0 2023-07-21T07:36:30.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.704+0000 7f888ffff700 1 -- 172.21.15.6:0/3102019230 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8890003a20 con 0x7f889806d8a0 2023-07-21T07:36:30.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.704+0000 7f888ffff700 1 -- 172.21.15.6:0/3102019230 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890003dd0 con 0x7f889806d8a0 2023-07-21T07:36:30.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.704+0000 7f889f4e7700 1 -- 172.21.15.6:0/3102019230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889806d8a0 msgr2=0x7f88980c4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:30.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.704+0000 7f889f4e7700 1 --2- 172.21.15.6:0/3102019230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889806d8a0 0x7f88980c4f80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f889806c510 tx=0x7f889000b330 comp rx=0 tx=0).stop 2023-07-21T07:36:30.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.704+0000 7f889f4e7700 1 -- 172.21.15.6:0/3102019230 shutdown_connections 2023-07-21T07:36:30.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.704+0000 7f889f4e7700 1 --2- 172.21.15.6:0/3102019230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889806d8a0 0x7f88980c4f80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:30.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.704+0000 7f889f4e7700 1 --2- 172.21.15.6:0/3102019230 >> v2:172.21.15.86:3300/0 conn(0x7f88980ba140 0x7f88980c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:30.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.704+0000 7f889f4e7700 1 -- 172.21.15.6:0/3102019230 >> 172.21.15.6:0/3102019230 conn(0x7f88980a8660 msgr2=0x7f88980a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:30.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.704+0000 7f889f4e7700 1 -- 172.21.15.6:0/3102019230 shutdown_connections 2023-07-21T07:36:30.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.704+0000 7f889f4e7700 1 -- 172.21.15.6:0/3102019230 wait complete. 2023-07-21T07:36:30.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.705+0000 7f889f4e7700 1 Processor -- start 2023-07-21T07:36:30.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.705+0000 7f889f4e7700 1 -- start start 2023-07-21T07:36:30.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.706+0000 7f889f4e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889806a300 0x7f88980a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:30.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.706+0000 7f889f4e7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f889806d8a0 0x7f88981ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:30.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.706+0000 7f889f4e7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88980ba140 0x7f88981ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:30.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.706+0000 7f889f4e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980be1b0 con 0x7f889806a300 2023-07-21T07:36:30.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.706+0000 7f889f4e7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980c0b40 con 0x7f889806d8a0 2023-07-21T07:36:30.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.706+0000 7f889f4e7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88980bf520 con 0x7f88980ba140 2023-07-21T07:36:30.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.706+0000 7f889d283700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889806a300 0x7f88980a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:30.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.706+0000 7f889d283700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889806a300 0x7f88980a7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35972/0 (socket says 172.21.15.6:35972) 2023-07-21T07:36:30.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.706+0000 7f889d283700 1 -- 172.21.15.6:0/2541086613 learned_addr learned my addr 172.21.15.6:0/2541086613 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:30.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.706+0000 7f889da84700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88980ba140 0x7f88981ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:30.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.706+0000 7f889ca82700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f889806d8a0 0x7f88981ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:30.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.707+0000 7f889d283700 1 -- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88980ba140 msgr2=0x7f88981ea2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:30.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.707+0000 7f889d283700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88980ba140 0x7f88981ea2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:30.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.707+0000 7f889d283700 1 -- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f889806d8a0 msgr2=0x7f88981ed9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:30.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.707+0000 7f889d283700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f889806d8a0 0x7f88981ed9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:30.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.707+0000 7f889d283700 1 -- 172.21.15.6:0/2541086613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8890009b30 con 0x7f889806a300 2023-07-21T07:36:30.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.707+0000 7f889da84700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88980ba140 0x7f88981ea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:30.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.707+0000 7f889d283700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889806a300 0x7f88980a7e80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f889400b4a0 tx=0x7f889400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:30.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.707+0000 7f888dffb700 1 -- 172.21.15.6:0/2541086613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894011830 con 0x7f889806a300 2023-07-21T07:36:30.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.707+0000 7f888dffb700 1 -- 172.21.15.6:0/2541086613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8894011990 con 0x7f889806a300 2023-07-21T07:36:30.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.707+0000 7f889f4e7700 1 -- 172.21.15.6:0/2541086613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88980c0630 con 0x7f889806a300 2023-07-21T07:36:30.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.707+0000 7f888dffb700 1 -- 172.21.15.6:0/2541086613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894011d40 con 0x7f889806a300 2023-07-21T07:36:30.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.707+0000 7f889f4e7700 1 -- 172.21.15.6:0/2541086613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88980c0860 con 0x7f889806a300 2023-07-21T07:36:30.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.708+0000 7f889f4e7700 1 -- 172.21.15.6:0/2541086613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88981ed2e0 con 0x7f889806a300 2023-07-21T07:36:30.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.708+0000 7f888dffb700 1 -- 172.21.15.6:0/2541086613 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f889401a400 con 0x7f889806a300 2023-07-21T07:36:30.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.709+0000 7f888dffb700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f887c06ad10 0x7f887c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:30.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.709+0000 7f888dffb700 1 -- 172.21.15.6:0/2541086613 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f88940891a0 con 0x7f889806a300 2023-07-21T07:36:30.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.709+0000 7f889ca82700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f887c06ad10 0x7f887c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:30.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.710+0000 7f889ca82700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f887c06ad10 0x7f887c06d1d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f889806e540 tx=0x7f8888008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:30.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.713+0000 7f888dffb700 1 -- 172.21.15.6:0/2541086613 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f88981ed2e0 con 0x7f889806a300 2023-07-21T07:36:31.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:30.959+0000 7f889f4e7700 1 -- 172.21.15.6:0/2541086613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f88981ed2e0 con 0x7f889806a300 2023-07-21T07:36:31.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.555+0000 7f888dffb700 1 -- 172.21.15.6:0/2541086613 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7f88981ed2e0 con 0x7f889806a300 2023-07-21T07:36:31.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.558+0000 7f889f4e7700 1 -- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f887c06ad10 msgr2=0x7f887c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:31.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.558+0000 7f889f4e7700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f887c06ad10 0x7f887c06d1d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f889806e540 tx=0x7f8888008040 comp rx=0 tx=0).stop 2023-07-21T07:36:31.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.558+0000 7f889f4e7700 1 -- 172.21.15.6:0/2541086613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889806a300 msgr2=0x7f88980a7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:31.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.558+0000 7f889f4e7700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889806a300 0x7f88980a7e80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f889400b4a0 tx=0x7f889400b860 comp rx=0 tx=0).stop 2023-07-21T07:36:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.558+0000 7f889f4e7700 1 -- 172.21.15.6:0/2541086613 shutdown_connections 2023-07-21T07:36:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.558+0000 7f889f4e7700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f887c06ad10 0x7f887c06d1d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.558+0000 7f889f4e7700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88980ba140 0x7f88981ea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.558+0000 7f889f4e7700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f889806a300 0x7f88980a7e80 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.558+0000 7f889f4e7700 1 --2- 172.21.15.6:0/2541086613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f889806d8a0 0x7f88981ed9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.558+0000 7f889f4e7700 1 -- 172.21.15.6:0/2541086613 >> 172.21.15.6:0/2541086613 conn(0x7f88980a8660 msgr2=0x7f88980c3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.558+0000 7f889f4e7700 1 -- 172.21.15.6:0/2541086613 shutdown_connections 2023-07-21T07:36:31.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.558+0000 7f889f4e7700 1 -- 172.21.15.6:0/2541086613 wait complete. 2023-07-21T07:36:31.626 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T07:36:31.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:36:31.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.703+0000 7fc6c12e7700 1 Processor -- start 2023-07-21T07:36:31.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.703+0000 7fc6c12e7700 1 -- start start 2023-07-21T07:36:31.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.704+0000 7fc6c12e7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6bc06b1a0 0x7fc6bc065fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:31.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.704+0000 7fc6c12e7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc6bc151250 0x7fc6bc151700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:31.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.704+0000 7fc6c12e7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6bc14ef20 con 0x7fc6bc14eb40 2023-07-21T07:36:31.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.704+0000 7fc6c12e7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6bc06bbf0 con 0x7fc6bc151250 2023-07-21T07:36:31.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.704+0000 7fc6c12e7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc066520 con 0x7fc6bc06b1a0 2023-07-21T07:36:31.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.704+0000 7fc6baffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc6bc14eb40 0x7fc6bc0aba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44000/0 (socket says 172.21.15.6:44000) 2023-07-21T07:36:31.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.704+0000 7fc6baffd700 1 -- 172.21.15.6:0/4259896611 learned_addr learned my addr 172.21.15.6:0/4259896611 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:31.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.704+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732173472 0 0) 0x7fc6b0001110 con 0x7fc6bc14eb40 2023-07-21T07:36:31.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6bb7fe700 1 --2- 172.21.15.6:0/4259896611 >> v2:172.21.15.86:3300/0 conn(0x7fc6bc151250 0x7fc6bc151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:31.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6ba7fc700 1 --2- 172.21.15.6:0/4259896611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6bc06b1a0 0x7fc6bc065fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:31.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a40035b0 con 0x7fc6bc14eb40 2023-07-21T07:36:31.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1343867018 0 0) 0x7fc6a40035b0 con 0x7fc6bc14eb40 2023-07-21T07:36:31.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6bc06b1a0 msgr2=0x7fc6bc065fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:31.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 --2- 172.21.15.6:0/4259896611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6bc06b1a0 0x7fc6bc065fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:31.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 >> v2:172.21.15.86:3300/0 conn(0x7fc6bc151250 msgr2=0x7fc6bc151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:31.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 --2- 172.21.15.6:0/4259896611 >> v2:172.21.15.86:3300/0 conn(0x7fc6bc151250 0x7fc6bc151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:31.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc070310 con 0x7fc6bc14eb40 2023-07-21T07:36:31.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7fc6b0001800 con 0x7fc6bc14eb40 2023-07-21T07:36:31.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 >> v1:172.21.15.6:6789/0 conn(0x7fc6bc14eb40 legacy=0x7fc6bc0aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:31.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 --2- 172.21.15.6:0/4259896611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a4003a00 0x7fc6a4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:31.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 --2- 172.21.15.6:0/4259896611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a4004850 0x7fc6a4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:31.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 --2- 172.21.15.6:0/4259896611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a4005210 0x7fc6a400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:31.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc06bbf0 con 0x7fc6a4003a00 2023-07-21T07:36:31.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc066520 con 0x7fc6a4004850 2023-07-21T07:36:31.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40045f0 con 0x7fc6a4005210 2023-07-21T07:36:31.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6baffd700 1 --2- 172.21.15.6:0/4259896611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a4003a00 0x7fc6a4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:31.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6ba7fc700 1 --2- 172.21.15.6:0/4259896611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a4004850 0x7fc6a4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:31.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6bb7fe700 1 --2- 172.21.15.6:0/4259896611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a4005210 0x7fc6a400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:31.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6baffd700 1 -- 172.21.15.6:0/4259896611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a4005210 msgr2=0x7fc6a400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:31.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6baffd700 1 --2- 172.21.15.6:0/4259896611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a4005210 0x7fc6a400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:31.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6baffd700 1 -- 172.21.15.6:0/4259896611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a4004850 msgr2=0x7fc6a4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:31.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6baffd700 1 --2- 172.21.15.6:0/4259896611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a4004850 0x7fc6a4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:31.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.705+0000 7fc6baffd700 1 -- 172.21.15.6:0/4259896611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40035b0 con 0x7fc6a4003a00 2023-07-21T07:36:31.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.706+0000 7fc6baffd700 1 --2- 172.21.15.6:0/4259896611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a4003a00 0x7fc6a4003e20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0007f40 tx=0x7fc6a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555136c63882c6fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:31.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.706+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000ce00 con 0x7fc6a4003a00 2023-07-21T07:36:31.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.706+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b0005960 con 0x7fc6a4003a00 2023-07-21T07:36:31.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.706+0000 7fc6b9ffb700 1 -- 172.21.15.6:0/4259896611 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0005d10 con 0x7fc6a4003a00 2023-07-21T07:36:31.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.706+0000 7fc6c12e7700 1 -- 172.21.15.6:0/4259896611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a4003a00 msgr2=0x7fc6a4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:31.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.706+0000 7fc6c12e7700 1 --2- 172.21.15.6:0/4259896611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a4003a00 0x7fc6a4003e20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0007f40 tx=0x7fc6a4005880 comp rx=0 tx=0).stop 2023-07-21T07:36:31.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.706+0000 7fc6bb7fe700 1 -- 172.21.15.6:0/4259896611 reap_dead start 2023-07-21T07:36:31.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.706+0000 7fc6c12e7700 1 -- 172.21.15.6:0/4259896611 shutdown_connections 2023-07-21T07:36:31.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.706+0000 7fc6c12e7700 1 -- 172.21.15.6:0/4259896611 >> 172.21.15.6:0/4259896611 conn(0x7fc6bc0c6140 msgr2=0x7fc6bc0c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:31.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.706+0000 7fc6c12e7700 1 -- 172.21.15.6:0/4259896611 shutdown_connections 2023-07-21T07:36:31.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.706+0000 7fc6c12e7700 1 -- 172.21.15.6:0/4259896611 wait complete. 2023-07-21T07:36:31.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.708+0000 7fc6c12e7700 1 Processor -- start 2023-07-21T07:36:31.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.708+0000 7fc6c12e7700 1 -- start start 2023-07-21T07:36:31.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.708+0000 7fc6c12e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a4003a00 0x7fc6bc0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:31.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.708+0000 7fc6c12e7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6bc14cfd0 0x7fc6bc070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:31.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.708+0000 7fc6c12e7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6bc14f2e0 0x7fc6bc142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:31.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.708+0000 7fc6c12e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0c4430 con 0x7fc6a4003a00 2023-07-21T07:36:31.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.708+0000 7fc6c12e7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc14dbe0 con 0x7fc6bc14cfd0 2023-07-21T07:36:31.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.708+0000 7fc6c12e7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc14dec0 con 0x7fc6bc14f2e0 2023-07-21T07:36:31.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.708+0000 7fc6baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a4003a00 0x7fc6bc0c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:31.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.708+0000 7fc6baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a4003a00 0x7fc6bc0c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35992/0 (socket says 172.21.15.6:35992) 2023-07-21T07:36:31.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.708+0000 7fc6baffd700 1 -- 172.21.15.6:0/2014565784 learned_addr learned my addr 172.21.15.6:0/2014565784 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:31.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.709+0000 7fc6bb7fe700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6bc14f2e0 0x7fc6bc142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:31.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.709+0000 7fc6ba7fc700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6bc14cfd0 0x7fc6bc070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:31.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.709+0000 7fc6baffd700 1 -- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6bc14f2e0 msgr2=0x7fc6bc142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:31.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.709+0000 7fc6baffd700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6bc14f2e0 0x7fc6bc142b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:31.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.709+0000 7fc6baffd700 1 -- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6bc14cfd0 msgr2=0x7fc6bc070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:31.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.709+0000 7fc6baffd700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6bc14cfd0 0x7fc6bc070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:31.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.709+0000 7fc6baffd700 1 -- 172.21.15.6:0/2014565784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc0c40c0 con 0x7fc6a4003a00 2023-07-21T07:36:31.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.709+0000 7fc6baffd700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a4003a00 0x7fc6bc0c48c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000c8b0 tx=0x7fc6b0001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:31.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.709+0000 7fc6a37fe700 1 -- 172.21.15.6:0/2014565784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0004870 con 0x7fc6a4003a00 2023-07-21T07:36:31.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.709+0000 7fc6a37fe700 1 -- 172.21.15.6:0/2014565784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b00049d0 con 0x7fc6a4003a00 2023-07-21T07:36:31.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.709+0000 7fc6c12e7700 1 -- 172.21.15.6:0/2014565784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6bc071380 con 0x7fc6a4003a00 2023-07-21T07:36:31.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.709+0000 7fc6a37fe700 1 -- 172.21.15.6:0/2014565784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0004dc0 con 0x7fc6a4003a00 2023-07-21T07:36:31.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.709+0000 7fc6c12e7700 1 -- 172.21.15.6:0/2014565784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc14c220 con 0x7fc6a4003a00 2023-07-21T07:36:31.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.710+0000 7fc6c12e7700 1 -- 172.21.15.6:0/2014565784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc0c3f20 con 0x7fc6a4003a00 2023-07-21T07:36:31.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.711+0000 7fc6a37fe700 1 -- 172.21.15.6:0/2014565784 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc6b0021020 con 0x7fc6a4003a00 2023-07-21T07:36:31.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.711+0000 7fc6a37fe700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc6a806ad10 0x7fc6a806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:31.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.711+0000 7fc6a37fe700 1 -- 172.21.15.6:0/2014565784 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6b0089d00 con 0x7fc6a4003a00 2023-07-21T07:36:31.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.711+0000 7fc6ba7fc700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc6a806ad10 0x7fc6a806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:31.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.712+0000 7fc6ba7fc700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc6a806ad10 0x7fc6a806d1d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc14d3d0 tx=0x7fc6ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:31.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.715+0000 7fc6a37fe700 1 -- 172.21.15.6:0/2014565784 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc6bc0c3f20 con 0x7fc6a4003a00 2023-07-21T07:36:32.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.957+0000 7fc6c12e7700 1 -- 172.21.15.6:0/2014565784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6bc14ef20 con 0x7fc6a4003a00 2023-07-21T07:36:32.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.958+0000 7fc6a37fe700 1 -- 172.21.15.6:0/2014565784 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4657 (secure 0 0 0) 0x7fc6bc14ef20 con 0x7fc6a4003a00 2023-07-21T07:36:32.012 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:32.012 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/853425943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":853425943},{"type":"v1","addr":"172.21.15.86:6837","nonce":853425943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5599,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/99889473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":99889473},{"type":"v1","addr":"172.21.15.86:6836","nonce":99889473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3714237035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3714237035},{"type":"v1","addr":"172.21.15.6:6833","nonce":3714237035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:36:27.950466+0000","modified":"2023-07-21T07:36:31.548780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5871},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5871":{"gid":5871,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3415849886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3415849886},{"type":"v1","addr":"172.21.15.6:6835","nonce":3415849886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-21T07:36:32.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.960+0000 7fc6c12e7700 1 -- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc6a806ad10 msgr2=0x7fc6a806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.960+0000 7fc6c12e7700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc6a806ad10 0x7fc6a806d1d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc14d3d0 tx=0x7fc6ac008040 comp rx=0 tx=0).stop 2023-07-21T07:36:32.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.960+0000 7fc6c12e7700 1 -- 172.21.15.6:0/2014565784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a4003a00 msgr2=0x7fc6bc0c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.960+0000 7fc6c12e7700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a4003a00 0x7fc6bc0c48c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000c8b0 tx=0x7fc6b0001b90 comp rx=0 tx=0).stop 2023-07-21T07:36:32.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.960+0000 7fc6c12e7700 1 -- 172.21.15.6:0/2014565784 shutdown_connections 2023-07-21T07:36:32.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.960+0000 7fc6c12e7700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc6a806ad10 0x7fc6a806d1d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.960+0000 7fc6c12e7700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6bc14f2e0 0x7fc6bc142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.960+0000 7fc6c12e7700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6a4003a00 0x7fc6bc0c48c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.960+0000 7fc6c12e7700 1 --2- 172.21.15.6:0/2014565784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6bc14cfd0 0x7fc6bc070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.960+0000 7fc6c12e7700 1 -- 172.21.15.6:0/2014565784 >> 172.21.15.6:0/2014565784 conn(0x7fc6bc0c6140 msgr2=0x7fc6bc1da5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:32.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.960+0000 7fc6c12e7700 1 -- 172.21.15.6:0/2014565784 shutdown_connections 2023-07-21T07:36:32.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:31.960+0000 7fc6c12e7700 1 -- 172.21.15.6:0/2014565784 wait complete. 2023-07-21T07:36:32.016 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 33 2023-07-21T07:36:32.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.097+0000 7f4f73f1d700 1 Processor -- start 2023-07-21T07:36:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.098+0000 7f4f73f1d700 1 -- start start 2023-07-21T07:36:32.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.098+0000 7f4f73f1d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f6c06b1a0 0x7f4f6c065fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.098+0000 7f4f73f1d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c14ef20 con 0x7f4f6c14eb40 2023-07-21T07:36:32.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.098+0000 7f4f73f1d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c06bbf0 con 0x7f4f6c151250 2023-07-21T07:36:32.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.098+0000 7f4f73f1d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c066520 con 0x7f4f6c06b1a0 2023-07-21T07:36:32.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.098+0000 7f4f71cb9700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4f6c14eb40 0x7f4f6c0aba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44020/0 (socket says 172.21.15.6:44020) 2023-07-21T07:36:32.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.098+0000 7f4f71cb9700 1 -- 172.21.15.6:0/4026387876 learned_addr learned my addr 172.21.15.6:0/4026387876 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:32.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.099+0000 7f4f714b8700 1 --2- 172.21.15.6:0/4026387876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f6c06b1a0 0x7f4f6c065fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.099+0000 7f4f70cb7700 1 -- 172.21.15.6:0/4026387876 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995459620 0 0) 0x7f4f68001110 con 0x7f4f6c14eb40 2023-07-21T07:36:32.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.099+0000 7f4f70cb7700 1 -- 172.21.15.6:0/4026387876 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f580035b0 con 0x7f4f6c14eb40 2023-07-21T07:36:32.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.099+0000 7f4f70cb7700 1 -- 172.21.15.6:0/4026387876 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127805206 0 0) 0x7f4f64001490 con 0x7f4f6c151250 2023-07-21T07:36:32.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.099+0000 7f4f70cb7700 1 -- 172.21.15.6:0/4026387876 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f68001110 con 0x7f4f6c151250 2023-07-21T07:36:32.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.099+0000 7f4f70cb7700 1 -- 172.21.15.6:0/4026387876 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2842611065 0 0) 0x7f4f580035b0 con 0x7f4f6c14eb40 2023-07-21T07:36:32.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.099+0000 7f4f714b8700 1 -- 172.21.15.6:0/4026387876 >> v1:172.21.15.86:6789/0 conn(0x7f4f6c151250 legacy=0x7f4f6c151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.099+0000 7f4f714b8700 1 -- 172.21.15.6:0/4026387876 >> v1:172.21.15.6:6789/0 conn(0x7f4f6c14eb40 legacy=0x7f4f6c0aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.099+0000 7f4f714b8700 1 -- 172.21.15.6:0/4026387876 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c070310 con 0x7f4f6c06b1a0 2023-07-21T07:36:32.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.099+0000 7f4f714b8700 1 --2- 172.21.15.6:0/4026387876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f6c06b1a0 0x7f4f6c065fe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009870 tx=0x7f4f5c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2ac7b1148f014f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:32.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.099+0000 7f4f70cb7700 1 -- 172.21.15.6:0/4026387876 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68001800 con 0x7f4f6c06b1a0 2023-07-21T07:36:32.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.099+0000 7f4f70cb7700 1 -- 172.21.15.6:0/4026387876 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c004030 con 0x7f4f6c06b1a0 2023-07-21T07:36:32.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.099+0000 7f4f70cb7700 1 -- 172.21.15.6:0/4026387876 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0043a0 con 0x7f4f6c06b1a0 2023-07-21T07:36:32.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.100+0000 7f4f73f1d700 1 -- 172.21.15.6:0/4026387876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f6c06b1a0 msgr2=0x7f4f6c065fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.100+0000 7f4f73f1d700 1 --2- 172.21.15.6:0/4026387876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f6c06b1a0 0x7f4f6c065fe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009870 tx=0x7f4f5c009b80 comp rx=0 tx=0).stop 2023-07-21T07:36:32.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.100+0000 7f4f73f1d700 1 -- 172.21.15.6:0/4026387876 shutdown_connections 2023-07-21T07:36:32.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.100+0000 7f4f73f1d700 1 --2- 172.21.15.6:0/4026387876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f6c06b1a0 0x7f4f6c065fe0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.100+0000 7f4f73f1d700 1 -- 172.21.15.6:0/4026387876 >> 172.21.15.6:0/4026387876 conn(0x7f4f6c0c6140 msgr2=0x7f4f6c0c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:32.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.100+0000 7f4f73f1d700 1 -- 172.21.15.6:0/4026387876 shutdown_connections 2023-07-21T07:36:32.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.100+0000 7f4f73f1d700 1 -- 172.21.15.6:0/4026387876 wait complete. 2023-07-21T07:36:32.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.101+0000 7f4f73f1d700 1 Processor -- start 2023-07-21T07:36:32.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.101+0000 7f4f73f1d700 1 -- start start 2023-07-21T07:36:32.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f73f1d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f6c14eb40 0x7f4f6c0c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f73f1d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f6c151250 0x7f4f6c1dbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f73f1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c0c4c10 0x7f4f6c145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f73f1d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c0c5c20 con 0x7f4f6c0c4c10 2023-07-21T07:36:32.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f73f1d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c148a30 con 0x7f4f6c151250 2023-07-21T07:36:32.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f73f1d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c150420 con 0x7f4f6c14eb40 2023-07-21T07:36:32.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f724ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c0c4c10 0x7f4f6c145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f724ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c0c4c10 0x7f4f6c145a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36010/0 (socket says 172.21.15.6:36010) 2023-07-21T07:36:32.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f724ba700 1 -- 172.21.15.6:0/509963678 learned_addr learned my addr 172.21.15.6:0/509963678 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:32.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f71cb9700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f6c14eb40 0x7f4f6c0c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f714b8700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f6c151250 0x7f4f6c1dbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f724ba700 1 -- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f6c14eb40 msgr2=0x7f4f6c0c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f724ba700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f6c14eb40 0x7f4f6c0c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f724ba700 1 -- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f6c151250 msgr2=0x7f4f6c1dbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f724ba700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f6c151250 0x7f4f6c1dbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f724ba700 1 -- 172.21.15.6:0/509963678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0094a0 con 0x7f4f6c0c4c10 2023-07-21T07:36:32.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f714b8700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f6c151250 0x7f4f6c1dbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:32.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.102+0000 7f4f724ba700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c0c4c10 0x7f4f6c145a60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400cbb0 tx=0x7f4f6400cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:32.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.103+0000 7f4f627fc700 1 -- 172.21.15.6:0/509963678 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64003c00 con 0x7f4f6c0c4c10 2023-07-21T07:36:32.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.103+0000 7f4f627fc700 1 -- 172.21.15.6:0/509963678 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f64003d60 con 0x7f4f6c0c4c10 2023-07-21T07:36:32.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.103+0000 7f4f73f1d700 1 -- 172.21.15.6:0/509963678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6c1501b0 con 0x7f4f6c0c4c10 2023-07-21T07:36:32.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.103+0000 7f4f627fc700 1 -- 172.21.15.6:0/509963678 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6400ab00 con 0x7f4f6c0c4c10 2023-07-21T07:36:32.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.103+0000 7f4f73f1d700 1 -- 172.21.15.6:0/509963678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c1dc170 con 0x7f4f6c0c4c10 2023-07-21T07:36:32.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.104+0000 7f4f73f1d700 1 -- 172.21.15.6:0/509963678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c06ff80 con 0x7f4f6c0c4c10 2023-07-21T07:36:32.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.104+0000 7f4f627fc700 1 -- 172.21.15.6:0/509963678 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f6400ac60 con 0x7f4f6c0c4c10 2023-07-21T07:36:32.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.104+0000 7f4f627fc700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4f5006ace0 0x7f4f5006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.105+0000 7f4f627fc700 1 -- 172.21.15.6:0/509963678 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4f640892b0 con 0x7f4f6c0c4c10 2023-07-21T07:36:32.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.105+0000 7f4f71cb9700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4f5006ace0 0x7f4f5006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.105+0000 7f4f71cb9700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4f5006ace0 0x7f4f5006d1a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4f68001370 tx=0x7f4f68001060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:32.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.109+0000 7f4f627fc700 1 -- 172.21.15.6:0/509963678 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f6c06ff80 con 0x7f4f6c0c4c10 2023-07-21T07:36:32.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.308+0000 7f4f73f1d700 1 -- 172.21.15.6:0/509963678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f6c1eb9f0 con 0x7f4f6c0c4c10 2023-07-21T07:36:32.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.309+0000 7f4f627fc700 1 -- 172.21.15.6:0/509963678 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18185 (secure 0 0 0) 0x7f4f6c1eb9f0 con 0x7f4f6c0c4c10 2023-07-21T07:36:32.364 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:32.364 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":54,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:36:29.536326+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:36:26.204826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T07:36:26.916497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:32.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.312+0000 7f4f73f1d700 1 -- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4f5006ace0 msgr2=0x7f4f5006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.312+0000 7f4f73f1d700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4f5006ace0 0x7f4f5006d1a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4f68001370 tx=0x7f4f68001060 comp rx=0 tx=0).stop 2023-07-21T07:36:32.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.312+0000 7f4f73f1d700 1 -- 172.21.15.6:0/509963678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c0c4c10 msgr2=0x7f4f6c145a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.312+0000 7f4f73f1d700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c0c4c10 0x7f4f6c145a60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400cbb0 tx=0x7f4f6400cec0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.312+0000 7f4f73f1d700 1 -- 172.21.15.6:0/509963678 shutdown_connections 2023-07-21T07:36:32.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.312+0000 7f4f73f1d700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f4f5006ace0 0x7f4f5006d1a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.312+0000 7f4f73f1d700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f6c0c4c10 0x7f4f6c145a60 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.312+0000 7f4f73f1d700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f6c14eb40 0x7f4f6c0c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.312+0000 7f4f73f1d700 1 --2- 172.21.15.6:0/509963678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f6c151250 0x7f4f6c1dbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.312+0000 7f4f73f1d700 1 -- 172.21.15.6:0/509963678 >> 172.21.15.6:0/509963678 conn(0x7f4f6c0c6140 msgr2=0x7f4f6c1d73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:32.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.312+0000 7f4f73f1d700 1 -- 172.21.15.6:0/509963678 shutdown_connections 2023-07-21T07:36:32.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.312+0000 7f4f73f1d700 1 -- 172.21.15.6:0/509963678 wait complete. 2023-07-21T07:36:32.378 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T07:36:32.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:36:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.449+0000 7f2949491700 1 Processor -- start 2023-07-21T07:36:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.449+0000 7f2949491700 1 -- start start 2023-07-21T07:36:32.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.449+0000 7f2949491700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2944151ac0 0x7f29440c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.449+0000 7f2949491700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f29440c47d0 0x7f29440c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.449+0000 7f2949491700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2944155390 con 0x7f29440c67d0 2023-07-21T07:36:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.449+0000 7f2949491700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29440bd7b0 con 0x7f2944151ac0 2023-07-21T07:36:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.449+0000 7f2949491700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2944154570 con 0x7f29440c47d0 2023-07-21T07:36:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.449+0000 7f2942ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2944151ac0 0x7f29440c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.449+0000 7f2942ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2944151ac0 0x7f29440c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36018/0 (socket says 172.21.15.6:36018) 2023-07-21T07:36:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.450+0000 7f2942ffd700 1 -- 172.21.15.6:0/1716934241 learned_addr learned my addr 172.21.15.6:0/1716934241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.450+0000 7f29427fc700 1 --2- 172.21.15.6:0/1716934241 >> v2:172.21.15.86:3300/0 conn(0x7f29440c47d0 0x7f29440c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.450+0000 7f2942ffd700 1 -- 172.21.15.6:0/1716934241 >> v2:172.21.15.86:3300/0 conn(0x7f29440c47d0 msgr2=0x7f29440c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.450+0000 7f2942ffd700 1 --2- 172.21.15.6:0/1716934241 >> v2:172.21.15.86:3300/0 conn(0x7f29440c47d0 0x7f29440c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.450+0000 7f2942ffd700 1 -- 172.21.15.6:0/1716934241 >> v1:172.21.15.86:6789/0 conn(0x7f29440c67d0 legacy=0x7f29440c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.450+0000 7f2942ffd700 1 -- 172.21.15.6:0/1716934241 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29440c83e0 con 0x7f2944151ac0 2023-07-21T07:36:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.450+0000 7f2942ffd700 1 --2- 172.21.15.6:0/1716934241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2944151ac0 0x7f29440c7ea0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f29440cab40 tx=0x7f2938009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e8f29d2b7eda9e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.450+0000 7f2941ffb700 1 -- 172.21.15.6:0/1716934241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293800b870 con 0x7f2944151ac0 2023-07-21T07:36:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.450+0000 7f2941ffb700 1 -- 172.21.15.6:0/1716934241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293800b9d0 con 0x7f2944151ac0 2023-07-21T07:36:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.450+0000 7f2941ffb700 1 -- 172.21.15.6:0/1716934241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293800bd60 con 0x7f2944151ac0 2023-07-21T07:36:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.451+0000 7f2949491700 1 -- 172.21.15.6:0/1716934241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2944151ac0 msgr2=0x7f29440c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.451+0000 7f2949491700 1 --2- 172.21.15.6:0/1716934241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2944151ac0 0x7f29440c7ea0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f29440cab40 tx=0x7f2938009bd0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.451+0000 7f2949491700 1 -- 172.21.15.6:0/1716934241 shutdown_connections 2023-07-21T07:36:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.451+0000 7f2949491700 1 --2- 172.21.15.6:0/1716934241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2944151ac0 0x7f29440c7ea0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.451+0000 7f2949491700 1 --2- 172.21.15.6:0/1716934241 >> v2:172.21.15.86:3300/0 conn(0x7f29440c47d0 0x7f29440c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.451+0000 7f2949491700 1 -- 172.21.15.6:0/1716934241 >> 172.21.15.6:0/1716934241 conn(0x7f29440717c0 msgr2=0x7f2944071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.451+0000 7f2949491700 1 -- 172.21.15.6:0/1716934241 shutdown_connections 2023-07-21T07:36:32.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.451+0000 7f2949491700 1 -- 172.21.15.6:0/1716934241 wait complete. 2023-07-21T07:36:32.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.452+0000 7f2949491700 1 Processor -- start 2023-07-21T07:36:32.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.452+0000 7f2949491700 1 -- start start 2023-07-21T07:36:32.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f2949491700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29440c47d0 0x7f2944150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f2949491700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29440c67d0 0x7f29440c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f2949491700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2944151ac0 0x7f29441492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f2949491700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29440c3e30 con 0x7f29440c67d0 2023-07-21T07:36:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f2949491700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29440c3220 con 0x7f2944151ac0 2023-07-21T07:36:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f2949491700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29440c3500 con 0x7f29440c47d0 2023-07-21T07:36:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f29427fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29440c67d0 0x7f29440c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f29427fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29440c67d0 0x7f29440c0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36022/0 (socket says 172.21.15.6:36022) 2023-07-21T07:36:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f29427fc700 1 -- 172.21.15.6:0/196868124 learned_addr learned my addr 172.21.15.6:0/196868124 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f2942ffd700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29440c47d0 0x7f2944150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f29437fe700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2944151ac0 0x7f29441492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f29427fc700 1 -- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29440c47d0 msgr2=0x7f2944150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f29427fc700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29440c47d0 0x7f2944150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f29427fc700 1 -- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2944151ac0 msgr2=0x7f29441492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f29427fc700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2944151ac0 0x7f29441492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f29427fc700 1 -- 172.21.15.6:0/196868124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2938009550 con 0x7f29440c67d0 2023-07-21T07:36:32.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f29437fe700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2944151ac0 0x7f29441492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:32.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.453+0000 7f29427fc700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29440c67d0 0x7f29440c0f20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f293400e810 tx=0x7f293400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:32.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.454+0000 7f292b7fe700 1 -- 172.21.15.6:0/196868124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934013610 con 0x7f29440c67d0 2023-07-21T07:36:32.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.454+0000 7f292b7fe700 1 -- 172.21.15.6:0/196868124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29340137b0 con 0x7f29440c67d0 2023-07-21T07:36:32.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.454+0000 7f2949491700 1 -- 172.21.15.6:0/196868124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29440c37e0 con 0x7f29440c67d0 2023-07-21T07:36:32.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.454+0000 7f292b7fe700 1 -- 172.21.15.6:0/196868124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934013b60 con 0x7f29440c67d0 2023-07-21T07:36:32.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.454+0000 7f2949491700 1 -- 172.21.15.6:0/196868124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29441511b0 con 0x7f29440c67d0 2023-07-21T07:36:32.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.455+0000 7f2949491700 1 -- 172.21.15.6:0/196868124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294404e470 con 0x7f29440c67d0 2023-07-21T07:36:32.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.455+0000 7f292b7fe700 1 -- 172.21.15.6:0/196868124 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2934013cc0 con 0x7f29440c67d0 2023-07-21T07:36:32.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.456+0000 7f292b7fe700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f293006ace0 0x7f293006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.456+0000 7f292b7fe700 1 -- 172.21.15.6:0/196868124 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2934089140 con 0x7f29440c67d0 2023-07-21T07:36:32.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.456+0000 7f2942ffd700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f293006ace0 0x7f293006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.457+0000 7f2942ffd700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f293006ace0 0x7f293006d1a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2938000c00 tx=0x7f2938008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:32.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.460+0000 7f292b7fe700 1 -- 172.21.15.6:0/196868124 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2934057c80 con 0x7f29440c67d0 2023-07-21T07:36:32.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.655+0000 7f2949491700 1 -- 172.21.15.6:0/196868124 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2944154a60 con 0x7f293006ace0 2023-07-21T07:36:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.664+0000 7f292b7fe700 1 -- 172.21.15.6:0/196868124 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305979 (secure 0 0 0) 0x7f293800bb40 con 0x7f293006ace0 2023-07-21T07:36:32.722 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:32.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.667+0000 7f2949491700 1 -- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f293006ace0 msgr2=0x7f293006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.667+0000 7f2949491700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f293006ace0 0x7f293006d1a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2938000c00 tx=0x7f2938008030 comp rx=0 tx=0).stop 2023-07-21T07:36:32.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.667+0000 7f2949491700 1 -- 172.21.15.6:0/196868124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29440c67d0 msgr2=0x7f29440c0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.667+0000 7f2949491700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29440c67d0 0x7f29440c0f20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f293400e810 tx=0x7f293400eb20 comp rx=0 tx=0).stop 2023-07-21T07:36:32.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.667+0000 7f2949491700 1 -- 172.21.15.6:0/196868124 shutdown_connections 2023-07-21T07:36:32.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.667+0000 7f2949491700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f293006ace0 0x7f293006d1a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.668+0000 7f2949491700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2944151ac0 0x7f29441492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.668+0000 7f2949491700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29440c47d0 0x7f2944150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.668+0000 7f2949491700 1 --2- 172.21.15.6:0/196868124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29440c67d0 0x7f29440c0f20 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.668+0000 7f2949491700 1 -- 172.21.15.6:0/196868124 >> 172.21.15.6:0/196868124 conn(0x7f29440717c0 msgr2=0x7f29440a98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:32.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.668+0000 7f2949491700 1 -- 172.21.15.6:0/196868124 shutdown_connections 2023-07-21T07:36:32.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.668+0000 7f2949491700 1 -- 172.21.15.6:0/196868124 wait complete. 2023-07-21T07:36:32.726 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:36:32.734 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-07-21T07:36:30.719812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222168,"kb_used_data":5988,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754752552,"statfs":{"total":773094113280,"available":772866613248,"internally_reserved":0,"allocated":6131712,"data_stored":3344716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.197693"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.533891+0000","last_change":"2023-07-21T07:36:27.533891+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.533891+0000","last_undegraded":"2023-07-21T07:36:27.533891+0000","last_fullsized":"2023-07-21T07:36:27.533891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.533820+0000","last_change":"2023-07-21T07:36:27.533820+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.533820+0000","last_undegraded":"2023-07-21T07:36:27.533820+0000","last_fullsized":"2023-07-21T07:36:27.533820+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530833+0000","last_change":"2023-07-21T07:36:27.530833+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530833+0000","last_undegraded":"2023-07-21T07:36:27.530833+0000","last_fullsized":"2023-07-21T07:36:27.530833+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537324+0000","last_change":"2023-07-21T07:36:27.537324+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537324+0000","last_undegraded":"2023-07-21T07:36:27.537324+0000","last_fullsized":"2023-07-21T07:36:27.537324+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.540734+0000","last_change":"2023-07-21T07:36:27.540734+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.540734+0000","last_undegraded":"2023-07-21T07:36:27.540734+0000","last_fullsized":"2023-07-21T07:36:27.540734+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537868+0000","last_change":"2023-07-21T07:36:27.537868+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537868+0000","last_undegraded":"2023-07-21T07:36:27.537868+0000","last_fullsized":"2023-07-21T07:36:27.537868+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539468+0000","last_change":"2023-07-21T07:36:27.539468+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539468+0000","last_undegraded":"2023-07-21T07:36:27.539468+0000","last_fullsized":"2023-07-21T07:36:27.539468+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.534948+0000","last_change":"2023-07-21T07:36:27.534948+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.534948+0000","last_undegraded":"2023-07-21T07:36:27.534948+0000","last_fullsized":"2023-07-21T07:36:27.534948+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530880+0000","last_change":"2023-07-21T07:36:27.530880+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530880+0000","last_undegraded":"2023-07-21T07:36:27.530880+0000","last_fullsized":"2023-07-21T07:36:27.530880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531351+0000","last_change":"2023-07-21T07:36:27.531351+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531351+0000","last_undegraded":"2023-07-21T07:36:27.531351+0000","last_fullsized":"2023-07-21T07:36:27.531351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536613+0000","last_change":"2023-07-21T07:36:27.536613+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536613+0000","last_undegraded":"2023-07-21T07:36:27.536613+0000","last_fullsized":"2023-07-21T07:36:27.536613+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536842+0000","last_change":"2023-07-21T07:36:27.536842+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536842+0000","last_undegraded":"2023-07-21T07:36:27.536842+0000","last_fullsized":"2023-07-21T07:36:27.536842+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.535086+0000","last_change":"2023-07-21T07:36:27.535086+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.535086+0000","last_undegraded":"2023-07-21T07:36:27.535086+0000","last_fullsized":"2023-07-21T07:36:27.535086+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530811+0000","last_change":"2023-07-21T07:36:27.530811+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530811+0000","last_undegraded":"2023-07-21T07:36:27.530811+0000","last_fullsized":"2023-07-21T07:36:27.530811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531253+0000","last_change":"2023-07-21T07:36:27.531253+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531253+0000","last_undegraded":"2023-07-21T07:36:27.531253+0000","last_fullsized":"2023-07-21T07:36:27.531253+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539895+0000","last_change":"2023-07-21T07:36:27.539895+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539895+0000","last_undegraded":"2023-07-21T07:36:27.539895+0000","last_fullsized":"2023-07-21T07:36:27.539895+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.533243+0000","last_change":"2023-07-21T07:36:27.533243+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.533243+0000","last_undegraded":"2023-07-21T07:36:27.533243+0000","last_fullsized":"2023-07-21T07:36:27.533243+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536970+0000","last_change":"2023-07-21T07:36:27.536970+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536970+0000","last_undegraded":"2023-07-21T07:36:27.536970+0000","last_fullsized":"2023-07-21T07:36:27.536970+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.540008+0000","last_change":"2023-07-21T07:36:27.540008+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.540008+0000","last_undegraded":"2023-07-21T07:36:27.540008+0000","last_fullsized":"2023-07-21T07:36:27.540008+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530276+0000","last_change":"2023-07-21T07:36:27.530276+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530276+0000","last_undegraded":"2023-07-21T07:36:27.530276+0000","last_fullsized":"2023-07-21T07:36:27.530276+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.535514+0000","last_change":"2023-07-21T07:36:27.535514+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.535514+0000","last_undegraded":"2023-07-21T07:36:27.535514+0000","last_fullsized":"2023-07-21T07:36:27.535514+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531165+0000","last_change":"2023-07-21T07:36:27.531165+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531165+0000","last_undegraded":"2023-07-21T07:36:27.531165+0000","last_fullsized":"2023-07-21T07:36:27.531165+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531582+0000","last_change":"2023-07-21T07:36:27.531582+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531582+0000","last_undegraded":"2023-07-21T07:36:27.531582+0000","last_fullsized":"2023-07-21T07:36:27.531582+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530906+0000","last_change":"2023-07-21T07:36:27.530906+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530906+0000","last_undegraded":"2023-07-21T07:36:27.530906+0000","last_fullsized":"2023-07-21T07:36:27.530906+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.543217+0000","last_change":"2023-07-21T07:36:27.543217+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.543217+0000","last_undegraded":"2023-07-21T07:36:27.543217+0000","last_fullsized":"2023-07-21T07:36:27.543217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537966+0000","last_change":"2023-07-21T07:36:27.537966+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537966+0000","last_undegraded":"2023-07-21T07:36:27.537966+0000","last_fullsized":"2023-07-21T07:36:27.537966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.535828+0000","last_change":"2023-07-21T07:36:27.535828+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.535828+0000","last_undegraded":"2023-07-21T07:36:27.535828+0000","last_fullsized":"2023-07-21T07:36:27.535828+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.534549+0000","last_change":"2023-07-21T07:36:27.534549+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.534549+0000","last_undegraded":"2023-07-21T07:36:27.534549+0000","last_fullsized":"2023-07-21T07:36:27.534549+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531198+0000","last_change":"2023-07-21T07:36:27.531198+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531198+0000","last_undegraded":"2023-07-21T07:36:27.531198+0000","last_fullsized":"2023-07-21T07:36:27.531198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.544479+0000","last_change":"2023-07-21T07:36:27.544479+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.544479+0000","last_undegraded":"2023-07-21T07:36:27.544479+0000","last_fullsized":"2023-07-21T07:36:27.544479+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536742+0000","last_change":"2023-07-21T07:36:27.536742+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536742+0000","last_undegraded":"2023-07-21T07:36:27.536742+0000","last_fullsized":"2023-07-21T07:36:27.536742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539842+0000","last_change":"2023-07-21T07:36:27.539842+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539842+0000","last_undegraded":"2023-07-21T07:36:27.539842+0000","last_fullsized":"2023-07-21T07:36:27.539842+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539068+0000","last_change":"2023-07-21T07:36:27.539068+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539068+0000","last_undegraded":"2023-07-21T07:36:27.539068+0000","last_fullsized":"2023-07-21T07:36:27.539068+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549798+0000","last_change":"2023-07-21T07:36:27.542913+0000","last_active":"2023-07-21T07:36:27.549798+0000","last_peered":"2023-07-21T07:36:27.549798+0000","last_clean":"2023-07-21T07:36:27.549798+0000","last_became_active":"2023-07-21T07:36:27.542352+0000","last_became_peered":"2023-07-21T07:36:27.542352+0000","last_unstale":"2023-07-21T07:36:27.549798+0000","last_undegraded":"2023-07-21T07:36:27.549798+0000","last_fullsized":"2023-07-21T07:36:27.549798+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:51:08.765704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.535331+0000","last_change":"2023-07-21T07:36:27.535331+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.535331+0000","last_undegraded":"2023-07-21T07:36:27.535331+0000","last_fullsized":"2023-07-21T07:36:27.535331+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549685+0000","last_change":"2023-07-21T07:36:27.544173+0000","last_active":"2023-07-21T07:36:27.549685+0000","last_peered":"2023-07-21T07:36:27.549685+0000","last_clean":"2023-07-21T07:36:27.549685+0000","last_became_active":"2023-07-21T07:36:27.543806+0000","last_became_peered":"2023-07-21T07:36:27.543806+0000","last_unstale":"2023-07-21T07:36:27.549685+0000","last_undegraded":"2023-07-21T07:36:27.549685+0000","last_fullsized":"2023-07-21T07:36:27.549685+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:29:12.899796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.538725+0000","last_change":"2023-07-21T07:36:27.538725+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.538725+0000","last_undegraded":"2023-07-21T07:36:27.538725+0000","last_fullsized":"2023-07-21T07:36:27.538725+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555018+0000","last_change":"2023-07-21T07:36:27.548717+0000","last_active":"2023-07-21T07:36:27.555018+0000","last_peered":"2023-07-21T07:36:27.555018+0000","last_clean":"2023-07-21T07:36:27.555018+0000","last_became_active":"2023-07-21T07:36:27.548229+0000","last_became_peered":"2023-07-21T07:36:27.548229+0000","last_unstale":"2023-07-21T07:36:27.555018+0000","last_undegraded":"2023-07-21T07:36:27.555018+0000","last_fullsized":"2023-07-21T07:36:27.555018+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:15.583978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.532491+0000","last_change":"2023-07-21T07:36:27.532491+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.532491+0000","last_undegraded":"2023-07-21T07:36:27.532491+0000","last_fullsized":"2023-07-21T07:36:27.532491+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555238+0000","last_change":"2023-07-21T07:36:27.550565+0000","last_active":"2023-07-21T07:36:27.555238+0000","last_peered":"2023-07-21T07:36:27.555238+0000","last_clean":"2023-07-21T07:36:27.555238+0000","last_became_active":"2023-07-21T07:36:27.550235+0000","last_became_peered":"2023-07-21T07:36:27.550235+0000","last_unstale":"2023-07-21T07:36:27.555238+0000","last_undegraded":"2023-07-21T07:36:27.555238+0000","last_fullsized":"2023-07-21T07:36:27.555238+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:19:40.401260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539389+0000","last_change":"2023-07-21T07:36:27.539389+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539389+0000","last_undegraded":"2023-07-21T07:36:27.539389+0000","last_fullsized":"2023-07-21T07:36:27.539389+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549091+0000","last_change":"2023-07-21T07:36:27.548030+0000","last_active":"2023-07-21T07:36:27.549091+0000","last_peered":"2023-07-21T07:36:27.549091+0000","last_clean":"2023-07-21T07:36:27.549091+0000","last_became_active":"2023-07-21T07:36:27.547734+0000","last_became_peered":"2023-07-21T07:36:27.547734+0000","last_unstale":"2023-07-21T07:36:27.549091+0000","last_undegraded":"2023-07-21T07:36:27.549091+0000","last_fullsized":"2023-07-21T07:36:27.549091+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:15:15.630428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.533295+0000","last_change":"2023-07-21T07:36:27.533295+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.533295+0000","last_undegraded":"2023-07-21T07:36:27.533295+0000","last_fullsized":"2023-07-21T07:36:27.533295+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.546146+0000","last_change":"2023-07-21T07:36:27.543128+0000","last_active":"2023-07-21T07:36:27.546146+0000","last_peered":"2023-07-21T07:36:27.546146+0000","last_clean":"2023-07-21T07:36:27.546146+0000","last_became_active":"2023-07-21T07:36:27.542777+0000","last_became_peered":"2023-07-21T07:36:27.542777+0000","last_unstale":"2023-07-21T07:36:27.546146+0000","last_undegraded":"2023-07-21T07:36:27.546146+0000","last_fullsized":"2023-07-21T07:36:27.546146+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:51:05.902828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539615+0000","last_change":"2023-07-21T07:36:27.539615+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539615+0000","last_undegraded":"2023-07-21T07:36:27.539615+0000","last_fullsized":"2023-07-21T07:36:27.539615+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.547854+0000","last_change":"2023-07-21T07:36:27.545649+0000","last_active":"2023-07-21T07:36:27.547854+0000","last_peered":"2023-07-21T07:36:27.547854+0000","last_clean":"2023-07-21T07:36:27.547854+0000","last_became_active":"2023-07-21T07:36:27.545358+0000","last_became_peered":"2023-07-21T07:36:27.545358+0000","last_unstale":"2023-07-21T07:36:27.547854+0000","last_undegraded":"2023-07-21T07:36:27.547854+0000","last_fullsized":"2023-07-21T07:36:27.547854+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:13:49.441576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530783+0000","last_change":"2023-07-21T07:36:27.530783+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530783+0000","last_undegraded":"2023-07-21T07:36:27.530783+0000","last_fullsized":"2023-07-21T07:36:27.530783+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.552571+0000","last_change":"2023-07-21T07:36:27.549188+0000","last_active":"2023-07-21T07:36:27.552571+0000","last_peered":"2023-07-21T07:36:27.552571+0000","last_clean":"2023-07-21T07:36:27.552571+0000","last_became_active":"2023-07-21T07:36:27.548866+0000","last_became_peered":"2023-07-21T07:36:27.548866+0000","last_unstale":"2023-07-21T07:36:27.552571+0000","last_undegraded":"2023-07-21T07:36:27.552571+0000","last_fullsized":"2023-07-21T07:36:27.552571+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:00:42.710186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.534085+0000","last_change":"2023-07-21T07:36:27.534085+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.534085+0000","last_undegraded":"2023-07-21T07:36:27.534085+0000","last_fullsized":"2023-07-21T07:36:27.534085+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548403+0000","last_change":"2023-07-21T07:36:27.541612+0000","last_active":"2023-07-21T07:36:27.548403+0000","last_peered":"2023-07-21T07:36:27.548403+0000","last_clean":"2023-07-21T07:36:27.548403+0000","last_became_active":"2023-07-21T07:36:27.541373+0000","last_became_peered":"2023-07-21T07:36:27.541373+0000","last_unstale":"2023-07-21T07:36:27.548403+0000","last_undegraded":"2023-07-21T07:36:27.548403+0000","last_fullsized":"2023-07-21T07:36:27.548403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:22:39.168554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531809+0000","last_change":"2023-07-21T07:36:27.531809+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531809+0000","last_undegraded":"2023-07-21T07:36:27.531809+0000","last_fullsized":"2023-07-21T07:36:27.531809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548525+0000","last_change":"2023-07-21T07:36:27.547744+0000","last_active":"2023-07-21T07:36:27.548525+0000","last_peered":"2023-07-21T07:36:27.548525+0000","last_clean":"2023-07-21T07:36:27.548525+0000","last_became_active":"2023-07-21T07:36:27.547463+0000","last_became_peered":"2023-07-21T07:36:27.547463+0000","last_unstale":"2023-07-21T07:36:27.548525+0000","last_undegraded":"2023-07-21T07:36:27.548525+0000","last_fullsized":"2023-07-21T07:36:27.548525+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:11:51.333518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.538196+0000","last_change":"2023-07-21T07:36:27.538196+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.538196+0000","last_undegraded":"2023-07-21T07:36:27.538196+0000","last_fullsized":"2023-07-21T07:36:27.538196+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548813+0000","last_change":"2023-07-21T07:36:27.542236+0000","last_active":"2023-07-21T07:36:27.548813+0000","last_peered":"2023-07-21T07:36:27.548813+0000","last_clean":"2023-07-21T07:36:27.548813+0000","last_became_active":"2023-07-21T07:36:27.541799+0000","last_became_peered":"2023-07-21T07:36:27.541799+0000","last_unstale":"2023-07-21T07:36:27.548813+0000","last_undegraded":"2023-07-21T07:36:27.548813+0000","last_fullsized":"2023-07-21T07:36:27.548813+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:47:52.464521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.535258+0000","last_change":"2023-07-21T07:36:27.535258+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.535258+0000","last_undegraded":"2023-07-21T07:36:27.535258+0000","last_fullsized":"2023-07-21T07:36:27.535258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549879+0000","last_change":"2023-07-21T07:36:27.546185+0000","last_active":"2023-07-21T07:36:27.549879+0000","last_peered":"2023-07-21T07:36:27.549879+0000","last_clean":"2023-07-21T07:36:27.549879+0000","last_became_active":"2023-07-21T07:36:27.545925+0000","last_became_peered":"2023-07-21T07:36:27.545925+0000","last_unstale":"2023-07-21T07:36:27.549879+0000","last_undegraded":"2023-07-21T07:36:27.549879+0000","last_fullsized":"2023-07-21T07:36:27.549879+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:58:52.351486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.534974+0000","last_change":"2023-07-21T07:36:27.534974+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.534974+0000","last_undegraded":"2023-07-21T07:36:27.534974+0000","last_fullsized":"2023-07-21T07:36:27.534974+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548933+0000","last_change":"2023-07-21T07:36:27.544775+0000","last_active":"2023-07-21T07:36:27.548933+0000","last_peered":"2023-07-21T07:36:27.548933+0000","last_clean":"2023-07-21T07:36:27.548933+0000","last_became_active":"2023-07-21T07:36:27.544495+0000","last_became_peered":"2023-07-21T07:36:27.544495+0000","last_unstale":"2023-07-21T07:36:27.548933+0000","last_undegraded":"2023-07-21T07:36:27.548933+0000","last_fullsized":"2023-07-21T07:36:27.548933+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:33.978793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536456+0000","last_change":"2023-07-21T07:36:27.536456+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536456+0000","last_undegraded":"2023-07-21T07:36:27.536456+0000","last_fullsized":"2023-07-21T07:36:27.536456+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555032+0000","last_change":"2023-07-21T07:36:27.550743+0000","last_active":"2023-07-21T07:36:27.555032+0000","last_peered":"2023-07-21T07:36:27.555032+0000","last_clean":"2023-07-21T07:36:27.555032+0000","last_became_active":"2023-07-21T07:36:27.550521+0000","last_became_peered":"2023-07-21T07:36:27.550521+0000","last_unstale":"2023-07-21T07:36:27.555032+0000","last_undegraded":"2023-07-21T07:36:27.555032+0000","last_fullsized":"2023-07-21T07:36:27.555032+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:52:38.333969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539163+0000","last_change":"2023-07-21T07:36:27.539163+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539163+0000","last_undegraded":"2023-07-21T07:36:27.539163+0000","last_fullsized":"2023-07-21T07:36:27.539163+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548621+0000","last_change":"2023-07-21T07:36:27.542687+0000","last_active":"2023-07-21T07:36:27.548621+0000","last_peered":"2023-07-21T07:36:27.548621+0000","last_clean":"2023-07-21T07:36:27.548621+0000","last_became_active":"2023-07-21T07:36:27.542483+0000","last_became_peered":"2023-07-21T07:36:27.542483+0000","last_unstale":"2023-07-21T07:36:27.548621+0000","last_undegraded":"2023-07-21T07:36:27.548621+0000","last_fullsized":"2023-07-21T07:36:27.548621+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:19:58.197391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.532623+0000","last_change":"2023-07-21T07:36:27.532623+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.532623+0000","last_undegraded":"2023-07-21T07:36:27.532623+0000","last_fullsized":"2023-07-21T07:36:27.532623+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.552233+0000","last_change":"2023-07-21T07:36:27.549363+0000","last_active":"2023-07-21T07:36:27.552233+0000","last_peered":"2023-07-21T07:36:27.552233+0000","last_clean":"2023-07-21T07:36:27.552233+0000","last_became_active":"2023-07-21T07:36:27.548945+0000","last_became_peered":"2023-07-21T07:36:27.548945+0000","last_unstale":"2023-07-21T07:36:27.552233+0000","last_undegraded":"2023-07-21T07:36:27.552233+0000","last_fullsized":"2023-07-21T07:36:27.552233+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:33:13.381515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.538385+0000","last_change":"2023-07-21T07:36:27.538385+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.538385+0000","last_undegraded":"2023-07-21T07:36:27.538385+0000","last_fullsized":"2023-07-21T07:36:27.538385+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.554950+0000","last_change":"2023-07-21T07:36:27.550087+0000","last_active":"2023-07-21T07:36:27.554950+0000","last_peered":"2023-07-21T07:36:27.554950+0000","last_clean":"2023-07-21T07:36:27.554950+0000","last_became_active":"2023-07-21T07:36:27.549834+0000","last_became_peered":"2023-07-21T07:36:27.549834+0000","last_unstale":"2023-07-21T07:36:27.554950+0000","last_undegraded":"2023-07-21T07:36:27.554950+0000","last_fullsized":"2023-07-21T07:36:27.554950+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:10:20.902536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539428+0000","last_change":"2023-07-21T07:36:27.539428+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539428+0000","last_undegraded":"2023-07-21T07:36:27.539428+0000","last_fullsized":"2023-07-21T07:36:27.539428+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548223+0000","last_change":"2023-07-21T07:36:27.545216+0000","last_active":"2023-07-21T07:36:27.548223+0000","last_peered":"2023-07-21T07:36:27.548223+0000","last_clean":"2023-07-21T07:36:27.548223+0000","last_became_active":"2023-07-21T07:36:27.544952+0000","last_became_peered":"2023-07-21T07:36:27.544952+0000","last_unstale":"2023-07-21T07:36:27.548223+0000","last_undegraded":"2023-07-21T07:36:27.548223+0000","last_fullsized":"2023-07-21T07:36:27.548223+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:34:33.116437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537605+0000","last_change":"2023-07-21T07:36:27.537605+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537605+0000","last_undegraded":"2023-07-21T07:36:27.537605+0000","last_fullsized":"2023-07-21T07:36:27.537605+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555037+0000","last_change":"2023-07-21T07:36:27.548955+0000","last_active":"2023-07-21T07:36:27.555037+0000","last_peered":"2023-07-21T07:36:27.555037+0000","last_clean":"2023-07-21T07:36:27.555037+0000","last_became_active":"2023-07-21T07:36:27.548615+0000","last_became_peered":"2023-07-21T07:36:27.548615+0000","last_unstale":"2023-07-21T07:36:27.555037+0000","last_undegraded":"2023-07-21T07:36:27.555037+0000","last_fullsized":"2023-07-21T07:36:27.555037+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:33:11.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.538647+0000","last_change":"2023-07-21T07:36:27.538647+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.538647+0000","last_undegraded":"2023-07-21T07:36:27.538647+0000","last_fullsized":"2023-07-21T07:36:27.538647+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549862+0000","last_change":"2023-07-21T07:36:27.546128+0000","last_active":"2023-07-21T07:36:27.549862+0000","last_peered":"2023-07-21T07:36:27.549862+0000","last_clean":"2023-07-21T07:36:27.549862+0000","last_became_active":"2023-07-21T07:36:27.545829+0000","last_became_peered":"2023-07-21T07:36:27.545829+0000","last_unstale":"2023-07-21T07:36:27.549862+0000","last_undegraded":"2023-07-21T07:36:27.549862+0000","last_fullsized":"2023-07-21T07:36:27.549862+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:19:58.197391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.538662+0000","last_change":"2023-07-21T07:36:27.538662+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.538662+0000","last_undegraded":"2023-07-21T07:36:27.538662+0000","last_fullsized":"2023-07-21T07:36:27.538662+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548821+0000","last_change":"2023-07-21T07:36:27.542890+0000","last_active":"2023-07-21T07:36:27.548821+0000","last_peered":"2023-07-21T07:36:27.548821+0000","last_clean":"2023-07-21T07:36:27.548821+0000","last_became_active":"2023-07-21T07:36:27.542614+0000","last_became_peered":"2023-07-21T07:36:27.542614+0000","last_unstale":"2023-07-21T07:36:27.548821+0000","last_undegraded":"2023-07-21T07:36:27.548821+0000","last_fullsized":"2023-07-21T07:36:27.548821+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:10:25.051264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.535357+0000","last_change":"2023-07-21T07:36:27.535357+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.535357+0000","last_undegraded":"2023-07-21T07:36:27.535357+0000","last_fullsized":"2023-07-21T07:36:27.535357+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.538565+0000","last_change":"2023-07-21T07:36:27.535134+0000","last_active":"2023-07-21T07:36:27.538565+0000","last_peered":"2023-07-21T07:36:27.538565+0000","last_clean":"2023-07-21T07:36:27.538565+0000","last_became_active":"2023-07-21T07:36:27.534830+0000","last_became_peered":"2023-07-21T07:36:27.534830+0000","last_unstale":"2023-07-21T07:36:27.538565+0000","last_undegraded":"2023-07-21T07:36:27.538565+0000","last_fullsized":"2023-07-21T07:36:27.538565+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:37:06.214318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.532645+0000","last_change":"2023-07-21T07:36:27.532645+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.532645+0000","last_undegraded":"2023-07-21T07:36:27.532645+0000","last_fullsized":"2023-07-21T07:36:27.532645+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.547832+0000","last_change":"2023-07-21T07:36:27.545372+0000","last_active":"2023-07-21T07:36:27.547832+0000","last_peered":"2023-07-21T07:36:27.547832+0000","last_clean":"2023-07-21T07:36:27.547832+0000","last_became_active":"2023-07-21T07:36:27.544933+0000","last_became_peered":"2023-07-21T07:36:27.544933+0000","last_unstale":"2023-07-21T07:36:27.547832+0000","last_undegraded":"2023-07-21T07:36:27.547832+0000","last_fullsized":"2023-07-21T07:36:27.547832+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:59:32.727551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539802+0000","last_change":"2023-07-21T07:36:27.539802+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539802+0000","last_undegraded":"2023-07-21T07:36:27.539802+0000","last_fullsized":"2023-07-21T07:36:27.539802+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549892+0000","last_change":"2023-07-21T07:36:27.542037+0000","last_active":"2023-07-21T07:36:27.549892+0000","last_peered":"2023-07-21T07:36:27.549892+0000","last_clean":"2023-07-21T07:36:27.549892+0000","last_became_active":"2023-07-21T07:36:27.541783+0000","last_became_peered":"2023-07-21T07:36:27.541783+0000","last_unstale":"2023-07-21T07:36:27.549892+0000","last_undegraded":"2023-07-21T07:36:27.549892+0000","last_fullsized":"2023-07-21T07:36:27.549892+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:20:03.237274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.538223+0000","last_change":"2023-07-21T07:36:27.538223+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.538223+0000","last_undegraded":"2023-07-21T07:36:27.538223+0000","last_fullsized":"2023-07-21T07:36:27.538223+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549850+0000","last_change":"2023-07-21T07:36:27.548492+0000","last_active":"2023-07-21T07:36:27.549850+0000","last_peered":"2023-07-21T07:36:27.549850+0000","last_clean":"2023-07-21T07:36:27.549850+0000","last_became_active":"2023-07-21T07:36:27.548083+0000","last_became_peered":"2023-07-21T07:36:27.548083+0000","last_unstale":"2023-07-21T07:36:27.549850+0000","last_undegraded":"2023-07-21T07:36:27.549850+0000","last_fullsized":"2023-07-21T07:36:27.549850+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:24:33.846082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.544096+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:36:27.544096+0000","last_peered":"2023-07-21T07:36:27.544096+0000","last_clean":"2023-07-21T07:36:27.544096+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:36:27.544096+0000","last_undegraded":"2023-07-21T07:36:27.544096+0000","last_fullsized":"2023-07-21T07:36:27.544096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:00:14.803571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536445+0000","last_change":"2023-07-21T07:36:27.536445+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536445+0000","last_undegraded":"2023-07-21T07:36:27.536445+0000","last_fullsized":"2023-07-21T07:36:27.536445+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548784+0000","last_change":"2023-07-21T07:36:27.542066+0000","last_active":"2023-07-21T07:36:27.548784+0000","last_peered":"2023-07-21T07:36:27.548784+0000","last_clean":"2023-07-21T07:36:27.548784+0000","last_became_active":"2023-07-21T07:36:27.541789+0000","last_became_peered":"2023-07-21T07:36:27.541789+0000","last_unstale":"2023-07-21T07:36:27.548784+0000","last_undegraded":"2023-07-21T07:36:27.548784+0000","last_fullsized":"2023-07-21T07:36:27.548784+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:14:50.100812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":75,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.529783+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:36:27.529783+0000","last_peered":"2023-07-21T07:36:27.529783+0000","last_clean":"2023-07-21T07:36:27.529783+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:36:27.529783+0000","last_undegraded":"2023-07-21T07:36:27.529783+0000","last_fullsized":"2023-07-21T07:36:27.529783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:29:58.189191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539602+0000","last_change":"2023-07-21T07:36:27.539602+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539602+0000","last_undegraded":"2023-07-21T07:36:27.539602+0000","last_fullsized":"2023-07-21T07:36:27.539602+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549594+0000","last_change":"2023-07-21T07:36:27.547064+0000","last_active":"2023-07-21T07:36:27.549594+0000","last_peered":"2023-07-21T07:36:27.549594+0000","last_clean":"2023-07-21T07:36:27.549594+0000","last_became_active":"2023-07-21T07:36:27.546817+0000","last_became_peered":"2023-07-21T07:36:27.546817+0000","last_unstale":"2023-07-21T07:36:27.549594+0000","last_undegraded":"2023-07-21T07:36:27.549594+0000","last_fullsized":"2023-07-21T07:36:27.549594+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:42.034968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.533936+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:36:27.533936+0000","last_peered":"2023-07-21T07:36:27.533936+0000","last_clean":"2023-07-21T07:36:27.533936+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:36:27.533936+0000","last_undegraded":"2023-07-21T07:36:27.533936+0000","last_fullsized":"2023-07-21T07:36:27.533936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:41:59.304488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539343+0000","last_change":"2023-07-21T07:36:27.539343+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539343+0000","last_undegraded":"2023-07-21T07:36:27.539343+0000","last_fullsized":"2023-07-21T07:36:27.539343+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.554956+0000","last_change":"2023-07-21T07:36:27.546993+0000","last_active":"2023-07-21T07:36:27.554956+0000","last_peered":"2023-07-21T07:36:27.554956+0000","last_clean":"2023-07-21T07:36:27.554956+0000","last_became_active":"2023-07-21T07:36:27.546675+0000","last_became_peered":"2023-07-21T07:36:27.546675+0000","last_unstale":"2023-07-21T07:36:27.554956+0000","last_undegraded":"2023-07-21T07:36:27.554956+0000","last_fullsized":"2023-07-21T07:36:27.554956+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:02:43.499920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.533181+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:36:27.533181+0000","last_peered":"2023-07-21T07:36:27.533181+0000","last_clean":"2023-07-21T07:36:27.533181+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:36:27.533181+0000","last_undegraded":"2023-07-21T07:36:27.533181+0000","last_fullsized":"2023-07-21T07:36:27.533181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:09:38.933989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.538911+0000","last_change":"2023-07-21T07:36:27.538911+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.538911+0000","last_undegraded":"2023-07-21T07:36:27.538911+0000","last_fullsized":"2023-07-21T07:36:27.538911+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.547633+0000","last_change":"2023-07-21T07:36:27.545082+0000","last_active":"2023-07-21T07:36:27.547633+0000","last_peered":"2023-07-21T07:36:27.547633+0000","last_clean":"2023-07-21T07:36:27.547633+0000","last_became_active":"2023-07-21T07:36:27.544787+0000","last_became_peered":"2023-07-21T07:36:27.544787+0000","last_unstale":"2023-07-21T07:36:27.547633+0000","last_undegraded":"2023-07-21T07:36:27.547633+0000","last_fullsized":"2023-07-21T07:36:27.547633+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:53:21.078423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.533272+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:36:27.533272+0000","last_peered":"2023-07-21T07:36:27.533272+0000","last_clean":"2023-07-21T07:36:27.533272+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:36:27.533272+0000","last_undegraded":"2023-07-21T07:36:27.533272+0000","last_fullsized":"2023-07-21T07:36:27.533272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:45:07.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.545340+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:36:27.545340+0000","last_peered":"2023-07-21T07:36:27.545340+0000","last_clean":"2023-07-21T07:36:27.545340+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:36:27.545340+0000","last_undegraded":"2023-07-21T07:36:27.545340+0000","last_fullsized":"2023-07-21T07:36:27.545340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:45:26.816257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536049+0000","last_change":"2023-07-21T07:36:27.536049+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536049+0000","last_undegraded":"2023-07-21T07:36:27.536049+0000","last_fullsized":"2023-07-21T07:36:27.536049+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555010+0000","last_change":"2023-07-21T07:36:27.550572+0000","last_active":"2023-07-21T07:36:27.555010+0000","last_peered":"2023-07-21T07:36:27.555010+0000","last_clean":"2023-07-21T07:36:27.555010+0000","last_became_active":"2023-07-21T07:36:27.550195+0000","last_became_peered":"2023-07-21T07:36:27.550195+0000","last_unstale":"2023-07-21T07:36:27.555010+0000","last_undegraded":"2023-07-21T07:36:27.555010+0000","last_fullsized":"2023-07-21T07:36:27.555010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:38:40.211173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.540944+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:36:27.540944+0000","last_peered":"2023-07-21T07:36:27.540944+0000","last_clean":"2023-07-21T07:36:27.540944+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:36:27.540944+0000","last_undegraded":"2023-07-21T07:36:27.540944+0000","last_fullsized":"2023-07-21T07:36:27.540944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:41:14.693331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537922+0000","last_change":"2023-07-21T07:36:27.537922+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537922+0000","last_undegraded":"2023-07-21T07:36:27.537922+0000","last_fullsized":"2023-07-21T07:36:27.537922+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549693+0000","last_change":"2023-07-21T07:36:27.544373+0000","last_active":"2023-07-21T07:36:27.549693+0000","last_peered":"2023-07-21T07:36:27.549693+0000","last_clean":"2023-07-21T07:36:27.549693+0000","last_became_active":"2023-07-21T07:36:27.544074+0000","last_became_peered":"2023-07-21T07:36:27.544074+0000","last_unstale":"2023-07-21T07:36:27.549693+0000","last_undegraded":"2023-07-21T07:36:27.549693+0000","last_fullsized":"2023-07-21T07:36:27.549693+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:32:26.034517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.545016+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:36:27.545016+0000","last_peered":"2023-07-21T07:36:27.545016+0000","last_clean":"2023-07-21T07:36:27.545016+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:36:27.545016+0000","last_undegraded":"2023-07-21T07:36:27.545016+0000","last_fullsized":"2023-07-21T07:36:27.545016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:49:35.393074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530834+0000","last_change":"2023-07-21T07:36:27.530834+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530834+0000","last_undegraded":"2023-07-21T07:36:27.530834+0000","last_fullsized":"2023-07-21T07:36:27.530834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.554983+0000","last_change":"2023-07-21T07:36:27.550570+0000","last_active":"2023-07-21T07:36:27.554983+0000","last_peered":"2023-07-21T07:36:27.554983+0000","last_clean":"2023-07-21T07:36:27.554983+0000","last_became_active":"2023-07-21T07:36:27.550296+0000","last_became_peered":"2023-07-21T07:36:27.550296+0000","last_unstale":"2023-07-21T07:36:27.554983+0000","last_undegraded":"2023-07-21T07:36:27.554983+0000","last_fullsized":"2023-07-21T07:36:27.554983+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:26:29.512185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":75,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.532046+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:36:27.532046+0000","last_peered":"2023-07-21T07:36:27.532046+0000","last_clean":"2023-07-21T07:36:27.532046+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:36:27.532046+0000","last_undegraded":"2023-07-21T07:36:27.532046+0000","last_fullsized":"2023-07-21T07:36:27.532046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:09:38.933989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":863348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.504}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.624}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.59499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":266360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.4990000000000006,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.4039999999999999,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.71099999999999997}]},{"osd":7,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":266360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.26700000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.31}]},{"osd":3,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.753},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.72599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":863348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.376}]},{"osd":3,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.35299999999999998}]},{"osd":4,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.751}]},{"osd":5,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":272980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.26900000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.33200000000000002}]},{"osd":3,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.627},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Jul 21 07:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.70599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":272980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.52300000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.505},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.755},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.80000000000000004}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.83799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":272980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":10.18,"5min":10.18,"15min":10.18},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":10.207000000000001,"5min":10.207000000000001,"15min":10.207000000000001},"last":0.68500000000000005}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.433},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.79600000000000004}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.77500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":266360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.499},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.625},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:36:32.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:36:32.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.844+0000 7f2c1e9eb700 1 Processor -- start 2023-07-21T07:36:32.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.845+0000 7f2c1e9eb700 1 -- start start 2023-07-21T07:36:32.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.845+0000 7f2c1e9eb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2c1806f620 0x7f2c181523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.845+0000 7f2c1e9eb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c181528f0 con 0x7f2c1814f9a0 2023-07-21T07:36:32.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.845+0000 7f2c1e9eb700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c180c2a10 con 0x7f2c1814fd80 2023-07-21T07:36:32.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.845+0000 7f2c1e9eb700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c18156950 con 0x7f2c1806f620 2023-07-21T07:36:32.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.845+0000 7f2c17fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2c1814f9a0 0x7f2c18156240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44048/0 (socket says 172.21.15.6:44048) 2023-07-21T07:36:32.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.845+0000 7f2c17fff700 1 -- 172.21.15.6:0/2930978896 learned_addr learned my addr 172.21.15.6:0/2930978896 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:32.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c177fe700 1 --2- 172.21.15.6:0/2930978896 >> v2:172.21.15.86:3300/0 conn(0x7f2c1806f620 0x7f2c181523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025902821 0 0) 0x7f2c181528f0 con 0x7f2c1814f9a0 2023-07-21T07:36:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c040035b0 con 0x7f2c1814f9a0 2023-07-21T07:36:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843171776 0 0) 0x7f2c10001490 con 0x7f2c1814fd80 2023-07-21T07:36:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c181528f0 con 0x7f2c1814fd80 2023-07-21T07:36:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3718149702 0 0) 0x7f2c040035b0 con 0x7f2c1814f9a0 2023-07-21T07:36:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 >> v2:172.21.15.86:3300/0 conn(0x7f2c1806f620 msgr2=0x7f2c181523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 --2- 172.21.15.6:0/2930978896 >> v2:172.21.15.86:3300/0 conn(0x7f2c1806f620 0x7f2c181523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 >> v1:172.21.15.86:6789/0 conn(0x7f2c1814fd80 legacy=0x7f2c180c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c18155db0 con 0x7f2c1814f9a0 2023-07-21T07:36:32.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f2c000015f0 con 0x7f2c1814f9a0 2023-07-21T07:36:32.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 >> v1:172.21.15.6:6789/0 conn(0x7f2c1814f9a0 legacy=0x7f2c18156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 --2- 172.21.15.6:0/2930978896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c04003be0 0x7f2c04003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 --2- 172.21.15.6:0/2930978896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c04004850 0x7f2c04004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 --2- 172.21.15.6:0/2930978896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c04005260 0x7f2c0400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18156950 con 0x7f2c04005260 2023-07-21T07:36:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0400c190 con 0x7f2c04004850 2023-07-21T07:36:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0400c350 con 0x7f2c04003be0 2023-07-21T07:36:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c1cf88700 1 --2- 172.21.15.6:0/2930978896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c04005260 0x7f2c0400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c177fe700 1 --2- 172.21.15.6:0/2930978896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c04004850 0x7f2c04004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.846+0000 7f2c17fff700 1 --2- 172.21.15.6:0/2930978896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c04003be0 0x7f2c04003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c1cf88700 1 -- 172.21.15.6:0/2930978896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c04003be0 msgr2=0x7f2c04003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c1cf88700 1 --2- 172.21.15.6:0/2930978896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c04003be0 0x7f2c04003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c1cf88700 1 -- 172.21.15.6:0/2930978896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c04004850 msgr2=0x7f2c04004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c1cf88700 1 --2- 172.21.15.6:0/2930978896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c04004850 0x7f2c04004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c1cf88700 1 -- 172.21.15.6:0/2930978896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c040035b0 con 0x7f2c04005260 2023-07-21T07:36:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c1cf88700 1 -- 172.21.15.6:0/2930978896 reap_dead start 2023-07-21T07:36:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c1cf88700 1 --2- 172.21.15.6:0/2930978896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c04005260 0x7f2c0400ba10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000c320 tx=0x7f2c04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd7e8c2308638a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c100020c0 con 0x7f2c04005260 2023-07-21T07:36:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c10003a00 con 0x7f2c04005260 2023-07-21T07:36:32.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c16ffd700 1 -- 172.21.15.6:0/2930978896 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1000cea0 con 0x7f2c04005260 2023-07-21T07:36:32.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/2930978896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c04005260 msgr2=0x7f2c0400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c1e9eb700 1 --2- 172.21.15.6:0/2930978896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c04005260 0x7f2c0400ba10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000c320 tx=0x7f2c04005880 comp rx=0 tx=0).stop 2023-07-21T07:36:32.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/2930978896 shutdown_connections 2023-07-21T07:36:32.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c1e9eb700 1 --2- 172.21.15.6:0/2930978896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c04005260 0x7f2c0400ba10 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/2930978896 >> 172.21.15.6:0/2930978896 conn(0x7f2c1806a480 msgr2=0x7f2c1806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:32.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.847+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/2930978896 shutdown_connections 2023-07-21T07:36:32.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.848+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/2930978896 wait complete. 2023-07-21T07:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.849+0000 7f2c1e9eb700 1 Processor -- start 2023-07-21T07:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.849+0000 7f2c1e9eb700 1 -- start start 2023-07-21T07:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.850+0000 7f2c1e9eb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c04005260 0x7f2c180a7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.850+0000 7f2c1e9eb700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c181524f0 0x7f2c180ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.850+0000 7f2c1e9eb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c181515b0 0x7f2c1814a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.850+0000 7f2c1e9eb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c180a9260 con 0x7f2c04005260 2023-07-21T07:36:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.850+0000 7f2c1e9eb700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c181ebdc0 con 0x7f2c181524f0 2023-07-21T07:36:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.850+0000 7f2c1e9eb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18151120 con 0x7f2c181515b0 2023-07-21T07:36:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.850+0000 7f2c17fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c04005260 0x7f2c180a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.850+0000 7f2c17fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c04005260 0x7f2c180a7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36040/0 (socket says 172.21.15.6:36040) 2023-07-21T07:36:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.850+0000 7f2c17fff700 1 -- 172.21.15.6:0/1604737752 learned_addr learned my addr 172.21.15.6:0/1604737752 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.850+0000 7f2c1cf88700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c181515b0 0x7f2c1814a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.850+0000 7f2c177fe700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c181524f0 0x7f2c180ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.851+0000 7f2c17fff700 1 -- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c181515b0 msgr2=0x7f2c1814a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.851+0000 7f2c17fff700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c181515b0 0x7f2c1814a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.851+0000 7f2c17fff700 1 -- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c181524f0 msgr2=0x7f2c180ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.851+0000 7f2c17fff700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c181524f0 0x7f2c180ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.851+0000 7f2c17fff700 1 -- 172.21.15.6:0/1604737752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c181eb840 con 0x7f2c04005260 2023-07-21T07:36:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.851+0000 7f2c177fe700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c181524f0 0x7f2c180ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.851+0000 7f2c17fff700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c04005260 0x7f2c180a7280 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2c00004ee0 tx=0x7f2c00007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.851+0000 7f2c14ff9700 1 -- 172.21.15.6:0/1604737752 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c00012350 con 0x7f2c04005260 2023-07-21T07:36:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.851+0000 7f2c14ff9700 1 -- 172.21.15.6:0/1604737752 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c000124b0 con 0x7f2c04005260 2023-07-21T07:36:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.851+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/1604737752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c181ebae0 con 0x7f2c04005260 2023-07-21T07:36:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.851+0000 7f2c14ff9700 1 -- 172.21.15.6:0/1604737752 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c00012820 con 0x7f2c04005260 2023-07-21T07:36:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.851+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/1604737752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c180ad930 con 0x7f2c04005260 2023-07-21T07:36:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.852+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/1604737752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c18074500 con 0x7f2c04005260 2023-07-21T07:36:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.852+0000 7f2c14ff9700 1 -- 172.21.15.6:0/1604737752 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c00012980 con 0x7f2c04005260 2023-07-21T07:36:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.853+0000 7f2c14ff9700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2bf806ace0 0x7f2bf806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.853+0000 7f2c14ff9700 1 -- 172.21.15.6:0/1604737752 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c00088df0 con 0x7f2c04005260 2023-07-21T07:36:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.853+0000 7f2c177fe700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2bf806ace0 0x7f2bf806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.853+0000 7f2c177fe700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2bf806ace0 0x7f2bf806d1a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2c180acda0 tx=0x7f2c08008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:32.857+0000 7f2c14ff9700 1 -- 172.21.15.6:0/1604737752 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2c00053f30 con 0x7f2c04005260 2023-07-21T07:36:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.049+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/1604737752 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c1806eb60 con 0x7f2bf806ace0 2023-07-21T07:36:33.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.058+0000 7f2c14ff9700 1 -- 172.21.15.6:0/1604737752 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308904 (secure 0 0 0) 0x7f2c08009830 con 0x7f2bf806ace0 2023-07-21T07:36:33.115 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:33.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.061+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2bf806ace0 msgr2=0x7f2bf806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.061+0000 7f2c1e9eb700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2bf806ace0 0x7f2bf806d1a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2c180acda0 tx=0x7f2c08008040 comp rx=0 tx=0).stop 2023-07-21T07:36:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.061+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/1604737752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c04005260 msgr2=0x7f2c180a7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.061+0000 7f2c1e9eb700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c04005260 0x7f2c180a7280 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2c00004ee0 tx=0x7f2c00007340 comp rx=0 tx=0).stop 2023-07-21T07:36:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.061+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/1604737752 shutdown_connections 2023-07-21T07:36:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.061+0000 7f2c1e9eb700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f2bf806ace0 0x7f2bf806d1a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.061+0000 7f2c1e9eb700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c181515b0 0x7f2c1814a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.061+0000 7f2c1e9eb700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c04005260 0x7f2c180a7280 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.061+0000 7f2c1e9eb700 1 --2- 172.21.15.6:0/1604737752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c181524f0 0x7f2c180ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.061+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/1604737752 >> 172.21.15.6:0/1604737752 conn(0x7f2c1806a480 msgr2=0x7f2c1806a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.061+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/1604737752 shutdown_connections 2023-07-21T07:36:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.061+0000 7f2c1e9eb700 1 -- 172.21.15.6:0/1604737752 wait complete. 2023-07-21T07:36:33.118 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:36:33.127 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-07-21T07:36:32.720377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592514,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222340,"kb_used_data":6152,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754752380,"statfs":{"total":773094113280,"available":772866437120,"internally_reserved":0,"allocated":6299648,"data_stored":3417006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2146,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001395"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543939+0000","last_change":"2023-07-21T07:36:28.546426+0000","last_active":"2023-07-21T07:36:29.543939+0000","last_peered":"2023-07-21T07:36:29.543939+0000","last_clean":"2023-07-21T07:36:29.543939+0000","last_became_active":"2023-07-21T07:36:28.546106+0000","last_became_peered":"2023-07-21T07:36:28.546106+0000","last_unstale":"2023-07-21T07:36:29.543939+0000","last_undegraded":"2023-07-21T07:36:29.543939+0000","last_fullsized":"2023-07-21T07:36:29.543939+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:15:19.595560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543870+0000","last_change":"2023-07-21T07:36:28.553546+0000","last_active":"2023-07-21T07:36:29.543870+0000","last_peered":"2023-07-21T07:36:29.543870+0000","last_clean":"2023-07-21T07:36:29.543870+0000","last_became_active":"2023-07-21T07:36:28.553260+0000","last_became_peered":"2023-07-21T07:36:28.553260+0000","last_unstale":"2023-07-21T07:36:29.543870+0000","last_undegraded":"2023-07-21T07:36:29.543870+0000","last_fullsized":"2023-07-21T07:36:29.543870+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:43:50.621919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530833+0000","last_change":"2023-07-21T07:36:27.530833+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530833+0000","last_undegraded":"2023-07-21T07:36:27.530833+0000","last_fullsized":"2023-07-21T07:36:27.530833+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725959+0000","last_change":"2023-07-21T07:36:28.553233+0000","last_active":"2023-07-21T07:36:30.725959+0000","last_peered":"2023-07-21T07:36:30.725959+0000","last_clean":"2023-07-21T07:36:30.725959+0000","last_became_active":"2023-07-21T07:36:28.552984+0000","last_became_peered":"2023-07-21T07:36:28.552984+0000","last_unstale":"2023-07-21T07:36:30.725959+0000","last_undegraded":"2023-07-21T07:36:30.725959+0000","last_fullsized":"2023-07-21T07:36:30.725959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:23:03.303111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279802+0000","last_change":"2023-07-21T07:36:28.555196+0000","last_active":"2023-07-21T07:36:30.279802+0000","last_peered":"2023-07-21T07:36:30.279802+0000","last_clean":"2023-07-21T07:36:30.279802+0000","last_became_active":"2023-07-21T07:36:28.554805+0000","last_became_peered":"2023-07-21T07:36:28.554805+0000","last_unstale":"2023-07-21T07:36:30.279802+0000","last_undegraded":"2023-07-21T07:36:30.279802+0000","last_fullsized":"2023-07-21T07:36:30.279802+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:14:30.726435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537868+0000","last_change":"2023-07-21T07:36:27.537868+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537868+0000","last_undegraded":"2023-07-21T07:36:27.537868+0000","last_fullsized":"2023-07-21T07:36:27.537868+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725610+0000","last_change":"2023-07-21T07:36:28.557367+0000","last_active":"2023-07-21T07:36:30.725610+0000","last_peered":"2023-07-21T07:36:30.725610+0000","last_clean":"2023-07-21T07:36:30.725610+0000","last_became_active":"2023-07-21T07:36:28.557060+0000","last_became_peered":"2023-07-21T07:36:28.557060+0000","last_unstale":"2023-07-21T07:36:30.725610+0000","last_undegraded":"2023-07-21T07:36:30.725610+0000","last_fullsized":"2023-07-21T07:36:30.725610+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:11:41.810201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.534948+0000","last_change":"2023-07-21T07:36:27.534948+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.534948+0000","last_undegraded":"2023-07-21T07:36:27.534948+0000","last_fullsized":"2023-07-21T07:36:27.534948+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530880+0000","last_change":"2023-07-21T07:36:27.530880+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530880+0000","last_undegraded":"2023-07-21T07:36:27.530880+0000","last_fullsized":"2023-07-21T07:36:27.530880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531351+0000","last_change":"2023-07-21T07:36:27.531351+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531351+0000","last_undegraded":"2023-07-21T07:36:27.531351+0000","last_fullsized":"2023-07-21T07:36:27.531351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725998+0000","last_change":"2023-07-21T07:36:28.550836+0000","last_active":"2023-07-21T07:36:30.725998+0000","last_peered":"2023-07-21T07:36:30.725998+0000","last_clean":"2023-07-21T07:36:30.725998+0000","last_became_active":"2023-07-21T07:36:28.550559+0000","last_became_peered":"2023-07-21T07:36:28.550559+0000","last_unstale":"2023-07-21T07:36:30.725998+0000","last_undegraded":"2023-07-21T07:36:30.725998+0000","last_fullsized":"2023-07-21T07:36:30.725998+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:04:12.046194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536842+0000","last_change":"2023-07-21T07:36:27.536842+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536842+0000","last_undegraded":"2023-07-21T07:36:27.536842+0000","last_fullsized":"2023-07-21T07:36:27.536842+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.535086+0000","last_change":"2023-07-21T07:36:27.535086+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.535086+0000","last_undegraded":"2023-07-21T07:36:27.535086+0000","last_fullsized":"2023-07-21T07:36:27.535086+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530811+0000","last_change":"2023-07-21T07:36:27.530811+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530811+0000","last_undegraded":"2023-07-21T07:36:27.530811+0000","last_fullsized":"2023-07-21T07:36:27.530811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531253+0000","last_change":"2023-07-21T07:36:27.531253+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531253+0000","last_undegraded":"2023-07-21T07:36:27.531253+0000","last_fullsized":"2023-07-21T07:36:27.531253+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725979+0000","last_change":"2023-07-21T07:36:28.561905+0000","last_active":"2023-07-21T07:36:30.725979+0000","last_peered":"2023-07-21T07:36:30.725979+0000","last_clean":"2023-07-21T07:36:30.725979+0000","last_became_active":"2023-07-21T07:36:28.561351+0000","last_became_peered":"2023-07-21T07:36:28.561351+0000","last_unstale":"2023-07-21T07:36:30.725979+0000","last_undegraded":"2023-07-21T07:36:30.725979+0000","last_fullsized":"2023-07-21T07:36:30.725979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:29:49.803144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.544010+0000","last_change":"2023-07-21T07:36:28.550124+0000","last_active":"2023-07-21T07:36:29.544010+0000","last_peered":"2023-07-21T07:36:29.544010+0000","last_clean":"2023-07-21T07:36:29.544010+0000","last_became_active":"2023-07-21T07:36:28.549862+0000","last_became_peered":"2023-07-21T07:36:28.549862+0000","last_unstale":"2023-07-21T07:36:29.544010+0000","last_undegraded":"2023-07-21T07:36:29.544010+0000","last_fullsized":"2023-07-21T07:36:29.544010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:16.457168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726109+0000","last_change":"2023-07-21T07:36:28.552922+0000","last_active":"2023-07-21T07:36:30.726109+0000","last_peered":"2023-07-21T07:36:30.726109+0000","last_clean":"2023-07-21T07:36:30.726109+0000","last_became_active":"2023-07-21T07:36:28.552646+0000","last_became_peered":"2023-07-21T07:36:28.552646+0000","last_unstale":"2023-07-21T07:36:30.726109+0000","last_undegraded":"2023-07-21T07:36:30.726109+0000","last_fullsized":"2023-07-21T07:36:30.726109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:02:44.505392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279950+0000","last_change":"2023-07-21T07:36:28.554910+0000","last_active":"2023-07-21T07:36:30.279950+0000","last_peered":"2023-07-21T07:36:30.279950+0000","last_clean":"2023-07-21T07:36:30.279950+0000","last_became_active":"2023-07-21T07:36:28.554628+0000","last_became_peered":"2023-07-21T07:36:28.554628+0000","last_unstale":"2023-07-21T07:36:30.279950+0000","last_undegraded":"2023-07-21T07:36:30.279950+0000","last_fullsized":"2023-07-21T07:36:30.279950+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:24:34.043625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530276+0000","last_change":"2023-07-21T07:36:27.530276+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530276+0000","last_undegraded":"2023-07-21T07:36:27.530276+0000","last_fullsized":"2023-07-21T07:36:27.530276+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.535514+0000","last_change":"2023-07-21T07:36:27.535514+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.535514+0000","last_undegraded":"2023-07-21T07:36:27.535514+0000","last_fullsized":"2023-07-21T07:36:27.535514+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531165+0000","last_change":"2023-07-21T07:36:27.531165+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531165+0000","last_undegraded":"2023-07-21T07:36:27.531165+0000","last_fullsized":"2023-07-21T07:36:27.531165+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531582+0000","last_change":"2023-07-21T07:36:27.531582+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531582+0000","last_undegraded":"2023-07-21T07:36:27.531582+0000","last_fullsized":"2023-07-21T07:36:27.531582+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530906+0000","last_change":"2023-07-21T07:36:27.530906+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530906+0000","last_undegraded":"2023-07-21T07:36:27.530906+0000","last_fullsized":"2023-07-21T07:36:27.530906+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.543217+0000","last_change":"2023-07-21T07:36:27.543217+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.543217+0000","last_undegraded":"2023-07-21T07:36:27.543217+0000","last_fullsized":"2023-07-21T07:36:27.543217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537966+0000","last_change":"2023-07-21T07:36:27.537966+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537966+0000","last_undegraded":"2023-07-21T07:36:27.537966+0000","last_fullsized":"2023-07-21T07:36:27.537966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725998+0000","last_change":"2023-07-21T07:36:28.554107+0000","last_active":"2023-07-21T07:36:30.725998+0000","last_peered":"2023-07-21T07:36:30.725998+0000","last_clean":"2023-07-21T07:36:30.725998+0000","last_became_active":"2023-07-21T07:36:28.553824+0000","last_became_peered":"2023-07-21T07:36:28.553824+0000","last_unstale":"2023-07-21T07:36:30.725998+0000","last_undegraded":"2023-07-21T07:36:30.725998+0000","last_fullsized":"2023-07-21T07:36:30.725998+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:35:20.960610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543780+0000","last_change":"2023-07-21T07:36:28.544714+0000","last_active":"2023-07-21T07:36:29.543780+0000","last_peered":"2023-07-21T07:36:29.543780+0000","last_clean":"2023-07-21T07:36:29.543780+0000","last_became_active":"2023-07-21T07:36:28.544330+0000","last_became_peered":"2023-07-21T07:36:28.544330+0000","last_unstale":"2023-07-21T07:36:29.543780+0000","last_undegraded":"2023-07-21T07:36:29.543780+0000","last_fullsized":"2023-07-21T07:36:29.543780+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:36.869529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531198+0000","last_change":"2023-07-21T07:36:27.531198+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531198+0000","last_undegraded":"2023-07-21T07:36:27.531198+0000","last_fullsized":"2023-07-21T07:36:27.531198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.544479+0000","last_change":"2023-07-21T07:36:27.544479+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.544479+0000","last_undegraded":"2023-07-21T07:36:27.544479+0000","last_fullsized":"2023-07-21T07:36:27.544479+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725688+0000","last_change":"2023-07-21T07:36:28.553711+0000","last_active":"2023-07-21T07:36:30.725688+0000","last_peered":"2023-07-21T07:36:30.725688+0000","last_clean":"2023-07-21T07:36:30.725688+0000","last_became_active":"2023-07-21T07:36:28.553426+0000","last_became_peered":"2023-07-21T07:36:28.553426+0000","last_unstale":"2023-07-21T07:36:30.725688+0000","last_undegraded":"2023-07-21T07:36:30.725688+0000","last_fullsized":"2023-07-21T07:36:30.725688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:24:34.851555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539842+0000","last_change":"2023-07-21T07:36:27.539842+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539842+0000","last_undegraded":"2023-07-21T07:36:27.539842+0000","last_fullsized":"2023-07-21T07:36:27.539842+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280185+0000","last_change":"2023-07-21T07:36:28.554012+0000","last_active":"2023-07-21T07:36:30.280185+0000","last_peered":"2023-07-21T07:36:30.280185+0000","last_clean":"2023-07-21T07:36:30.280185+0000","last_became_active":"2023-07-21T07:36:28.553737+0000","last_became_peered":"2023-07-21T07:36:28.553737+0000","last_unstale":"2023-07-21T07:36:30.280185+0000","last_undegraded":"2023-07-21T07:36:30.280185+0000","last_fullsized":"2023-07-21T07:36:30.280185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:36:21.975321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"53'4","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.544028+0000","last_change":"2023-07-21T07:36:27.542913+0000","last_active":"2023-07-21T07:36:29.544028+0000","last_peered":"2023-07-21T07:36:29.544028+0000","last_clean":"2023-07-21T07:36:29.544028+0000","last_became_active":"2023-07-21T07:36:27.542352+0000","last_became_peered":"2023-07-21T07:36:27.542352+0000","last_unstale":"2023-07-21T07:36:29.544028+0000","last_undegraded":"2023-07-21T07:36:29.544028+0000","last_fullsized":"2023-07-21T07:36:29.544028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:58:50.271243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726159+0000","last_change":"2023-07-21T07:36:28.549909+0000","last_active":"2023-07-21T07:36:30.726159+0000","last_peered":"2023-07-21T07:36:30.726159+0000","last_clean":"2023-07-21T07:36:30.726159+0000","last_became_active":"2023-07-21T07:36:28.549643+0000","last_became_peered":"2023-07-21T07:36:28.549643+0000","last_unstale":"2023-07-21T07:36:30.726159+0000","last_undegraded":"2023-07-21T07:36:30.726159+0000","last_fullsized":"2023-07-21T07:36:30.726159+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:16.589451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549685+0000","last_change":"2023-07-21T07:36:27.544173+0000","last_active":"2023-07-21T07:36:27.549685+0000","last_peered":"2023-07-21T07:36:27.549685+0000","last_clean":"2023-07-21T07:36:27.549685+0000","last_became_active":"2023-07-21T07:36:27.543806+0000","last_became_peered":"2023-07-21T07:36:27.543806+0000","last_unstale":"2023-07-21T07:36:27.549685+0000","last_undegraded":"2023-07-21T07:36:27.549685+0000","last_fullsized":"2023-07-21T07:36:27.549685+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:29:12.899796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.538725+0000","last_change":"2023-07-21T07:36:27.538725+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.538725+0000","last_undegraded":"2023-07-21T07:36:27.538725+0000","last_fullsized":"2023-07-21T07:36:27.538725+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555018+0000","last_change":"2023-07-21T07:36:27.548717+0000","last_active":"2023-07-21T07:36:27.555018+0000","last_peered":"2023-07-21T07:36:27.555018+0000","last_clean":"2023-07-21T07:36:27.555018+0000","last_became_active":"2023-07-21T07:36:27.548229+0000","last_became_peered":"2023-07-21T07:36:27.548229+0000","last_unstale":"2023-07-21T07:36:27.555018+0000","last_undegraded":"2023-07-21T07:36:27.555018+0000","last_fullsized":"2023-07-21T07:36:27.555018+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:15.583978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.532491+0000","last_change":"2023-07-21T07:36:27.532491+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.532491+0000","last_undegraded":"2023-07-21T07:36:27.532491+0000","last_fullsized":"2023-07-21T07:36:27.532491+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555238+0000","last_change":"2023-07-21T07:36:27.550565+0000","last_active":"2023-07-21T07:36:27.555238+0000","last_peered":"2023-07-21T07:36:27.555238+0000","last_clean":"2023-07-21T07:36:27.555238+0000","last_became_active":"2023-07-21T07:36:27.550235+0000","last_became_peered":"2023-07-21T07:36:27.550235+0000","last_unstale":"2023-07-21T07:36:27.555238+0000","last_undegraded":"2023-07-21T07:36:27.555238+0000","last_fullsized":"2023-07-21T07:36:27.555238+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:19:40.401260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726118+0000","last_change":"2023-07-21T07:36:28.564622+0000","last_active":"2023-07-21T07:36:30.726118+0000","last_peered":"2023-07-21T07:36:30.726118+0000","last_clean":"2023-07-21T07:36:30.726118+0000","last_became_active":"2023-07-21T07:36:28.564322+0000","last_became_peered":"2023-07-21T07:36:28.564322+0000","last_unstale":"2023-07-21T07:36:30.726118+0000","last_undegraded":"2023-07-21T07:36:30.726118+0000","last_fullsized":"2023-07-21T07:36:30.726118+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:00:11.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549091+0000","last_change":"2023-07-21T07:36:27.548030+0000","last_active":"2023-07-21T07:36:27.549091+0000","last_peered":"2023-07-21T07:36:27.549091+0000","last_clean":"2023-07-21T07:36:27.549091+0000","last_became_active":"2023-07-21T07:36:27.547734+0000","last_became_peered":"2023-07-21T07:36:27.547734+0000","last_unstale":"2023-07-21T07:36:27.549091+0000","last_undegraded":"2023-07-21T07:36:27.549091+0000","last_fullsized":"2023-07-21T07:36:27.549091+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:15:15.630428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543364+0000","last_change":"2023-07-21T07:36:28.561529+0000","last_active":"2023-07-21T07:36:29.543364+0000","last_peered":"2023-07-21T07:36:29.543364+0000","last_clean":"2023-07-21T07:36:29.543364+0000","last_became_active":"2023-07-21T07:36:28.561238+0000","last_became_peered":"2023-07-21T07:36:28.561238+0000","last_unstale":"2023-07-21T07:36:29.543364+0000","last_undegraded":"2023-07-21T07:36:29.543364+0000","last_fullsized":"2023-07-21T07:36:29.543364+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:51:29.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.546146+0000","last_change":"2023-07-21T07:36:27.543128+0000","last_active":"2023-07-21T07:36:27.546146+0000","last_peered":"2023-07-21T07:36:27.546146+0000","last_clean":"2023-07-21T07:36:27.546146+0000","last_became_active":"2023-07-21T07:36:27.542777+0000","last_became_peered":"2023-07-21T07:36:27.542777+0000","last_unstale":"2023-07-21T07:36:27.546146+0000","last_undegraded":"2023-07-21T07:36:27.546146+0000","last_fullsized":"2023-07-21T07:36:27.546146+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:51:05.902828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279686+0000","last_change":"2023-07-21T07:36:28.552687+0000","last_active":"2023-07-21T07:36:30.279686+0000","last_peered":"2023-07-21T07:36:30.279686+0000","last_clean":"2023-07-21T07:36:30.279686+0000","last_became_active":"2023-07-21T07:36:28.552238+0000","last_became_peered":"2023-07-21T07:36:28.552238+0000","last_unstale":"2023-07-21T07:36:30.279686+0000","last_undegraded":"2023-07-21T07:36:30.279686+0000","last_fullsized":"2023-07-21T07:36:30.279686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:56.957478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.547854+0000","last_change":"2023-07-21T07:36:27.545649+0000","last_active":"2023-07-21T07:36:27.547854+0000","last_peered":"2023-07-21T07:36:27.547854+0000","last_clean":"2023-07-21T07:36:27.547854+0000","last_became_active":"2023-07-21T07:36:27.545358+0000","last_became_peered":"2023-07-21T07:36:27.545358+0000","last_unstale":"2023-07-21T07:36:27.547854+0000","last_undegraded":"2023-07-21T07:36:27.547854+0000","last_fullsized":"2023-07-21T07:36:27.547854+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:13:49.441576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530783+0000","last_change":"2023-07-21T07:36:27.530783+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530783+0000","last_undegraded":"2023-07-21T07:36:27.530783+0000","last_fullsized":"2023-07-21T07:36:27.530783+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279697+0000","last_change":"2023-07-21T07:36:27.549188+0000","last_active":"2023-07-21T07:36:30.279697+0000","last_peered":"2023-07-21T07:36:30.279697+0000","last_clean":"2023-07-21T07:36:30.279697+0000","last_became_active":"2023-07-21T07:36:27.548866+0000","last_became_peered":"2023-07-21T07:36:27.548866+0000","last_unstale":"2023-07-21T07:36:30.279697+0000","last_undegraded":"2023-07-21T07:36:30.279697+0000","last_fullsized":"2023-07-21T07:36:30.279697+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:28:04.208946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543643+0000","last_change":"2023-07-21T07:36:28.561022+0000","last_active":"2023-07-21T07:36:29.543643+0000","last_peered":"2023-07-21T07:36:29.543643+0000","last_clean":"2023-07-21T07:36:29.543643+0000","last_became_active":"2023-07-21T07:36:28.560541+0000","last_became_peered":"2023-07-21T07:36:28.560541+0000","last_unstale":"2023-07-21T07:36:29.543643+0000","last_undegraded":"2023-07-21T07:36:29.543643+0000","last_fullsized":"2023-07-21T07:36:29.543643+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:00:13.900861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548403+0000","last_change":"2023-07-21T07:36:27.541612+0000","last_active":"2023-07-21T07:36:27.548403+0000","last_peered":"2023-07-21T07:36:27.548403+0000","last_clean":"2023-07-21T07:36:27.548403+0000","last_became_active":"2023-07-21T07:36:27.541373+0000","last_became_peered":"2023-07-21T07:36:27.541373+0000","last_unstale":"2023-07-21T07:36:27.548403+0000","last_undegraded":"2023-07-21T07:36:27.548403+0000","last_fullsized":"2023-07-21T07:36:27.548403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:22:39.168554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531809+0000","last_change":"2023-07-21T07:36:27.531809+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531809+0000","last_undegraded":"2023-07-21T07:36:27.531809+0000","last_fullsized":"2023-07-21T07:36:27.531809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726257+0000","last_change":"2023-07-21T07:36:27.547744+0000","last_active":"2023-07-21T07:36:30.726257+0000","last_peered":"2023-07-21T07:36:30.726257+0000","last_clean":"2023-07-21T07:36:30.726257+0000","last_became_active":"2023-07-21T07:36:27.547463+0000","last_became_peered":"2023-07-21T07:36:27.547463+0000","last_unstale":"2023-07-21T07:36:30.726257+0000","last_undegraded":"2023-07-21T07:36:30.726257+0000","last_fullsized":"2023-07-21T07:36:30.726257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:33:11.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280048+0000","last_change":"2023-07-21T07:36:28.542046+0000","last_active":"2023-07-21T07:36:30.280048+0000","last_peered":"2023-07-21T07:36:30.280048+0000","last_clean":"2023-07-21T07:36:30.280048+0000","last_became_active":"2023-07-21T07:36:28.541690+0000","last_became_peered":"2023-07-21T07:36:28.541690+0000","last_unstale":"2023-07-21T07:36:30.280048+0000","last_undegraded":"2023-07-21T07:36:30.280048+0000","last_fullsized":"2023-07-21T07:36:30.280048+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:01:36.571829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548813+0000","last_change":"2023-07-21T07:36:27.542236+0000","last_active":"2023-07-21T07:36:27.548813+0000","last_peered":"2023-07-21T07:36:27.548813+0000","last_clean":"2023-07-21T07:36:27.548813+0000","last_became_active":"2023-07-21T07:36:27.541799+0000","last_became_peered":"2023-07-21T07:36:27.541799+0000","last_unstale":"2023-07-21T07:36:27.548813+0000","last_undegraded":"2023-07-21T07:36:27.548813+0000","last_fullsized":"2023-07-21T07:36:27.548813+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:47:52.464521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726160+0000","last_change":"2023-07-21T07:36:28.555407+0000","last_active":"2023-07-21T07:36:30.726160+0000","last_peered":"2023-07-21T07:36:30.726160+0000","last_clean":"2023-07-21T07:36:30.726160+0000","last_became_active":"2023-07-21T07:36:28.552229+0000","last_became_peered":"2023-07-21T07:36:28.552229+0000","last_unstale":"2023-07-21T07:36:30.726160+0000","last_undegraded":"2023-07-21T07:36:30.726160+0000","last_fullsized":"2023-07-21T07:36:30.726160+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:32:27.039990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"53'6","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543716+0000","last_change":"2023-07-21T07:36:27.546185+0000","last_active":"2023-07-21T07:36:29.543716+0000","last_peered":"2023-07-21T07:36:29.543716+0000","last_clean":"2023-07-21T07:36:29.543716+0000","last_became_active":"2023-07-21T07:36:27.545925+0000","last_became_peered":"2023-07-21T07:36:27.545925+0000","last_unstale":"2023-07-21T07:36:29.543716+0000","last_undegraded":"2023-07-21T07:36:29.543716+0000","last_fullsized":"2023-07-21T07:36:29.543716+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:19:54.238779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725630+0000","last_change":"2023-07-21T07:36:28.549175+0000","last_active":"2023-07-21T07:36:30.725630+0000","last_peered":"2023-07-21T07:36:30.725630+0000","last_clean":"2023-07-21T07:36:30.725630+0000","last_became_active":"2023-07-21T07:36:28.548904+0000","last_became_peered":"2023-07-21T07:36:28.548904+0000","last_unstale":"2023-07-21T07:36:30.725630+0000","last_undegraded":"2023-07-21T07:36:30.725630+0000","last_fullsized":"2023-07-21T07:36:30.725630+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:56:50.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548933+0000","last_change":"2023-07-21T07:36:27.544775+0000","last_active":"2023-07-21T07:36:27.548933+0000","last_peered":"2023-07-21T07:36:27.548933+0000","last_clean":"2023-07-21T07:36:27.548933+0000","last_became_active":"2023-07-21T07:36:27.544495+0000","last_became_peered":"2023-07-21T07:36:27.544495+0000","last_unstale":"2023-07-21T07:36:27.548933+0000","last_undegraded":"2023-07-21T07:36:27.548933+0000","last_fullsized":"2023-07-21T07:36:27.548933+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:33.978793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536456+0000","last_change":"2023-07-21T07:36:27.536456+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536456+0000","last_undegraded":"2023-07-21T07:36:27.536456+0000","last_fullsized":"2023-07-21T07:36:27.536456+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555032+0000","last_change":"2023-07-21T07:36:27.550743+0000","last_active":"2023-07-21T07:36:27.555032+0000","last_peered":"2023-07-21T07:36:27.555032+0000","last_clean":"2023-07-21T07:36:27.555032+0000","last_became_active":"2023-07-21T07:36:27.550521+0000","last_became_peered":"2023-07-21T07:36:27.550521+0000","last_unstale":"2023-07-21T07:36:27.555032+0000","last_undegraded":"2023-07-21T07:36:27.555032+0000","last_fullsized":"2023-07-21T07:36:27.555032+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:52:38.333969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279756+0000","last_change":"2023-07-21T07:36:28.555482+0000","last_active":"2023-07-21T07:36:30.279756+0000","last_peered":"2023-07-21T07:36:30.279756+0000","last_clean":"2023-07-21T07:36:30.279756+0000","last_became_active":"2023-07-21T07:36:28.554468+0000","last_became_peered":"2023-07-21T07:36:28.554468+0000","last_unstale":"2023-07-21T07:36:30.279756+0000","last_undegraded":"2023-07-21T07:36:30.279756+0000","last_fullsized":"2023-07-21T07:36:30.279756+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:02:56.001893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548621+0000","last_change":"2023-07-21T07:36:27.542687+0000","last_active":"2023-07-21T07:36:27.548621+0000","last_peered":"2023-07-21T07:36:27.548621+0000","last_clean":"2023-07-21T07:36:27.548621+0000","last_became_active":"2023-07-21T07:36:27.542483+0000","last_became_peered":"2023-07-21T07:36:27.542483+0000","last_unstale":"2023-07-21T07:36:27.548621+0000","last_undegraded":"2023-07-21T07:36:27.548621+0000","last_fullsized":"2023-07-21T07:36:27.548621+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:19:58.197391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543556+0000","last_change":"2023-07-21T07:36:28.546081+0000","last_active":"2023-07-21T07:36:29.543556+0000","last_peered":"2023-07-21T07:36:29.543556+0000","last_clean":"2023-07-21T07:36:29.543556+0000","last_became_active":"2023-07-21T07:36:28.545781+0000","last_became_peered":"2023-07-21T07:36:28.545781+0000","last_unstale":"2023-07-21T07:36:29.543556+0000","last_undegraded":"2023-07-21T07:36:29.543556+0000","last_fullsized":"2023-07-21T07:36:29.543556+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:25:10.591064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'8","reported_seq":21,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725624+0000","last_change":"2023-07-21T07:36:27.549363+0000","last_active":"2023-07-21T07:36:30.725624+0000","last_peered":"2023-07-21T07:36:30.725624+0000","last_clean":"2023-07-21T07:36:30.725624+0000","last_became_active":"2023-07-21T07:36:27.548945+0000","last_became_peered":"2023-07-21T07:36:27.548945+0000","last_unstale":"2023-07-21T07:36:30.725624+0000","last_undegraded":"2023-07-21T07:36:30.725624+0000","last_fullsized":"2023-07-21T07:36:30.725624+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:15:15.630428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.538385+0000","last_change":"2023-07-21T07:36:27.538385+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.538385+0000","last_undegraded":"2023-07-21T07:36:27.538385+0000","last_fullsized":"2023-07-21T07:36:27.538385+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.554950+0000","last_change":"2023-07-21T07:36:27.550087+0000","last_active":"2023-07-21T07:36:27.554950+0000","last_peered":"2023-07-21T07:36:27.554950+0000","last_clean":"2023-07-21T07:36:27.554950+0000","last_became_active":"2023-07-21T07:36:27.549834+0000","last_became_peered":"2023-07-21T07:36:27.549834+0000","last_unstale":"2023-07-21T07:36:27.554950+0000","last_undegraded":"2023-07-21T07:36:27.554950+0000","last_fullsized":"2023-07-21T07:36:27.554950+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:10:20.902536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726130+0000","last_change":"2023-07-21T07:36:28.554479+0000","last_active":"2023-07-21T07:36:30.726130+0000","last_peered":"2023-07-21T07:36:30.726130+0000","last_clean":"2023-07-21T07:36:30.726130+0000","last_became_active":"2023-07-21T07:36:28.554145+0000","last_became_peered":"2023-07-21T07:36:28.554145+0000","last_unstale":"2023-07-21T07:36:30.726130+0000","last_undegraded":"2023-07-21T07:36:30.726130+0000","last_fullsized":"2023-07-21T07:36:30.726130+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:06:53.576148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548223+0000","last_change":"2023-07-21T07:36:27.545216+0000","last_active":"2023-07-21T07:36:27.548223+0000","last_peered":"2023-07-21T07:36:27.548223+0000","last_clean":"2023-07-21T07:36:27.548223+0000","last_became_active":"2023-07-21T07:36:27.544952+0000","last_became_peered":"2023-07-21T07:36:27.544952+0000","last_unstale":"2023-07-21T07:36:27.548223+0000","last_undegraded":"2023-07-21T07:36:27.548223+0000","last_fullsized":"2023-07-21T07:36:27.548223+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:34:33.116437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537605+0000","last_change":"2023-07-21T07:36:27.537605+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537605+0000","last_undegraded":"2023-07-21T07:36:27.537605+0000","last_fullsized":"2023-07-21T07:36:27.537605+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555037+0000","last_change":"2023-07-21T07:36:27.548955+0000","last_active":"2023-07-21T07:36:27.555037+0000","last_peered":"2023-07-21T07:36:27.555037+0000","last_clean":"2023-07-21T07:36:27.555037+0000","last_became_active":"2023-07-21T07:36:27.548615+0000","last_became_peered":"2023-07-21T07:36:27.548615+0000","last_unstale":"2023-07-21T07:36:27.555037+0000","last_undegraded":"2023-07-21T07:36:27.555037+0000","last_fullsized":"2023-07-21T07:36:27.555037+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:33:11.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280328+0000","last_change":"2023-07-21T07:36:28.553270+0000","last_active":"2023-07-21T07:36:30.280328+0000","last_peered":"2023-07-21T07:36:30.280328+0000","last_clean":"2023-07-21T07:36:30.280328+0000","last_became_active":"2023-07-21T07:36:28.552988+0000","last_became_peered":"2023-07-21T07:36:28.552988+0000","last_unstale":"2023-07-21T07:36:30.280328+0000","last_undegraded":"2023-07-21T07:36:30.280328+0000","last_fullsized":"2023-07-21T07:36:30.280328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:31:25.239166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543615+0000","last_change":"2023-07-21T07:36:27.546128+0000","last_active":"2023-07-21T07:36:29.543615+0000","last_peered":"2023-07-21T07:36:29.543615+0000","last_clean":"2023-07-21T07:36:29.543615+0000","last_became_active":"2023-07-21T07:36:27.545829+0000","last_became_peered":"2023-07-21T07:36:27.545829+0000","last_unstale":"2023-07-21T07:36:29.543615+0000","last_undegraded":"2023-07-21T07:36:29.543615+0000","last_fullsized":"2023-07-21T07:36:29.543615+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:18:16.539928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279643+0000","last_change":"2023-07-21T07:36:28.550679+0000","last_active":"2023-07-21T07:36:30.279643+0000","last_peered":"2023-07-21T07:36:30.279643+0000","last_clean":"2023-07-21T07:36:30.279643+0000","last_became_active":"2023-07-21T07:36:28.550320+0000","last_became_peered":"2023-07-21T07:36:28.550320+0000","last_unstale":"2023-07-21T07:36:30.279643+0000","last_undegraded":"2023-07-21T07:36:30.279643+0000","last_fullsized":"2023-07-21T07:36:30.279643+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:20:36.808964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548821+0000","last_change":"2023-07-21T07:36:27.542890+0000","last_active":"2023-07-21T07:36:27.548821+0000","last_peered":"2023-07-21T07:36:27.548821+0000","last_clean":"2023-07-21T07:36:27.548821+0000","last_became_active":"2023-07-21T07:36:27.542614+0000","last_became_peered":"2023-07-21T07:36:27.542614+0000","last_unstale":"2023-07-21T07:36:27.548821+0000","last_undegraded":"2023-07-21T07:36:27.548821+0000","last_fullsized":"2023-07-21T07:36:27.548821+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:10:25.051264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725745+0000","last_change":"2023-07-21T07:36:28.549203+0000","last_active":"2023-07-21T07:36:30.725745+0000","last_peered":"2023-07-21T07:36:30.725745+0000","last_clean":"2023-07-21T07:36:30.725745+0000","last_became_active":"2023-07-21T07:36:28.548933+0000","last_became_peered":"2023-07-21T07:36:28.548933+0000","last_unstale":"2023-07-21T07:36:30.725745+0000","last_undegraded":"2023-07-21T07:36:30.725745+0000","last_fullsized":"2023-07-21T07:36:30.725745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:24:40.746510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.538565+0000","last_change":"2023-07-21T07:36:27.535134+0000","last_active":"2023-07-21T07:36:27.538565+0000","last_peered":"2023-07-21T07:36:27.538565+0000","last_clean":"2023-07-21T07:36:27.538565+0000","last_became_active":"2023-07-21T07:36:27.534830+0000","last_became_peered":"2023-07-21T07:36:27.534830+0000","last_unstale":"2023-07-21T07:36:27.538565+0000","last_undegraded":"2023-07-21T07:36:27.538565+0000","last_fullsized":"2023-07-21T07:36:27.538565+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:37:06.214318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543559+0000","last_change":"2023-07-21T07:36:28.549213+0000","last_active":"2023-07-21T07:36:29.543559+0000","last_peered":"2023-07-21T07:36:29.543559+0000","last_clean":"2023-07-21T07:36:29.543559+0000","last_became_active":"2023-07-21T07:36:28.548890+0000","last_became_peered":"2023-07-21T07:36:28.548890+0000","last_unstale":"2023-07-21T07:36:29.543559+0000","last_undegraded":"2023-07-21T07:36:29.543559+0000","last_fullsized":"2023-07-21T07:36:29.543559+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:43.391138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.547832+0000","last_change":"2023-07-21T07:36:27.545372+0000","last_active":"2023-07-21T07:36:27.547832+0000","last_peered":"2023-07-21T07:36:27.547832+0000","last_clean":"2023-07-21T07:36:27.547832+0000","last_became_active":"2023-07-21T07:36:27.544933+0000","last_became_peered":"2023-07-21T07:36:27.544933+0000","last_unstale":"2023-07-21T07:36:27.547832+0000","last_undegraded":"2023-07-21T07:36:27.547832+0000","last_fullsized":"2023-07-21T07:36:27.547832+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:59:32.727551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725917+0000","last_change":"2023-07-21T07:36:28.561703+0000","last_active":"2023-07-21T07:36:30.725917+0000","last_peered":"2023-07-21T07:36:30.725917+0000","last_clean":"2023-07-21T07:36:30.725917+0000","last_became_active":"2023-07-21T07:36:28.561400+0000","last_became_peered":"2023-07-21T07:36:28.561400+0000","last_unstale":"2023-07-21T07:36:30.725917+0000","last_undegraded":"2023-07-21T07:36:30.725917+0000","last_fullsized":"2023-07-21T07:36:30.725917+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:21:40.954647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543373+0000","last_change":"2023-07-21T07:36:27.542037+0000","last_active":"2023-07-21T07:36:29.543373+0000","last_peered":"2023-07-21T07:36:29.543373+0000","last_clean":"2023-07-21T07:36:29.543373+0000","last_became_active":"2023-07-21T07:36:27.541783+0000","last_became_peered":"2023-07-21T07:36:27.541783+0000","last_unstale":"2023-07-21T07:36:29.543373+0000","last_undegraded":"2023-07-21T07:36:29.543373+0000","last_fullsized":"2023-07-21T07:36:29.543373+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:47:19.494591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280363+0000","last_change":"2023-07-21T07:36:28.553251+0000","last_active":"2023-07-21T07:36:30.280363+0000","last_peered":"2023-07-21T07:36:30.280363+0000","last_clean":"2023-07-21T07:36:30.280363+0000","last_became_active":"2023-07-21T07:36:28.552971+0000","last_became_peered":"2023-07-21T07:36:28.552971+0000","last_unstale":"2023-07-21T07:36:30.280363+0000","last_undegraded":"2023-07-21T07:36:30.280363+0000","last_fullsized":"2023-07-21T07:36:30.280363+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:17.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549850+0000","last_change":"2023-07-21T07:36:27.548492+0000","last_active":"2023-07-21T07:36:27.549850+0000","last_peered":"2023-07-21T07:36:27.549850+0000","last_clean":"2023-07-21T07:36:27.549850+0000","last_became_active":"2023-07-21T07:36:27.548083+0000","last_became_peered":"2023-07-21T07:36:27.548083+0000","last_unstale":"2023-07-21T07:36:27.549850+0000","last_undegraded":"2023-07-21T07:36:27.549850+0000","last_fullsized":"2023-07-21T07:36:27.549850+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:24:33.846082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280415+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:36:30.280415+0000","last_peered":"2023-07-21T07:36:30.280415+0000","last_clean":"2023-07-21T07:36:30.280415+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:36:30.280415+0000","last_undegraded":"2023-07-21T07:36:30.280415+0000","last_fullsized":"2023-07-21T07:36:30.280415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:18:18.973777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726034+0000","last_change":"2023-07-21T07:36:28.550245+0000","last_active":"2023-07-21T07:36:30.726034+0000","last_peered":"2023-07-21T07:36:30.726034+0000","last_clean":"2023-07-21T07:36:30.726034+0000","last_became_active":"2023-07-21T07:36:28.548746+0000","last_became_peered":"2023-07-21T07:36:28.548746+0000","last_unstale":"2023-07-21T07:36:30.726034+0000","last_undegraded":"2023-07-21T07:36:30.726034+0000","last_fullsized":"2023-07-21T07:36:30.726034+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:17:46.007416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548784+0000","last_change":"2023-07-21T07:36:27.542066+0000","last_active":"2023-07-21T07:36:27.548784+0000","last_peered":"2023-07-21T07:36:27.548784+0000","last_clean":"2023-07-21T07:36:27.548784+0000","last_became_active":"2023-07-21T07:36:27.541789+0000","last_became_peered":"2023-07-21T07:36:27.541789+0000","last_unstale":"2023-07-21T07:36:27.548784+0000","last_undegraded":"2023-07-21T07:36:27.548784+0000","last_fullsized":"2023-07-21T07:36:27.548784+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:14:50.100812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543977+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:36:29.543977+0000","last_peered":"2023-07-21T07:36:29.543977+0000","last_clean":"2023-07-21T07:36:29.543977+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:36:29.543977+0000","last_undegraded":"2023-07-21T07:36:29.543977+0000","last_fullsized":"2023-07-21T07:36:29.543977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:08:25.435210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280017+0000","last_change":"2023-07-21T07:36:28.555257+0000","last_active":"2023-07-21T07:36:30.280017+0000","last_peered":"2023-07-21T07:36:30.280017+0000","last_clean":"2023-07-21T07:36:30.280017+0000","last_became_active":"2023-07-21T07:36:28.554356+0000","last_became_peered":"2023-07-21T07:36:28.554356+0000","last_unstale":"2023-07-21T07:36:30.280017+0000","last_undegraded":"2023-07-21T07:36:30.280017+0000","last_fullsized":"2023-07-21T07:36:30.280017+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:07:09.045197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549594+0000","last_change":"2023-07-21T07:36:27.547064+0000","last_active":"2023-07-21T07:36:27.549594+0000","last_peered":"2023-07-21T07:36:27.549594+0000","last_clean":"2023-07-21T07:36:27.549594+0000","last_became_active":"2023-07-21T07:36:27.546817+0000","last_became_peered":"2023-07-21T07:36:27.546817+0000","last_unstale":"2023-07-21T07:36:27.549594+0000","last_undegraded":"2023-07-21T07:36:27.549594+0000","last_fullsized":"2023-07-21T07:36:27.549594+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:42.034968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.533936+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:36:27.533936+0000","last_peered":"2023-07-21T07:36:27.533936+0000","last_clean":"2023-07-21T07:36:27.533936+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:36:27.533936+0000","last_undegraded":"2023-07-21T07:36:27.533936+0000","last_fullsized":"2023-07-21T07:36:27.533936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:41:59.304488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539343+0000","last_change":"2023-07-21T07:36:27.539343+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539343+0000","last_undegraded":"2023-07-21T07:36:27.539343+0000","last_fullsized":"2023-07-21T07:36:27.539343+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.554956+0000","last_change":"2023-07-21T07:36:27.546993+0000","last_active":"2023-07-21T07:36:27.554956+0000","last_peered":"2023-07-21T07:36:27.554956+0000","last_clean":"2023-07-21T07:36:27.554956+0000","last_became_active":"2023-07-21T07:36:27.546675+0000","last_became_peered":"2023-07-21T07:36:27.546675+0000","last_unstale":"2023-07-21T07:36:27.554956+0000","last_undegraded":"2023-07-21T07:36:27.554956+0000","last_fullsized":"2023-07-21T07:36:27.554956+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:02:43.499920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.533181+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:36:27.533181+0000","last_peered":"2023-07-21T07:36:27.533181+0000","last_clean":"2023-07-21T07:36:27.533181+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:36:27.533181+0000","last_undegraded":"2023-07-21T07:36:27.533181+0000","last_fullsized":"2023-07-21T07:36:27.533181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:09:38.933989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279886+0000","last_change":"2023-07-21T07:36:28.550594+0000","last_active":"2023-07-21T07:36:30.279886+0000","last_peered":"2023-07-21T07:36:30.279886+0000","last_clean":"2023-07-21T07:36:30.279886+0000","last_became_active":"2023-07-21T07:36:28.550307+0000","last_became_peered":"2023-07-21T07:36:28.550307+0000","last_unstale":"2023-07-21T07:36:30.279886+0000","last_undegraded":"2023-07-21T07:36:30.279886+0000","last_fullsized":"2023-07-21T07:36:30.279886+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:36:10.034314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.547633+0000","last_change":"2023-07-21T07:36:27.545082+0000","last_active":"2023-07-21T07:36:27.547633+0000","last_peered":"2023-07-21T07:36:27.547633+0000","last_clean":"2023-07-21T07:36:27.547633+0000","last_became_active":"2023-07-21T07:36:27.544787+0000","last_became_peered":"2023-07-21T07:36:27.544787+0000","last_unstale":"2023-07-21T07:36:27.547633+0000","last_undegraded":"2023-07-21T07:36:27.547633+0000","last_fullsized":"2023-07-21T07:36:27.547633+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:53:21.078423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.533272+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:36:27.533272+0000","last_peered":"2023-07-21T07:36:27.533272+0000","last_clean":"2023-07-21T07:36:27.533272+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:36:27.533272+0000","last_undegraded":"2023-07-21T07:36:27.533272+0000","last_fullsized":"2023-07-21T07:36:27.533272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:45:07.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.545340+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:36:27.545340+0000","last_peered":"2023-07-21T07:36:27.545340+0000","last_clean":"2023-07-21T07:36:27.545340+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:36:27.545340+0000","last_undegraded":"2023-07-21T07:36:27.545340+0000","last_fullsized":"2023-07-21T07:36:27.545340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:45:26.816257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536049+0000","last_change":"2023-07-21T07:36:27.536049+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536049+0000","last_undegraded":"2023-07-21T07:36:27.536049+0000","last_fullsized":"2023-07-21T07:36:27.536049+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555010+0000","last_change":"2023-07-21T07:36:27.550572+0000","last_active":"2023-07-21T07:36:27.555010+0000","last_peered":"2023-07-21T07:36:27.555010+0000","last_clean":"2023-07-21T07:36:27.555010+0000","last_became_active":"2023-07-21T07:36:27.550195+0000","last_became_peered":"2023-07-21T07:36:27.550195+0000","last_unstale":"2023-07-21T07:36:27.555010+0000","last_undegraded":"2023-07-21T07:36:27.555010+0000","last_fullsized":"2023-07-21T07:36:27.555010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:38:40.211173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725668+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:36:30.725668+0000","last_peered":"2023-07-21T07:36:30.725668+0000","last_clean":"2023-07-21T07:36:30.725668+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:36:30.725668+0000","last_undegraded":"2023-07-21T07:36:30.725668+0000","last_fullsized":"2023-07-21T07:36:30.725668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:10:59.819304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279848+0000","last_change":"2023-07-21T07:36:28.552513+0000","last_active":"2023-07-21T07:36:30.279848+0000","last_peered":"2023-07-21T07:36:30.279848+0000","last_clean":"2023-07-21T07:36:30.279848+0000","last_became_active":"2023-07-21T07:36:28.551895+0000","last_became_peered":"2023-07-21T07:36:28.551895+0000","last_unstale":"2023-07-21T07:36:30.279848+0000","last_undegraded":"2023-07-21T07:36:30.279848+0000","last_fullsized":"2023-07-21T07:36:30.279848+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:44:16.702073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549693+0000","last_change":"2023-07-21T07:36:27.544373+0000","last_active":"2023-07-21T07:36:27.549693+0000","last_peered":"2023-07-21T07:36:27.549693+0000","last_clean":"2023-07-21T07:36:27.549693+0000","last_became_active":"2023-07-21T07:36:27.544074+0000","last_became_peered":"2023-07-21T07:36:27.544074+0000","last_unstale":"2023-07-21T07:36:27.549693+0000","last_undegraded":"2023-07-21T07:36:27.549693+0000","last_fullsized":"2023-07-21T07:36:27.549693+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:32:26.034517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.545016+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:36:27.545016+0000","last_peered":"2023-07-21T07:36:27.545016+0000","last_clean":"2023-07-21T07:36:27.545016+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:36:27.545016+0000","last_undegraded":"2023-07-21T07:36:27.545016+0000","last_fullsized":"2023-07-21T07:36:27.545016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:49:35.393074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530834+0000","last_change":"2023-07-21T07:36:27.530834+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530834+0000","last_undegraded":"2023-07-21T07:36:27.530834+0000","last_fullsized":"2023-07-21T07:36:27.530834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.554983+0000","last_change":"2023-07-21T07:36:27.550570+0000","last_active":"2023-07-21T07:36:27.554983+0000","last_peered":"2023-07-21T07:36:27.554983+0000","last_clean":"2023-07-21T07:36:27.554983+0000","last_became_active":"2023-07-21T07:36:27.550296+0000","last_became_peered":"2023-07-21T07:36:27.550296+0000","last_unstale":"2023-07-21T07:36:27.554983+0000","last_undegraded":"2023-07-21T07:36:27.554983+0000","last_fullsized":"2023-07-21T07:36:27.554983+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:26:29.512185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543544+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:36:29.543544+0000","last_peered":"2023-07-21T07:36:29.543544+0000","last_clean":"2023-07-21T07:36:29.543544+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:36:29.543544+0000","last_undegraded":"2023-07-21T07:36:29.543544+0000","last_fullsized":"2023-07-21T07:36:29.543544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:53:43.924057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2146,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":863348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.504}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.624}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.59499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":286795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.4990000000000006,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.4039999999999999,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":675840,"data_stored":289089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34699999999999998,"15min":0.35099999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.502,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.249,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.49399999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.26000000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.34699999999999998,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.44700000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.307},{"interface":"front","average":{"1min":0.433,"5min":0.436,"15min":0.436},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.379}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.57499999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.40600000000000003,"15min":0.41199999999999998},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56299999999999994,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59699999999999998,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89300000000000002,"5min":1.006,"15min":1.006},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73599999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63400000000000001,"15min":0.64600000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80500000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82699999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.64000000000000001,"15min":0.65500000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68600000000000005,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.45800000000000002}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.69099999999999995,"15min":0.70899999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85299999999999998,"5min":1.339,"15min":1.339},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.747,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.503}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":863348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.376}]},{"osd":3,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.35299999999999998}]},{"osd":4,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.751}]},{"osd":5,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":647168,"data_stored":286761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.35399999999999998},"min":{"1min":0.23599999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45900000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34899999999999998,"15min":0.34999999999999998},"min":{"1min":0.249,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.27500000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.29499999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.49199999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34300000000000003}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.51900000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.32800000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60099999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.434,"5min":0.379,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82199999999999995,"5min":1.127,"15min":1.127},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76000000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":1.109,"15min":1.109},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.622,"15min":0.61299999999999999},"min":{"1min":0.501,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88400000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.60299999999999998},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84699999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.67200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":272980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.52300000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.505},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.755},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.80000000000000004}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.83799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":288325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":10.18,"5min":10.18,"15min":10.18},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":10.207000000000001,"5min":10.207000000000001,"15min":10.207000000000001},"last":0.496}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.65300000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.46600000000000003}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.625}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":266360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.499},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.625},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:36:33.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:36:33.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.239+0000 7fecb4f5a700 1 Processor -- start 2023-07-21T07:36:33.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.239+0000 7fecb4f5a700 1 -- start start 2023-07-21T07:36:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.240+0000 7fecb4f5a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fecb006a300 0x7fecb00c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.240+0000 7fecb4f5a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb00c3120 con 0x7fecb0157b00 2023-07-21T07:36:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.240+0000 7fecb4f5a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb0154860 con 0x7fecb00c2bf0 2023-07-21T07:36:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.240+0000 7fecb4f5a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb00c1e60 con 0x7fecb006a300 2023-07-21T07:36:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.240+0000 7fecae59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fecb006a300 0x7fecb00c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.240+0000 7fecaed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fecb0157b00 0x7fecb0157f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44072/0 (socket says 172.21.15.6:44072) 2023-07-21T07:36:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.240+0000 7fecaed9d700 1 -- 172.21.15.6:0/274638634 learned_addr learned my addr 172.21.15.6:0/274638634 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.240+0000 7fecae59c700 1 -- 172.21.15.6:0/274638634 >> v1:172.21.15.86:6789/0 conn(0x7fecb00c2bf0 legacy=0x7fecb01516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.240+0000 7fecae59c700 1 -- 172.21.15.6:0/274638634 >> v1:172.21.15.6:6789/0 conn(0x7fecb0157b00 legacy=0x7fecb0157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.240+0000 7fecae59c700 1 -- 172.21.15.6:0/274638634 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb0154b40 con 0x7fecb006a300 2023-07-21T07:36:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.241+0000 7fecae59c700 1 --2- 172.21.15.6:0/274638634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb006a300 0x7fecb00c26b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fec98009840 tx=0x7fec98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ab65817a7eed83 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.241+0000 7fecad59a700 1 -- 172.21.15.6:0/274638634 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98004230 con 0x7fecb006a300 2023-07-21T07:36:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.241+0000 7fecad59a700 1 -- 172.21.15.6:0/274638634 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec98004390 con 0x7fecb006a300 2023-07-21T07:36:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.241+0000 7fecad59a700 1 -- 172.21.15.6:0/274638634 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec980036a0 con 0x7fecb006a300 2023-07-21T07:36:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.241+0000 7fecb4f5a700 1 -- 172.21.15.6:0/274638634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb006a300 msgr2=0x7fecb00c26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.241+0000 7fecb4f5a700 1 --2- 172.21.15.6:0/274638634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb006a300 0x7fecb00c26b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fec98009840 tx=0x7fec98009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.241+0000 7fecb4f5a700 1 -- 172.21.15.6:0/274638634 shutdown_connections 2023-07-21T07:36:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.241+0000 7fecb4f5a700 1 --2- 172.21.15.6:0/274638634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb006a300 0x7fecb00c26b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.241+0000 7fecb4f5a700 1 -- 172.21.15.6:0/274638634 >> 172.21.15.6:0/274638634 conn(0x7fecb00a8c90 msgr2=0x7fecb006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.241+0000 7fecb4f5a700 1 -- 172.21.15.6:0/274638634 shutdown_connections 2023-07-21T07:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.241+0000 7fecb4f5a700 1 -- 172.21.15.6:0/274638634 wait complete. 2023-07-21T07:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.243+0000 7fecb4f5a700 1 Processor -- start 2023-07-21T07:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.243+0000 7fecb4f5a700 1 -- start start 2023-07-21T07:36:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.243+0000 7fecb4f5a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb006a300 0x7fecb0071c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:33.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.243+0000 7fecb4f5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb00c2bf0 0x7fecb014d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:33.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecb4f5a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb0157b00 0x7fecb00bf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:33.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecb4f5a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb01ed790 con 0x7fecb00c2bf0 2023-07-21T07:36:33.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecb4f5a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00bed20 con 0x7fecb006a300 2023-07-21T07:36:33.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecb4f5a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb0155ac0 con 0x7fecb0157b00 2023-07-21T07:36:33.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecadd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb00c2bf0 0x7fecb014d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecadd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb00c2bf0 0x7fecb014d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36056/0 (socket says 172.21.15.6:36056) 2023-07-21T07:36:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecadd9b700 1 -- 172.21.15.6:0/2569880750 learned_addr learned my addr 172.21.15.6:0/2569880750 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecae59c700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb006a300 0x7fecb0071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecaed9d700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb0157b00 0x7fecb00bf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecadd9b700 1 -- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb0157b00 msgr2=0x7fecb00bf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecadd9b700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb0157b00 0x7fecb00bf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecadd9b700 1 -- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb006a300 msgr2=0x7fecb0071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecadd9b700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb006a300 0x7fecb0071c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecadd9b700 1 -- 172.21.15.6:0/2569880750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980094a0 con 0x7fecb00c2bf0 2023-07-21T07:36:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecae59c700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb006a300 0x7fecb0071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecadd9b700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb00c2bf0 0x7fecb014d280 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7feca000c4d0 tx=0x7feca000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7feca6ffd700 1 -- 172.21.15.6:0/2569880750 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0011790 con 0x7fecb00c2bf0 2023-07-21T07:36:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7feca6ffd700 1 -- 172.21.15.6:0/2569880750 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca00118f0 con 0x7fecb00c2bf0 2023-07-21T07:36:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecb4f5a700 1 -- 172.21.15.6:0/2569880750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb00c07c0 con 0x7fecb00c2bf0 2023-07-21T07:36:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7feca6ffd700 1 -- 172.21.15.6:0/2569880750 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0011ca0 con 0x7fecb00c2bf0 2023-07-21T07:36:33.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.244+0000 7fecb4f5a700 1 -- 172.21.15.6:0/2569880750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb01edc50 con 0x7fecb00c2bf0 2023-07-21T07:36:33.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.245+0000 7fecb4f5a700 1 -- 172.21.15.6:0/2569880750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb00bee90 con 0x7fecb00c2bf0 2023-07-21T07:36:33.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.246+0000 7feca6ffd700 1 -- 172.21.15.6:0/2569880750 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feca001c460 con 0x7fecb00c2bf0 2023-07-21T07:36:33.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.246+0000 7feca6ffd700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fec9006ace0 0x7fec9006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:33.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.246+0000 7feca6ffd700 1 -- 172.21.15.6:0/2569880750 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feca00892f0 con 0x7fecb00c2bf0 2023-07-21T07:36:33.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.246+0000 7fecae59c700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fec9006ace0 0x7fec9006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:33.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.247+0000 7fecae59c700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fec9006ace0 0x7fec9006d1a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fec98000c00 tx=0x7fec9801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:33.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.251+0000 7feca6ffd700 1 -- 172.21.15.6:0/2569880750 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fecb00bee90 con 0x7fecb00c2bf0 2023-07-21T07:36:33.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.442+0000 7fecb4f5a700 1 -- 172.21.15.6:0/2569880750 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fecb0154510 con 0x7fec9006ace0 2023-07-21T07:36:33.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.452+0000 7feca6ffd700 1 -- 172.21.15.6:0/2569880750 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308904 (secure 0 0 0) 0x7fec98004210 con 0x7fec9006ace0 2023-07-21T07:36:33.508 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.454+0000 7fecb4f5a700 1 -- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fec9006ace0 msgr2=0x7fec9006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.454+0000 7fecb4f5a700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fec9006ace0 0x7fec9006d1a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fec98000c00 tx=0x7fec9801c040 comp rx=0 tx=0).stop 2023-07-21T07:36:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.454+0000 7fecb4f5a700 1 -- 172.21.15.6:0/2569880750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb00c2bf0 msgr2=0x7fecb014d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.454+0000 7fecb4f5a700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb00c2bf0 0x7fecb014d280 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7feca000c4d0 tx=0x7feca000c890 comp rx=0 tx=0).stop 2023-07-21T07:36:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.454+0000 7fecb4f5a700 1 -- 172.21.15.6:0/2569880750 shutdown_connections 2023-07-21T07:36:33.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.454+0000 7fecb4f5a700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fec9006ace0 0x7fec9006d1a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.454+0000 7fecb4f5a700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb0157b00 0x7fecb00bf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.454+0000 7fecb4f5a700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb006a300 0x7fecb0071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.454+0000 7fecb4f5a700 1 --2- 172.21.15.6:0/2569880750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecb00c2bf0 0x7fecb014d280 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.454+0000 7fecb4f5a700 1 -- 172.21.15.6:0/2569880750 >> 172.21.15.6:0/2569880750 conn(0x7fecb00a8c90 msgr2=0x7fecb0152720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:33.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.454+0000 7fecb4f5a700 1 -- 172.21.15.6:0/2569880750 shutdown_connections 2023-07-21T07:36:33.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.454+0000 7fecb4f5a700 1 -- 172.21.15.6:0/2569880750 wait complete. 2023-07-21T07:36:33.515 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:36:33.521 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-07-21T07:36:32.720377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592514,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222340,"kb_used_data":6152,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754752380,"statfs":{"total":773094113280,"available":772866437120,"internally_reserved":0,"allocated":6299648,"data_stored":3417006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2146,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001395"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543939+0000","last_change":"2023-07-21T07:36:28.546426+0000","last_active":"2023-07-21T07:36:29.543939+0000","last_peered":"2023-07-21T07:36:29.543939+0000","last_clean":"2023-07-21T07:36:29.543939+0000","last_became_active":"2023-07-21T07:36:28.546106+0000","last_became_peered":"2023-07-21T07:36:28.546106+0000","last_unstale":"2023-07-21T07:36:29.543939+0000","last_undegraded":"2023-07-21T07:36:29.543939+0000","last_fullsized":"2023-07-21T07:36:29.543939+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:15:19.595560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543870+0000","last_change":"2023-07-21T07:36:28.553546+0000","last_active":"2023-07-21T07:36:29.543870+0000","last_peered":"2023-07-21T07:36:29.543870+0000","last_clean":"2023-07-21T07:36:29.543870+0000","last_became_active":"2023-07-21T07:36:28.553260+0000","last_became_peered":"2023-07-21T07:36:28.553260+0000","last_unstale":"2023-07-21T07:36:29.543870+0000","last_undegraded":"2023-07-21T07:36:29.543870+0000","last_fullsized":"2023-07-21T07:36:29.543870+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:43:50.621919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530833+0000","last_change":"2023-07-21T07:36:27.530833+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530833+0000","last_undegraded":"2023-07-21T07:36:27.530833+0000","last_fullsized":"2023-07-21T07:36:27.530833+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725959+0000","last_change":"2023-07-21T07:36:28.553233+0000","last_active":"2023-07-21T07:36:30.725959+0000","last_peered":"2023-07-21T07:36:30.725959+0000","last_clean":"2023-07-21T07:36:30.725959+0000","last_became_active":"2023-07-21T07:36:28.552984+0000","last_became_peered":"2023-07-21T07:36:28.552984+0000","last_unstale":"2023-07-21T07:36:30.725959+0000","last_undegraded":"2023-07-21T07:36:30.725959+0000","last_fullsized":"2023-07-21T07:36:30.725959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:23:03.303111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279802+0000","last_change":"2023-07-21T07:36:28.555196+0000","last_active":"2023-07-21T07:36:30.279802+0000","last_peered":"2023-07-21T07:36:30.279802+0000","last_clean":"2023-07-21T07:36:30.279802+0000","last_became_active":"2023-07-21T07:36:28.554805+0000","last_became_peered":"2023-07-21T07:36:28.554805+0000","last_unstale":"2023-07-21T07:36:30.279802+0000","last_undegraded":"2023-07-21T07:36:30.279802+0000","last_fullsized":"2023-07-21T07:36:30.279802+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:14:30.726435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537868+0000","last_change":"2023-07-21T07:36:27.537868+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537868+0000","last_undegraded":"2023-07-21T07:36:27.537868+0000","last_fullsized":"2023-07-21T07:36:27.537868+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725610+0000","last_change":"2023-07-21T07:36:28.557367+0000","last_active":"2023-07-21T07:36:30.725610+0000","last_peered":"2023-07-21T07:36:30.725610+0000","last_clean":"2023-07-21T07:36:30.725610+0000","last_became_active":"2023-07-21T07:36:28.557060+0000","last_became_peered":"2023-07-21T07:36:28.557060+0000","last_unstale":"2023-07-21T07:36:30.725610+0000","last_undegraded":"2023-07-21T07:36:30.725610+0000","last_fullsized":"2023-07-21T07:36:30.725610+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:11:41.810201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.534948+0000","last_change":"2023-07-21T07:36:27.534948+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.534948+0000","last_undegraded":"2023-07-21T07:36:27.534948+0000","last_fullsized":"2023-07-21T07:36:27.534948+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530880+0000","last_change":"2023-07-21T07:36:27.530880+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530880+0000","last_undegraded":"2023-07-21T07:36:27.530880+0000","last_fullsized":"2023-07-21T07:36:27.530880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531351+0000","last_change":"2023-07-21T07:36:27.531351+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531351+0000","last_undegraded":"2023-07-21T07:36:27.531351+0000","last_fullsized":"2023-07-21T07:36:27.531351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725998+0000","last_change":"2023-07-21T07:36:28.550836+0000","last_active":"2023-07-21T07:36:30.725998+0000","last_peered":"2023-07-21T07:36:30.725998+0000","last_clean":"2023-07-21T07:36:30.725998+0000","last_became_active":"2023-07-21T07:36:28.550559+0000","last_became_peered":"2023-07-21T07:36:28.550559+0000","last_unstale":"2023-07-21T07:36:30.725998+0000","last_undegraded":"2023-07-21T07:36:30.725998+0000","last_fullsized":"2023-07-21T07:36:30.725998+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:04:12.046194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536842+0000","last_change":"2023-07-21T07:36:27.536842+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536842+0000","last_undegraded":"2023-07-21T07:36:27.536842+0000","last_fullsized":"2023-07-21T07:36:27.536842+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.535086+0000","last_change":"2023-07-21T07:36:27.535086+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.535086+0000","last_undegraded":"2023-07-21T07:36:27.535086+0000","last_fullsized":"2023-07-21T07:36:27.535086+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530811+0000","last_change":"2023-07-21T07:36:27.530811+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530811+0000","last_undegraded":"2023-07-21T07:36:27.530811+0000","last_fullsized":"2023-07-21T07:36:27.530811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531253+0000","last_change":"2023-07-21T07:36:27.531253+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531253+0000","last_undegraded":"2023-07-21T07:36:27.531253+0000","last_fullsized":"2023-07-21T07:36:27.531253+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725979+0000","last_change":"2023-07-21T07:36:28.561905+0000","last_active":"2023-07-21T07:36:30.725979+0000","last_peered":"2023-07-21T07:36:30.725979+0000","last_clean":"2023-07-21T07:36:30.725979+0000","last_became_active":"2023-07-21T07:36:28.561351+0000","last_became_peered":"2023-07-21T07:36:28.561351+0000","last_unstale":"2023-07-21T07:36:30.725979+0000","last_undegraded":"2023-07-21T07:36:30.725979+0000","last_fullsized":"2023-07-21T07:36:30.725979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:29:49.803144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.544010+0000","last_change":"2023-07-21T07:36:28.550124+0000","last_active":"2023-07-21T07:36:29.544010+0000","last_peered":"2023-07-21T07:36:29.544010+0000","last_clean":"2023-07-21T07:36:29.544010+0000","last_became_active":"2023-07-21T07:36:28.549862+0000","last_became_peered":"2023-07-21T07:36:28.549862+0000","last_unstale":"2023-07-21T07:36:29.544010+0000","last_undegraded":"2023-07-21T07:36:29.544010+0000","last_fullsized":"2023-07-21T07:36:29.544010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:16.457168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726109+0000","last_change":"2023-07-21T07:36:28.552922+0000","last_active":"2023-07-21T07:36:30.726109+0000","last_peered":"2023-07-21T07:36:30.726109+0000","last_clean":"2023-07-21T07:36:30.726109+0000","last_became_active":"2023-07-21T07:36:28.552646+0000","last_became_peered":"2023-07-21T07:36:28.552646+0000","last_unstale":"2023-07-21T07:36:30.726109+0000","last_undegraded":"2023-07-21T07:36:30.726109+0000","last_fullsized":"2023-07-21T07:36:30.726109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:02:44.505392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279950+0000","last_change":"2023-07-21T07:36:28.554910+0000","last_active":"2023-07-21T07:36:30.279950+0000","last_peered":"2023-07-21T07:36:30.279950+0000","last_clean":"2023-07-21T07:36:30.279950+0000","last_became_active":"2023-07-21T07:36:28.554628+0000","last_became_peered":"2023-07-21T07:36:28.554628+0000","last_unstale":"2023-07-21T07:36:30.279950+0000","last_undegraded":"2023-07-21T07:36:30.279950+0000","last_fullsized":"2023-07-21T07:36:30.279950+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:24:34.043625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530276+0000","last_change":"2023-07-21T07:36:27.530276+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530276+0000","last_undegraded":"2023-07-21T07:36:27.530276+0000","last_fullsized":"2023-07-21T07:36:27.530276+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.535514+0000","last_change":"2023-07-21T07:36:27.535514+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.535514+0000","last_undegraded":"2023-07-21T07:36:27.535514+0000","last_fullsized":"2023-07-21T07:36:27.535514+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531165+0000","last_change":"2023-07-21T07:36:27.531165+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531165+0000","last_undegraded":"2023-07-21T07:36:27.531165+0000","last_fullsized":"2023-07-21T07:36:27.531165+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531582+0000","last_change":"2023-07-21T07:36:27.531582+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531582+0000","last_undegraded":"2023-07-21T07:36:27.531582+0000","last_fullsized":"2023-07-21T07:36:27.531582+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530906+0000","last_change":"2023-07-21T07:36:27.530906+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530906+0000","last_undegraded":"2023-07-21T07:36:27.530906+0000","last_fullsized":"2023-07-21T07:36:27.530906+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.543217+0000","last_change":"2023-07-21T07:36:27.543217+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.543217+0000","last_undegraded":"2023-07-21T07:36:27.543217+0000","last_fullsized":"2023-07-21T07:36:27.543217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537966+0000","last_change":"2023-07-21T07:36:27.537966+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537966+0000","last_undegraded":"2023-07-21T07:36:27.537966+0000","last_fullsized":"2023-07-21T07:36:27.537966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725998+0000","last_change":"2023-07-21T07:36:28.554107+0000","last_active":"2023-07-21T07:36:30.725998+0000","last_peered":"2023-07-21T07:36:30.725998+0000","last_clean":"2023-07-21T07:36:30.725998+0000","last_became_active":"2023-07-21T07:36:28.553824+0000","last_became_peered":"2023-07-21T07:36:28.553824+0000","last_unstale":"2023-07-21T07:36:30.725998+0000","last_undegraded":"2023-07-21T07:36:30.725998+0000","last_fullsized":"2023-07-21T07:36:30.725998+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:35:20.960610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543780+0000","last_change":"2023-07-21T07:36:28.544714+0000","last_active":"2023-07-21T07:36:29.543780+0000","last_peered":"2023-07-21T07:36:29.543780+0000","last_clean":"2023-07-21T07:36:29.543780+0000","last_became_active":"2023-07-21T07:36:28.544330+0000","last_became_peered":"2023-07-21T07:36:28.544330+0000","last_unstale":"2023-07-21T07:36:29.543780+0000","last_undegraded":"2023-07-21T07:36:29.543780+0000","last_fullsized":"2023-07-21T07:36:29.543780+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:36.869529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531198+0000","last_change":"2023-07-21T07:36:27.531198+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531198+0000","last_undegraded":"2023-07-21T07:36:27.531198+0000","last_fullsized":"2023-07-21T07:36:27.531198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.544479+0000","last_change":"2023-07-21T07:36:27.544479+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.544479+0000","last_undegraded":"2023-07-21T07:36:27.544479+0000","last_fullsized":"2023-07-21T07:36:27.544479+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725688+0000","last_change":"2023-07-21T07:36:28.553711+0000","last_active":"2023-07-21T07:36:30.725688+0000","last_peered":"2023-07-21T07:36:30.725688+0000","last_clean":"2023-07-21T07:36:30.725688+0000","last_became_active":"2023-07-21T07:36:28.553426+0000","last_became_peered":"2023-07-21T07:36:28.553426+0000","last_unstale":"2023-07-21T07:36:30.725688+0000","last_undegraded":"2023-07-21T07:36:30.725688+0000","last_fullsized":"2023-07-21T07:36:30.725688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:24:34.851555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539842+0000","last_change":"2023-07-21T07:36:27.539842+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539842+0000","last_undegraded":"2023-07-21T07:36:27.539842+0000","last_fullsized":"2023-07-21T07:36:27.539842+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280185+0000","last_change":"2023-07-21T07:36:28.554012+0000","last_active":"2023-07-21T07:36:30.280185+0000","last_peered":"2023-07-21T07:36:30.280185+0000","last_clean":"2023-07-21T07:36:30.280185+0000","last_became_active":"2023-07-21T07:36:28.553737+0000","last_became_peered":"2023-07-21T07:36:28.553737+0000","last_unstale":"2023-07-21T07:36:30.280185+0000","last_undegraded":"2023-07-21T07:36:30.280185+0000","last_fullsized":"2023-07-21T07:36:30.280185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:36:21.975321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"53'4","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.544028+0000","last_change":"2023-07-21T07:36:27.542913+0000","last_active":"2023-07-21T07:36:29.544028+0000","last_peered":"2023-07-21T07:36:29.544028+0000","last_clean":"2023-07-21T07:36:29.544028+0000","last_became_active":"2023-07-21T07:36:27.542352+0000","last_became_peered":"2023-07-21T07:36:27.542352+0000","last_unstale":"2023-07-21T07:36:29.544028+0000","last_undegraded":"2023-07-21T07:36:29.544028+0000","last_fullsized":"2023-07-21T07:36:29.544028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:58:50.271243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726159+0000","last_change":"2023-07-21T07:36:28.549909+0000","last_active":"2023-07-21T07:36:30.726159+0000","last_peered":"2023-07-21T07:36:30.726159+0000","last_clean":"2023-07-21T07:36:30.726159+0000","last_became_active":"2023-07-21T07:36:28.549643+0000","last_became_peered":"2023-07-21T07:36:28.549643+0000","last_unstale":"2023-07-21T07:36:30.726159+0000","last_undegraded":"2023-07-21T07:36:30.726159+0000","last_fullsized":"2023-07-21T07:36:30.726159+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:16.589451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549685+0000","last_change":"2023-07-21T07:36:27.544173+0000","last_active":"2023-07-21T07:36:27.549685+0000","last_peered":"2023-07-21T07:36:27.549685+0000","last_clean":"2023-07-21T07:36:27.549685+0000","last_became_active":"2023-07-21T07:36:27.543806+0000","last_became_peered":"2023-07-21T07:36:27.543806+0000","last_unstale":"2023-07-21T07:36:27.549685+0000","last_undegraded":"2023-07-21T07:36:27.549685+0000","last_fullsized":"2023-07-21T07:36:27.549685+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:29:12.899796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.538725+0000","last_change":"2023-07-21T07:36:27.538725+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.538725+0000","last_undegraded":"2023-07-21T07:36:27.538725+0000","last_fullsized":"2023-07-21T07:36:27.538725+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555018+0000","last_change":"2023-07-21T07:36:27.548717+0000","last_active":"2023-07-21T07:36:27.555018+0000","last_peered":"2023-07-21T07:36:27.555018+0000","last_clean":"2023-07-21T07:36:27.555018+0000","last_became_active":"2023-07-21T07:36:27.548229+0000","last_became_peered":"2023-07-21T07:36:27.548229+0000","last_unstale":"2023-07-21T07:36:27.555018+0000","last_undegraded":"2023-07-21T07:36:27.555018+0000","last_fullsized":"2023-07-21T07:36:27.555018+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:15.583978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.532491+0000","last_change":"2023-07-21T07:36:27.532491+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.532491+0000","last_undegraded":"2023-07-21T07:36:27.532491+0000","last_fullsized":"2023-07-21T07:36:27.532491+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555238+0000","last_change":"2023-07-21T07:36:27.550565+0000","last_active":"2023-07-21T07:36:27.555238+0000","last_peered":"2023-07-21T07:36:27.555238+0000","last_clean":"2023-07-21T07:36:27.555238+0000","last_became_active":"2023-07-21T07:36:27.550235+0000","last_became_peered":"2023-07-21T07:36:27.550235+0000","last_unstale":"2023-07-21T07:36:27.555238+0000","last_undegraded":"2023-07-21T07:36:27.555238+0000","last_fullsized":"2023-07-21T07:36:27.555238+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:19:40.401260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726118+0000","last_change":"2023-07-21T07:36:28.564622+0000","last_active":"2023-07-21T07:36:30.726118+0000","last_peered":"2023-07-21T07:36:30.726118+0000","last_clean":"2023-07-21T07:36:30.726118+0000","last_became_active":"2023-07-21T07:36:28.564322+0000","last_became_peered":"2023-07-21T07:36:28.564322+0000","last_unstale":"2023-07-21T07:36:30.726118+0000","last_undegraded":"2023-07-21T07:36:30.726118+0000","last_fullsized":"2023-07-21T07:36:30.726118+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:00:11.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549091+0000","last_change":"2023-07-21T07:36:27.548030+0000","last_active":"2023-07-21T07:36:27.549091+0000","last_peered":"2023-07-21T07:36:27.549091+0000","last_clean":"2023-07-21T07:36:27.549091+0000","last_became_active":"2023-07-21T07:36:27.547734+0000","last_became_peered":"2023-07-21T07:36:27.547734+0000","last_unstale":"2023-07-21T07:36:27.549091+0000","last_undegraded":"2023-07-21T07:36:27.549091+0000","last_fullsized":"2023-07-21T07:36:27.549091+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:15:15.630428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543364+0000","last_change":"2023-07-21T07:36:28.561529+0000","last_active":"2023-07-21T07:36:29.543364+0000","last_peered":"2023-07-21T07:36:29.543364+0000","last_clean":"2023-07-21T07:36:29.543364+0000","last_became_active":"2023-07-21T07:36:28.561238+0000","last_became_peered":"2023-07-21T07:36:28.561238+0000","last_unstale":"2023-07-21T07:36:29.543364+0000","last_undegraded":"2023-07-21T07:36:29.543364+0000","last_fullsized":"2023-07-21T07:36:29.543364+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:51:29.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.546146+0000","last_change":"2023-07-21T07:36:27.543128+0000","last_active":"2023-07-21T07:36:27.546146+0000","last_peered":"2023-07-21T07:36:27.546146+0000","last_clean":"2023-07-21T07:36:27.546146+0000","last_became_active":"2023-07-21T07:36:27.542777+0000","last_became_peered":"2023-07-21T07:36:27.542777+0000","last_unstale":"2023-07-21T07:36:27.546146+0000","last_undegraded":"2023-07-21T07:36:27.546146+0000","last_fullsized":"2023-07-21T07:36:27.546146+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:51:05.902828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279686+0000","last_change":"2023-07-21T07:36:28.552687+0000","last_active":"2023-07-21T07:36:30.279686+0000","last_peered":"2023-07-21T07:36:30.279686+0000","last_clean":"2023-07-21T07:36:30.279686+0000","last_became_active":"2023-07-21T07:36:28.552238+0000","last_became_peered":"2023-07-21T07:36:28.552238+0000","last_unstale":"2023-07-21T07:36:30.279686+0000","last_undegraded":"2023-07-21T07:36:30.279686+0000","last_fullsized":"2023-07-21T07:36:30.279686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:56.957478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.547854+0000","last_change":"2023-07-21T07:36:27.545649+0000","last_active":"2023-07-21T07:36:27.547854+0000","last_peered":"2023-07-21T07:36:27.547854+0000","last_clean":"2023-07-21T07:36:27.547854+0000","last_became_active":"2023-07-21T07:36:27.545358+0000","last_became_peered":"2023-07-21T07:36:27.545358+0000","last_unstale":"2023-07-21T07:36:27.547854+0000","last_undegraded":"2023-07-21T07:36:27.547854+0000","last_fullsized":"2023-07-21T07:36:27.547854+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:13:49.441576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530783+0000","last_change":"2023-07-21T07:36:27.530783+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530783+0000","last_undegraded":"2023-07-21T07:36:27.530783+0000","last_fullsized":"2023-07-21T07:36:27.530783+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279697+0000","last_change":"2023-07-21T07:36:27.549188+0000","last_active":"2023-07-21T07:36:30.279697+0000","last_peered":"2023-07-21T07:36:30.279697+0000","last_clean":"2023-07-21T07:36:30.279697+0000","last_became_active":"2023-07-21T07:36:27.548866+0000","last_became_peered":"2023-07-21T07:36:27.548866+0000","last_unstale":"2023-07-21T07:36:30.279697+0000","last_undegraded":"2023-07-21T07:36:30.279697+0000","last_fullsized":"2023-07-21T07:36:30.279697+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:28:04.208946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543643+0000","last_change":"2023-07-21T07:36:28.561022+0000","last_active":"2023-07-21T07:36:29.543643+0000","last_peered":"2023-07-21T07:36:29.543643+0000","last_clean":"2023-07-21T07:36:29.543643+0000","last_became_active":"2023-07-21T07:36:28.560541+0000","last_became_peered":"2023-07-21T07:36:28.560541+0000","last_unstale":"2023-07-21T07:36:29.543643+0000","last_undegraded":"2023-07-21T07:36:29.543643+0000","last_fullsized":"2023-07-21T07:36:29.543643+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:00:13.900861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548403+0000","last_change":"2023-07-21T07:36:27.541612+0000","last_active":"2023-07-21T07:36:27.548403+0000","last_peered":"2023-07-21T07:36:27.548403+0000","last_clean":"2023-07-21T07:36:27.548403+0000","last_became_active":"2023-07-21T07:36:27.541373+0000","last_became_peered":"2023-07-21T07:36:27.541373+0000","last_unstale":"2023-07-21T07:36:27.548403+0000","last_undegraded":"2023-07-21T07:36:27.548403+0000","last_fullsized":"2023-07-21T07:36:27.548403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:22:39.168554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531809+0000","last_change":"2023-07-21T07:36:27.531809+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531809+0000","last_undegraded":"2023-07-21T07:36:27.531809+0000","last_fullsized":"2023-07-21T07:36:27.531809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726257+0000","last_change":"2023-07-21T07:36:27.547744+0000","last_active":"2023-07-21T07:36:30.726257+0000","last_peered":"2023-07-21T07:36:30.726257+0000","last_clean":"2023-07-21T07:36:30.726257+0000","last_became_active":"2023-07-21T07:36:27.547463+0000","last_became_peered":"2023-07-21T07:36:27.547463+0000","last_unstale":"2023-07-21T07:36:30.726257+0000","last_undegraded":"2023-07-21T07:36:30.726257+0000","last_fullsized":"2023-07-21T07:36:30.726257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:33:11.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280048+0000","last_change":"2023-07-21T07:36:28.542046+0000","last_active":"2023-07-21T07:36:30.280048+0000","last_peered":"2023-07-21T07:36:30.280048+0000","last_clean":"2023-07-21T07:36:30.280048+0000","last_became_active":"2023-07-21T07:36:28.541690+0000","last_became_peered":"2023-07-21T07:36:28.541690+0000","last_unstale":"2023-07-21T07:36:30.280048+0000","last_undegraded":"2023-07-21T07:36:30.280048+0000","last_fullsized":"2023-07-21T07:36:30.280048+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:01:36.571829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548813+0000","last_change":"2023-07-21T07:36:27.542236+0000","last_active":"2023-07-21T07:36:27.548813+0000","last_peered":"2023-07-21T07:36:27.548813+0000","last_clean":"2023-07-21T07:36:27.548813+0000","last_became_active":"2023-07-21T07:36:27.541799+0000","last_became_peered":"2023-07-21T07:36:27.541799+0000","last_unstale":"2023-07-21T07:36:27.548813+0000","last_undegraded":"2023-07-21T07:36:27.548813+0000","last_fullsized":"2023-07-21T07:36:27.548813+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:47:52.464521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726160+0000","last_change":"2023-07-21T07:36:28.555407+0000","last_active":"2023-07-21T07:36:30.726160+0000","last_peered":"2023-07-21T07:36:30.726160+0000","last_clean":"2023-07-21T07:36:30.726160+0000","last_became_active":"2023-07-21T07:36:28.552229+0000","last_became_peered":"2023-07-21T07:36:28.552229+0000","last_unstale":"2023-07-21T07:36:30.726160+0000","last_undegraded":"2023-07-21T07:36:30.726160+0000","last_fullsized":"2023-07-21T07:36:30.726160+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:32:27.039990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"53'6","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543716+0000","last_change":"2023-07-21T07:36:27.546185+0000","last_active":"2023-07-21T07:36:29.543716+0000","last_peered":"2023-07-21T07:36:29.543716+0000","last_clean":"2023-07-21T07:36:29.543716+0000","last_became_active":"2023-07-21T07:36:27.545925+0000","last_became_peered":"2023-07-21T07:36:27.545925+0000","last_unstale":"2023-07-21T07:36:29.543716+0000","last_undegraded":"2023-07-21T07:36:29.543716+0000","last_fullsized":"2023-07-21T07:36:29.543716+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:19:54.238779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725630+0000","last_change":"2023-07-21T07:36:28.549175+0000","last_active":"2023-07-21T07:36:30.725630+0000","last_peered":"2023-07-21T07:36:30.725630+0000","last_clean":"2023-07-21T07:36:30.725630+0000","last_became_active":"2023-07-21T07:36:28.548904+0000","last_became_peered":"2023-07-21T07:36:28.548904+0000","last_unstale":"2023-07-21T07:36:30.725630+0000","last_undegraded":"2023-07-21T07:36:30.725630+0000","last_fullsized":"2023-07-21T07:36:30.725630+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:56:50.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548933+0000","last_change":"2023-07-21T07:36:27.544775+0000","last_active":"2023-07-21T07:36:27.548933+0000","last_peered":"2023-07-21T07:36:27.548933+0000","last_clean":"2023-07-21T07:36:27.548933+0000","last_became_active":"2023-07-21T07:36:27.544495+0000","last_became_peered":"2023-07-21T07:36:27.544495+0000","last_unstale":"2023-07-21T07:36:27.548933+0000","last_undegraded":"2023-07-21T07:36:27.548933+0000","last_fullsized":"2023-07-21T07:36:27.548933+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:33.978793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536456+0000","last_change":"2023-07-21T07:36:27.536456+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536456+0000","last_undegraded":"2023-07-21T07:36:27.536456+0000","last_fullsized":"2023-07-21T07:36:27.536456+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555032+0000","last_change":"2023-07-21T07:36:27.550743+0000","last_active":"2023-07-21T07:36:27.555032+0000","last_peered":"2023-07-21T07:36:27.555032+0000","last_clean":"2023-07-21T07:36:27.555032+0000","last_became_active":"2023-07-21T07:36:27.550521+0000","last_became_peered":"2023-07-21T07:36:27.550521+0000","last_unstale":"2023-07-21T07:36:27.555032+0000","last_undegraded":"2023-07-21T07:36:27.555032+0000","last_fullsized":"2023-07-21T07:36:27.555032+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:52:38.333969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279756+0000","last_change":"2023-07-21T07:36:28.555482+0000","last_active":"2023-07-21T07:36:30.279756+0000","last_peered":"2023-07-21T07:36:30.279756+0000","last_clean":"2023-07-21T07:36:30.279756+0000","last_became_active":"2023-07-21T07:36:28.554468+0000","last_became_peered":"2023-07-21T07:36:28.554468+0000","last_unstale":"2023-07-21T07:36:30.279756+0000","last_undegraded":"2023-07-21T07:36:30.279756+0000","last_fullsized":"2023-07-21T07:36:30.279756+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:02:56.001893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548621+0000","last_change":"2023-07-21T07:36:27.542687+0000","last_active":"2023-07-21T07:36:27.548621+0000","last_peered":"2023-07-21T07:36:27.548621+0000","last_clean":"2023-07-21T07:36:27.548621+0000","last_became_active":"2023-07-21T07:36:27.542483+0000","last_became_peered":"2023-07-21T07:36:27.542483+0000","last_unstale":"2023-07-21T07:36:27.548621+0000","last_undegraded":"2023-07-21T07:36:27.548621+0000","last_fullsized":"2023-07-21T07:36:27.548621+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:19:58.197391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543556+0000","last_change":"2023-07-21T07:36:28.546081+0000","last_active":"2023-07-21T07:36:29.543556+0000","last_peered":"2023-07-21T07:36:29.543556+0000","last_clean":"2023-07-21T07:36:29.543556+0000","last_became_active":"2023-07-21T07:36:28.545781+0000","last_became_peered":"2023-07-21T07:36:28.545781+0000","last_unstale":"2023-07-21T07:36:29.543556+0000","last_undegraded":"2023-07-21T07:36:29.543556+0000","last_fullsized":"2023-07-21T07:36:29.543556+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:25:10.591064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'8","reported_seq":21,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725624+0000","last_change":"2023-07-21T07:36:27.549363+0000","last_active":"2023-07-21T07:36:30.725624+0000","last_peered":"2023-07-21T07:36:30.725624+0000","last_clean":"2023-07-21T07:36:30.725624+0000","last_became_active":"2023-07-21T07:36:27.548945+0000","last_became_peered":"2023-07-21T07:36:27.548945+0000","last_unstale":"2023-07-21T07:36:30.725624+0000","last_undegraded":"2023-07-21T07:36:30.725624+0000","last_fullsized":"2023-07-21T07:36:30.725624+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:15:15.630428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.538385+0000","last_change":"2023-07-21T07:36:27.538385+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.538385+0000","last_undegraded":"2023-07-21T07:36:27.538385+0000","last_fullsized":"2023-07-21T07:36:27.538385+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.554950+0000","last_change":"2023-07-21T07:36:27.550087+0000","last_active":"2023-07-21T07:36:27.554950+0000","last_peered":"2023-07-21T07:36:27.554950+0000","last_clean":"2023-07-21T07:36:27.554950+0000","last_became_active":"2023-07-21T07:36:27.549834+0000","last_became_peered":"2023-07-21T07:36:27.549834+0000","last_unstale":"2023-07-21T07:36:27.554950+0000","last_undegraded":"2023-07-21T07:36:27.554950+0000","last_fullsized":"2023-07-21T07:36:27.554950+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:10:20.902536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726130+0000","last_change":"2023-07-21T07:36:28.554479+0000","last_active":"2023-07-21T07:36:30.726130+0000","last_peered":"2023-07-21T07:36:30.726130+0000","last_clean":"2023-07-21T07:36:30.726130+0000","last_became_active":"2023-07-21T07:36:28.554145+0000","last_became_peered":"2023-07-21T07:36:28.554145+0000","last_unstale":"2023-07-21T07:36:30.726130+0000","last_undegraded":"2023-07-21T07:36:30.726130+0000","last_fullsized":"2023-07-21T07:36:30.726130+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:06:53.576148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548223+0000","last_change":"2023-07-21T07:36:27.545216+0000","last_active":"2023-07-21T07:36:27.548223+0000","last_peered":"2023-07-21T07:36:27.548223+0000","last_clean":"2023-07-21T07:36:27.548223+0000","last_became_active":"2023-07-21T07:36:27.544952+0000","last_became_peered":"2023-07-21T07:36:27.544952+0000","last_unstale":"2023-07-21T07:36:27.548223+0000","last_undegraded":"2023-07-21T07:36:27.548223+0000","last_fullsized":"2023-07-21T07:36:27.548223+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:34:33.116437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537605+0000","last_change":"2023-07-21T07:36:27.537605+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537605+0000","last_undegraded":"2023-07-21T07:36:27.537605+0000","last_fullsized":"2023-07-21T07:36:27.537605+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555037+0000","last_change":"2023-07-21T07:36:27.548955+0000","last_active":"2023-07-21T07:36:27.555037+0000","last_peered":"2023-07-21T07:36:27.555037+0000","last_clean":"2023-07-21T07:36:27.555037+0000","last_became_active":"2023-07-21T07:36:27.548615+0000","last_became_peered":"2023-07-21T07:36:27.548615+0000","last_unstale":"2023-07-21T07:36:27.555037+0000","last_undegraded":"2023-07-21T07:36:27.555037+0000","last_fullsized":"2023-07-21T07:36:27.555037+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:33:11.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280328+0000","last_change":"2023-07-21T07:36:28.553270+0000","last_active":"2023-07-21T07:36:30.280328+0000","last_peered":"2023-07-21T07:36:30.280328+0000","last_clean":"2023-07-21T07:36:30.280328+0000","last_became_active":"2023-07-21T07:36:28.552988+0000","last_became_peered":"2023-07-21T07:36:28.552988+0000","last_unstale":"2023-07-21T07:36:30.280328+0000","last_undegraded":"2023-07-21T07:36:30.280328+0000","last_fullsized":"2023-07-21T07:36:30.280328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:31:25.239166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543615+0000","last_change":"2023-07-21T07:36:27.546128+0000","last_active":"2023-07-21T07:36:29.543615+0000","last_peered":"2023-07-21T07:36:29.543615+0000","last_clean":"2023-07-21T07:36:29.543615+0000","last_became_active":"2023-07-21T07:36:27.545829+0000","last_became_peered":"2023-07-21T07:36:27.545829+0000","last_unstale":"2023-07-21T07:36:29.543615+0000","last_undegraded":"2023-07-21T07:36:29.543615+0000","last_fullsized":"2023-07-21T07:36:29.543615+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:18:16.539928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279643+0000","last_change":"2023-07-21T07:36:28.550679+0000","last_active":"2023-07-21T07:36:30.279643+0000","last_peered":"2023-07-21T07:36:30.279643+0000","last_clean":"2023-07-21T07:36:30.279643+0000","last_became_active":"2023-07-21T07:36:28.550320+0000","last_became_peered":"2023-07-21T07:36:28.550320+0000","last_unstale":"2023-07-21T07:36:30.279643+0000","last_undegraded":"2023-07-21T07:36:30.279643+0000","last_fullsized":"2023-07-21T07:36:30.279643+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:20:36.808964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548821+0000","last_change":"2023-07-21T07:36:27.542890+0000","last_active":"2023-07-21T07:36:27.548821+0000","last_peered":"2023-07-21T07:36:27.548821+0000","last_clean":"2023-07-21T07:36:27.548821+0000","last_became_active":"2023-07-21T07:36:27.542614+0000","last_became_peered":"2023-07-21T07:36:27.542614+0000","last_unstale":"2023-07-21T07:36:27.548821+0000","last_undegraded":"2023-07-21T07:36:27.548821+0000","last_fullsized":"2023-07-21T07:36:27.548821+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:10:25.051264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725745+0000","last_change":"2023-07-21T07:36:28.549203+0000","last_active":"2023-07-21T07:36:30.725745+0000","last_peered":"2023-07-21T07:36:30.725745+0000","last_clean":"2023-07-21T07:36:30.725745+0000","last_became_active":"2023-07-21T07:36:28.548933+0000","last_became_peered":"2023-07-21T07:36:28.548933+0000","last_unstale":"2023-07-21T07:36:30.725745+0000","last_undegraded":"2023-07-21T07:36:30.725745+0000","last_fullsized":"2023-07-21T07:36:30.725745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:24:40.746510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.538565+0000","last_change":"2023-07-21T07:36:27.535134+0000","last_active":"2023-07-21T07:36:27.538565+0000","last_peered":"2023-07-21T07:36:27.538565+0000","last_clean":"2023-07-21T07:36:27.538565+0000","last_became_active":"2023-07-21T07:36:27.534830+0000","last_became_peered":"2023-07-21T07:36:27.534830+0000","last_unstale":"2023-07-21T07:36:27.538565+0000","last_undegraded":"2023-07-21T07:36:27.538565+0000","last_fullsized":"2023-07-21T07:36:27.538565+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:37:06.214318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543559+0000","last_change":"2023-07-21T07:36:28.549213+0000","last_active":"2023-07-21T07:36:29.543559+0000","last_peered":"2023-07-21T07:36:29.543559+0000","last_clean":"2023-07-21T07:36:29.543559+0000","last_became_active":"2023-07-21T07:36:28.548890+0000","last_became_peered":"2023-07-21T07:36:28.548890+0000","last_unstale":"2023-07-21T07:36:29.543559+0000","last_undegraded":"2023-07-21T07:36:29.543559+0000","last_fullsized":"2023-07-21T07:36:29.543559+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:43.391138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.547832+0000","last_change":"2023-07-21T07:36:27.545372+0000","last_active":"2023-07-21T07:36:27.547832+0000","last_peered":"2023-07-21T07:36:27.547832+0000","last_clean":"2023-07-21T07:36:27.547832+0000","last_became_active":"2023-07-21T07:36:27.544933+0000","last_became_peered":"2023-07-21T07:36:27.544933+0000","last_unstale":"2023-07-21T07:36:27.547832+0000","last_undegraded":"2023-07-21T07:36:27.547832+0000","last_fullsized":"2023-07-21T07:36:27.547832+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:59:32.727551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725917+0000","last_change":"2023-07-21T07:36:28.561703+0000","last_active":"2023-07-21T07:36:30.725917+0000","last_peered":"2023-07-21T07:36:30.725917+0000","last_clean":"2023-07-21T07:36:30.725917+0000","last_became_active":"2023-07-21T07:36:28.561400+0000","last_became_peered":"2023-07-21T07:36:28.561400+0000","last_unstale":"2023-07-21T07:36:30.725917+0000","last_undegraded":"2023-07-21T07:36:30.725917+0000","last_fullsized":"2023-07-21T07:36:30.725917+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:21:40.954647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543373+0000","last_change":"2023-07-21T07:36:27.542037+0000","last_active":"2023-07-21T07:36:29.543373+0000","last_peered":"2023-07-21T07:36:29.543373+0000","last_clean":"2023-07-21T07:36:29.543373+0000","last_became_active":"2023-07-21T07:36:27.541783+0000","last_became_peered":"2023-07-21T07:36:27.541783+0000","last_unstale":"2023-07-21T07:36:29.543373+0000","last_undegraded":"2023-07-21T07:36:29.543373+0000","last_fullsized":"2023-07-21T07:36:29.543373+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:47:19.494591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280363+0000","last_change":"2023-07-21T07:36:28.553251+0000","last_active":"2023-07-21T07:36:30.280363+0000","last_peered":"2023-07-21T07:36:30.280363+0000","last_clean":"2023-07-21T07:36:30.280363+0000","last_became_active":"2023-07-21T07:36:28.552971+0000","last_became_peered":"2023-07-21T07:36:28.552971+0000","last_unstale":"2023-07-21T07:36:30.280363+0000","last_undegraded":"2023-07-21T07:36:30.280363+0000","last_fullsized":"2023-07-21T07:36:30.280363+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:17.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549850+0000","last_change":"2023-07-21T07:36:27.548492+0000","last_active":"2023-07-21T07:36:27.549850+0000","last_peered":"2023-07-21T07:36:27.549850+0000","last_clean":"2023-07-21T07:36:27.549850+0000","last_became_active":"2023-07-21T07:36:27.548083+0000","last_became_peered":"2023-07-21T07:36:27.548083+0000","last_unstale":"2023-07-21T07:36:27.549850+0000","last_undegraded":"2023-07-21T07:36:27.549850+0000","last_fullsized":"2023-07-21T07:36:27.549850+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:24:33.846082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280415+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:36:30.280415+0000","last_peered":"2023-07-21T07:36:30.280415+0000","last_clean":"2023-07-21T07:36:30.280415+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:36:30.280415+0000","last_undegraded":"2023-07-21T07:36:30.280415+0000","last_fullsized":"2023-07-21T07:36:30.280415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:18:18.973777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726034+0000","last_change":"2023-07-21T07:36:28.550245+0000","last_active":"2023-07-21T07:36:30.726034+0000","last_peered":"2023-07-21T07:36:30.726034+0000","last_clean":"2023-07-21T07:36:30.726034+0000","last_became_active":"2023-07-21T07:36:28.548746+0000","last_became_peered":"2023-07-21T07:36:28.548746+0000","last_unstale":"2023-07-21T07:36:30.726034+0000","last_undegraded":"2023-07-21T07:36:30.726034+0000","last_fullsized":"2023-07-21T07:36:30.726034+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:17:46.007416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548784+0000","last_change":"2023-07-21T07:36:27.542066+0000","last_active":"2023-07-21T07:36:27.548784+0000","last_peered":"2023-07-21T07:36:27.548784+0000","last_clean":"2023-07-21T07:36:27.548784+0000","last_became_active":"2023-07-21T07:36:27.541789+0000","last_became_peered":"2023-07-21T07:36:27.541789+0000","last_unstale":"2023-07-21T07:36:27.548784+0000","last_undegraded":"2023-07-21T07:36:27.548784+0000","last_fullsized":"2023-07-21T07:36:27.548784+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:14:50.100812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543977+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:36:29.543977+0000","last_peered":"2023-07-21T07:36:29.543977+0000","last_clean":"2023-07-21T07:36:29.543977+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:36:29.543977+0000","last_undegraded":"2023-07-21T07:36:29.543977+0000","last_fullsized":"2023-07-21T07:36:29.543977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:08:25.435210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280017+0000","last_change":"2023-07-21T07:36:28.555257+0000","last_active":"2023-07-21T07:36:30.280017+0000","last_peered":"2023-07-21T07:36:30.280017+0000","last_clean":"2023-07-21T07:36:30.280017+0000","last_became_active":"2023-07-21T07:36:28.554356+0000","last_became_peered":"2023-07-21T07:36:28.554356+0000","last_unstale":"2023-07-21T07:36:30.280017+0000","last_undegraded":"2023-07-21T07:36:30.280017+0000","last_fullsized":"2023-07-21T07:36:30.280017+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:07:09.045197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549594+0000","last_change":"2023-07-21T07:36:27.547064+0000","last_active":"2023-07-21T07:36:27.549594+0000","last_peered":"2023-07-21T07:36:27.549594+0000","last_clean":"2023-07-21T07:36:27.549594+0000","last_became_active":"2023-07-21T07:36:27.546817+0000","last_became_peered":"2023-07-21T07:36:27.546817+0000","last_unstale":"2023-07-21T07:36:27.549594+0000","last_undegraded":"2023-07-21T07:36:27.549594+0000","last_fullsized":"2023-07-21T07:36:27.549594+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:42.034968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.533936+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:36:27.533936+0000","last_peered":"2023-07-21T07:36:27.533936+0000","last_clean":"2023-07-21T07:36:27.533936+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:36:27.533936+0000","last_undegraded":"2023-07-21T07:36:27.533936+0000","last_fullsized":"2023-07-21T07:36:27.533936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:41:59.304488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539343+0000","last_change":"2023-07-21T07:36:27.539343+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539343+0000","last_undegraded":"2023-07-21T07:36:27.539343+0000","last_fullsized":"2023-07-21T07:36:27.539343+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.554956+0000","last_change":"2023-07-21T07:36:27.546993+0000","last_active":"2023-07-21T07:36:27.554956+0000","last_peered":"2023-07-21T07:36:27.554956+0000","last_clean":"2023-07-21T07:36:27.554956+0000","last_became_active":"2023-07-21T07:36:27.546675+0000","last_became_peered":"2023-07-21T07:36:27.546675+0000","last_unstale":"2023-07-21T07:36:27.554956+0000","last_undegraded":"2023-07-21T07:36:27.554956+0000","last_fullsized":"2023-07-21T07:36:27.554956+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:02:43.499920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.533181+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:36:27.533181+0000","last_peered":"2023-07-21T07:36:27.533181+0000","last_clean":"2023-07-21T07:36:27.533181+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:36:27.533181+0000","last_undegraded":"2023-07-21T07:36:27.533181+0000","last_fullsized":"2023-07-21T07:36:27.533181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:09:38.933989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279886+0000","last_change":"2023-07-21T07:36:28.550594+0000","last_active":"2023-07-21T07:36:30.279886+0000","last_peered":"2023-07-21T07:36:30.279886+0000","last_clean":"2023-07-21T07:36:30.279886+0000","last_became_active":"2023-07-21T07:36:28.550307+0000","last_became_peered":"2023-07-21T07:36:28.550307+0000","last_unstale":"2023-07-21T07:36:30.279886+0000","last_undegraded":"2023-07-21T07:36:30.279886+0000","last_fullsized":"2023-07-21T07:36:30.279886+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:36:10.034314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.547633+0000","last_change":"2023-07-21T07:36:27.545082+0000","last_active":"2023-07-21T07:36:27.547633+0000","last_peered":"2023-07-21T07:36:27.547633+0000","last_clean":"2023-07-21T07:36:27.547633+0000","last_became_active":"2023-07-21T07:36:27.544787+0000","last_became_peered":"2023-07-21T07:36:27.544787+0000","last_unstale":"2023-07-21T07:36:27.547633+0000","last_undegraded":"2023-07-21T07:36:27.547633+0000","last_fullsized":"2023-07-21T07:36:27.547633+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:53:21.078423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.533272+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:36:27.533272+0000","last_peered":"2023-07-21T07:36:27.533272+0000","last_clean":"2023-07-21T07:36:27.533272+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:36:27.533272+0000","last_undegraded":"2023-07-21T07:36:27.533272+0000","last_fullsized":"2023-07-21T07:36:27.533272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:45:07.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.545340+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:36:27.545340+0000","last_peered":"2023-07-21T07:36:27.545340+0000","last_clean":"2023-07-21T07:36:27.545340+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:36:27.545340+0000","last_undegraded":"2023-07-21T07:36:27.545340+0000","last_fullsized":"2023-07-21T07:36:27.545340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:45:26.816257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536049+0000","last_change":"2023-07-21T07:36:27.536049+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536049+0000","last_undegraded":"2023-07-21T07:36:27.536049+0000","last_fullsized":"2023-07-21T07:36:27.536049+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555010+0000","last_change":"2023-07-21T07:36:27.550572+0000","last_active":"2023-07-21T07:36:27.555010+0000","last_peered":"2023-07-21T07:36:27.555010+0000","last_clean":"2023-07-21T07:36:27.555010+0000","last_became_active":"2023-07-21T07:36:27.550195+0000","last_became_peered":"2023-07-21T07:36:27.550195+0000","last_unstale":"2023-07-21T07:36:27.555010+0000","last_undegraded":"2023-07-21T07:36:27.555010+0000","last_fullsized":"2023-07-21T07:36:27.555010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:38:40.211173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725668+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:36:30.725668+0000","last_peered":"2023-07-21T07:36:30.725668+0000","last_clean":"2023-07-21T07:36:30.725668+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:36:30.725668+0000","last_undegraded":"2023-07-21T07:36:30.725668+0000","last_fullsized":"2023-07-21T07:36:30.725668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:10:59.819304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279848+0000","last_change":"2023-07-21T07:36:28.552513+0000","last_active":"2023-07-21T07:36:30.279848+0000","last_peered":"2023-07-21T07:36:30.279848+0000","last_clean":"2023-07-21T07:36:30.279848+0000","last_became_active":"2023-07-21T07:36:28.551895+0000","last_became_peered":"2023-07-21T07:36:28.551895+0000","last_unstale":"2023-07-21T07:36:30.279848+0000","last_undegraded":"2023-07-21T07:36:30.279848+0000","last_fullsized":"2023-07-21T07:36:30.279848+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:44:16.702073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549693+0000","last_change":"2023-07-21T07:36:27.544373+0000","last_active":"2023-07-21T07:36:27.549693+0000","last_peered":"2023-07-21T07:36:27.549693+0000","last_clean":"2023-07-21T07:36:27.549693+0000","last_became_active":"2023-07-21T07:36:27.544074+0000","last_became_peered":"2023-07-21T07:36:27.544074+0000","last_unstale":"2023-07-21T07:36:27.549693+0000","last_undegraded":"2023-07-21T07:36:27.549693+0000","last_fullsized":"2023-07-21T07:36:27.549693+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:32:26.034517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.545016+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:36:27.545016+0000","last_peered":"2023-07-21T07:36:27.545016+0000","last_clean":"2023-07-21T07:36:27.545016+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:36:27.545016+0000","last_undegraded":"2023-07-21T07:36:27.545016+0000","last_fullsized":"2023-07-21T07:36:27.545016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:49:35.393074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530834+0000","last_change":"2023-07-21T07:36:27.530834+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530834+0000","last_undegraded":"2023-07-21T07:36:27.530834+0000","last_fullsized":"2023-07-21T07:36:27.530834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.554983+0000","last_change":"2023-07-21T07:36:27.550570+0000","last_active":"2023-07-21T07:36:27.554983+0000","last_peered":"2023-07-21T07:36:27.554983+0000","last_clean":"2023-07-21T07:36:27.554983+0000","last_became_active":"2023-07-21T07:36:27.550296+0000","last_became_peered":"2023-07-21T07:36:27.550296+0000","last_unstale":"2023-07-21T07:36:27.554983+0000","last_undegraded":"2023-07-21T07:36:27.554983+0000","last_fullsized":"2023-07-21T07:36:27.554983+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:26:29.512185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543544+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:36:29.543544+0000","last_peered":"2023-07-21T07:36:29.543544+0000","last_clean":"2023-07-21T07:36:29.543544+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:36:29.543544+0000","last_undegraded":"2023-07-21T07:36:29.543544+0000","last_fullsized":"2023-07-21T07:36:29.543544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:53:43.924057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2146,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":863348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.504}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.624}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.59499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":286795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.4990000000000006,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.4039999999999999,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":675840,"data_stored":289089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34699999999999998,"15min":0.35099999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.502,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.249,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.49399999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.26000000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.34699999999999998,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.44700000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.307},{"interface":"front","average":{"1min":0.433,"5min":0.436,"15min":0.436},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.379}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.57499999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.40600000000000003,"15min":0.41199999999999998},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56299999999999994,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59699999999999998,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89300000000000002,"5min":1.006,"15min":1.006},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73599999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63400000000000001,"15min":0.64600000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80500000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82699999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.64000000000000001,"15min":0.65500000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68600000000000005,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.45800000000000002}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.69099999999999995,"15min":0.70899999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85299999999999998,"5min":1.339,"15min":1.339},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.747,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.503}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":863348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.376}]},{"osd":3,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.35299999999999998}]},{"osd":4,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.751}]},{"osd":5,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":647168,"data_stored":286761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.35399999999999998},"min":{"1min":0.23599999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45900000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34899999999999998,"15min":0.34999999999999998},"min":{"1min":0.249,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.27500000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.29499999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.49199999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34300000000000003}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.51900000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.32800000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60099999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.434,"5min":0.379,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82199999999999995,"5min":1.127,"15min":1.127},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76000000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":1.109,"15min":1.109},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.622,"15min":0.61299999999999999},"min":{"1min":0.501,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88400000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.60299999999999998},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84699999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.67200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":272980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.52300000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.505},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.755},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.80000000000000004}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.83799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":288325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":10.18,"5min":10.18,"15min":10.18},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":10.207000000000001,"5min":10.207000000000001,"15min":10.207000000000001},"last":0.496}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.65300000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.46600000000000003}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.625}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":266360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.499},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.625},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:36:33.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-07-21T07:36:33.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.530833+0000', 'last_change': '2023-07-21T07:36:27.530833+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.530833+0000', 'last_undegraded': '2023-07-21T07:36:27.530833+0000', 'last_fullsized': '2023-07-21T07:36:27.530833+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T07:36:33.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-07-21T07:36:33.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.537868+0000', 'last_change': '2023-07-21T07:36:27.537868+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.537868+0000', 'last_undegraded': '2023-07-21T07:36:27.537868+0000', 'last_fullsized': '2023-07-21T07:36:27.537868+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T07:36:33.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-07-21T07:36:33.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.534948+0000', 'last_change': '2023-07-21T07:36:27.534948+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.534948+0000', 'last_undegraded': '2023-07-21T07:36:27.534948+0000', 'last_fullsized': '2023-07-21T07:36:27.534948+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T07:36:33.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-07-21T07:36:33.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.530880+0000', 'last_change': '2023-07-21T07:36:27.530880+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.530880+0000', 'last_undegraded': '2023-07-21T07:36:27.530880+0000', 'last_fullsized': '2023-07-21T07:36:27.530880+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T07:36:33.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-07-21T07:36:33.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.531351+0000', 'last_change': '2023-07-21T07:36:27.531351+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.531351+0000', 'last_undegraded': '2023-07-21T07:36:27.531351+0000', 'last_fullsized': '2023-07-21T07:36:27.531351+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T07:36:33.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-07-21T07:36:33.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.536842+0000', 'last_change': '2023-07-21T07:36:27.536842+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.536842+0000', 'last_undegraded': '2023-07-21T07:36:27.536842+0000', 'last_fullsized': '2023-07-21T07:36:27.536842+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T07:36:33.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-07-21T07:36:33.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.535086+0000', 'last_change': '2023-07-21T07:36:27.535086+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.535086+0000', 'last_undegraded': '2023-07-21T07:36:27.535086+0000', 'last_fullsized': '2023-07-21T07:36:27.535086+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T07:36:33.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-07-21T07:36:33.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.530811+0000', 'last_change': '2023-07-21T07:36:27.530811+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.530811+0000', 'last_undegraded': '2023-07-21T07:36:27.530811+0000', 'last_fullsized': '2023-07-21T07:36:27.530811+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T07:36:33.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-07-21T07:36:33.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.531253+0000', 'last_change': '2023-07-21T07:36:27.531253+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.531253+0000', 'last_undegraded': '2023-07-21T07:36:27.531253+0000', 'last_fullsized': '2023-07-21T07:36:27.531253+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T07:36:33.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-07-21T07:36:33.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.530276+0000', 'last_change': '2023-07-21T07:36:27.530276+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.530276+0000', 'last_undegraded': '2023-07-21T07:36:27.530276+0000', 'last_fullsized': '2023-07-21T07:36:27.530276+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T07:36:33.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-07-21T07:36:33.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.535514+0000', 'last_change': '2023-07-21T07:36:27.535514+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.535514+0000', 'last_undegraded': '2023-07-21T07:36:27.535514+0000', 'last_fullsized': '2023-07-21T07:36:27.535514+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T07:36:33.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-07-21T07:36:33.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.531165+0000', 'last_change': '2023-07-21T07:36:27.531165+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.531165+0000', 'last_undegraded': '2023-07-21T07:36:27.531165+0000', 'last_fullsized': '2023-07-21T07:36:27.531165+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T07:36:33.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-07-21T07:36:33.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.531582+0000', 'last_change': '2023-07-21T07:36:27.531582+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.531582+0000', 'last_undegraded': '2023-07-21T07:36:27.531582+0000', 'last_fullsized': '2023-07-21T07:36:27.531582+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T07:36:33.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-07-21T07:36:33.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.530906+0000', 'last_change': '2023-07-21T07:36:27.530906+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.530906+0000', 'last_undegraded': '2023-07-21T07:36:27.530906+0000', 'last_fullsized': '2023-07-21T07:36:27.530906+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T07:36:33.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-07-21T07:36:33.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.543217+0000', 'last_change': '2023-07-21T07:36:27.543217+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.543217+0000', 'last_undegraded': '2023-07-21T07:36:27.543217+0000', 'last_fullsized': '2023-07-21T07:36:27.543217+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T07:36:33.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-07-21T07:36:33.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.537966+0000', 'last_change': '2023-07-21T07:36:27.537966+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.537966+0000', 'last_undegraded': '2023-07-21T07:36:27.537966+0000', 'last_fullsized': '2023-07-21T07:36:27.537966+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T07:36:33.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-07-21T07:36:33.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.531198+0000', 'last_change': '2023-07-21T07:36:27.531198+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.531198+0000', 'last_undegraded': '2023-07-21T07:36:27.531198+0000', 'last_fullsized': '2023-07-21T07:36:27.531198+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T07:36:33.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-07-21T07:36:33.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.544479+0000', 'last_change': '2023-07-21T07:36:27.544479+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.544479+0000', 'last_undegraded': '2023-07-21T07:36:27.544479+0000', 'last_fullsized': '2023-07-21T07:36:27.544479+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T07:36:33.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-07-21T07:36:33.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.539842+0000', 'last_change': '2023-07-21T07:36:27.539842+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.539842+0000', 'last_undegraded': '2023-07-21T07:36:27.539842+0000', 'last_fullsized': '2023-07-21T07:36:27.539842+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T07:36:33.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-07-21T07:36:33.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.538725+0000', 'last_change': '2023-07-21T07:36:27.538725+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.538725+0000', 'last_undegraded': '2023-07-21T07:36:27.538725+0000', 'last_fullsized': '2023-07-21T07:36:27.538725+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T07:36:33.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-07-21T07:36:33.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.532491+0000', 'last_change': '2023-07-21T07:36:27.532491+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.532491+0000', 'last_undegraded': '2023-07-21T07:36:27.532491+0000', 'last_fullsized': '2023-07-21T07:36:27.532491+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T07:36:33.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-07-21T07:36:33.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.530783+0000', 'last_change': '2023-07-21T07:36:27.530783+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.530783+0000', 'last_undegraded': '2023-07-21T07:36:27.530783+0000', 'last_fullsized': '2023-07-21T07:36:27.530783+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T07:36:33.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-07-21T07:36:33.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.531809+0000', 'last_change': '2023-07-21T07:36:27.531809+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.531809+0000', 'last_undegraded': '2023-07-21T07:36:27.531809+0000', 'last_fullsized': '2023-07-21T07:36:27.531809+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T07:36:33.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-07-21T07:36:33.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.536456+0000', 'last_change': '2023-07-21T07:36:27.536456+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.536456+0000', 'last_undegraded': '2023-07-21T07:36:27.536456+0000', 'last_fullsized': '2023-07-21T07:36:27.536456+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T07:36:33.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-07-21T07:36:33.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.538385+0000', 'last_change': '2023-07-21T07:36:27.538385+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.538385+0000', 'last_undegraded': '2023-07-21T07:36:27.538385+0000', 'last_fullsized': '2023-07-21T07:36:27.538385+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T07:36:33.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-07-21T07:36:33.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.537605+0000', 'last_change': '2023-07-21T07:36:27.537605+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.537605+0000', 'last_undegraded': '2023-07-21T07:36:27.537605+0000', 'last_fullsized': '2023-07-21T07:36:27.537605+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T07:36:33.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-07-21T07:36:33.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.539343+0000', 'last_change': '2023-07-21T07:36:27.539343+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.539343+0000', 'last_undegraded': '2023-07-21T07:36:27.539343+0000', 'last_fullsized': '2023-07-21T07:36:27.539343+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T07:36:33.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-07-21T07:36:33.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.536049+0000', 'last_change': '2023-07-21T07:36:27.536049+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.536049+0000', 'last_undegraded': '2023-07-21T07:36:27.536049+0000', 'last_fullsized': '2023-07-21T07:36:27.536049+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T07:36:33.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-07-21T07:36:33.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2023-07-21T07:36:27.530834+0000', 'last_change': '2023-07-21T07:36:27.530834+0000', 'last_active': '2023-07-21T07:36:27.521688+0000', 'last_peered': '2023-07-21T07:36:27.521688+0000', 'last_clean': '2023-07-21T07:36:27.521688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T07:36:27.530834+0000', 'last_undegraded': '2023-07-21T07:36:27.530834+0000', 'last_fullsized': '2023-07-21T07:36:27.530834+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'last_clean_scrub_stamp': '2023-07-21T07:36:27.521688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T07:36:33.547 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T07:36:33.567 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-07-21T07:36:33.514+0000 7f232b9c0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T07:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.631+0000 7f7d5a795700 1 Processor -- start 2023-07-21T07:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.631+0000 7f7d5a795700 1 -- start start 2023-07-21T07:36:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.632+0000 7f7d5a795700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7d5414e870 0x7f7d5414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.632+0000 7f7d5a795700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d540c4930 0x7f7d54151330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.632+0000 7f7d5a795700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d540c4ef0 con 0x7f7d540a5f00 2023-07-21T07:36:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.632+0000 7f7d5a795700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d540c1df0 con 0x7f7d540c4930 2023-07-21T07:36:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.632+0000 7f7d5a795700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d540c1450 con 0x7f7d5414e870 2023-07-21T07:36:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.632+0000 7f7d58d32700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d540c4930 0x7f7d54151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.632+0000 7f7d58d32700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d540c4930 0x7f7d54151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36066/0 (socket says 172.21.15.6:36066) 2023-07-21T07:36:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.632+0000 7f7d58d32700 1 -- 172.21.15.6:0/2867880261 learned_addr learned my addr 172.21.15.6:0/2867880261 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.632+0000 7f7d53fff700 1 --2- 172.21.15.6:0/2867880261 >> v2:172.21.15.86:3300/0 conn(0x7f7d5414e870 0x7f7d5414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.632+0000 7f7d58d32700 1 -- 172.21.15.6:0/2867880261 >> v2:172.21.15.86:3300/0 conn(0x7f7d5414e870 msgr2=0x7f7d5414ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.632+0000 7f7d58d32700 1 --2- 172.21.15.6:0/2867880261 >> v2:172.21.15.86:3300/0 conn(0x7f7d5414e870 0x7f7d5414ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.632+0000 7f7d58d32700 1 -- 172.21.15.6:0/2867880261 >> v1:172.21.15.86:6789/0 conn(0x7f7d540a5f00 legacy=0x7f7d540c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.632+0000 7f7d58d32700 1 -- 172.21.15.6:0/2867880261 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d540c1730 con 0x7f7d540c4930 2023-07-21T07:36:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.633+0000 7f7d58d32700 1 --2- 172.21.15.6:0/2867880261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d540c4930 0x7f7d54151330 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7d540c3410 tx=0x7f7d4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56262135ea059a93 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:33.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.633+0000 7f7d52ffd700 1 -- 172.21.15.6:0/2867880261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c00e070 con 0x7f7d540c4930 2023-07-21T07:36:33.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.633+0000 7f7d52ffd700 1 -- 172.21.15.6:0/2867880261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c003a20 con 0x7f7d540c4930 2023-07-21T07:36:33.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.633+0000 7f7d52ffd700 1 -- 172.21.15.6:0/2867880261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c003dd0 con 0x7f7d540c4930 2023-07-21T07:36:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.633+0000 7f7d5a795700 1 -- 172.21.15.6:0/2867880261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d540c4930 msgr2=0x7f7d54151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.633+0000 7f7d5a795700 1 --2- 172.21.15.6:0/2867880261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d540c4930 0x7f7d54151330 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7d540c3410 tx=0x7f7d4c00b330 comp rx=0 tx=0).stop 2023-07-21T07:36:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.633+0000 7f7d5a795700 1 -- 172.21.15.6:0/2867880261 shutdown_connections 2023-07-21T07:36:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.633+0000 7f7d5a795700 1 --2- 172.21.15.6:0/2867880261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d540c4930 0x7f7d54151330 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.633+0000 7f7d5a795700 1 --2- 172.21.15.6:0/2867880261 >> v2:172.21.15.86:3300/0 conn(0x7f7d5414e870 0x7f7d5414ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.633+0000 7f7d5a795700 1 -- 172.21.15.6:0/2867880261 >> 172.21.15.6:0/2867880261 conn(0x7f7d540a8660 msgr2=0x7f7d540a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.633+0000 7f7d5a795700 1 -- 172.21.15.6:0/2867880261 shutdown_connections 2023-07-21T07:36:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.633+0000 7f7d5a795700 1 -- 172.21.15.6:0/2867880261 wait complete. 2023-07-21T07:36:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.634+0000 7f7d5a795700 1 Processor -- start 2023-07-21T07:36:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.635+0000 7f7d5a795700 1 -- start start 2023-07-21T07:36:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.635+0000 7f7d5a795700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d540a5f00 0x7f7d5414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.635+0000 7f7d5a795700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d540c4930 0x7f7d5414a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.635+0000 7f7d5a795700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d5414e870 0x7f7d541e9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.635+0000 7f7d5a795700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d54150b70 con 0x7f7d540a5f00 2023-07-21T07:36:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.635+0000 7f7d5a795700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5414b820 con 0x7f7d540c4930 2023-07-21T07:36:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.635+0000 7f7d5a795700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5414ac60 con 0x7f7d5414e870 2023-07-21T07:36:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.635+0000 7f7d53fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d540a5f00 0x7f7d5414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d53fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d540a5f00 0x7f7d5414b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36068/0 (socket says 172.21.15.6:36068) 2023-07-21T07:36:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d53fff700 1 -- 172.21.15.6:0/779246698 learned_addr learned my addr 172.21.15.6:0/779246698 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d537fe700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d540c4930 0x7f7d5414a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d58d32700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d5414e870 0x7f7d541e9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d53fff700 1 -- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d5414e870 msgr2=0x7f7d541e9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d53fff700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d5414e870 0x7f7d541e9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d53fff700 1 -- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d540c4930 msgr2=0x7f7d5414a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d53fff700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d540c4930 0x7f7d5414a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d53fff700 1 -- 172.21.15.6:0/779246698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c009b30 con 0x7f7d540a5f00 2023-07-21T07:36:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d53fff700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d540a5f00 0x7f7d5414b2e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400c7f0 tx=0x7f7d4400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d50ff9700 1 -- 172.21.15.6:0/779246698 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44011800 con 0x7f7d540a5f00 2023-07-21T07:36:33.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d50ff9700 1 -- 172.21.15.6:0/779246698 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d44011960 con 0x7f7d540a5f00 2023-07-21T07:36:33.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d5a795700 1 -- 172.21.15.6:0/779246698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d541ea580 con 0x7f7d540a5f00 2023-07-21T07:36:33.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d50ff9700 1 -- 172.21.15.6:0/779246698 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44011cf0 con 0x7f7d540a5f00 2023-07-21T07:36:33.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.636+0000 7f7d5a795700 1 -- 172.21.15.6:0/779246698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d541510f0 con 0x7f7d540a5f00 2023-07-21T07:36:33.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.637+0000 7f7d5a795700 1 -- 172.21.15.6:0/779246698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5414a570 con 0x7f7d540a5f00 2023-07-21T07:36:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.638+0000 7f7d50ff9700 1 -- 172.21.15.6:0/779246698 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7d44018360 con 0x7f7d540a5f00 2023-07-21T07:36:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.638+0000 7f7d50ff9700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7d3406ace0 0x7f7d3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.638+0000 7f7d50ff9700 1 -- 172.21.15.6:0/779246698 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d44089500 con 0x7f7d540a5f00 2023-07-21T07:36:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.638+0000 7f7d537fe700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7d3406ace0 0x7f7d3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.639+0000 7f7d537fe700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7d3406ace0 0x7f7d3406d1a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7d5414cb80 tx=0x7f7d3c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.643+0000 7f7d50ff9700 1 -- 172.21.15.6:0/779246698 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7d44058050 con 0x7f7d540a5f00 2023-07-21T07:36:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.923+0000 7f7d5a795700 1 -- 172.21.15.6:0/779246698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7d54074500 con 0x7f7d540a5f00 2023-07-21T07:36:33.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.923+0000 7f7d50ff9700 1 -- 172.21.15.6:0/779246698 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1517 (secure 0 0 0) 0x7f7d44057be0 con 0x7f7d540a5f00 2023-07-21T07:36:33.977 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:33.978 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":138,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1689924866,"num_in_osds":8,"osd_in_since":1689924857,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":76},{"state_name":"creating+peering","count":29}],"num_pgs":105,"num_pools":4,"num_objects":12,"data_bytes":592514,"bytes_used":227676160,"bytes_avail":772866437120,"bytes_total":773094113280,"inactive_pgs_ratio":0.27619048953056335,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":33,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5871}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-07-21T07:36:08.715233+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-21T07:36:33.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.925+0000 7f7d5a795700 1 -- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7d3406ace0 msgr2=0x7f7d3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:33.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.925+0000 7f7d5a795700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7d3406ace0 0x7f7d3406d1a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7d5414cb80 tx=0x7f7d3c008040 comp rx=0 tx=0).stop 2023-07-21T07:36:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.925+0000 7f7d5a795700 1 -- 172.21.15.6:0/779246698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d540a5f00 msgr2=0x7f7d5414b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.925+0000 7f7d5a795700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d540a5f00 0x7f7d5414b2e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400c7f0 tx=0x7f7d4400cbb0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.925+0000 7f7d5a795700 1 -- 172.21.15.6:0/779246698 shutdown_connections 2023-07-21T07:36:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.925+0000 7f7d5a795700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7d3406ace0 0x7f7d3406d1a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.925+0000 7f7d5a795700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d5414e870 0x7f7d541e9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.925+0000 7f7d5a795700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d540a5f00 0x7f7d5414b2e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.925+0000 7f7d5a795700 1 --2- 172.21.15.6:0/779246698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d540c4930 0x7f7d5414a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.925+0000 7f7d5a795700 1 -- 172.21.15.6:0/779246698 >> 172.21.15.6:0/779246698 conn(0x7f7d540a8660 msgr2=0x7f7d540c3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.925+0000 7f7d5a795700 1 -- 172.21.15.6:0/779246698 shutdown_connections 2023-07-21T07:36:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:33.925+0000 7f7d5a795700 1 -- 172.21.15.6:0/779246698 wait complete. 2023-07-21T07:36:33.991 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T07:36:33.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:36:34.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.102+0000 7fc04febf700 1 Processor -- start 2023-07-21T07:36:34.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.103+0000 7fc04febf700 1 -- start start 2023-07-21T07:36:34.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.103+0000 7fc04febf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0480c3750 0x7fc0480c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:34.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.103+0000 7fc04febf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc04814ed60 0x7fc048154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.103+0000 7fc04febf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0480ba440 con 0x7fc0480c6170 2023-07-21T07:36:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.103+0000 7fc04febf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0480c15d0 con 0x7fc04814ed60 2023-07-21T07:36:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.103+0000 7fc04febf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0480c18b0 con 0x7fc0480c3750 2023-07-21T07:36:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04d45a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc0480c6170 0x7fc04814e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44096/0 (socket says 172.21.15.6:44096) 2023-07-21T07:36:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04d45a700 1 -- 172.21.15.6:0/456132409 learned_addr learned my addr 172.21.15.6:0/456132409 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04e45c700 1 --2- 172.21.15.6:0/456132409 >> v2:172.21.15.86:3300/0 conn(0x7fc04814ed60 0x7fc048154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04dc5b700 1 --2- 172.21.15.6:0/456132409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0480c3750 0x7fc0480c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04cc59700 1 -- 172.21.15.6:0/456132409 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184570574 0 0) 0x7fc0480ba440 con 0x7fc0480c6170 2023-07-21T07:36:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04cc59700 1 -- 172.21.15.6:0/456132409 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0340035b0 con 0x7fc0480c6170 2023-07-21T07:36:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04cc59700 1 -- 172.21.15.6:0/456132409 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3186504914 0 0) 0x7fc0340035b0 con 0x7fc0480c6170 2023-07-21T07:36:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04dc5b700 1 -- 172.21.15.6:0/456132409 >> v2:172.21.15.86:3300/0 conn(0x7fc04814ed60 msgr2=0x7fc048154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04dc5b700 1 --2- 172.21.15.6:0/456132409 >> v2:172.21.15.86:3300/0 conn(0x7fc04814ed60 0x7fc048154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04dc5b700 1 -- 172.21.15.6:0/456132409 >> v1:172.21.15.6:6789/0 conn(0x7fc0480c6170 legacy=0x7fc04814e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04dc5b700 1 -- 172.21.15.6:0/456132409 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0480c1b90 con 0x7fc0480c3750 2023-07-21T07:36:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04e45c700 1 --2- 172.21.15.6:0/456132409 >> v2:172.21.15.86:3300/0 conn(0x7fc04814ed60 0x7fc048154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04dc5b700 1 --2- 172.21.15.6:0/456132409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0480c3750 0x7fc0480c53e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc044009840 tx=0x7fc044009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5235b78f4076d8e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.104+0000 7fc04cc59700 1 -- 172.21.15.6:0/456132409 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038001670 con 0x7fc0480c3750 2023-07-21T07:36:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.105+0000 7fc04cc59700 1 -- 172.21.15.6:0/456132409 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc044004030 con 0x7fc0480c3750 2023-07-21T07:36:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.105+0000 7fc04cc59700 1 -- 172.21.15.6:0/456132409 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0440043c0 con 0x7fc0480c3750 2023-07-21T07:36:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.105+0000 7fc04febf700 1 -- 172.21.15.6:0/456132409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0480c3750 msgr2=0x7fc0480c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.105+0000 7fc04febf700 1 --2- 172.21.15.6:0/456132409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0480c3750 0x7fc0480c53e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc044009840 tx=0x7fc044009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.105+0000 7fc04febf700 1 -- 172.21.15.6:0/456132409 shutdown_connections 2023-07-21T07:36:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.105+0000 7fc04febf700 1 --2- 172.21.15.6:0/456132409 >> v2:172.21.15.86:3300/0 conn(0x7fc04814ed60 0x7fc048154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.105+0000 7fc04febf700 1 --2- 172.21.15.6:0/456132409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0480c3750 0x7fc0480c53e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.105+0000 7fc04febf700 1 -- 172.21.15.6:0/456132409 >> 172.21.15.6:0/456132409 conn(0x7fc0480a8c90 msgr2=0x7fc04806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:34.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.105+0000 7fc04febf700 1 -- 172.21.15.6:0/456132409 shutdown_connections 2023-07-21T07:36:34.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.105+0000 7fc04febf700 1 -- 172.21.15.6:0/456132409 wait complete. 2023-07-21T07:36:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.106+0000 7fc04febf700 1 Processor -- start 2023-07-21T07:36:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.106+0000 7fc04febf700 1 -- start start 2023-07-21T07:36:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04febf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0480c3750 0x7fc0480c0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04febf700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0480c6170 0x7fc0480c0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04febf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc04814ed60 0x7fc04814f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04febf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0480be5b0 con 0x7fc0480c3750 2023-07-21T07:36:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04febf700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc048151270 con 0x7fc0480c6170 2023-07-21T07:36:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04febf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0480be800 con 0x7fc04814ed60 2023-07-21T07:36:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04dc5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0480c3750 0x7fc0480c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04dc5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0480c3750 0x7fc0480c0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36082/0 (socket says 172.21.15.6:36082) 2023-07-21T07:36:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04dc5b700 1 -- 172.21.15.6:0/665695141 learned_addr learned my addr 172.21.15.6:0/665695141 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04dc5b700 1 -- 172.21.15.6:0/665695141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc04814ed60 msgr2=0x7fc04814f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:34.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04d45a700 1 --2- 172.21.15.6:0/665695141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0480c6170 0x7fc0480c0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:34.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04dc5b700 1 --2- 172.21.15.6:0/665695141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc04814ed60 0x7fc04814f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:34.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04dc5b700 1 -- 172.21.15.6:0/665695141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0480c6170 msgr2=0x7fc0480c0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:34.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04dc5b700 1 --2- 172.21.15.6:0/665695141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0480c6170 0x7fc0480c0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:34.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.107+0000 7fc04dc5b700 1 -- 172.21.15.6:0/665695141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc040009a70 con 0x7fc0480c3750 2023-07-21T07:36:34.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.108+0000 7fc04dc5b700 1 --2- 172.21.15.6:0/665695141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0480c3750 0x7fc0480c0150 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc0440090b0 tx=0x7fc044004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:34.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.108+0000 7fc03e7fc700 1 -- 172.21.15.6:0/665695141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044003e20 con 0x7fc0480c3750 2023-07-21T07:36:34.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.108+0000 7fc03e7fc700 1 -- 172.21.15.6:0/665695141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04401f070 con 0x7fc0480c3750 2023-07-21T07:36:34.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.108+0000 7fc03e7fc700 1 -- 172.21.15.6:0/665695141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044011870 con 0x7fc0480c3750 2023-07-21T07:36:34.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.108+0000 7fc04febf700 1 -- 172.21.15.6:0/665695141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0440094a0 con 0x7fc0480c3750 2023-07-21T07:36:34.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.108+0000 7fc04febf700 1 -- 172.21.15.6:0/665695141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc048150f00 con 0x7fc0480c3750 2023-07-21T07:36:34.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.109+0000 7fc04febf700 1 -- 172.21.15.6:0/665695141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04814f4d0 con 0x7fc0480c3750 2023-07-21T07:36:34.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.109+0000 7fc03e7fc700 1 -- 172.21.15.6:0/665695141 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc0440119d0 con 0x7fc0480c3750 2023-07-21T07:36:34.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.109+0000 7fc03e7fc700 1 --2- 172.21.15.6:0/665695141 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc02c06ad10 0x7fc02c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:34.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.110+0000 7fc03e7fc700 1 -- 172.21.15.6:0/665695141 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc044021070 con 0x7fc0480c3750 2023-07-21T07:36:34.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.110+0000 7fc04d45a700 1 --2- 172.21.15.6:0/665695141 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc02c06ad10 0x7fc02c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:34.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.110+0000 7fc04d45a700 1 --2- 172.21.15.6:0/665695141 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc02c06ad10 0x7fc02c06d1d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc0380011e0 tx=0x7fc038009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:34.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.114+0000 7fc03e7fc700 1 -- 172.21.15.6:0/665695141 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc044055e60 con 0x7fc0480c3750 2023-07-21T07:36:34.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.306+0000 7fc04febf700 1 -- 172.21.15.6:0/665695141 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0480c1e70 con 0x7fc02c06ad10 2023-07-21T07:36:34.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.315+0000 7fc03e7fc700 1 -- 172.21.15.6:0/665695141 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308904 (secure 0 0 0) 0x7fc038007df0 con 0x7fc02c06ad10 2023-07-21T07:36:34.372 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.318+0000 7fc04febf700 1 -- 172.21.15.6:0/665695141 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc02c06ad10 msgr2=0x7fc02c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.318+0000 7fc04febf700 1 --2- 172.21.15.6:0/665695141 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc02c06ad10 0x7fc02c06d1d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc0380011e0 tx=0x7fc038009040 comp rx=0 tx=0).stop 2023-07-21T07:36:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.318+0000 7fc04febf700 1 -- 172.21.15.6:0/665695141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0480c3750 msgr2=0x7fc0480c0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.318+0000 7fc04febf700 1 --2- 172.21.15.6:0/665695141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0480c3750 0x7fc0480c0150 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc0440090b0 tx=0x7fc044004750 comp rx=0 tx=0).stop 2023-07-21T07:36:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.318+0000 7fc04febf700 1 -- 172.21.15.6:0/665695141 shutdown_connections 2023-07-21T07:36:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.318+0000 7fc04febf700 1 --2- 172.21.15.6:0/665695141 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc02c06ad10 0x7fc02c06d1d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.318+0000 7fc04febf700 1 --2- 172.21.15.6:0/665695141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc04814ed60 0x7fc04814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.318+0000 7fc04febf700 1 --2- 172.21.15.6:0/665695141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0480c3750 0x7fc0480c0150 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.318+0000 7fc04febf700 1 --2- 172.21.15.6:0/665695141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0480c6170 0x7fc0480c0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.318+0000 7fc04febf700 1 -- 172.21.15.6:0/665695141 >> 172.21.15.6:0/665695141 conn(0x7fc0480a8c90 msgr2=0x7fc0480c48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.319+0000 7fc04febf700 1 -- 172.21.15.6:0/665695141 shutdown_connections 2023-07-21T07:36:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:34.319+0000 7fc04febf700 1 -- 172.21.15.6:0/665695141 wait complete. 2023-07-21T07:36:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:36:34.384 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-07-21T07:36:32.720377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592514,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222340,"kb_used_data":6152,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754752380,"statfs":{"total":773094113280,"available":772866437120,"internally_reserved":0,"allocated":6299648,"data_stored":3417006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2146,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001395"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543939+0000","last_change":"2023-07-21T07:36:28.546426+0000","last_active":"2023-07-21T07:36:29.543939+0000","last_peered":"2023-07-21T07:36:29.543939+0000","last_clean":"2023-07-21T07:36:29.543939+0000","last_became_active":"2023-07-21T07:36:28.546106+0000","last_became_peered":"2023-07-21T07:36:28.546106+0000","last_unstale":"2023-07-21T07:36:29.543939+0000","last_undegraded":"2023-07-21T07:36:29.543939+0000","last_fullsized":"2023-07-21T07:36:29.543939+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:15:19.595560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543870+0000","last_change":"2023-07-21T07:36:28.553546+0000","last_active":"2023-07-21T07:36:29.543870+0000","last_peered":"2023-07-21T07:36:29.543870+0000","last_clean":"2023-07-21T07:36:29.543870+0000","last_became_active":"2023-07-21T07:36:28.553260+0000","last_became_peered":"2023-07-21T07:36:28.553260+0000","last_unstale":"2023-07-21T07:36:29.543870+0000","last_undegraded":"2023-07-21T07:36:29.543870+0000","last_fullsized":"2023-07-21T07:36:29.543870+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:43:50.621919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530833+0000","last_change":"2023-07-21T07:36:27.530833+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530833+0000","last_undegraded":"2023-07-21T07:36:27.530833+0000","last_fullsized":"2023-07-21T07:36:27.530833+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725959+0000","last_change":"2023-07-21T07:36:28.553233+0000","last_active":"2023-07-21T07:36:30.725959+0000","last_peered":"2023-07-21T07:36:30.725959+0000","last_clean":"2023-07-21T07:36:30.725959+0000","last_became_active":"2023-07-21T07:36:28.552984+0000","last_became_peered":"2023-07-21T07:36:28.552984+0000","last_unstale":"2023-07-21T07:36:30.725959+0000","last_undegraded":"2023-07-21T07:36:30.725959+0000","last_fullsized":"2023-07-21T07:36:30.725959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:23:03.303111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279802+0000","last_change":"2023-07-21T07:36:28.555196+0000","last_active":"2023-07-21T07:36:30.279802+0000","last_peered":"2023-07-21T07:36:30.279802+0000","last_clean":"2023-07-21T07:36:30.279802+0000","last_became_active":"2023-07-21T07:36:28.554805+0000","last_became_peered":"2023-07-21T07:36:28.554805+0000","last_unstale":"2023-07-21T07:36:30.279802+0000","last_undegraded":"2023-07-21T07:36:30.279802+0000","last_fullsized":"2023-07-21T07:36:30.279802+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:14:30.726435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537868+0000","last_change":"2023-07-21T07:36:27.537868+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537868+0000","last_undegraded":"2023-07-21T07:36:27.537868+0000","last_fullsized":"2023-07-21T07:36:27.537868+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725610+0000","last_change":"2023-07-21T07:36:28.557367+0000","last_active":"2023-07-21T07:36:30.725610+0000","last_peered":"2023-07-21T07:36:30.725610+0000","last_clean":"2023-07-21T07:36:30.725610+0000","last_became_active":"2023-07-21T07:36:28.557060+0000","last_became_peered":"2023-07-21T07:36:28.557060+0000","last_unstale":"2023-07-21T07:36:30.725610+0000","last_undegraded":"2023-07-21T07:36:30.725610+0000","last_fullsized":"2023-07-21T07:36:30.725610+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:11:41.810201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.534948+0000","last_change":"2023-07-21T07:36:27.534948+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.534948+0000","last_undegraded":"2023-07-21T07:36:27.534948+0000","last_fullsized":"2023-07-21T07:36:27.534948+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530880+0000","last_change":"2023-07-21T07:36:27.530880+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530880+0000","last_undegraded":"2023-07-21T07:36:27.530880+0000","last_fullsized":"2023-07-21T07:36:27.530880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531351+0000","last_change":"2023-07-21T07:36:27.531351+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531351+0000","last_undegraded":"2023-07-21T07:36:27.531351+0000","last_fullsized":"2023-07-21T07:36:27.531351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725998+0000","last_change":"2023-07-21T07:36:28.550836+0000","last_active":"2023-07-21T07:36:30.725998+0000","last_peered":"2023-07-21T07:36:30.725998+0000","last_clean":"2023-07-21T07:36:30.725998+0000","last_became_active":"2023-07-21T07:36:28.550559+0000","last_became_peered":"2023-07-21T07:36:28.550559+0000","last_unstale":"2023-07-21T07:36:30.725998+0000","last_undegraded":"2023-07-21T07:36:30.725998+0000","last_fullsized":"2023-07-21T07:36:30.725998+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:04:12.046194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536842+0000","last_change":"2023-07-21T07:36:27.536842+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536842+0000","last_undegraded":"2023-07-21T07:36:27.536842+0000","last_fullsized":"2023-07-21T07:36:27.536842+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.535086+0000","last_change":"2023-07-21T07:36:27.535086+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.535086+0000","last_undegraded":"2023-07-21T07:36:27.535086+0000","last_fullsized":"2023-07-21T07:36:27.535086+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530811+0000","last_change":"2023-07-21T07:36:27.530811+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530811+0000","last_undegraded":"2023-07-21T07:36:27.530811+0000","last_fullsized":"2023-07-21T07:36:27.530811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531253+0000","last_change":"2023-07-21T07:36:27.531253+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531253+0000","last_undegraded":"2023-07-21T07:36:27.531253+0000","last_fullsized":"2023-07-21T07:36:27.531253+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725979+0000","last_change":"2023-07-21T07:36:28.561905+0000","last_active":"2023-07-21T07:36:30.725979+0000","last_peered":"2023-07-21T07:36:30.725979+0000","last_clean":"2023-07-21T07:36:30.725979+0000","last_became_active":"2023-07-21T07:36:28.561351+0000","last_became_peered":"2023-07-21T07:36:28.561351+0000","last_unstale":"2023-07-21T07:36:30.725979+0000","last_undegraded":"2023-07-21T07:36:30.725979+0000","last_fullsized":"2023-07-21T07:36:30.725979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:29:49.803144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.544010+0000","last_change":"2023-07-21T07:36:28.550124+0000","last_active":"2023-07-21T07:36:29.544010+0000","last_peered":"2023-07-21T07:36:29.544010+0000","last_clean":"2023-07-21T07:36:29.544010+0000","last_became_active":"2023-07-21T07:36:28.549862+0000","last_became_peered":"2023-07-21T07:36:28.549862+0000","last_unstale":"2023-07-21T07:36:29.544010+0000","last_undegraded":"2023-07-21T07:36:29.544010+0000","last_fullsized":"2023-07-21T07:36:29.544010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:16.457168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726109+0000","last_change":"2023-07-21T07:36:28.552922+0000","last_active":"2023-07-21T07:36:30.726109+0000","last_peered":"2023-07-21T07:36:30.726109+0000","last_clean":"2023-07-21T07:36:30.726109+0000","last_became_active":"2023-07-21T07:36:28.552646+0000","last_became_peered":"2023-07-21T07:36:28.552646+0000","last_unstale":"2023-07-21T07:36:30.726109+0000","last_undegraded":"2023-07-21T07:36:30.726109+0000","last_fullsized":"2023-07-21T07:36:30.726109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:02:44.505392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279950+0000","last_change":"2023-07-21T07:36:28.554910+0000","last_active":"2023-07-21T07:36:30.279950+0000","last_peered":"2023-07-21T07:36:30.279950+0000","last_clean":"2023-07-21T07:36:30.279950+0000","last_became_active":"2023-07-21T07:36:28.554628+0000","last_became_peered":"2023-07-21T07:36:28.554628+0000","last_unstale":"2023-07-21T07:36:30.279950+0000","last_undegraded":"2023-07-21T07:36:30.279950+0000","last_fullsized":"2023-07-21T07:36:30.279950+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:24:34.043625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530276+0000","last_change":"2023-07-21T07:36:27.530276+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530276+0000","last_undegraded":"2023-07-21T07:36:27.530276+0000","last_fullsized":"2023-07-21T07:36:27.530276+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.535514+0000","last_change":"2023-07-21T07:36:27.535514+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.535514+0000","last_undegraded":"2023-07-21T07:36:27.535514+0000","last_fullsized":"2023-07-21T07:36:27.535514+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531165+0000","last_change":"2023-07-21T07:36:27.531165+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531165+0000","last_undegraded":"2023-07-21T07:36:27.531165+0000","last_fullsized":"2023-07-21T07:36:27.531165+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531582+0000","last_change":"2023-07-21T07:36:27.531582+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531582+0000","last_undegraded":"2023-07-21T07:36:27.531582+0000","last_fullsized":"2023-07-21T07:36:27.531582+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530906+0000","last_change":"2023-07-21T07:36:27.530906+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530906+0000","last_undegraded":"2023-07-21T07:36:27.530906+0000","last_fullsized":"2023-07-21T07:36:27.530906+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.543217+0000","last_change":"2023-07-21T07:36:27.543217+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.543217+0000","last_undegraded":"2023-07-21T07:36:27.543217+0000","last_fullsized":"2023-07-21T07:36:27.543217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537966+0000","last_change":"2023-07-21T07:36:27.537966+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537966+0000","last_undegraded":"2023-07-21T07:36:27.537966+0000","last_fullsized":"2023-07-21T07:36:27.537966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725998+0000","last_change":"2023-07-21T07:36:28.554107+0000","last_active":"2023-07-21T07:36:30.725998+0000","last_peered":"2023-07-21T07:36:30.725998+0000","last_clean":"2023-07-21T07:36:30.725998+0000","last_became_active":"2023-07-21T07:36:28.553824+0000","last_became_peered":"2023-07-21T07:36:28.553824+0000","last_unstale":"2023-07-21T07:36:30.725998+0000","last_undegraded":"2023-07-21T07:36:30.725998+0000","last_fullsized":"2023-07-21T07:36:30.725998+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:35:20.960610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543780+0000","last_change":"2023-07-21T07:36:28.544714+0000","last_active":"2023-07-21T07:36:29.543780+0000","last_peered":"2023-07-21T07:36:29.543780+0000","last_clean":"2023-07-21T07:36:29.543780+0000","last_became_active":"2023-07-21T07:36:28.544330+0000","last_became_peered":"2023-07-21T07:36:28.544330+0000","last_unstale":"2023-07-21T07:36:29.543780+0000","last_undegraded":"2023-07-21T07:36:29.543780+0000","last_fullsized":"2023-07-21T07:36:29.543780+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:36.869529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531198+0000","last_change":"2023-07-21T07:36:27.531198+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531198+0000","last_undegraded":"2023-07-21T07:36:27.531198+0000","last_fullsized":"2023-07-21T07:36:27.531198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.544479+0000","last_change":"2023-07-21T07:36:27.544479+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.544479+0000","last_undegraded":"2023-07-21T07:36:27.544479+0000","last_fullsized":"2023-07-21T07:36:27.544479+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725688+0000","last_change":"2023-07-21T07:36:28.553711+0000","last_active":"2023-07-21T07:36:30.725688+0000","last_peered":"2023-07-21T07:36:30.725688+0000","last_clean":"2023-07-21T07:36:30.725688+0000","last_became_active":"2023-07-21T07:36:28.553426+0000","last_became_peered":"2023-07-21T07:36:28.553426+0000","last_unstale":"2023-07-21T07:36:30.725688+0000","last_undegraded":"2023-07-21T07:36:30.725688+0000","last_fullsized":"2023-07-21T07:36:30.725688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:24:34.851555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539842+0000","last_change":"2023-07-21T07:36:27.539842+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539842+0000","last_undegraded":"2023-07-21T07:36:27.539842+0000","last_fullsized":"2023-07-21T07:36:27.539842+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280185+0000","last_change":"2023-07-21T07:36:28.554012+0000","last_active":"2023-07-21T07:36:30.280185+0000","last_peered":"2023-07-21T07:36:30.280185+0000","last_clean":"2023-07-21T07:36:30.280185+0000","last_became_active":"2023-07-21T07:36:28.553737+0000","last_became_peered":"2023-07-21T07:36:28.553737+0000","last_unstale":"2023-07-21T07:36:30.280185+0000","last_undegraded":"2023-07-21T07:36:30.280185+0000","last_fullsized":"2023-07-21T07:36:30.280185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:36:21.975321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"53'4","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.544028+0000","last_change":"2023-07-21T07:36:27.542913+0000","last_active":"2023-07-21T07:36:29.544028+0000","last_peered":"2023-07-21T07:36:29.544028+0000","last_clean":"2023-07-21T07:36:29.544028+0000","last_became_active":"2023-07-21T07:36:27.542352+0000","last_became_peered":"2023-07-21T07:36:27.542352+0000","last_unstale":"2023-07-21T07:36:29.544028+0000","last_undegraded":"2023-07-21T07:36:29.544028+0000","last_fullsized":"2023-07-21T07:36:29.544028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:58:50.271243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726159+0000","last_change":"2023-07-21T07:36:28.549909+0000","last_active":"2023-07-21T07:36:30.726159+0000","last_peered":"2023-07-21T07:36:30.726159+0000","last_clean":"2023-07-21T07:36:30.726159+0000","last_became_active":"2023-07-21T07:36:28.549643+0000","last_became_peered":"2023-07-21T07:36:28.549643+0000","last_unstale":"2023-07-21T07:36:30.726159+0000","last_undegraded":"2023-07-21T07:36:30.726159+0000","last_fullsized":"2023-07-21T07:36:30.726159+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:16.589451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549685+0000","last_change":"2023-07-21T07:36:27.544173+0000","last_active":"2023-07-21T07:36:27.549685+0000","last_peered":"2023-07-21T07:36:27.549685+0000","last_clean":"2023-07-21T07:36:27.549685+0000","last_became_active":"2023-07-21T07:36:27.543806+0000","last_became_peered":"2023-07-21T07:36:27.543806+0000","last_unstale":"2023-07-21T07:36:27.549685+0000","last_undegraded":"2023-07-21T07:36:27.549685+0000","last_fullsized":"2023-07-21T07:36:27.549685+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:29:12.899796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.538725+0000","last_change":"2023-07-21T07:36:27.538725+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.538725+0000","last_undegraded":"2023-07-21T07:36:27.538725+0000","last_fullsized":"2023-07-21T07:36:27.538725+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555018+0000","last_change":"2023-07-21T07:36:27.548717+0000","last_active":"2023-07-21T07:36:27.555018+0000","last_peered":"2023-07-21T07:36:27.555018+0000","last_clean":"2023-07-21T07:36:27.555018+0000","last_became_active":"2023-07-21T07:36:27.548229+0000","last_became_peered":"2023-07-21T07:36:27.548229+0000","last_unstale":"2023-07-21T07:36:27.555018+0000","last_undegraded":"2023-07-21T07:36:27.555018+0000","last_fullsized":"2023-07-21T07:36:27.555018+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:15.583978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.532491+0000","last_change":"2023-07-21T07:36:27.532491+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.532491+0000","last_undegraded":"2023-07-21T07:36:27.532491+0000","last_fullsized":"2023-07-21T07:36:27.532491+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555238+0000","last_change":"2023-07-21T07:36:27.550565+0000","last_active":"2023-07-21T07:36:27.555238+0000","last_peered":"2023-07-21T07:36:27.555238+0000","last_clean":"2023-07-21T07:36:27.555238+0000","last_became_active":"2023-07-21T07:36:27.550235+0000","last_became_peered":"2023-07-21T07:36:27.550235+0000","last_unstale":"2023-07-21T07:36:27.555238+0000","last_undegraded":"2023-07-21T07:36:27.555238+0000","last_fullsized":"2023-07-21T07:36:27.555238+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:19:40.401260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726118+0000","last_change":"2023-07-21T07:36:28.564622+0000","last_active":"2023-07-21T07:36:30.726118+0000","last_peered":"2023-07-21T07:36:30.726118+0000","last_clean":"2023-07-21T07:36:30.726118+0000","last_became_active":"2023-07-21T07:36:28.564322+0000","last_became_peered":"2023-07-21T07:36:28.564322+0000","last_unstale":"2023-07-21T07:36:30.726118+0000","last_undegraded":"2023-07-21T07:36:30.726118+0000","last_fullsized":"2023-07-21T07:36:30.726118+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:00:11.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549091+0000","last_change":"2023-07-21T07:36:27.548030+0000","last_active":"2023-07-21T07:36:27.549091+0000","last_peered":"2023-07-21T07:36:27.549091+0000","last_clean":"2023-07-21T07:36:27.549091+0000","last_became_active":"2023-07-21T07:36:27.547734+0000","last_became_peered":"2023-07-21T07:36:27.547734+0000","last_unstale":"2023-07-21T07:36:27.549091+0000","last_undegraded":"2023-07-21T07:36:27.549091+0000","last_fullsized":"2023-07-21T07:36:27.549091+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:15:15.630428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543364+0000","last_change":"2023-07-21T07:36:28.561529+0000","last_active":"2023-07-21T07:36:29.543364+0000","last_peered":"2023-07-21T07:36:29.543364+0000","last_clean":"2023-07-21T07:36:29.543364+0000","last_became_active":"2023-07-21T07:36:28.561238+0000","last_became_peered":"2023-07-21T07:36:28.561238+0000","last_unstale":"2023-07-21T07:36:29.543364+0000","last_undegraded":"2023-07-21T07:36:29.543364+0000","last_fullsized":"2023-07-21T07:36:29.543364+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:51:29.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.546146+0000","last_change":"2023-07-21T07:36:27.543128+0000","last_active":"2023-07-21T07:36:27.546146+0000","last_peered":"2023-07-21T07:36:27.546146+0000","last_clean":"2023-07-21T07:36:27.546146+0000","last_became_active":"2023-07-21T07:36:27.542777+0000","last_became_peered":"2023-07-21T07:36:27.542777+0000","last_unstale":"2023-07-21T07:36:27.546146+0000","last_undegraded":"2023-07-21T07:36:27.546146+0000","last_fullsized":"2023-07-21T07:36:27.546146+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:51:05.902828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279686+0000","last_change":"2023-07-21T07:36:28.552687+0000","last_active":"2023-07-21T07:36:30.279686+0000","last_peered":"2023-07-21T07:36:30.279686+0000","last_clean":"2023-07-21T07:36:30.279686+0000","last_became_active":"2023-07-21T07:36:28.552238+0000","last_became_peered":"2023-07-21T07:36:28.552238+0000","last_unstale":"2023-07-21T07:36:30.279686+0000","last_undegraded":"2023-07-21T07:36:30.279686+0000","last_fullsized":"2023-07-21T07:36:30.279686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:56.957478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.547854+0000","last_change":"2023-07-21T07:36:27.545649+0000","last_active":"2023-07-21T07:36:27.547854+0000","last_peered":"2023-07-21T07:36:27.547854+0000","last_clean":"2023-07-21T07:36:27.547854+0000","last_became_active":"2023-07-21T07:36:27.545358+0000","last_became_peered":"2023-07-21T07:36:27.545358+0000","last_unstale":"2023-07-21T07:36:27.547854+0000","last_undegraded":"2023-07-21T07:36:27.547854+0000","last_fullsized":"2023-07-21T07:36:27.547854+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:13:49.441576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530783+0000","last_change":"2023-07-21T07:36:27.530783+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530783+0000","last_undegraded":"2023-07-21T07:36:27.530783+0000","last_fullsized":"2023-07-21T07:36:27.530783+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279697+0000","last_change":"2023-07-21T07:36:27.549188+0000","last_active":"2023-07-21T07:36:30.279697+0000","last_peered":"2023-07-21T07:36:30.279697+0000","last_clean":"2023-07-21T07:36:30.279697+0000","last_became_active":"2023-07-21T07:36:27.548866+0000","last_became_peered":"2023-07-21T07:36:27.548866+0000","last_unstale":"2023-07-21T07:36:30.279697+0000","last_undegraded":"2023-07-21T07:36:30.279697+0000","last_fullsized":"2023-07-21T07:36:30.279697+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:28:04.208946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543643+0000","last_change":"2023-07-21T07:36:28.561022+0000","last_active":"2023-07-21T07:36:29.543643+0000","last_peered":"2023-07-21T07:36:29.543643+0000","last_clean":"2023-07-21T07:36:29.543643+0000","last_became_active":"2023-07-21T07:36:28.560541+0000","last_became_peered":"2023-07-21T07:36:28.560541+0000","last_unstale":"2023-07-21T07:36:29.543643+0000","last_undegraded":"2023-07-21T07:36:29.543643+0000","last_fullsized":"2023-07-21T07:36:29.543643+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:00:13.900861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548403+0000","last_change":"2023-07-21T07:36:27.541612+0000","last_active":"2023-07-21T07:36:27.548403+0000","last_peered":"2023-07-21T07:36:27.548403+0000","last_clean":"2023-07-21T07:36:27.548403+0000","last_became_active":"2023-07-21T07:36:27.541373+0000","last_became_peered":"2023-07-21T07:36:27.541373+0000","last_unstale":"2023-07-21T07:36:27.548403+0000","last_undegraded":"2023-07-21T07:36:27.548403+0000","last_fullsized":"2023-07-21T07:36:27.548403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:22:39.168554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.531809+0000","last_change":"2023-07-21T07:36:27.531809+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.531809+0000","last_undegraded":"2023-07-21T07:36:27.531809+0000","last_fullsized":"2023-07-21T07:36:27.531809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726257+0000","last_change":"2023-07-21T07:36:27.547744+0000","last_active":"2023-07-21T07:36:30.726257+0000","last_peered":"2023-07-21T07:36:30.726257+0000","last_clean":"2023-07-21T07:36:30.726257+0000","last_became_active":"2023-07-21T07:36:27.547463+0000","last_became_peered":"2023-07-21T07:36:27.547463+0000","last_unstale":"2023-07-21T07:36:30.726257+0000","last_undegraded":"2023-07-21T07:36:30.726257+0000","last_fullsized":"2023-07-21T07:36:30.726257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:33:11.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280048+0000","last_change":"2023-07-21T07:36:28.542046+0000","last_active":"2023-07-21T07:36:30.280048+0000","last_peered":"2023-07-21T07:36:30.280048+0000","last_clean":"2023-07-21T07:36:30.280048+0000","last_became_active":"2023-07-21T07:36:28.541690+0000","last_became_peered":"2023-07-21T07:36:28.541690+0000","last_unstale":"2023-07-21T07:36:30.280048+0000","last_undegraded":"2023-07-21T07:36:30.280048+0000","last_fullsized":"2023-07-21T07:36:30.280048+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:01:36.571829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548813+0000","last_change":"2023-07-21T07:36:27.542236+0000","last_active":"2023-07-21T07:36:27.548813+0000","last_peered":"2023-07-21T07:36:27.548813+0000","last_clean":"2023-07-21T07:36:27.548813+0000","last_became_active":"2023-07-21T07:36:27.541799+0000","last_became_peered":"2023-07-21T07:36:27.541799+0000","last_unstale":"2023-07-21T07:36:27.548813+0000","last_undegraded":"2023-07-21T07:36:27.548813+0000","last_fullsized":"2023-07-21T07:36:27.548813+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:47:52.464521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726160+0000","last_change":"2023-07-21T07:36:28.555407+0000","last_active":"2023-07-21T07:36:30.726160+0000","last_peered":"2023-07-21T07:36:30.726160+0000","last_clean":"2023-07-21T07:36:30.726160+0000","last_became_active":"2023-07-21T07:36:28.552229+0000","last_became_peered":"2023-07-21T07:36:28.552229+0000","last_unstale":"2023-07-21T07:36:30.726160+0000","last_undegraded":"2023-07-21T07:36:30.726160+0000","last_fullsized":"2023-07-21T07:36:30.726160+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:32:27.039990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"53'6","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543716+0000","last_change":"2023-07-21T07:36:27.546185+0000","last_active":"2023-07-21T07:36:29.543716+0000","last_peered":"2023-07-21T07:36:29.543716+0000","last_clean":"2023-07-21T07:36:29.543716+0000","last_became_active":"2023-07-21T07:36:27.545925+0000","last_became_peered":"2023-07-21T07:36:27.545925+0000","last_unstale":"2023-07-21T07:36:29.543716+0000","last_undegraded":"2023-07-21T07:36:29.543716+0000","last_fullsized":"2023-07-21T07:36:29.543716+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:19:54.238779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725630+0000","last_change":"2023-07-21T07:36:28.549175+0000","last_active":"2023-07-21T07:36:30.725630+0000","last_peered":"2023-07-21T07:36:30.725630+0000","last_clean":"2023-07-21T07:36:30.725630+0000","last_became_active":"2023-07-21T07:36:28.548904+0000","last_became_peered":"2023-07-21T07:36:28.548904+0000","last_unstale":"2023-07-21T07:36:30.725630+0000","last_undegraded":"2023-07-21T07:36:30.725630+0000","last_fullsized":"2023-07-21T07:36:30.725630+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:56:50.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548933+0000","last_change":"2023-07-21T07:36:27.544775+0000","last_active":"2023-07-21T07:36:27.548933+0000","last_peered":"2023-07-21T07:36:27.548933+0000","last_clean":"2023-07-21T07:36:27.548933+0000","last_became_active":"2023-07-21T07:36:27.544495+0000","last_became_peered":"2023-07-21T07:36:27.544495+0000","last_unstale":"2023-07-21T07:36:27.548933+0000","last_undegraded":"2023-07-21T07:36:27.548933+0000","last_fullsized":"2023-07-21T07:36:27.548933+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:33.978793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536456+0000","last_change":"2023-07-21T07:36:27.536456+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536456+0000","last_undegraded":"2023-07-21T07:36:27.536456+0000","last_fullsized":"2023-07-21T07:36:27.536456+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555032+0000","last_change":"2023-07-21T07:36:27.550743+0000","last_active":"2023-07-21T07:36:27.555032+0000","last_peered":"2023-07-21T07:36:27.555032+0000","last_clean":"2023-07-21T07:36:27.555032+0000","last_became_active":"2023-07-21T07:36:27.550521+0000","last_became_peered":"2023-07-21T07:36:27.550521+0000","last_unstale":"2023-07-21T07:36:27.555032+0000","last_undegraded":"2023-07-21T07:36:27.555032+0000","last_fullsized":"2023-07-21T07:36:27.555032+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:52:38.333969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279756+0000","last_change":"2023-07-21T07:36:28.555482+0000","last_active":"2023-07-21T07:36:30.279756+0000","last_peered":"2023-07-21T07:36:30.279756+0000","last_clean":"2023-07-21T07:36:30.279756+0000","last_became_active":"2023-07-21T07:36:28.554468+0000","last_became_peered":"2023-07-21T07:36:28.554468+0000","last_unstale":"2023-07-21T07:36:30.279756+0000","last_undegraded":"2023-07-21T07:36:30.279756+0000","last_fullsized":"2023-07-21T07:36:30.279756+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:02:56.001893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548621+0000","last_change":"2023-07-21T07:36:27.542687+0000","last_active":"2023-07-21T07:36:27.548621+0000","last_peered":"2023-07-21T07:36:27.548621+0000","last_clean":"2023-07-21T07:36:27.548621+0000","last_became_active":"2023-07-21T07:36:27.542483+0000","last_became_peered":"2023-07-21T07:36:27.542483+0000","last_unstale":"2023-07-21T07:36:27.548621+0000","last_undegraded":"2023-07-21T07:36:27.548621+0000","last_fullsized":"2023-07-21T07:36:27.548621+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:19:58.197391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543556+0000","last_change":"2023-07-21T07:36:28.546081+0000","last_active":"2023-07-21T07:36:29.543556+0000","last_peered":"2023-07-21T07:36:29.543556+0000","last_clean":"2023-07-21T07:36:29.543556+0000","last_became_active":"2023-07-21T07:36:28.545781+0000","last_became_peered":"2023-07-21T07:36:28.545781+0000","last_unstale":"2023-07-21T07:36:29.543556+0000","last_undegraded":"2023-07-21T07:36:29.543556+0000","last_fullsized":"2023-07-21T07:36:29.543556+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:25:10.591064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'8","reported_seq":21,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725624+0000","last_change":"2023-07-21T07:36:27.549363+0000","last_active":"2023-07-21T07:36:30.725624+0000","last_peered":"2023-07-21T07:36:30.725624+0000","last_clean":"2023-07-21T07:36:30.725624+0000","last_became_active":"2023-07-21T07:36:27.548945+0000","last_became_peered":"2023-07-21T07:36:27.548945+0000","last_unstale":"2023-07-21T07:36:30.725624+0000","last_undegraded":"2023-07-21T07:36:30.725624+0000","last_fullsized":"2023-07-21T07:36:30.725624+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:15:15.630428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.538385+0000","last_change":"2023-07-21T07:36:27.538385+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.538385+0000","last_undegraded":"2023-07-21T07:36:27.538385+0000","last_fullsized":"2023-07-21T07:36:27.538385+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.554950+0000","last_change":"2023-07-21T07:36:27.550087+0000","last_active":"2023-07-21T07:36:27.554950+0000","last_peered":"2023-07-21T07:36:27.554950+0000","last_clean":"2023-07-21T07:36:27.554950+0000","last_became_active":"2023-07-21T07:36:27.549834+0000","last_became_peered":"2023-07-21T07:36:27.549834+0000","last_unstale":"2023-07-21T07:36:27.554950+0000","last_undegraded":"2023-07-21T07:36:27.554950+0000","last_fullsized":"2023-07-21T07:36:27.554950+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:10:20.902536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726130+0000","last_change":"2023-07-21T07:36:28.554479+0000","last_active":"2023-07-21T07:36:30.726130+0000","last_peered":"2023-07-21T07:36:30.726130+0000","last_clean":"2023-07-21T07:36:30.726130+0000","last_became_active":"2023-07-21T07:36:28.554145+0000","last_became_peered":"2023-07-21T07:36:28.554145+0000","last_unstale":"2023-07-21T07:36:30.726130+0000","last_undegraded":"2023-07-21T07:36:30.726130+0000","last_fullsized":"2023-07-21T07:36:30.726130+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:06:53.576148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548223+0000","last_change":"2023-07-21T07:36:27.545216+0000","last_active":"2023-07-21T07:36:27.548223+0000","last_peered":"2023-07-21T07:36:27.548223+0000","last_clean":"2023-07-21T07:36:27.548223+0000","last_became_active":"2023-07-21T07:36:27.544952+0000","last_became_peered":"2023-07-21T07:36:27.544952+0000","last_unstale":"2023-07-21T07:36:27.548223+0000","last_undegraded":"2023-07-21T07:36:27.548223+0000","last_fullsized":"2023-07-21T07:36:27.548223+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:34:33.116437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.537605+0000","last_change":"2023-07-21T07:36:27.537605+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.537605+0000","last_undegraded":"2023-07-21T07:36:27.537605+0000","last_fullsized":"2023-07-21T07:36:27.537605+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555037+0000","last_change":"2023-07-21T07:36:27.548955+0000","last_active":"2023-07-21T07:36:27.555037+0000","last_peered":"2023-07-21T07:36:27.555037+0000","last_clean":"2023-07-21T07:36:27.555037+0000","last_became_active":"2023-07-21T07:36:27.548615+0000","last_became_peered":"2023-07-21T07:36:27.548615+0000","last_unstale":"2023-07-21T07:36:27.555037+0000","last_undegraded":"2023-07-21T07:36:27.555037+0000","last_fullsized":"2023-07-21T07:36:27.555037+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:33:11.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280328+0000","last_change":"2023-07-21T07:36:28.553270+0000","last_active":"2023-07-21T07:36:30.280328+0000","last_peered":"2023-07-21T07:36:30.280328+0000","last_clean":"2023-07-21T07:36:30.280328+0000","last_became_active":"2023-07-21T07:36:28.552988+0000","last_became_peered":"2023-07-21T07:36:28.552988+0000","last_unstale":"2023-07-21T07:36:30.280328+0000","last_undegraded":"2023-07-21T07:36:30.280328+0000","last_fullsized":"2023-07-21T07:36:30.280328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:31:25.239166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543615+0000","last_change":"2023-07-21T07:36:27.546128+0000","last_active":"2023-07-21T07:36:29.543615+0000","last_peered":"2023-07-21T07:36:29.543615+0000","last_clean":"2023-07-21T07:36:29.543615+0000","last_became_active":"2023-07-21T07:36:27.545829+0000","last_became_peered":"2023-07-21T07:36:27.545829+0000","last_unstale":"2023-07-21T07:36:29.543615+0000","last_undegraded":"2023-07-21T07:36:29.543615+0000","last_fullsized":"2023-07-21T07:36:29.543615+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:18:16.539928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279643+0000","last_change":"2023-07-21T07:36:28.550679+0000","last_active":"2023-07-21T07:36:30.279643+0000","last_peered":"2023-07-21T07:36:30.279643+0000","last_clean":"2023-07-21T07:36:30.279643+0000","last_became_active":"2023-07-21T07:36:28.550320+0000","last_became_peered":"2023-07-21T07:36:28.550320+0000","last_unstale":"2023-07-21T07:36:30.279643+0000","last_undegraded":"2023-07-21T07:36:30.279643+0000","last_fullsized":"2023-07-21T07:36:30.279643+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:20:36.808964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548821+0000","last_change":"2023-07-21T07:36:27.542890+0000","last_active":"2023-07-21T07:36:27.548821+0000","last_peered":"2023-07-21T07:36:27.548821+0000","last_clean":"2023-07-21T07:36:27.548821+0000","last_became_active":"2023-07-21T07:36:27.542614+0000","last_became_peered":"2023-07-21T07:36:27.542614+0000","last_unstale":"2023-07-21T07:36:27.548821+0000","last_undegraded":"2023-07-21T07:36:27.548821+0000","last_fullsized":"2023-07-21T07:36:27.548821+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:10:25.051264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725745+0000","last_change":"2023-07-21T07:36:28.549203+0000","last_active":"2023-07-21T07:36:30.725745+0000","last_peered":"2023-07-21T07:36:30.725745+0000","last_clean":"2023-07-21T07:36:30.725745+0000","last_became_active":"2023-07-21T07:36:28.548933+0000","last_became_peered":"2023-07-21T07:36:28.548933+0000","last_unstale":"2023-07-21T07:36:30.725745+0000","last_undegraded":"2023-07-21T07:36:30.725745+0000","last_fullsized":"2023-07-21T07:36:30.725745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:24:40.746510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.538565+0000","last_change":"2023-07-21T07:36:27.535134+0000","last_active":"2023-07-21T07:36:27.538565+0000","last_peered":"2023-07-21T07:36:27.538565+0000","last_clean":"2023-07-21T07:36:27.538565+0000","last_became_active":"2023-07-21T07:36:27.534830+0000","last_became_peered":"2023-07-21T07:36:27.534830+0000","last_unstale":"2023-07-21T07:36:27.538565+0000","last_undegraded":"2023-07-21T07:36:27.538565+0000","last_fullsized":"2023-07-21T07:36:27.538565+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:37:06.214318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543559+0000","last_change":"2023-07-21T07:36:28.549213+0000","last_active":"2023-07-21T07:36:29.543559+0000","last_peered":"2023-07-21T07:36:29.543559+0000","last_clean":"2023-07-21T07:36:29.543559+0000","last_became_active":"2023-07-21T07:36:28.548890+0000","last_became_peered":"2023-07-21T07:36:28.548890+0000","last_unstale":"2023-07-21T07:36:29.543559+0000","last_undegraded":"2023-07-21T07:36:29.543559+0000","last_fullsized":"2023-07-21T07:36:29.543559+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:43.391138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.547832+0000","last_change":"2023-07-21T07:36:27.545372+0000","last_active":"2023-07-21T07:36:27.547832+0000","last_peered":"2023-07-21T07:36:27.547832+0000","last_clean":"2023-07-21T07:36:27.547832+0000","last_became_active":"2023-07-21T07:36:27.544933+0000","last_became_peered":"2023-07-21T07:36:27.544933+0000","last_unstale":"2023-07-21T07:36:27.547832+0000","last_undegraded":"2023-07-21T07:36:27.547832+0000","last_fullsized":"2023-07-21T07:36:27.547832+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:59:32.727551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725917+0000","last_change":"2023-07-21T07:36:28.561703+0000","last_active":"2023-07-21T07:36:30.725917+0000","last_peered":"2023-07-21T07:36:30.725917+0000","last_clean":"2023-07-21T07:36:30.725917+0000","last_became_active":"2023-07-21T07:36:28.561400+0000","last_became_peered":"2023-07-21T07:36:28.561400+0000","last_unstale":"2023-07-21T07:36:30.725917+0000","last_undegraded":"2023-07-21T07:36:30.725917+0000","last_fullsized":"2023-07-21T07:36:30.725917+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:21:40.954647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543373+0000","last_change":"2023-07-21T07:36:27.542037+0000","last_active":"2023-07-21T07:36:29.543373+0000","last_peered":"2023-07-21T07:36:29.543373+0000","last_clean":"2023-07-21T07:36:29.543373+0000","last_became_active":"2023-07-21T07:36:27.541783+0000","last_became_peered":"2023-07-21T07:36:27.541783+0000","last_unstale":"2023-07-21T07:36:29.543373+0000","last_undegraded":"2023-07-21T07:36:29.543373+0000","last_fullsized":"2023-07-21T07:36:29.543373+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:47:19.494591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280363+0000","last_change":"2023-07-21T07:36:28.553251+0000","last_active":"2023-07-21T07:36:30.280363+0000","last_peered":"2023-07-21T07:36:30.280363+0000","last_clean":"2023-07-21T07:36:30.280363+0000","last_became_active":"2023-07-21T07:36:28.552971+0000","last_became_peered":"2023-07-21T07:36:28.552971+0000","last_unstale":"2023-07-21T07:36:30.280363+0000","last_undegraded":"2023-07-21T07:36:30.280363+0000","last_fullsized":"2023-07-21T07:36:30.280363+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:17.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549850+0000","last_change":"2023-07-21T07:36:27.548492+0000","last_active":"2023-07-21T07:36:27.549850+0000","last_peered":"2023-07-21T07:36:27.549850+0000","last_clean":"2023-07-21T07:36:27.549850+0000","last_became_active":"2023-07-21T07:36:27.548083+0000","last_became_peered":"2023-07-21T07:36:27.548083+0000","last_unstale":"2023-07-21T07:36:27.549850+0000","last_undegraded":"2023-07-21T07:36:27.549850+0000","last_fullsized":"2023-07-21T07:36:27.549850+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:24:33.846082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280415+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:36:30.280415+0000","last_peered":"2023-07-21T07:36:30.280415+0000","last_clean":"2023-07-21T07:36:30.280415+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:36:30.280415+0000","last_undegraded":"2023-07-21T07:36:30.280415+0000","last_fullsized":"2023-07-21T07:36:30.280415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:18:18.973777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726034+0000","last_change":"2023-07-21T07:36:28.550245+0000","last_active":"2023-07-21T07:36:30.726034+0000","last_peered":"2023-07-21T07:36:30.726034+0000","last_clean":"2023-07-21T07:36:30.726034+0000","last_became_active":"2023-07-21T07:36:28.548746+0000","last_became_peered":"2023-07-21T07:36:28.548746+0000","last_unstale":"2023-07-21T07:36:30.726034+0000","last_undegraded":"2023-07-21T07:36:30.726034+0000","last_fullsized":"2023-07-21T07:36:30.726034+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:17:46.007416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.548784+0000","last_change":"2023-07-21T07:36:27.542066+0000","last_active":"2023-07-21T07:36:27.548784+0000","last_peered":"2023-07-21T07:36:27.548784+0000","last_clean":"2023-07-21T07:36:27.548784+0000","last_became_active":"2023-07-21T07:36:27.541789+0000","last_became_peered":"2023-07-21T07:36:27.541789+0000","last_unstale":"2023-07-21T07:36:27.548784+0000","last_undegraded":"2023-07-21T07:36:27.548784+0000","last_fullsized":"2023-07-21T07:36:27.548784+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:14:50.100812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543977+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:36:29.543977+0000","last_peered":"2023-07-21T07:36:29.543977+0000","last_clean":"2023-07-21T07:36:29.543977+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:36:29.543977+0000","last_undegraded":"2023-07-21T07:36:29.543977+0000","last_fullsized":"2023-07-21T07:36:29.543977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:08:25.435210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280017+0000","last_change":"2023-07-21T07:36:28.555257+0000","last_active":"2023-07-21T07:36:30.280017+0000","last_peered":"2023-07-21T07:36:30.280017+0000","last_clean":"2023-07-21T07:36:30.280017+0000","last_became_active":"2023-07-21T07:36:28.554356+0000","last_became_peered":"2023-07-21T07:36:28.554356+0000","last_unstale":"2023-07-21T07:36:30.280017+0000","last_undegraded":"2023-07-21T07:36:30.280017+0000","last_fullsized":"2023-07-21T07:36:30.280017+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:07:09.045197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549594+0000","last_change":"2023-07-21T07:36:27.547064+0000","last_active":"2023-07-21T07:36:27.549594+0000","last_peered":"2023-07-21T07:36:27.549594+0000","last_clean":"2023-07-21T07:36:27.549594+0000","last_became_active":"2023-07-21T07:36:27.546817+0000","last_became_peered":"2023-07-21T07:36:27.546817+0000","last_unstale":"2023-07-21T07:36:27.549594+0000","last_undegraded":"2023-07-21T07:36:27.549594+0000","last_fullsized":"2023-07-21T07:36:27.549594+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:42.034968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.533936+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:36:27.533936+0000","last_peered":"2023-07-21T07:36:27.533936+0000","last_clean":"2023-07-21T07:36:27.533936+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:36:27.533936+0000","last_undegraded":"2023-07-21T07:36:27.533936+0000","last_fullsized":"2023-07-21T07:36:27.533936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:41:59.304488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.539343+0000","last_change":"2023-07-21T07:36:27.539343+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.539343+0000","last_undegraded":"2023-07-21T07:36:27.539343+0000","last_fullsized":"2023-07-21T07:36:27.539343+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.554956+0000","last_change":"2023-07-21T07:36:27.546993+0000","last_active":"2023-07-21T07:36:27.554956+0000","last_peered":"2023-07-21T07:36:27.554956+0000","last_clean":"2023-07-21T07:36:27.554956+0000","last_became_active":"2023-07-21T07:36:27.546675+0000","last_became_peered":"2023-07-21T07:36:27.546675+0000","last_unstale":"2023-07-21T07:36:27.554956+0000","last_undegraded":"2023-07-21T07:36:27.554956+0000","last_fullsized":"2023-07-21T07:36:27.554956+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:02:43.499920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.533181+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:36:27.533181+0000","last_peered":"2023-07-21T07:36:27.533181+0000","last_clean":"2023-07-21T07:36:27.533181+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:36:27.533181+0000","last_undegraded":"2023-07-21T07:36:27.533181+0000","last_fullsized":"2023-07-21T07:36:27.533181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:09:38.933989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279886+0000","last_change":"2023-07-21T07:36:28.550594+0000","last_active":"2023-07-21T07:36:30.279886+0000","last_peered":"2023-07-21T07:36:30.279886+0000","last_clean":"2023-07-21T07:36:30.279886+0000","last_became_active":"2023-07-21T07:36:28.550307+0000","last_became_peered":"2023-07-21T07:36:28.550307+0000","last_unstale":"2023-07-21T07:36:30.279886+0000","last_undegraded":"2023-07-21T07:36:30.279886+0000","last_fullsized":"2023-07-21T07:36:30.279886+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:36:10.034314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.547633+0000","last_change":"2023-07-21T07:36:27.545082+0000","last_active":"2023-07-21T07:36:27.547633+0000","last_peered":"2023-07-21T07:36:27.547633+0000","last_clean":"2023-07-21T07:36:27.547633+0000","last_became_active":"2023-07-21T07:36:27.544787+0000","last_became_peered":"2023-07-21T07:36:27.544787+0000","last_unstale":"2023-07-21T07:36:27.547633+0000","last_undegraded":"2023-07-21T07:36:27.547633+0000","last_fullsized":"2023-07-21T07:36:27.547633+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:53:21.078423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.533272+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:36:27.533272+0000","last_peered":"2023-07-21T07:36:27.533272+0000","last_clean":"2023-07-21T07:36:27.533272+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:36:27.533272+0000","last_undegraded":"2023-07-21T07:36:27.533272+0000","last_fullsized":"2023-07-21T07:36:27.533272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:45:07.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.545340+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:36:27.545340+0000","last_peered":"2023-07-21T07:36:27.545340+0000","last_clean":"2023-07-21T07:36:27.545340+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:36:27.545340+0000","last_undegraded":"2023-07-21T07:36:27.545340+0000","last_fullsized":"2023-07-21T07:36:27.545340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:45:26.816257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.536049+0000","last_change":"2023-07-21T07:36:27.536049+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.536049+0000","last_undegraded":"2023-07-21T07:36:27.536049+0000","last_fullsized":"2023-07-21T07:36:27.536049+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.555010+0000","last_change":"2023-07-21T07:36:27.550572+0000","last_active":"2023-07-21T07:36:27.555010+0000","last_peered":"2023-07-21T07:36:27.555010+0000","last_clean":"2023-07-21T07:36:27.555010+0000","last_became_active":"2023-07-21T07:36:27.550195+0000","last_became_peered":"2023-07-21T07:36:27.550195+0000","last_unstale":"2023-07-21T07:36:27.555010+0000","last_undegraded":"2023-07-21T07:36:27.555010+0000","last_fullsized":"2023-07-21T07:36:27.555010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:38:40.211173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725668+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:36:30.725668+0000","last_peered":"2023-07-21T07:36:30.725668+0000","last_clean":"2023-07-21T07:36:30.725668+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:36:30.725668+0000","last_undegraded":"2023-07-21T07:36:30.725668+0000","last_fullsized":"2023-07-21T07:36:30.725668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:10:59.819304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279848+0000","last_change":"2023-07-21T07:36:28.552513+0000","last_active":"2023-07-21T07:36:30.279848+0000","last_peered":"2023-07-21T07:36:30.279848+0000","last_clean":"2023-07-21T07:36:30.279848+0000","last_became_active":"2023-07-21T07:36:28.551895+0000","last_became_peered":"2023-07-21T07:36:28.551895+0000","last_unstale":"2023-07-21T07:36:30.279848+0000","last_undegraded":"2023-07-21T07:36:30.279848+0000","last_fullsized":"2023-07-21T07:36:30.279848+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:44:16.702073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.549693+0000","last_change":"2023-07-21T07:36:27.544373+0000","last_active":"2023-07-21T07:36:27.549693+0000","last_peered":"2023-07-21T07:36:27.549693+0000","last_clean":"2023-07-21T07:36:27.549693+0000","last_became_active":"2023-07-21T07:36:27.544074+0000","last_became_peered":"2023-07-21T07:36:27.544074+0000","last_unstale":"2023-07-21T07:36:27.549693+0000","last_undegraded":"2023-07-21T07:36:27.549693+0000","last_fullsized":"2023-07-21T07:36:27.549693+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:32:26.034517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.545016+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:36:27.545016+0000","last_peered":"2023-07-21T07:36:27.545016+0000","last_clean":"2023-07-21T07:36:27.545016+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:36:27.545016+0000","last_undegraded":"2023-07-21T07:36:27.545016+0000","last_fullsized":"2023-07-21T07:36:27.545016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:49:35.393074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2023-07-21T07:36:27.530834+0000","last_change":"2023-07-21T07:36:27.530834+0000","last_active":"2023-07-21T07:36:27.521688+0000","last_peered":"2023-07-21T07:36:27.521688+0000","last_clean":"2023-07-21T07:36:27.521688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T07:36:27.530834+0000","last_undegraded":"2023-07-21T07:36:27.530834+0000","last_fullsized":"2023-07-21T07:36:27.530834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-21T07:36:27.554983+0000","last_change":"2023-07-21T07:36:27.550570+0000","last_active":"2023-07-21T07:36:27.554983+0000","last_peered":"2023-07-21T07:36:27.554983+0000","last_clean":"2023-07-21T07:36:27.554983+0000","last_became_active":"2023-07-21T07:36:27.550296+0000","last_became_peered":"2023-07-21T07:36:27.550296+0000","last_unstale":"2023-07-21T07:36:27.554983+0000","last_undegraded":"2023-07-21T07:36:27.554983+0000","last_fullsized":"2023-07-21T07:36:27.554983+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:26:29.512185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543544+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:36:29.543544+0000","last_peered":"2023-07-21T07:36:29.543544+0000","last_clean":"2023-07-21T07:36:29.543544+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:36:29.543544+0000","last_undegraded":"2023-07-21T07:36:29.543544+0000","last_fullsized":"2023-07-21T07:36:29.543544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:53:43.924057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2146,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":863348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.504}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.624}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.59499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":286795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.4990000000000006,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.4039999999999999,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":675840,"data_stored":289089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34699999999999998,"15min":0.35099999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.502,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.249,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.49399999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.26000000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.34699999999999998,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.44700000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.307},{"interface":"front","average":{"1min":0.433,"5min":0.436,"15min":0.436},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.379}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.57499999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.40600000000000003,"15min":0.41199999999999998},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56299999999999994,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59699999999999998,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89300000000000002,"5min":1.006,"15min":1.006},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73599999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63400000000000001,"15min":0.64600000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80500000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82699999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.64000000000000001,"15min":0.65500000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68600000000000005,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.45800000000000002}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.69099999999999995,"15min":0.70899999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85299999999999998,"5min":1.339,"15min":1.339},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.747,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.503}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":863348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32600000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.376}]},{"osd":3,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.35299999999999998}]},{"osd":4,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.751}]},{"osd":5,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Jul 21 07:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":647168,"data_stored":286761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.35399999999999998},"min":{"1min":0.23599999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45900000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34899999999999998,"15min":0.34999999999999998},"min":{"1min":0.249,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.27500000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.29499999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.49199999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34300000000000003}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.51900000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.32800000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60099999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.434,"5min":0.379,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82199999999999995,"5min":1.127,"15min":1.127},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76000000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":1.109,"15min":1.109},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.622,"15min":0.61299999999999999},"min":{"1min":0.501,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88400000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.60299999999999998},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84699999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.67200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":272980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.52300000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.505},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.755},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.80000000000000004}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.83799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":288325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":10.18,"5min":10.18,"15min":10.18},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":10.207000000000001,"5min":10.207000000000001,"15min":10.207000000000001},"last":0.496}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.65300000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.46600000000000003}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.625}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":266360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.499},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.625},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:36:37.392 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:36:37.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.477+0000 7f15e9477700 1 Processor -- start 2023-07-21T07:36:37.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.477+0000 7f15e9477700 1 -- start start 2023-07-21T07:36:37.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.478+0000 7f15e9477700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e40c4930 0x7f15e414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.478+0000 7f15e9477700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e40c4ef0 con 0x7f15e40a5f00 2023-07-21T07:36:37.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.478+0000 7f15e9477700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e40c1450 con 0x7f15e414e870 2023-07-21T07:36:37.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.478+0000 7f15e9477700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40c1df0 con 0x7f15e40c4930 2023-07-21T07:36:37.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.478+0000 7f15e27fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f15e40a5f00 0x7f15e4151330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44112/0 (socket says 172.21.15.6:44112) 2023-07-21T07:36:37.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.478+0000 7f15e27fc700 1 -- 172.21.15.6:0/3270399981 learned_addr learned my addr 172.21.15.6:0/3270399981 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.478+0000 7f15e37fe700 1 --2- 172.21.15.6:0/3270399981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e40c4930 0x7f15e414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298928783 0 0) 0x7f15e40c4ef0 con 0x7f15e40a5f00 2023-07-21T07:36:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15cc0035b0 con 0x7f15e40a5f00 2023-07-21T07:36:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018687077 0 0) 0x7f15e40c1450 con 0x7f15e414e870 2023-07-21T07:36:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e40c4ef0 con 0x7f15e414e870 2023-07-21T07:36:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3146096909 0 0) 0x7f15cc0035b0 con 0x7f15e40a5f00 2023-07-21T07:36:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e40c4930 msgr2=0x7f15e414ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:37.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 --2- 172.21.15.6:0/3270399981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e40c4930 0x7f15e414ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 >> v1:172.21.15.86:6789/0 conn(0x7f15e414e870 legacy=0x7f15e40c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e40c1730 con 0x7f15e40a5f00 2023-07-21T07:36:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f15d4001670 con 0x7f15e40a5f00 2023-07-21T07:36:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 >> v1:172.21.15.6:6789/0 conn(0x7f15e40a5f00 legacy=0x7f15e4151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 --2- 172.21.15.6:0/3270399981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e40c4930 0x7f15cc003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 --2- 172.21.15.6:0/3270399981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15cc004170 0x7f15cc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 --2- 172.21.15.6:0/3270399981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc004d90 0x7f15cc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40c1df0 con 0x7f15cc004d90 2023-07-21T07:36:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc00bc70 con 0x7f15cc004170 2023-07-21T07:36:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc00be30 con 0x7f15e40c4930 2023-07-21T07:36:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e37fe700 1 --2- 172.21.15.6:0/3270399981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc004d90 0x7f15cc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e2ffd700 1 --2- 172.21.15.6:0/3270399981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e40c4930 0x7f15cc003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e27fc700 1 --2- 172.21.15.6:0/3270399981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15cc004170 0x7f15cc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e37fe700 1 -- 172.21.15.6:0/3270399981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e40c4930 msgr2=0x7f15cc003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e37fe700 1 --2- 172.21.15.6:0/3270399981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e40c4930 0x7f15cc003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e37fe700 1 -- 172.21.15.6:0/3270399981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15cc004170 msgr2=0x7f15cc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e37fe700 1 --2- 172.21.15.6:0/3270399981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15cc004170 0x7f15cc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e37fe700 1 -- 172.21.15.6:0/3270399981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc0035b0 con 0x7f15cc004d90 2023-07-21T07:36:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.479+0000 7f15e27fc700 1 --2- 172.21.15.6:0/3270399981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15cc004170 0x7f15cc004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.480+0000 7f15e37fe700 1 --2- 172.21.15.6:0/3270399981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc004d90 0x7f15cc005210 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009fc0 tx=0x7f15cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35bb57ec6663f79 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.480+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc00ec30 con 0x7f15cc004d90 2023-07-21T07:36:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.480+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc00f040 con 0x7f15cc004d90 2023-07-21T07:36:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.480+0000 7f15e1ffb700 1 -- 172.21.15.6:0/3270399981 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc014480 con 0x7f15cc004d90 2023-07-21T07:36:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.480+0000 7f15e9477700 1 -- 172.21.15.6:0/3270399981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc004d90 msgr2=0x7f15cc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.480+0000 7f15e9477700 1 --2- 172.21.15.6:0/3270399981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc004d90 0x7f15cc005210 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009fc0 tx=0x7f15cc005880 comp rx=0 tx=0).stop 2023-07-21T07:36:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.480+0000 7f15e37fe700 1 -- 172.21.15.6:0/3270399981 reap_dead start 2023-07-21T07:36:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.480+0000 7f15e9477700 1 -- 172.21.15.6:0/3270399981 shutdown_connections 2023-07-21T07:36:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.480+0000 7f15e9477700 1 -- 172.21.15.6:0/3270399981 >> 172.21.15.6:0/3270399981 conn(0x7f15e40a8660 msgr2=0x7f15e40a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.480+0000 7f15e9477700 1 -- 172.21.15.6:0/3270399981 shutdown_connections 2023-07-21T07:36:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.480+0000 7f15e9477700 1 -- 172.21.15.6:0/3270399981 wait complete. 2023-07-21T07:36:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.482+0000 7f15e9477700 1 Processor -- start 2023-07-21T07:36:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.482+0000 7f15e9477700 1 -- start start 2023-07-21T07:36:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.482+0000 7f15e9477700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15cc004d90 0x7f15e4150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e9477700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e40c0b30 0x7f15e41db000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e9477700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15e40ab340 0x7f15e40aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e9477700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40ac6a0 con 0x7f15e40ab340 2023-07-21T07:36:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e9477700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e41edaf0 con 0x7f15cc004d90 2023-07-21T07:36:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e9477700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e41eddd0 con 0x7f15e40c0b30 2023-07-21T07:36:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15e40ab340 0x7f15e40aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15e40ab340 0x7f15e40aa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36106/0 (socket says 172.21.15.6:36106) 2023-07-21T07:36:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e37fe700 1 -- 172.21.15.6:0/2851244667 learned_addr learned my addr 172.21.15.6:0/2851244667 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e27fc700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e40c0b30 0x7f15e41db000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e2ffd700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15cc004d90 0x7f15e4150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e37fe700 1 -- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e40c0b30 msgr2=0x7f15e41db000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e37fe700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e40c0b30 0x7f15e41db000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e37fe700 1 -- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15cc004d90 msgr2=0x7f15e4150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e37fe700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15cc004d90 0x7f15e4150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e37fe700 1 -- 172.21.15.6:0/2851244667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e40abfe0 con 0x7f15e40ab340 2023-07-21T07:36:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e37fe700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15e40ab340 0x7f15e40aa2e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f15dc017040 tx=0x7f15dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15cb7fe700 1 -- 172.21.15.6:0/2851244667 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc007000 con 0x7f15e40ab340 2023-07-21T07:36:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15cb7fe700 1 -- 172.21.15.6:0/2851244667 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc004470 con 0x7f15e40ab340 2023-07-21T07:36:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e9477700 1 -- 172.21.15.6:0/2851244667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e40ac2c0 con 0x7f15e40ab340 2023-07-21T07:36:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15cb7fe700 1 -- 172.21.15.6:0/2851244667 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc004820 con 0x7f15e40ab340 2023-07-21T07:36:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.483+0000 7f15e9477700 1 -- 172.21.15.6:0/2851244667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e414f1a0 con 0x7f15e40ab340 2023-07-21T07:36:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.484+0000 7f15e9477700 1 -- 172.21.15.6:0/2851244667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e40ac7e0 con 0x7f15e40ab340 2023-07-21T07:36:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.485+0000 7f15cb7fe700 1 -- 172.21.15.6:0/2851244667 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15dc023070 con 0x7f15e40ab340 2023-07-21T07:36:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.485+0000 7f15cb7fe700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f15d006ad10 0x7f15d006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.486+0000 7f15cb7fe700 1 -- 172.21.15.6:0/2851244667 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15dc08aae0 con 0x7f15e40ab340 2023-07-21T07:36:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.486+0000 7f15e2ffd700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f15d006ad10 0x7f15d006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.486+0000 7f15e2ffd700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f15d006ad10 0x7f15d006d1d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f15d80078e0 tx=0x7f15d8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.490+0000 7f15cb7fe700 1 -- 172.21.15.6:0/2851244667 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f15e40ac7e0 con 0x7f15e40ab340 2023-07-21T07:36:37.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.686+0000 7f15e9477700 1 -- 172.21.15.6:0/2851244667 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15e40c66a0 con 0x7f15d006ad10 2023-07-21T07:36:37.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.695+0000 7f15cb7fe700 1 -- 172.21.15.6:0/2851244667 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311509 (secure 0 0 0) 0x7f15d80114c0 con 0x7f15d006ad10 2023-07-21T07:36:37.752 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.698+0000 7f15e9477700 1 -- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f15d006ad10 msgr2=0x7f15d006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.698+0000 7f15e9477700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f15d006ad10 0x7f15d006d1d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f15d80078e0 tx=0x7f15d8009040 comp rx=0 tx=0).stop 2023-07-21T07:36:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.698+0000 7f15e9477700 1 -- 172.21.15.6:0/2851244667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15e40ab340 msgr2=0x7f15e40aa2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.698+0000 7f15e9477700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15e40ab340 0x7f15e40aa2e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f15dc017040 tx=0x7f15dc009750 comp rx=0 tx=0).stop 2023-07-21T07:36:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.698+0000 7f15e9477700 1 -- 172.21.15.6:0/2851244667 shutdown_connections 2023-07-21T07:36:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.698+0000 7f15e9477700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f15d006ad10 0x7f15d006d1d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.698+0000 7f15e9477700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15e40ab340 0x7f15e40aa2e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.698+0000 7f15e9477700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15cc004d90 0x7f15e4150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.698+0000 7f15e9477700 1 --2- 172.21.15.6:0/2851244667 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e40c0b30 0x7f15e41db000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.698+0000 7f15e9477700 1 -- 172.21.15.6:0/2851244667 >> 172.21.15.6:0/2851244667 conn(0x7f15e40a8660 msgr2=0x7f15e40c6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.698+0000 7f15e9477700 1 -- 172.21.15.6:0/2851244667 shutdown_connections 2023-07-21T07:36:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.698+0000 7f15e9477700 1 -- 172.21.15.6:0/2851244667 wait complete. 2023-07-21T07:36:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:36:37.765 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-07-21T07:36:36.721544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222464,"kb_used_data":6280,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754752256,"statfs":{"total":773094113280,"available":772866310144,"internally_reserved":0,"allocated":6430720,"data_stored":3479548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.191235"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543939+0000","last_change":"2023-07-21T07:36:28.546426+0000","last_active":"2023-07-21T07:36:29.543939+0000","last_peered":"2023-07-21T07:36:29.543939+0000","last_clean":"2023-07-21T07:36:29.543939+0000","last_became_active":"2023-07-21T07:36:28.546106+0000","last_became_peered":"2023-07-21T07:36:28.546106+0000","last_unstale":"2023-07-21T07:36:29.543939+0000","last_undegraded":"2023-07-21T07:36:29.543939+0000","last_fullsized":"2023-07-21T07:36:29.543939+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:15:19.595560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543870+0000","last_change":"2023-07-21T07:36:28.553546+0000","last_active":"2023-07-21T07:36:29.543870+0000","last_peered":"2023-07-21T07:36:29.543870+0000","last_clean":"2023-07-21T07:36:29.543870+0000","last_became_active":"2023-07-21T07:36:28.553260+0000","last_became_peered":"2023-07-21T07:36:28.553260+0000","last_unstale":"2023-07-21T07:36:29.543870+0000","last_undegraded":"2023-07-21T07:36:29.543870+0000","last_fullsized":"2023-07-21T07:36:29.543870+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:43:50.621919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545913+0000","last_change":"2023-07-21T07:36:28.554364+0000","last_active":"2023-07-21T07:36:29.545913+0000","last_peered":"2023-07-21T07:36:29.545913+0000","last_clean":"2023-07-21T07:36:29.545913+0000","last_became_active":"2023-07-21T07:36:28.554095+0000","last_became_peered":"2023-07-21T07:36:28.554095+0000","last_unstale":"2023-07-21T07:36:29.545913+0000","last_undegraded":"2023-07-21T07:36:29.545913+0000","last_fullsized":"2023-07-21T07:36:29.545913+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:47:50.154203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725959+0000","last_change":"2023-07-21T07:36:28.553233+0000","last_active":"2023-07-21T07:36:30.725959+0000","last_peered":"2023-07-21T07:36:30.725959+0000","last_clean":"2023-07-21T07:36:30.725959+0000","last_became_active":"2023-07-21T07:36:28.552984+0000","last_became_peered":"2023-07-21T07:36:28.552984+0000","last_unstale":"2023-07-21T07:36:30.725959+0000","last_undegraded":"2023-07-21T07:36:30.725959+0000","last_fullsized":"2023-07-21T07:36:30.725959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:23:03.303111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279802+0000","last_change":"2023-07-21T07:36:28.555196+0000","last_active":"2023-07-21T07:36:30.279802+0000","last_peered":"2023-07-21T07:36:30.279802+0000","last_clean":"2023-07-21T07:36:30.279802+0000","last_became_active":"2023-07-21T07:36:28.554805+0000","last_became_peered":"2023-07-21T07:36:28.554805+0000","last_unstale":"2023-07-21T07:36:30.279802+0000","last_undegraded":"2023-07-21T07:36:30.279802+0000","last_fullsized":"2023-07-21T07:36:30.279802+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:14:30.726435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.065695+0000","last_change":"2023-07-21T07:36:28.557651+0000","last_active":"2023-07-21T07:36:30.065695+0000","last_peered":"2023-07-21T07:36:30.065695+0000","last_clean":"2023-07-21T07:36:30.065695+0000","last_became_active":"2023-07-21T07:36:28.557396+0000","last_became_peered":"2023-07-21T07:36:28.557396+0000","last_unstale":"2023-07-21T07:36:30.065695+0000","last_undegraded":"2023-07-21T07:36:30.065695+0000","last_fullsized":"2023-07-21T07:36:30.065695+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:34.984265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725610+0000","last_change":"2023-07-21T07:36:28.557367+0000","last_active":"2023-07-21T07:36:30.725610+0000","last_peered":"2023-07-21T07:36:30.725610+0000","last_clean":"2023-07-21T07:36:30.725610+0000","last_became_active":"2023-07-21T07:36:28.557060+0000","last_became_peered":"2023-07-21T07:36:28.557060+0000","last_unstale":"2023-07-21T07:36:30.725610+0000","last_undegraded":"2023-07-21T07:36:30.725610+0000","last_fullsized":"2023-07-21T07:36:30.725610+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:11:41.810201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545099+0000","last_change":"2023-07-21T07:36:28.550020+0000","last_active":"2023-07-21T07:36:29.545099+0000","last_peered":"2023-07-21T07:36:29.545099+0000","last_clean":"2023-07-21T07:36:29.545099+0000","last_became_active":"2023-07-21T07:36:28.549706+0000","last_became_peered":"2023-07-21T07:36:28.549706+0000","last_unstale":"2023-07-21T07:36:29.545099+0000","last_undegraded":"2023-07-21T07:36:29.545099+0000","last_fullsized":"2023-07-21T07:36:29.545099+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:16:38.855328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.546249+0000","last_change":"2023-07-21T07:36:28.553926+0000","last_active":"2023-07-21T07:36:29.546249+0000","last_peered":"2023-07-21T07:36:29.546249+0000","last_clean":"2023-07-21T07:36:29.546249+0000","last_became_active":"2023-07-21T07:36:28.552424+0000","last_became_peered":"2023-07-21T07:36:28.552424+0000","last_unstale":"2023-07-21T07:36:29.546249+0000","last_undegraded":"2023-07-21T07:36:29.546249+0000","last_fullsized":"2023-07-21T07:36:29.546249+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:21:56.390688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545820+0000","last_change":"2023-07-21T07:36:28.551408+0000","last_active":"2023-07-21T07:36:29.545820+0000","last_peered":"2023-07-21T07:36:29.545820+0000","last_clean":"2023-07-21T07:36:29.545820+0000","last_became_active":"2023-07-21T07:36:28.551138+0000","last_became_peered":"2023-07-21T07:36:28.551138+0000","last_unstale":"2023-07-21T07:36:29.545820+0000","last_undegraded":"2023-07-21T07:36:29.545820+0000","last_fullsized":"2023-07-21T07:36:29.545820+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:24.687597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725998+0000","last_change":"2023-07-21T07:36:28.550836+0000","last_active":"2023-07-21T07:36:30.725998+0000","last_peered":"2023-07-21T07:36:30.725998+0000","last_clean":"2023-07-21T07:36:30.725998+0000","last_became_active":"2023-07-21T07:36:28.550559+0000","last_became_peered":"2023-07-21T07:36:28.550559+0000","last_unstale":"2023-07-21T07:36:30.725998+0000","last_undegraded":"2023-07-21T07:36:30.725998+0000","last_fullsized":"2023-07-21T07:36:30.725998+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:04:12.046194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545995+0000","last_change":"2023-07-21T07:36:28.550059+0000","last_active":"2023-07-21T07:36:29.545995+0000","last_peered":"2023-07-21T07:36:29.545995+0000","last_clean":"2023-07-21T07:36:29.545995+0000","last_became_active":"2023-07-21T07:36:28.549772+0000","last_became_peered":"2023-07-21T07:36:28.549772+0000","last_unstale":"2023-07-21T07:36:29.545995+0000","last_undegraded":"2023-07-21T07:36:29.545995+0000","last_fullsized":"2023-07-21T07:36:29.545995+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:48:33.890439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545186+0000","last_change":"2023-07-21T07:36:28.548999+0000","last_active":"2023-07-21T07:36:29.545186+0000","last_peered":"2023-07-21T07:36:29.545186+0000","last_clean":"2023-07-21T07:36:29.545186+0000","last_became_active":"2023-07-21T07:36:28.548721+0000","last_became_peered":"2023-07-21T07:36:28.548721+0000","last_unstale":"2023-07-21T07:36:29.545186+0000","last_undegraded":"2023-07-21T07:36:29.545186+0000","last_fullsized":"2023-07-21T07:36:29.545186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:10:58.291575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545627+0000","last_change":"2023-07-21T07:36:28.551943+0000","last_active":"2023-07-21T07:36:29.545627+0000","last_peered":"2023-07-21T07:36:29.545627+0000","last_clean":"2023-07-21T07:36:29.545627+0000","last_became_active":"2023-07-21T07:36:28.551690+0000","last_became_peered":"2023-07-21T07:36:28.551690+0000","last_unstale":"2023-07-21T07:36:29.545627+0000","last_undegraded":"2023-07-21T07:36:29.545627+0000","last_fullsized":"2023-07-21T07:36:29.545627+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:28:58.739292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.546310+0000","last_change":"2023-07-21T07:36:28.551052+0000","last_active":"2023-07-21T07:36:29.546310+0000","last_peered":"2023-07-21T07:36:29.546310+0000","last_clean":"2023-07-21T07:36:29.546310+0000","last_became_active":"2023-07-21T07:36:28.550737+0000","last_became_peered":"2023-07-21T07:36:28.550737+0000","last_unstale":"2023-07-21T07:36:29.546310+0000","last_undegraded":"2023-07-21T07:36:29.546310+0000","last_fullsized":"2023-07-21T07:36:29.546310+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:04:48.451498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725979+0000","last_change":"2023-07-21T07:36:28.561905+0000","last_active":"2023-07-21T07:36:30.725979+0000","last_peered":"2023-07-21T07:36:30.725979+0000","last_clean":"2023-07-21T07:36:30.725979+0000","last_became_active":"2023-07-21T07:36:28.561351+0000","last_became_peered":"2023-07-21T07:36:28.561351+0000","last_unstale":"2023-07-21T07:36:30.725979+0000","last_undegraded":"2023-07-21T07:36:30.725979+0000","last_fullsized":"2023-07-21T07:36:30.725979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:29:49.803144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.544010+0000","last_change":"2023-07-21T07:36:28.550124+0000","last_active":"2023-07-21T07:36:29.544010+0000","last_peered":"2023-07-21T07:36:29.544010+0000","last_clean":"2023-07-21T07:36:29.544010+0000","last_became_active":"2023-07-21T07:36:28.549862+0000","last_became_peered":"2023-07-21T07:36:28.549862+0000","last_unstale":"2023-07-21T07:36:29.544010+0000","last_undegraded":"2023-07-21T07:36:29.544010+0000","last_fullsized":"2023-07-21T07:36:29.544010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:16.457168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726109+0000","last_change":"2023-07-21T07:36:28.552922+0000","last_active":"2023-07-21T07:36:30.726109+0000","last_peered":"2023-07-21T07:36:30.726109+0000","last_clean":"2023-07-21T07:36:30.726109+0000","last_became_active":"2023-07-21T07:36:28.552646+0000","last_became_peered":"2023-07-21T07:36:28.552646+0000","last_unstale":"2023-07-21T07:36:30.726109+0000","last_undegraded":"2023-07-21T07:36:30.726109+0000","last_fullsized":"2023-07-21T07:36:30.726109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:02:44.505392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279950+0000","last_change":"2023-07-21T07:36:28.554910+0000","last_active":"2023-07-21T07:36:30.279950+0000","last_peered":"2023-07-21T07:36:30.279950+0000","last_clean":"2023-07-21T07:36:30.279950+0000","last_became_active":"2023-07-21T07:36:28.554628+0000","last_became_peered":"2023-07-21T07:36:28.554628+0000","last_unstale":"2023-07-21T07:36:30.279950+0000","last_undegraded":"2023-07-21T07:36:30.279950+0000","last_fullsized":"2023-07-21T07:36:30.279950+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:24:34.043625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725836+0000","last_change":"2023-07-21T07:36:28.547134+0000","last_active":"2023-07-21T07:36:30.725836+0000","last_peered":"2023-07-21T07:36:30.725836+0000","last_clean":"2023-07-21T07:36:30.725836+0000","last_became_active":"2023-07-21T07:36:28.546821+0000","last_became_peered":"2023-07-21T07:36:28.546821+0000","last_unstale":"2023-07-21T07:36:30.725836+0000","last_undegraded":"2023-07-21T07:36:30.725836+0000","last_fullsized":"2023-07-21T07:36:30.725836+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:51:09.771177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545037+0000","last_change":"2023-07-21T07:36:28.546888+0000","last_active":"2023-07-21T07:36:29.545037+0000","last_peered":"2023-07-21T07:36:29.545037+0000","last_clean":"2023-07-21T07:36:29.545037+0000","last_became_active":"2023-07-21T07:36:28.546615+0000","last_became_peered":"2023-07-21T07:36:28.546615+0000","last_unstale":"2023-07-21T07:36:29.545037+0000","last_undegraded":"2023-07-21T07:36:29.545037+0000","last_fullsized":"2023-07-21T07:36:29.545037+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:47:50.154203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725425+0000","last_change":"2023-07-21T07:36:28.551413+0000","last_active":"2023-07-21T07:36:30.725425+0000","last_peered":"2023-07-21T07:36:30.725425+0000","last_clean":"2023-07-21T07:36:30.725425+0000","last_became_active":"2023-07-21T07:36:28.551080+0000","last_became_peered":"2023-07-21T07:36:28.551080+0000","last_unstale":"2023-07-21T07:36:30.725425+0000","last_undegraded":"2023-07-21T07:36:30.725425+0000","last_fullsized":"2023-07-21T07:36:30.725425+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:24:41.835926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725373+0000","last_change":"2023-07-21T07:36:28.551886+0000","last_active":"2023-07-21T07:36:30.725373+0000","last_peered":"2023-07-21T07:36:30.725373+0000","last_clean":"2023-07-21T07:36:30.725373+0000","last_became_active":"2023-07-21T07:36:28.551565+0000","last_became_peered":"2023-07-21T07:36:28.551565+0000","last_unstale":"2023-07-21T07:36:30.725373+0000","last_undegraded":"2023-07-21T07:36:30.725373+0000","last_fullsized":"2023-07-21T07:36:30.725373+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:19:59.202863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545046+0000","last_change":"2023-07-21T07:36:28.558221+0000","last_active":"2023-07-21T07:36:29.545046+0000","last_peered":"2023-07-21T07:36:29.545046+0000","last_clean":"2023-07-21T07:36:29.545046+0000","last_became_active":"2023-07-21T07:36:28.557198+0000","last_became_peered":"2023-07-21T07:36:28.557198+0000","last_unstale":"2023-07-21T07:36:29.545046+0000","last_undegraded":"2023-07-21T07:36:29.545046+0000","last_fullsized":"2023-07-21T07:36:29.545046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:45:24.215143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545354+0000","last_change":"2023-07-21T07:36:28.557669+0000","last_active":"2023-07-21T07:36:29.545354+0000","last_peered":"2023-07-21T07:36:29.545354+0000","last_clean":"2023-07-21T07:36:29.545354+0000","last_became_active":"2023-07-21T07:36:28.557198+0000","last_became_peered":"2023-07-21T07:36:28.557198+0000","last_unstale":"2023-07-21T07:36:29.545354+0000","last_undegraded":"2023-07-21T07:36:29.545354+0000","last_fullsized":"2023-07-21T07:36:29.545354+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:13:11.986531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545473+0000","last_change":"2023-07-21T07:36:28.556248+0000","last_active":"2023-07-21T07:36:29.545473+0000","last_peered":"2023-07-21T07:36:29.545473+0000","last_clean":"2023-07-21T07:36:29.545473+0000","last_became_active":"2023-07-21T07:36:28.556010+0000","last_became_peered":"2023-07-21T07:36:28.556010+0000","last_unstale":"2023-07-21T07:36:29.545473+0000","last_undegraded":"2023-07-21T07:36:29.545473+0000","last_fullsized":"2023-07-21T07:36:29.545473+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:21:56.390688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725998+0000","last_change":"2023-07-21T07:36:28.554107+0000","last_active":"2023-07-21T07:36:30.725998+0000","last_peered":"2023-07-21T07:36:30.725998+0000","last_clean":"2023-07-21T07:36:30.725998+0000","last_became_active":"2023-07-21T07:36:28.553824+0000","last_became_peered":"2023-07-21T07:36:28.553824+0000","last_unstale":"2023-07-21T07:36:30.725998+0000","last_undegraded":"2023-07-21T07:36:30.725998+0000","last_fullsized":"2023-07-21T07:36:30.725998+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:35:20.960610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543780+0000","last_change":"2023-07-21T07:36:28.544714+0000","last_active":"2023-07-21T07:36:29.543780+0000","last_peered":"2023-07-21T07:36:29.543780+0000","last_clean":"2023-07-21T07:36:29.543780+0000","last_became_active":"2023-07-21T07:36:28.544330+0000","last_became_peered":"2023-07-21T07:36:28.544330+0000","last_unstale":"2023-07-21T07:36:29.543780+0000","last_undegraded":"2023-07-21T07:36:29.543780+0000","last_fullsized":"2023-07-21T07:36:29.543780+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:55:36.869529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545691+0000","last_change":"2023-07-21T07:36:28.553757+0000","last_active":"2023-07-21T07:36:29.545691+0000","last_peered":"2023-07-21T07:36:29.545691+0000","last_clean":"2023-07-21T07:36:29.545691+0000","last_became_active":"2023-07-21T07:36:28.553520+0000","last_became_peered":"2023-07-21T07:36:28.553520+0000","last_unstale":"2023-07-21T07:36:29.545691+0000","last_undegraded":"2023-07-21T07:36:29.545691+0000","last_fullsized":"2023-07-21T07:36:29.545691+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:10:58.291575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.544946+0000","last_change":"2023-07-21T07:36:28.546337+0000","last_active":"2023-07-21T07:36:29.544946+0000","last_peered":"2023-07-21T07:36:29.544946+0000","last_clean":"2023-07-21T07:36:29.544946+0000","last_became_active":"2023-07-21T07:36:28.546061+0000","last_became_peered":"2023-07-21T07:36:28.546061+0000","last_unstale":"2023-07-21T07:36:29.544946+0000","last_undegraded":"2023-07-21T07:36:29.544946+0000","last_fullsized":"2023-07-21T07:36:29.544946+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:41:31.754173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725688+0000","last_change":"2023-07-21T07:36:28.553711+0000","last_active":"2023-07-21T07:36:30.725688+0000","last_peered":"2023-07-21T07:36:30.725688+0000","last_clean":"2023-07-21T07:36:30.725688+0000","last_became_active":"2023-07-21T07:36:28.553426+0000","last_became_peered":"2023-07-21T07:36:28.553426+0000","last_unstale":"2023-07-21T07:36:30.725688+0000","last_undegraded":"2023-07-21T07:36:30.725688+0000","last_fullsized":"2023-07-21T07:36:30.725688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:24:34.851555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.065494+0000","last_change":"2023-07-21T07:36:28.557219+0000","last_active":"2023-07-21T07:36:30.065494+0000","last_peered":"2023-07-21T07:36:30.065494+0000","last_clean":"2023-07-21T07:36:30.065494+0000","last_became_active":"2023-07-21T07:36:28.556584+0000","last_became_peered":"2023-07-21T07:36:28.556584+0000","last_unstale":"2023-07-21T07:36:30.065494+0000","last_undegraded":"2023-07-21T07:36:30.065494+0000","last_fullsized":"2023-07-21T07:36:30.065494+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:19:59.202863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280185+0000","last_change":"2023-07-21T07:36:28.554012+0000","last_active":"2023-07-21T07:36:30.280185+0000","last_peered":"2023-07-21T07:36:30.280185+0000","last_clean":"2023-07-21T07:36:30.280185+0000","last_became_active":"2023-07-21T07:36:28.553737+0000","last_became_peered":"2023-07-21T07:36:28.553737+0000","last_unstale":"2023-07-21T07:36:30.280185+0000","last_undegraded":"2023-07-21T07:36:30.280185+0000","last_fullsized":"2023-07-21T07:36:30.280185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:36:21.975321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"53'4","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.544028+0000","last_change":"2023-07-21T07:36:27.542913+0000","last_active":"2023-07-21T07:36:29.544028+0000","last_peered":"2023-07-21T07:36:29.544028+0000","last_clean":"2023-07-21T07:36:29.544028+0000","last_became_active":"2023-07-21T07:36:27.542352+0000","last_became_peered":"2023-07-21T07:36:27.542352+0000","last_unstale":"2023-07-21T07:36:29.544028+0000","last_undegraded":"2023-07-21T07:36:29.544028+0000","last_fullsized":"2023-07-21T07:36:29.544028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:58:50.271243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726159+0000","last_change":"2023-07-21T07:36:28.549909+0000","last_active":"2023-07-21T07:36:30.726159+0000","last_peered":"2023-07-21T07:36:30.726159+0000","last_clean":"2023-07-21T07:36:30.726159+0000","last_became_active":"2023-07-21T07:36:28.549643+0000","last_became_peered":"2023-07-21T07:36:28.549643+0000","last_unstale":"2023-07-21T07:36:30.726159+0000","last_undegraded":"2023-07-21T07:36:30.726159+0000","last_fullsized":"2023-07-21T07:36:30.726159+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:16.589451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"53'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.066019+0000","last_change":"2023-07-21T07:36:27.544173+0000","last_active":"2023-07-21T07:36:30.066019+0000","last_peered":"2023-07-21T07:36:30.066019+0000","last_clean":"2023-07-21T07:36:30.066019+0000","last_became_active":"2023-07-21T07:36:27.543806+0000","last_became_peered":"2023-07-21T07:36:27.543806+0000","last_unstale":"2023-07-21T07:36:30.066019+0000","last_undegraded":"2023-07-21T07:36:30.066019+0000","last_fullsized":"2023-07-21T07:36:30.066019+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:22:39.168554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.065941+0000","last_change":"2023-07-21T07:36:28.553914+0000","last_active":"2023-07-21T07:36:30.065941+0000","last_peered":"2023-07-21T07:36:30.065941+0000","last_clean":"2023-07-21T07:36:30.065941+0000","last_became_active":"2023-07-21T07:36:28.553610+0000","last_became_peered":"2023-07-21T07:36:28.553610+0000","last_unstale":"2023-07-21T07:36:30.065941+0000","last_undegraded":"2023-07-21T07:36:30.065941+0000","last_fullsized":"2023-07-21T07:36:30.065941+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:43.040440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"53'2","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.065871+0000","last_change":"2023-07-21T07:36:27.548717+0000","last_active":"2023-07-21T07:36:30.065871+0000","last_peered":"2023-07-21T07:36:30.065871+0000","last_clean":"2023-07-21T07:36:30.065871+0000","last_became_active":"2023-07-21T07:36:27.548229+0000","last_became_peered":"2023-07-21T07:36:27.548229+0000","last_unstale":"2023-07-21T07:36:30.065871+0000","last_undegraded":"2023-07-21T07:36:30.065871+0000","last_fullsized":"2023-07-21T07:36:30.065871+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:47:52.464521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545579+0000","last_change":"2023-07-21T07:36:28.551204+0000","last_active":"2023-07-21T07:36:29.545579+0000","last_peered":"2023-07-21T07:36:29.545579+0000","last_clean":"2023-07-21T07:36:29.545579+0000","last_became_active":"2023-07-21T07:36:28.550896+0000","last_became_peered":"2023-07-21T07:36:28.550896+0000","last_unstale":"2023-07-21T07:36:29.545579+0000","last_undegraded":"2023-07-21T07:36:29.545579+0000","last_fullsized":"2023-07-21T07:36:29.545579+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:29:23.804284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"53'2","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.065672+0000","last_change":"2023-07-21T07:36:27.550565+0000","last_active":"2023-07-21T07:36:30.065672+0000","last_peered":"2023-07-21T07:36:30.065672+0000","last_clean":"2023-07-21T07:36:30.065672+0000","last_became_active":"2023-07-21T07:36:27.550235+0000","last_became_peered":"2023-07-21T07:36:27.550235+0000","last_unstale":"2023-07-21T07:36:30.065672+0000","last_undegraded":"2023-07-21T07:36:30.065672+0000","last_fullsized":"2023-07-21T07:36:30.065672+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:47:05.576287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726118+0000","last_change":"2023-07-21T07:36:28.564622+0000","last_active":"2023-07-21T07:36:30.726118+0000","last_peered":"2023-07-21T07:36:30.726118+0000","last_clean":"2023-07-21T07:36:30.726118+0000","last_became_active":"2023-07-21T07:36:28.564322+0000","last_became_peered":"2023-07-21T07:36:28.564322+0000","last_unstale":"2023-07-21T07:36:30.726118+0000","last_undegraded":"2023-07-21T07:36:30.726118+0000","last_fullsized":"2023-07-21T07:36:30.726118+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:00:11.597226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"53'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725695+0000","last_change":"2023-07-21T07:36:27.548030+0000","last_active":"2023-07-21T07:36:30.725695+0000","last_peered":"2023-07-21T07:36:30.725695+0000","last_clean":"2023-07-21T07:36:30.725695+0000","last_became_active":"2023-07-21T07:36:27.547734+0000","last_became_peered":"2023-07-21T07:36:27.547734+0000","last_unstale":"2023-07-21T07:36:30.725695+0000","last_undegraded":"2023-07-21T07:36:30.725695+0000","last_fullsized":"2023-07-21T07:36:30.725695+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:13:45.840365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543364+0000","last_change":"2023-07-21T07:36:28.561529+0000","last_active":"2023-07-21T07:36:29.543364+0000","last_peered":"2023-07-21T07:36:29.543364+0000","last_clean":"2023-07-21T07:36:29.543364+0000","last_became_active":"2023-07-21T07:36:28.561238+0000","last_became_peered":"2023-07-21T07:36:28.561238+0000","last_unstale":"2023-07-21T07:36:29.543364+0000","last_undegraded":"2023-07-21T07:36:29.543364+0000","last_fullsized":"2023-07-21T07:36:29.543364+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:51:29.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"53'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725582+0000","last_change":"2023-07-21T07:36:27.543128+0000","last_active":"2023-07-21T07:36:30.725582+0000","last_peered":"2023-07-21T07:36:30.725582+0000","last_clean":"2023-07-21T07:36:30.725582+0000","last_became_active":"2023-07-21T07:36:27.542777+0000","last_became_peered":"2023-07-21T07:36:27.542777+0000","last_unstale":"2023-07-21T07:36:30.725582+0000","last_undegraded":"2023-07-21T07:36:30.725582+0000","last_fullsized":"2023-07-21T07:36:30.725582+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:56:57.025959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279686+0000","last_change":"2023-07-21T07:36:28.552687+0000","last_active":"2023-07-21T07:36:30.279686+0000","last_peered":"2023-07-21T07:36:30.279686+0000","last_clean":"2023-07-21T07:36:30.279686+0000","last_became_active":"2023-07-21T07:36:28.552238+0000","last_became_peered":"2023-07-21T07:36:28.552238+0000","last_unstale":"2023-07-21T07:36:30.279686+0000","last_undegraded":"2023-07-21T07:36:30.279686+0000","last_fullsized":"2023-07-21T07:36:30.279686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:22:56.957478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725331+0000","last_change":"2023-07-21T07:36:27.545649+0000","last_active":"2023-07-21T07:36:30.725331+0000","last_peered":"2023-07-21T07:36:30.725331+0000","last_clean":"2023-07-21T07:36:30.725331+0000","last_became_active":"2023-07-21T07:36:27.545358+0000","last_became_peered":"2023-07-21T07:36:27.545358+0000","last_unstale":"2023-07-21T07:36:30.725331+0000","last_undegraded":"2023-07-21T07:36:30.725331+0000","last_fullsized":"2023-07-21T07:36:30.725331+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:39:24.784638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725658+0000","last_change":"2023-07-21T07:36:28.551678+0000","last_active":"2023-07-21T07:36:30.725658+0000","last_peered":"2023-07-21T07:36:30.725658+0000","last_clean":"2023-07-21T07:36:30.725658+0000","last_became_active":"2023-07-21T07:36:28.551150+0000","last_became_peered":"2023-07-21T07:36:28.551150+0000","last_unstale":"2023-07-21T07:36:30.725658+0000","last_undegraded":"2023-07-21T07:36:30.725658+0000","last_fullsized":"2023-07-21T07:36:30.725658+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:31:12.174896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279697+0000","last_change":"2023-07-21T07:36:27.549188+0000","last_active":"2023-07-21T07:36:30.279697+0000","last_peered":"2023-07-21T07:36:30.279697+0000","last_clean":"2023-07-21T07:36:30.279697+0000","last_became_active":"2023-07-21T07:36:27.548866+0000","last_became_peered":"2023-07-21T07:36:27.548866+0000","last_unstale":"2023-07-21T07:36:30.279697+0000","last_undegraded":"2023-07-21T07:36:30.279697+0000","last_fullsized":"2023-07-21T07:36:30.279697+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:28:04.208946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543643+0000","last_change":"2023-07-21T07:36:28.561022+0000","last_active":"2023-07-21T07:36:29.543643+0000","last_peered":"2023-07-21T07:36:29.543643+0000","last_clean":"2023-07-21T07:36:29.543643+0000","last_became_active":"2023-07-21T07:36:28.560541+0000","last_became_peered":"2023-07-21T07:36:28.560541+0000","last_unstale":"2023-07-21T07:36:29.543643+0000","last_undegraded":"2023-07-21T07:36:29.543643+0000","last_fullsized":"2023-07-21T07:36:29.543643+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:00:13.900861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.546084+0000","last_change":"2023-07-21T07:36:27.541612+0000","last_active":"2023-07-21T07:36:29.546084+0000","last_peered":"2023-07-21T07:36:29.546084+0000","last_clean":"2023-07-21T07:36:29.546084+0000","last_became_active":"2023-07-21T07:36:27.541373+0000","last_became_peered":"2023-07-21T07:36:27.541373+0000","last_unstale":"2023-07-21T07:36:29.546084+0000","last_undegraded":"2023-07-21T07:36:29.546084+0000","last_fullsized":"2023-07-21T07:36:29.546084+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:14:44.450077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725854+0000","last_change":"2023-07-21T07:36:28.547366+0000","last_active":"2023-07-21T07:36:30.725854+0000","last_peered":"2023-07-21T07:36:30.725854+0000","last_clean":"2023-07-21T07:36:30.725854+0000","last_became_active":"2023-07-21T07:36:28.547029+0000","last_became_peered":"2023-07-21T07:36:28.547029+0000","last_unstale":"2023-07-21T07:36:30.725854+0000","last_undegraded":"2023-07-21T07:36:30.725854+0000","last_fullsized":"2023-07-21T07:36:30.725854+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:58:53.356958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726257+0000","last_change":"2023-07-21T07:36:27.547744+0000","last_active":"2023-07-21T07:36:30.726257+0000","last_peered":"2023-07-21T07:36:30.726257+0000","last_clean":"2023-07-21T07:36:30.726257+0000","last_became_active":"2023-07-21T07:36:27.547463+0000","last_became_peered":"2023-07-21T07:36:27.547463+0000","last_unstale":"2023-07-21T07:36:30.726257+0000","last_undegraded":"2023-07-21T07:36:30.726257+0000","last_fullsized":"2023-07-21T07:36:30.726257+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:33:11.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280048+0000","last_change":"2023-07-21T07:36:28.542046+0000","last_active":"2023-07-21T07:36:30.280048+0000","last_peered":"2023-07-21T07:36:30.280048+0000","last_clean":"2023-07-21T07:36:30.280048+0000","last_became_active":"2023-07-21T07:36:28.541690+0000","last_became_peered":"2023-07-21T07:36:28.541690+0000","last_unstale":"2023-07-21T07:36:30.280048+0000","last_undegraded":"2023-07-21T07:36:30.280048+0000","last_fullsized":"2023-07-21T07:36:30.280048+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:01:36.571829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"53'3","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545570+0000","last_change":"2023-07-21T07:36:27.542236+0000","last_active":"2023-07-21T07:36:29.545570+0000","last_peered":"2023-07-21T07:36:29.545570+0000","last_clean":"2023-07-21T07:36:29.545570+0000","last_became_active":"2023-07-21T07:36:27.541799+0000","last_became_peered":"2023-07-21T07:36:27.541799+0000","last_unstale":"2023-07-21T07:36:29.545570+0000","last_undegraded":"2023-07-21T07:36:29.545570+0000","last_fullsized":"2023-07-21T07:36:29.545570+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:16:54.511787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726160+0000","last_change":"2023-07-21T07:36:28.555407+0000","last_active":"2023-07-21T07:36:30.726160+0000","last_peered":"2023-07-21T07:36:30.726160+0000","last_clean":"2023-07-21T07:36:30.726160+0000","last_became_active":"2023-07-21T07:36:28.552229+0000","last_became_peered":"2023-07-21T07:36:28.552229+0000","last_unstale":"2023-07-21T07:36:30.726160+0000","last_undegraded":"2023-07-21T07:36:30.726160+0000","last_fullsized":"2023-07-21T07:36:30.726160+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:32:27.039990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"53'6","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543716+0000","last_change":"2023-07-21T07:36:27.546185+0000","last_active":"2023-07-21T07:36:29.543716+0000","last_peered":"2023-07-21T07:36:29.543716+0000","last_clean":"2023-07-21T07:36:29.543716+0000","last_became_active":"2023-07-21T07:36:27.545925+0000","last_became_peered":"2023-07-21T07:36:27.545925+0000","last_unstale":"2023-07-21T07:36:29.543716+0000","last_undegraded":"2023-07-21T07:36:29.543716+0000","last_fullsized":"2023-07-21T07:36:29.543716+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:19:54.238779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725630+0000","last_change":"2023-07-21T07:36:28.549175+0000","last_active":"2023-07-21T07:36:30.725630+0000","last_peered":"2023-07-21T07:36:30.725630+0000","last_clean":"2023-07-21T07:36:30.725630+0000","last_became_active":"2023-07-21T07:36:28.548904+0000","last_became_peered":"2023-07-21T07:36:28.548904+0000","last_unstale":"2023-07-21T07:36:30.725630+0000","last_undegraded":"2023-07-21T07:36:30.725630+0000","last_fullsized":"2023-07-21T07:36:30.725630+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:56:50.368327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"53'2","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545830+0000","last_change":"2023-07-21T07:36:27.544775+0000","last_active":"2023-07-21T07:36:29.545830+0000","last_peered":"2023-07-21T07:36:29.545830+0000","last_clean":"2023-07-21T07:36:29.545830+0000","last_became_active":"2023-07-21T07:36:27.544495+0000","last_became_peered":"2023-07-21T07:36:27.544495+0000","last_unstale":"2023-07-21T07:36:29.545830+0000","last_undegraded":"2023-07-21T07:36:29.545830+0000","last_fullsized":"2023-07-21T07:36:29.545830+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:19:37.263451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.546616+0000","last_change":"2023-07-21T07:36:28.553926+0000","last_active":"2023-07-21T07:36:29.546616+0000","last_peered":"2023-07-21T07:36:29.546616+0000","last_clean":"2023-07-21T07:36:29.546616+0000","last_became_active":"2023-07-21T07:36:28.551968+0000","last_became_peered":"2023-07-21T07:36:28.551968+0000","last_unstale":"2023-07-21T07:36:29.546616+0000","last_undegraded":"2023-07-21T07:36:29.546616+0000","last_fullsized":"2023-07-21T07:36:29.546616+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:04:00.194503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.546282+0000","last_change":"2023-07-21T07:36:27.550743+0000","last_active":"2023-07-21T07:36:29.546282+0000","last_peered":"2023-07-21T07:36:29.546282+0000","last_clean":"2023-07-21T07:36:29.546282+0000","last_became_active":"2023-07-21T07:36:27.550521+0000","last_became_peered":"2023-07-21T07:36:27.550521+0000","last_unstale":"2023-07-21T07:36:29.546282+0000","last_undegraded":"2023-07-21T07:36:29.546282+0000","last_fullsized":"2023-07-21T07:36:29.546282+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:40:12.809857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279756+0000","last_change":"2023-07-21T07:36:28.555482+0000","last_active":"2023-07-21T07:36:30.279756+0000","last_peered":"2023-07-21T07:36:30.279756+0000","last_clean":"2023-07-21T07:36:30.279756+0000","last_became_active":"2023-07-21T07:36:28.554468+0000","last_became_peered":"2023-07-21T07:36:28.554468+0000","last_unstale":"2023-07-21T07:36:30.279756+0000","last_undegraded":"2023-07-21T07:36:30.279756+0000","last_fullsized":"2023-07-21T07:36:30.279756+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:02:56.001893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.546484+0000","last_change":"2023-07-21T07:36:27.542687+0000","last_active":"2023-07-21T07:36:29.546484+0000","last_peered":"2023-07-21T07:36:29.546484+0000","last_clean":"2023-07-21T07:36:29.546484+0000","last_became_active":"2023-07-21T07:36:27.542483+0000","last_became_peered":"2023-07-21T07:36:27.542483+0000","last_unstale":"2023-07-21T07:36:29.546484+0000","last_undegraded":"2023-07-21T07:36:29.546484+0000","last_fullsized":"2023-07-21T07:36:29.546484+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:15:40.424401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543556+0000","last_change":"2023-07-21T07:36:28.546081+0000","last_active":"2023-07-21T07:36:29.543556+0000","last_peered":"2023-07-21T07:36:29.543556+0000","last_clean":"2023-07-21T07:36:29.543556+0000","last_became_active":"2023-07-21T07:36:28.545781+0000","last_became_peered":"2023-07-21T07:36:28.545781+0000","last_unstale":"2023-07-21T07:36:29.543556+0000","last_undegraded":"2023-07-21T07:36:29.543556+0000","last_fullsized":"2023-07-21T07:36:29.543556+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:25:10.591064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'8","reported_seq":21,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725624+0000","last_change":"2023-07-21T07:36:27.549363+0000","last_active":"2023-07-21T07:36:30.725624+0000","last_peered":"2023-07-21T07:36:30.725624+0000","last_clean":"2023-07-21T07:36:30.725624+0000","last_became_active":"2023-07-21T07:36:27.548945+0000","last_became_peered":"2023-07-21T07:36:27.548945+0000","last_unstale":"2023-07-21T07:36:30.725624+0000","last_undegraded":"2023-07-21T07:36:30.725624+0000","last_fullsized":"2023-07-21T07:36:30.725624+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:15:15.630428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.065649+0000","last_change":"2023-07-21T07:36:28.551178+0000","last_active":"2023-07-21T07:36:30.065649+0000","last_peered":"2023-07-21T07:36:30.065649+0000","last_clean":"2023-07-21T07:36:30.065649+0000","last_became_active":"2023-07-21T07:36:28.550868+0000","last_became_peered":"2023-07-21T07:36:28.550868+0000","last_unstale":"2023-07-21T07:36:30.065649+0000","last_undegraded":"2023-07-21T07:36:30.065649+0000","last_fullsized":"2023-07-21T07:36:30.065649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:11:32.617795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"53'2","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545554+0000","last_change":"2023-07-21T07:36:27.550087+0000","last_active":"2023-07-21T07:36:29.545554+0000","last_peered":"2023-07-21T07:36:29.545554+0000","last_clean":"2023-07-21T07:36:29.545554+0000","last_became_active":"2023-07-21T07:36:27.549834+0000","last_became_peered":"2023-07-21T07:36:27.549834+0000","last_unstale":"2023-07-21T07:36:29.545554+0000","last_undegraded":"2023-07-21T07:36:29.545554+0000","last_fullsized":"2023-07-21T07:36:29.545554+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:29:22.798812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726130+0000","last_change":"2023-07-21T07:36:28.554479+0000","last_active":"2023-07-21T07:36:30.726130+0000","last_peered":"2023-07-21T07:36:30.726130+0000","last_clean":"2023-07-21T07:36:30.726130+0000","last_became_active":"2023-07-21T07:36:28.554145+0000","last_became_peered":"2023-07-21T07:36:28.554145+0000","last_unstale":"2023-07-21T07:36:30.726130+0000","last_undegraded":"2023-07-21T07:36:30.726130+0000","last_fullsized":"2023-07-21T07:36:30.726130+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:06:53.576148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545748+0000","last_change":"2023-07-21T07:36:27.545216+0000","last_active":"2023-07-21T07:36:29.545748+0000","last_peered":"2023-07-21T07:36:29.545748+0000","last_clean":"2023-07-21T07:36:29.545748+0000","last_became_active":"2023-07-21T07:36:27.544952+0000","last_became_peered":"2023-07-21T07:36:27.544952+0000","last_unstale":"2023-07-21T07:36:29.545748+0000","last_undegraded":"2023-07-21T07:36:29.545748+0000","last_fullsized":"2023-07-21T07:36:29.545748+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:15:40.424401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545607+0000","last_change":"2023-07-21T07:36:28.554762+0000","last_active":"2023-07-21T07:36:29.545607+0000","last_peered":"2023-07-21T07:36:29.545607+0000","last_clean":"2023-07-21T07:36:29.545607+0000","last_became_active":"2023-07-21T07:36:28.554473+0000","last_became_peered":"2023-07-21T07:36:28.554473+0000","last_unstale":"2023-07-21T07:36:29.545607+0000","last_undegraded":"2023-07-21T07:36:29.545607+0000","last_fullsized":"2023-07-21T07:36:29.545607+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:36:57.945900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.065768+0000","last_change":"2023-07-21T07:36:27.548955+0000","last_active":"2023-07-21T07:36:30.065768+0000","last_peered":"2023-07-21T07:36:30.065768+0000","last_clean":"2023-07-21T07:36:30.065768+0000","last_became_active":"2023-07-21T07:36:27.548615+0000","last_became_peered":"2023-07-21T07:36:27.548615+0000","last_unstale":"2023-07-21T07:36:30.065768+0000","last_undegraded":"2023-07-21T07:36:30.065768+0000","last_fullsized":"2023-07-21T07:36:30.065768+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:14:50.100812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280328+0000","last_change":"2023-07-21T07:36:28.553270+0000","last_active":"2023-07-21T07:36:30.280328+0000","last_peered":"2023-07-21T07:36:30.280328+0000","last_clean":"2023-07-21T07:36:30.280328+0000","last_became_active":"2023-07-21T07:36:28.552988+0000","last_became_peered":"2023-07-21T07:36:28.552988+0000","last_unstale":"2023-07-21T07:36:30.280328+0000","last_undegraded":"2023-07-21T07:36:30.280328+0000","last_fullsized":"2023-07-21T07:36:30.280328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:31:25.239166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543615+0000","last_change":"2023-07-21T07:36:27.546128+0000","last_active":"2023-07-21T07:36:29.543615+0000","last_peered":"2023-07-21T07:36:29.543615+0000","last_clean":"2023-07-21T07:36:29.543615+0000","last_became_active":"2023-07-21T07:36:27.545829+0000","last_became_peered":"2023-07-21T07:36:27.545829+0000","last_unstale":"2023-07-21T07:36:29.543615+0000","last_undegraded":"2023-07-21T07:36:29.543615+0000","last_fullsized":"2023-07-21T07:36:29.543615+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:18:16.539928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279643+0000","last_change":"2023-07-21T07:36:28.550679+0000","last_active":"2023-07-21T07:36:30.279643+0000","last_peered":"2023-07-21T07:36:30.279643+0000","last_clean":"2023-07-21T07:36:30.279643+0000","last_became_active":"2023-07-21T07:36:28.550320+0000","last_became_peered":"2023-07-21T07:36:28.550320+0000","last_unstale":"2023-07-21T07:36:30.279643+0000","last_undegraded":"2023-07-21T07:36:30.279643+0000","last_fullsized":"2023-07-21T07:36:30.279643+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:20:36.808964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.546078+0000","last_change":"2023-07-21T07:36:27.542890+0000","last_active":"2023-07-21T07:36:29.546078+0000","last_peered":"2023-07-21T07:36:29.546078+0000","last_clean":"2023-07-21T07:36:29.546078+0000","last_became_active":"2023-07-21T07:36:27.542614+0000","last_became_peered":"2023-07-21T07:36:27.542614+0000","last_unstale":"2023-07-21T07:36:29.546078+0000","last_undegraded":"2023-07-21T07:36:29.546078+0000","last_fullsized":"2023-07-21T07:36:29.546078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:48:00.998896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725745+0000","last_change":"2023-07-21T07:36:28.549203+0000","last_active":"2023-07-21T07:36:30.725745+0000","last_peered":"2023-07-21T07:36:30.725745+0000","last_clean":"2023-07-21T07:36:30.725745+0000","last_became_active":"2023-07-21T07:36:28.548933+0000","last_became_peered":"2023-07-21T07:36:28.548933+0000","last_unstale":"2023-07-21T07:36:30.725745+0000","last_undegraded":"2023-07-21T07:36:30.725745+0000","last_fullsized":"2023-07-21T07:36:30.725745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:24:40.746510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725435+0000","last_change":"2023-07-21T07:36:27.535134+0000","last_active":"2023-07-21T07:36:30.725435+0000","last_peered":"2023-07-21T07:36:30.725435+0000","last_clean":"2023-07-21T07:36:30.725435+0000","last_became_active":"2023-07-21T07:36:27.534830+0000","last_became_peered":"2023-07-21T07:36:27.534830+0000","last_unstale":"2023-07-21T07:36:30.725435+0000","last_undegraded":"2023-07-21T07:36:30.725435+0000","last_fullsized":"2023-07-21T07:36:30.725435+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:14:16.607217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543559+0000","last_change":"2023-07-21T07:36:28.549213+0000","last_active":"2023-07-21T07:36:29.543559+0000","last_peered":"2023-07-21T07:36:29.543559+0000","last_clean":"2023-07-21T07:36:29.543559+0000","last_became_active":"2023-07-21T07:36:28.548890+0000","last_became_peered":"2023-07-21T07:36:28.548890+0000","last_unstale":"2023-07-21T07:36:29.543559+0000","last_undegraded":"2023-07-21T07:36:29.543559+0000","last_fullsized":"2023-07-21T07:36:29.543559+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:39:43.391138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725487+0000","last_change":"2023-07-21T07:36:27.545372+0000","last_active":"2023-07-21T07:36:30.725487+0000","last_peered":"2023-07-21T07:36:30.725487+0000","last_clean":"2023-07-21T07:36:30.725487+0000","last_became_active":"2023-07-21T07:36:27.544933+0000","last_became_peered":"2023-07-21T07:36:27.544933+0000","last_unstale":"2023-07-21T07:36:30.725487+0000","last_undegraded":"2023-07-21T07:36:30.725487+0000","last_fullsized":"2023-07-21T07:36:30.725487+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:59:06.453773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725917+0000","last_change":"2023-07-21T07:36:28.561703+0000","last_active":"2023-07-21T07:36:30.725917+0000","last_peered":"2023-07-21T07:36:30.725917+0000","last_clean":"2023-07-21T07:36:30.725917+0000","last_became_active":"2023-07-21T07:36:28.561400+0000","last_became_peered":"2023-07-21T07:36:28.561400+0000","last_unstale":"2023-07-21T07:36:30.725917+0000","last_undegraded":"2023-07-21T07:36:30.725917+0000","last_fullsized":"2023-07-21T07:36:30.725917+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:21:40.954647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543373+0000","last_change":"2023-07-21T07:36:27.542037+0000","last_active":"2023-07-21T07:36:29.543373+0000","last_peered":"2023-07-21T07:36:29.543373+0000","last_clean":"2023-07-21T07:36:29.543373+0000","last_became_active":"2023-07-21T07:36:27.541783+0000","last_became_peered":"2023-07-21T07:36:27.541783+0000","last_unstale":"2023-07-21T07:36:29.543373+0000","last_undegraded":"2023-07-21T07:36:29.543373+0000","last_fullsized":"2023-07-21T07:36:29.543373+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:47:19.494591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280363+0000","last_change":"2023-07-21T07:36:28.553251+0000","last_active":"2023-07-21T07:36:30.280363+0000","last_peered":"2023-07-21T07:36:30.280363+0000","last_clean":"2023-07-21T07:36:30.280363+0000","last_became_active":"2023-07-21T07:36:28.552971+0000","last_became_peered":"2023-07-21T07:36:28.552971+0000","last_unstale":"2023-07-21T07:36:30.280363+0000","last_undegraded":"2023-07-21T07:36:30.280363+0000","last_fullsized":"2023-07-21T07:36:30.280363+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:17.537518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725809+0000","last_change":"2023-07-21T07:36:27.548492+0000","last_active":"2023-07-21T07:36:30.725809+0000","last_peered":"2023-07-21T07:36:30.725809+0000","last_clean":"2023-07-21T07:36:30.725809+0000","last_became_active":"2023-07-21T07:36:27.548083+0000","last_became_peered":"2023-07-21T07:36:27.548083+0000","last_unstale":"2023-07-21T07:36:30.725809+0000","last_undegraded":"2023-07-21T07:36:30.725809+0000","last_fullsized":"2023-07-21T07:36:30.725809+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:31:50.867525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280415+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:36:30.280415+0000","last_peered":"2023-07-21T07:36:30.280415+0000","last_clean":"2023-07-21T07:36:30.280415+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:36:30.280415+0000","last_undegraded":"2023-07-21T07:36:30.280415+0000","last_fullsized":"2023-07-21T07:36:30.280415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:18:18.973777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.726034+0000","last_change":"2023-07-21T07:36:28.550245+0000","last_active":"2023-07-21T07:36:30.726034+0000","last_peered":"2023-07-21T07:36:30.726034+0000","last_clean":"2023-07-21T07:36:30.726034+0000","last_became_active":"2023-07-21T07:36:28.548746+0000","last_became_peered":"2023-07-21T07:36:28.548746+0000","last_unstale":"2023-07-21T07:36:30.726034+0000","last_undegraded":"2023-07-21T07:36:30.726034+0000","last_fullsized":"2023-07-21T07:36:30.726034+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:17:46.007416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"53'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545744+0000","last_change":"2023-07-21T07:36:27.542066+0000","last_active":"2023-07-21T07:36:29.545744+0000","last_peered":"2023-07-21T07:36:29.545744+0000","last_clean":"2023-07-21T07:36:29.545744+0000","last_became_active":"2023-07-21T07:36:27.541789+0000","last_became_peered":"2023-07-21T07:36:27.541789+0000","last_unstale":"2023-07-21T07:36:29.545744+0000","last_undegraded":"2023-07-21T07:36:29.545744+0000","last_fullsized":"2023-07-21T07:36:29.545744+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:19:21.744719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543977+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:36:29.543977+0000","last_peered":"2023-07-21T07:36:29.543977+0000","last_clean":"2023-07-21T07:36:29.543977+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:36:29.543977+0000","last_undegraded":"2023-07-21T07:36:29.543977+0000","last_fullsized":"2023-07-21T07:36:29.543977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:08:25.435210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.280017+0000","last_change":"2023-07-21T07:36:28.555257+0000","last_active":"2023-07-21T07:36:30.280017+0000","last_peered":"2023-07-21T07:36:30.280017+0000","last_clean":"2023-07-21T07:36:30.280017+0000","last_became_active":"2023-07-21T07:36:28.554356+0000","last_became_peered":"2023-07-21T07:36:28.554356+0000","last_unstale":"2023-07-21T07:36:30.280017+0000","last_undegraded":"2023-07-21T07:36:30.280017+0000","last_fullsized":"2023-07-21T07:36:30.280017+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:07:09.045197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"53'2","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545970+0000","last_change":"2023-07-21T07:36:27.547064+0000","last_active":"2023-07-21T07:36:29.545970+0000","last_peered":"2023-07-21T07:36:29.545970+0000","last_clean":"2023-07-21T07:36:29.545970+0000","last_became_active":"2023-07-21T07:36:27.546817+0000","last_became_peered":"2023-07-21T07:36:27.546817+0000","last_unstale":"2023-07-21T07:36:29.545970+0000","last_undegraded":"2023-07-21T07:36:29.545970+0000","last_fullsized":"2023-07-21T07:36:29.545970+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:36:56.940428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545903+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:36:29.545903+0000","last_peered":"2023-07-21T07:36:29.545903+0000","last_clean":"2023-07-21T07:36:29.545903+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:36:29.545903+0000","last_undegraded":"2023-07-21T07:36:29.545903+0000","last_fullsized":"2023-07-21T07:36:29.545903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:39:38.070367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.065490+0000","last_change":"2023-07-21T07:36:28.556796+0000","last_active":"2023-07-21T07:36:30.065490+0000","last_peered":"2023-07-21T07:36:30.065490+0000","last_clean":"2023-07-21T07:36:30.065490+0000","last_became_active":"2023-07-21T07:36:28.556511+0000","last_became_peered":"2023-07-21T07:36:28.556511+0000","last_unstale":"2023-07-21T07:36:30.065490+0000","last_undegraded":"2023-07-21T07:36:30.065490+0000","last_fullsized":"2023-07-21T07:36:30.065490+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:58:53.356958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"53'2","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.065722+0000","last_change":"2023-07-21T07:36:27.546993+0000","last_active":"2023-07-21T07:36:30.065722+0000","last_peered":"2023-07-21T07:36:30.065722+0000","last_clean":"2023-07-21T07:36:30.065722+0000","last_became_active":"2023-07-21T07:36:27.546675+0000","last_became_peered":"2023-07-21T07:36:27.546675+0000","last_unstale":"2023-07-21T07:36:30.065722+0000","last_undegraded":"2023-07-21T07:36:30.065722+0000","last_fullsized":"2023-07-21T07:36:30.065722+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:10:25.051264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545754+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:36:29.545754+0000","last_peered":"2023-07-21T07:36:29.545754+0000","last_clean":"2023-07-21T07:36:29.545754+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:36:29.545754+0000","last_undegraded":"2023-07-21T07:36:29.545754+0000","last_fullsized":"2023-07-21T07:36:29.545754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:53:25.418049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279886+0000","last_change":"2023-07-21T07:36:28.550594+0000","last_active":"2023-07-21T07:36:30.279886+0000","last_peered":"2023-07-21T07:36:30.279886+0000","last_clean":"2023-07-21T07:36:30.279886+0000","last_became_active":"2023-07-21T07:36:28.550307+0000","last_became_peered":"2023-07-21T07:36:28.550307+0000","last_unstale":"2023-07-21T07:36:30.279886+0000","last_undegraded":"2023-07-21T07:36:30.279886+0000","last_fullsized":"2023-07-21T07:36:30.279886+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:36:10.034314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725328+0000","last_change":"2023-07-21T07:36:27.545082+0000","last_active":"2023-07-21T07:36:30.725328+0000","last_peered":"2023-07-21T07:36:30.725328+0000","last_clean":"2023-07-21T07:36:30.725328+0000","last_became_active":"2023-07-21T07:36:27.544787+0000","last_became_peered":"2023-07-21T07:36:27.544787+0000","last_unstale":"2023-07-21T07:36:30.725328+0000","last_undegraded":"2023-07-21T07:36:30.725328+0000","last_fullsized":"2023-07-21T07:36:30.725328+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:20:03.237274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":224,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545963+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:36:29.545963+0000","last_peered":"2023-07-21T07:36:29.545963+0000","last_clean":"2023-07-21T07:36:29.545963+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:36:29.545963+0000","last_undegraded":"2023-07-21T07:36:29.545963+0000","last_fullsized":"2023-07-21T07:36:29.545963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:14:40.132618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545197+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:36:29.545197+0000","last_peered":"2023-07-21T07:36:29.545197+0000","last_clean":"2023-07-21T07:36:29.545197+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:36:29.545197+0000","last_undegraded":"2023-07-21T07:36:29.545197+0000","last_fullsized":"2023-07-21T07:36:29.545197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:46:08.320562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545203+0000","last_change":"2023-07-21T07:36:28.555760+0000","last_active":"2023-07-21T07:36:29.545203+0000","last_peered":"2023-07-21T07:36:29.545203+0000","last_clean":"2023-07-21T07:36:29.545203+0000","last_became_active":"2023-07-21T07:36:28.555505+0000","last_became_peered":"2023-07-21T07:36:28.555505+0000","last_unstale":"2023-07-21T07:36:29.545203+0000","last_undegraded":"2023-07-21T07:36:29.545203+0000","last_fullsized":"2023-07-21T07:36:29.545203+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:14:45.455549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.546446+0000","last_change":"2023-07-21T07:36:27.550572+0000","last_active":"2023-07-21T07:36:29.546446+0000","last_peered":"2023-07-21T07:36:29.546446+0000","last_clean":"2023-07-21T07:36:29.546446+0000","last_became_active":"2023-07-21T07:36:27.550195+0000","last_became_peered":"2023-07-21T07:36:27.550195+0000","last_unstale":"2023-07-21T07:36:29.546446+0000","last_undegraded":"2023-07-21T07:36:29.546446+0000","last_fullsized":"2023-07-21T07:36:29.546446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:04:23.493757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.725668+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:36:30.725668+0000","last_peered":"2023-07-21T07:36:30.725668+0000","last_clean":"2023-07-21T07:36:30.725668+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:36:30.725668+0000","last_undegraded":"2023-07-21T07:36:30.725668+0000","last_fullsized":"2023-07-21T07:36:30.725668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:10:59.819304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.279848+0000","last_change":"2023-07-21T07:36:28.552513+0000","last_active":"2023-07-21T07:36:30.279848+0000","last_peered":"2023-07-21T07:36:30.279848+0000","last_clean":"2023-07-21T07:36:30.279848+0000","last_became_active":"2023-07-21T07:36:28.551895+0000","last_became_peered":"2023-07-21T07:36:28.551895+0000","last_unstale":"2023-07-21T07:36:30.279848+0000","last_undegraded":"2023-07-21T07:36:30.279848+0000","last_fullsized":"2023-07-21T07:36:30.279848+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:44:16.702073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:30.065495+0000","last_change":"2023-07-21T07:36:27.544373+0000","last_active":"2023-07-21T07:36:30.065495+0000","last_peered":"2023-07-21T07:36:30.065495+0000","last_clean":"2023-07-21T07:36:30.065495+0000","last_became_active":"2023-07-21T07:36:27.544074+0000","last_became_peered":"2023-07-21T07:36:27.544074+0000","last_unstale":"2023-07-21T07:36:30.065495+0000","last_undegraded":"2023-07-21T07:36:30.065495+0000","last_fullsized":"2023-07-21T07:36:30.065495+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:51:08.765704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.546585+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:36:29.546585+0000","last_peered":"2023-07-21T07:36:29.546585+0000","last_clean":"2023-07-21T07:36:29.546585+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:36:29.546585+0000","last_undegraded":"2023-07-21T07:36:29.546585+0000","last_fullsized":"2023-07-21T07:36:29.546585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:28:30.230344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.546122+0000","last_change":"2023-07-21T07:36:28.553427+0000","last_active":"2023-07-21T07:36:29.546122+0000","last_peered":"2023-07-21T07:36:29.546122+0000","last_clean":"2023-07-21T07:36:29.546122+0000","last_became_active":"2023-07-21T07:36:28.553096+0000","last_became_peered":"2023-07-21T07:36:28.553096+0000","last_unstale":"2023-07-21T07:36:29.546122+0000","last_undegraded":"2023-07-21T07:36:29.546122+0000","last_fullsized":"2023-07-21T07:36:29.546122+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:13:11.986531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"53'1","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.545497+0000","last_change":"2023-07-21T07:36:27.550570+0000","last_active":"2023-07-21T07:36:29.545497+0000","last_peered":"2023-07-21T07:36:29.545497+0000","last_clean":"2023-07-21T07:36:29.545497+0000","last_became_active":"2023-07-21T07:36:27.550296+0000","last_became_peered":"2023-07-21T07:36:27.550296+0000","last_unstale":"2023-07-21T07:36:29.545497+0000","last_undegraded":"2023-07-21T07:36:29.545497+0000","last_fullsized":"2023-07-21T07:36:29.545497+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:04:47.446026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-07-21T07:36:29.543544+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:36:29.543544+0000","last_peered":"2023-07-21T07:36:29.543544+0000","last_clean":"2023-07-21T07:36:29.543544+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:36:29.543544+0000","last_undegraded":"2023-07-21T07:36:29.543544+0000","last_fullsized":"2023-07-21T07:36:29.543544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:53:43.924057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1257472,"data_stored":877905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.71999999999999997,"5min":0.876,"15min":0.876},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.75,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.67800000000000005,"5min":0.871,"15min":0.871},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.44400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72899999999999998,"5min":0.878,"15min":0.878},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.628}]},{"osd":3,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.64600000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60199999999999998,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71499999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59899999999999998}]},{"osd":4,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71399999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61499999999999999}]},{"osd":5,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86799999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.47599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":286795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":8.4990000000000006,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.4039999999999999,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Jul 21 07:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":675840,"data_stored":289089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34699999999999998,"15min":0.35099999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.502,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.249,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.49399999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.26000000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.34699999999999998,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.44700000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.307},{"interface":"front","average":{"1min":0.433,"5min":0.436,"15min":0.436},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.379}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.57499999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.40600000000000003,"15min":0.41199999999999998},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56299999999999994,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59699999999999998,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89300000000000002,"5min":1.006,"15min":1.006},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73599999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63400000000000001,"15min":0.64600000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80500000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82699999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.64000000000000001,"15min":0.65500000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68600000000000005,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.45800000000000002}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.69099999999999995,"15min":0.70899999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85299999999999998,"5min":1.339,"15min":1.339},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.747,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.503}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1241088,"data_stored":877129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.373,"15min":0.378},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52000000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.497,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.377,"15min":0.376},"min":{"1min":0.26800000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.60599999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.32400000000000001}]},{"osd":3,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.37,"15min":0.372},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51500000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66100000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.374}]},{"osd":4,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69699999999999995,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83999999999999997,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81299999999999994,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.76400000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.77600000000000002,"15min":0.80800000000000005},"min":{"1min":0.47499999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.751,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79400000000000004,"5min":1.002,"15min":1.002},"last":0.57099999999999995}]},{"osd":7,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85999999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.504,"5min":0.433,"15min":0.433},"max":{"1min":0.72899999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":647168,"data_stored":286761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.35399999999999998},"min":{"1min":0.23599999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45900000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34899999999999998,"15min":0.34999999999999998},"min":{"1min":0.249,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.27500000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.29499999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.49199999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34300000000000003}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.51900000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.32800000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60099999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.434,"5min":0.379,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82199999999999995,"5min":1.127,"15min":1.127},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76000000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":1.109,"15min":1.109},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.622,"15min":0.61299999999999999},"min":{"1min":0.501,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88400000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.60299999999999998},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84699999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.67200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":647168,"data_stored":286761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.374},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.309}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.33500000000000002}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.28999999999999998}]},{"osd":4,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.627},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.748}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":288325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":10.18,"5min":10.18,"15min":10.18},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":10.207000000000001,"5min":10.207000000000001,"15min":10.207000000000001},"last":0.496}]},{"osd":1,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.65300000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.46600000000000003}]},{"osd":7,"last update":"Fri Jul 21 07:35:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.625}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":651264,"data_stored":286783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64400000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.38700000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70399999999999996,"5min":0.751,"15min":0.751},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53900000000000003,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.68700000000000006,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.67300000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.70399999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.42199999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.623,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.47199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.62,"15min":0.624},"min":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.67300000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.60799999999999998}]},{"osd":4,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.72599999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.42599999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69299999999999995,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.70999999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.72499999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.75,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.75}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:36:37.771 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T07:36:37.772 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T07:36:37.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.883+0000 7f07c6d3a700 1 Processor -- start 2023-07-21T07:36:37.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.883+0000 7f07c6d3a700 1 -- start start 2023-07-21T07:36:37.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.884+0000 7f07c6d3a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c00ba140 0x7f07c00c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.884+0000 7f07c6d3a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f07c006d8a0 0x7f07c00c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.884+0000 7f07c6d3a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c0155530 con 0x7f07c006a300 2023-07-21T07:36:37.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.884+0000 7f07c6d3a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c00c1a30 con 0x7f07c006d8a0 2023-07-21T07:36:37.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.884+0000 7f07c6d3a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0154920 con 0x7f07c00ba140 2023-07-21T07:36:37.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.884+0000 7f07c4ad6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f07c006a300 0x7f07c01519b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44130/0 (socket says 172.21.15.6:44130) 2023-07-21T07:36:37.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.884+0000 7f07c4ad6700 1 -- 172.21.15.6:0/3318324611 learned_addr learned my addr 172.21.15.6:0/3318324611 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:37.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.884+0000 7f07c52d7700 1 --2- 172.21.15.6:0/3318324611 >> v2:172.21.15.86:3300/0 conn(0x7f07c006d8a0 0x7f07c00c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.884+0000 7f07bffff700 1 --2- 172.21.15.6:0/3318324611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c00ba140 0x7f07c00c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.884+0000 7f07bf7fe700 1 -- 172.21.15.6:0/3318324611 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048582615 0 0) 0x7f07c0155530 con 0x7f07c006a300 2023-07-21T07:36:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.884+0000 7f07bf7fe700 1 -- 172.21.15.6:0/3318324611 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07b00035b0 con 0x7f07c006a300 2023-07-21T07:36:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.885+0000 7f07bffff700 1 -- 172.21.15.6:0/3318324611 >> v2:172.21.15.86:3300/0 conn(0x7f07c006d8a0 msgr2=0x7f07c00c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.885+0000 7f07bffff700 1 --2- 172.21.15.6:0/3318324611 >> v2:172.21.15.86:3300/0 conn(0x7f07c006d8a0 0x7f07c00c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.885+0000 7f07bffff700 1 -- 172.21.15.6:0/3318324611 >> v1:172.21.15.6:6789/0 conn(0x7f07c006a300 legacy=0x7f07c01519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.885+0000 7f07bffff700 1 -- 172.21.15.6:0/3318324611 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c0154c00 con 0x7f07c00ba140 2023-07-21T07:36:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.885+0000 7f07c52d7700 1 --2- 172.21.15.6:0/3318324611 >> v2:172.21.15.86:3300/0 conn(0x7f07c006d8a0 0x7f07c00c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:37.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.885+0000 7f07bffff700 1 --2- 172.21.15.6:0/3318324611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c00ba140 0x7f07c00c4a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07ac009840 tx=0x7f07ac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49d1ca51312d40bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:37.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.885+0000 7f07bf7fe700 1 -- 172.21.15.6:0/3318324611 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac011830 con 0x7f07c00ba140 2023-07-21T07:36:37.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.885+0000 7f07bf7fe700 1 -- 172.21.15.6:0/3318324611 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ac011990 con 0x7f07c00ba140 2023-07-21T07:36:37.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.885+0000 7f07bf7fe700 1 -- 172.21.15.6:0/3318324611 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac011d00 con 0x7f07c00ba140 2023-07-21T07:36:37.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.885+0000 7f07c6d3a700 1 -- 172.21.15.6:0/3318324611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c00ba140 msgr2=0x7f07c00c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:37.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.885+0000 7f07c6d3a700 1 --2- 172.21.15.6:0/3318324611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c00ba140 0x7f07c00c4a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07ac009840 tx=0x7f07ac009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:37.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.886+0000 7f07c6d3a700 1 -- 172.21.15.6:0/3318324611 shutdown_connections 2023-07-21T07:36:37.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.886+0000 7f07c6d3a700 1 --2- 172.21.15.6:0/3318324611 >> v2:172.21.15.86:3300/0 conn(0x7f07c006d8a0 0x7f07c00c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.886+0000 7f07c6d3a700 1 --2- 172.21.15.6:0/3318324611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c00ba140 0x7f07c00c4a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.886+0000 7f07c6d3a700 1 -- 172.21.15.6:0/3318324611 >> 172.21.15.6:0/3318324611 conn(0x7f07c00a8660 msgr2=0x7f07c00a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:37.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.886+0000 7f07c6d3a700 1 -- 172.21.15.6:0/3318324611 shutdown_connections 2023-07-21T07:36:37.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.886+0000 7f07c6d3a700 1 -- 172.21.15.6:0/3318324611 wait complete. 2023-07-21T07:36:37.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.887+0000 7f07c6d3a700 1 Processor -- start 2023-07-21T07:36:37.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.887+0000 7f07c6d3a700 1 -- start start 2023-07-21T07:36:37.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.888+0000 7f07c6d3a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006a300 0x7f07c00a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.888+0000 7f07c6d3a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07c006d8a0 0x7f07c0071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.888+0000 7f07c6d3a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c00ba140 0x7f07c0071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.888+0000 7f07c6d3a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00a70c0 con 0x7f07c006d8a0 2023-07-21T07:36:37.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.888+0000 7f07c6d3a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00716a0 con 0x7f07c006a300 2023-07-21T07:36:37.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.888+0000 7f07c6d3a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00a8480 con 0x7f07c00ba140 2023-07-21T07:36:37.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.888+0000 7f07bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07c006d8a0 0x7f07c0071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.888+0000 7f07bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07c006d8a0 0x7f07c0071a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36116/0 (socket says 172.21.15.6:36116) 2023-07-21T07:36:37.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.888+0000 7f07bffff700 1 -- 172.21.15.6:0/1235978493 learned_addr learned my addr 172.21.15.6:0/1235978493 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:37.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07c52d7700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c00ba140 0x7f07c0071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07c4ad6700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006a300 0x7f07c00a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07bffff700 1 -- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c00ba140 msgr2=0x7f07c0071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:37.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07bffff700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c00ba140 0x7f07c0071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07bffff700 1 -- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006a300 msgr2=0x7f07c00a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:37.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07bffff700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006a300 0x7f07c00a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:37.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07bffff700 1 -- 172.21.15.6:0/1235978493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b8009a70 con 0x7f07c006d8a0 2023-07-21T07:36:37.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07c4ad6700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006a300 0x7f07c00a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:37.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07bffff700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07c006d8a0 0x7f07c0071a30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0090b0 tx=0x7f07ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:37.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07bd7fa700 1 -- 172.21.15.6:0/1235978493 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac0043d0 con 0x7f07c006d8a0 2023-07-21T07:36:37.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07bd7fa700 1 -- 172.21.15.6:0/1235978493 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ac004530 con 0x7f07c006d8a0 2023-07-21T07:36:37.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07c6d3a700 1 -- 172.21.15.6:0/1235978493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ac0094a0 con 0x7f07c006d8a0 2023-07-21T07:36:37.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07bd7fa700 1 -- 172.21.15.6:0/1235978493 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac0038a0 con 0x7f07c006d8a0 2023-07-21T07:36:37.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.889+0000 7f07c6d3a700 1 -- 172.21.15.6:0/1235978493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c00a7640 con 0x7f07c006d8a0 2023-07-21T07:36:37.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.890+0000 7f07c6d3a700 1 -- 172.21.15.6:0/1235978493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c00a6260 con 0x7f07c006d8a0 2023-07-21T07:36:37.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.891+0000 7f07bd7fa700 1 -- 172.21.15.6:0/1235978493 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f07ac003a00 con 0x7f07c006d8a0 2023-07-21T07:36:37.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.891+0000 7f07bd7fa700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f07a406ace0 0x7f07a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:37.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.891+0000 7f07bd7fa700 1 -- 172.21.15.6:0/1235978493 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07ac08a270 con 0x7f07c006d8a0 2023-07-21T07:36:37.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.891+0000 7f07c4ad6700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f07a406ace0 0x7f07a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:37.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.892+0000 7f07c4ad6700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f07a406ace0 0x7f07a406d1a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f07b4005910 tx=0x7f07b4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:37.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:37.895+0000 7f07bd7fa700 1 -- 172.21.15.6:0/1235978493 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f07c00a6260 con 0x7f07c006d8a0 2023-07-21T07:36:38.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.177+0000 7f07c6d3a700 1 -- 172.21.15.6:0/1235978493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f07c00a6260 con 0x7f07c006d8a0 2023-07-21T07:36:38.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.180+0000 7f07bd7fa700 1 -- 172.21.15.6:0/1235978493 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f07c00a6260 con 0x7f07c006d8a0 2023-07-21T07:36:38.234 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T07:36:38.235 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDVNLpkoWkHNxAAuz8SyrpFX/iEiqy/znfHAQ== 2023-07-21T07:36:38.235 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T07:36:38.235 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T07:36:38.235 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T07:36:38.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.182+0000 7f07c6d3a700 1 -- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f07a406ace0 msgr2=0x7f07a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:38.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.182+0000 7f07c6d3a700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f07a406ace0 0x7f07a406d1a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f07b4005910 tx=0x7f07b4009040 comp rx=0 tx=0).stop 2023-07-21T07:36:38.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.183+0000 7f07c6d3a700 1 -- 172.21.15.6:0/1235978493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07c006d8a0 msgr2=0x7f07c0071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:38.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.183+0000 7f07c6d3a700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07c006d8a0 0x7f07c0071a30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0090b0 tx=0x7f07ac004750 comp rx=0 tx=0).stop 2023-07-21T07:36:38.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.183+0000 7f07c6d3a700 1 -- 172.21.15.6:0/1235978493 shutdown_connections 2023-07-21T07:36:38.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.183+0000 7f07c6d3a700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f07a406ace0 0x7f07a406d1a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.183+0000 7f07c6d3a700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c00ba140 0x7f07c0071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.183+0000 7f07c6d3a700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c006a300 0x7f07c00a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.183+0000 7f07c6d3a700 1 --2- 172.21.15.6:0/1235978493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07c006d8a0 0x7f07c0071a30 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.183+0000 7f07c6d3a700 1 -- 172.21.15.6:0/1235978493 >> 172.21.15.6:0/1235978493 conn(0x7f07c00a8660 msgr2=0x7f07c0150de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:38.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.183+0000 7f07c6d3a700 1 -- 172.21.15.6:0/1235978493 shutdown_connections 2023-07-21T07:36:38.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.183+0000 7f07c6d3a700 1 -- 172.21.15.6:0/1235978493 wait complete. 2023-07-21T07:36:38.239 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-07-21T07:36:38.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:36:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.320+0000 7fb7eb53f700 1 Processor -- start 2023-07-21T07:36:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.320+0000 7fb7eb53f700 1 -- start start 2023-07-21T07:36:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.321+0000 7fb7eb53f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7e406a300 0x7fb7e40c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.321+0000 7fb7eb53f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb7e40c2bf0 0x7fb7e41516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.321+0000 7fb7eb53f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e40c3120 con 0x7fb7e4151be0 2023-07-21T07:36:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.321+0000 7fb7eb53f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e40c1e60 con 0x7fb7e40c2bf0 2023-07-21T07:36:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.321+0000 7fb7eb53f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4154860 con 0x7fb7e406a300 2023-07-21T07:36:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.321+0000 7fb7e9adc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb7e4151be0 0x7fb7e4157b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44144/0 (socket says 172.21.15.6:44144) 2023-07-21T07:36:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.321+0000 7fb7e9adc700 1 -- 172.21.15.6:0/865805647 learned_addr learned my addr 172.21.15.6:0/865805647 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.321+0000 7fb7e8ada700 1 --2- 172.21.15.6:0/865805647 >> v2:172.21.15.86:3300/0 conn(0x7fb7e40c2bf0 0x7fb7e41516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.321+0000 7fb7e92db700 1 --2- 172.21.15.6:0/865805647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7e406a300 0x7fb7e40c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.321+0000 7fb7dbfff700 1 -- 172.21.15.6:0/865805647 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586869681 0 0) 0x7fb7e40c3120 con 0x7fb7e4151be0 2023-07-21T07:36:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.321+0000 7fb7dbfff700 1 -- 172.21.15.6:0/865805647 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7d00035b0 con 0x7fb7e4151be0 2023-07-21T07:36:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.322+0000 7fb7e8ada700 1 -- 172.21.15.6:0/865805647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7e406a300 msgr2=0x7fb7e40c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.322+0000 7fb7dbfff700 1 -- 172.21.15.6:0/865805647 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2082338533 0 0) 0x7fb7d00035b0 con 0x7fb7e4151be0 2023-07-21T07:36:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.322+0000 7fb7e8ada700 1 --2- 172.21.15.6:0/865805647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7e406a300 0x7fb7e40c26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.322+0000 7fb7e8ada700 1 -- 172.21.15.6:0/865805647 >> v1:172.21.15.6:6789/0 conn(0x7fb7e4151be0 legacy=0x7fb7e4157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.322+0000 7fb7e8ada700 1 -- 172.21.15.6:0/865805647 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e4154b40 con 0x7fb7e40c2bf0 2023-07-21T07:36:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.322+0000 7fb7e92db700 1 --2- 172.21.15.6:0/865805647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7e406a300 0x7fb7e40c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.322+0000 7fb7e8ada700 1 --2- 172.21.15.6:0/865805647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7e40c2bf0 0x7fb7e41516a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009840 tx=0x7fb7e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=960d9e1857d8a20b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:38.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.322+0000 7fb7dbfff700 1 -- 172.21.15.6:0/865805647 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0019f0 con 0x7fb7e40c2bf0 2023-07-21T07:36:38.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.322+0000 7fb7dbfff700 1 -- 172.21.15.6:0/865805647 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e0004030 con 0x7fb7e40c2bf0 2023-07-21T07:36:38.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.322+0000 7fb7dbfff700 1 -- 172.21.15.6:0/865805647 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00043c0 con 0x7fb7e40c2bf0 2023-07-21T07:36:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.323+0000 7fb7eb53f700 1 -- 172.21.15.6:0/865805647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7e40c2bf0 msgr2=0x7fb7e41516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.323+0000 7fb7eb53f700 1 --2- 172.21.15.6:0/865805647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7e40c2bf0 0x7fb7e41516a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009840 tx=0x7fb7e0009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.323+0000 7fb7eb53f700 1 -- 172.21.15.6:0/865805647 shutdown_connections 2023-07-21T07:36:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.323+0000 7fb7eb53f700 1 --2- 172.21.15.6:0/865805647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7e406a300 0x7fb7e40c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.323+0000 7fb7eb53f700 1 --2- 172.21.15.6:0/865805647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7e40c2bf0 0x7fb7e41516a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.323+0000 7fb7eb53f700 1 -- 172.21.15.6:0/865805647 >> 172.21.15.6:0/865805647 conn(0x7fb7e40a8c90 msgr2=0x7fb7e406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.323+0000 7fb7eb53f700 1 -- 172.21.15.6:0/865805647 shutdown_connections 2023-07-21T07:36:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.323+0000 7fb7eb53f700 1 -- 172.21.15.6:0/865805647 wait complete. 2023-07-21T07:36:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.324+0000 7fb7eb53f700 1 Processor -- start 2023-07-21T07:36:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.324+0000 7fb7eb53f700 1 -- start start 2023-07-21T07:36:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7eb53f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e406a300 0x7fb7e414f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7eb53f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7e40c2bf0 0x7fb7e40bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7eb53f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7e4151be0 0x7fb7e40be2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7eb53f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4071110 con 0x7fb7e406a300 2023-07-21T07:36:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7eb53f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e40715a0 con 0x7fb7e4151be0 2023-07-21T07:36:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7eb53f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e40bd940 con 0x7fb7e40c2bf0 2023-07-21T07:36:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7e92db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e406a300 0x7fb7e414f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7e92db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e406a300 0x7fb7e414f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36126/0 (socket says 172.21.15.6:36126) 2023-07-21T07:36:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7e92db700 1 -- 172.21.15.6:0/700256345 learned_addr learned my addr 172.21.15.6:0/700256345 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7e8ada700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7e40c2bf0 0x7fb7e40bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7e92db700 1 -- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7e40c2bf0 msgr2=0x7fb7e40bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7e92db700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7e40c2bf0 0x7fb7e40bdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7e9adc700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7e4151be0 0x7fb7e40be2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7e92db700 1 -- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7e4151be0 msgr2=0x7fb7e40be2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7e92db700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7e4151be0 0x7fb7e40be2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7e92db700 1 -- 172.21.15.6:0/700256345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d40094a0 con 0x7fb7e406a300 2023-07-21T07:36:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7e9adc700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7e4151be0 0x7fb7e40be2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7e92db700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e406a300 0x7fb7e414f0a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400ebe0 tx=0x7fb7d4009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7d9ffb700 1 -- 172.21.15.6:0/700256345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400c910 con 0x7fb7e406a300 2023-07-21T07:36:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7d9ffb700 1 -- 172.21.15.6:0/700256345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d400ca70 con 0x7fb7e406a300 2023-07-21T07:36:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7eb53f700 1 -- 172.21.15.6:0/700256345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e00094a0 con 0x7fb7e406a300 2023-07-21T07:36:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.325+0000 7fb7d9ffb700 1 -- 172.21.15.6:0/700256345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400cde0 con 0x7fb7e406a300 2023-07-21T07:36:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.326+0000 7fb7eb53f700 1 -- 172.21.15.6:0/700256345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e40707e0 con 0x7fb7e406a300 2023-07-21T07:36:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.327+0000 7fb7eb53f700 1 -- 172.21.15.6:0/700256345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e406c650 con 0x7fb7e406a300 2023-07-21T07:36:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.327+0000 7fb7d9ffb700 1 -- 172.21.15.6:0/700256345 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb7d4013470 con 0x7fb7e406a300 2023-07-21T07:36:38.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.328+0000 7fb7d9ffb700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb7c806ad10 0x7fb7c806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:38.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.328+0000 7fb7d9ffb700 1 -- 172.21.15.6:0/700256345 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb7d4089940 con 0x7fb7e406a300 2023-07-21T07:36:38.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.328+0000 7fb7e8ada700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb7c806ad10 0x7fb7c806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:38.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.328+0000 7fb7e8ada700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb7c806ad10 0x7fb7c806d1d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40c3050 tx=0x7fb7e0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:38.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.332+0000 7fb7d9ffb700 1 -- 172.21.15.6:0/700256345 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb7d4054a80 con 0x7fb7e406a300 2023-07-21T07:36:38.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.574+0000 7fb7eb53f700 1 -- 172.21.15.6:0/700256345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7e4074500 con 0x7fb7e406a300 2023-07-21T07:36:38.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.575+0000 7fb7d9ffb700 1 -- 172.21.15.6:0/700256345 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4657 (secure 0 0 0) 0x7fb7d40580a0 con 0x7fb7e406a300 2023-07-21T07:36:38.629 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:38.629 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/853425943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":853425943},{"type":"v1","addr":"172.21.15.86:6837","nonce":853425943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5599,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/99889473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":99889473},{"type":"v1","addr":"172.21.15.86:6836","nonce":99889473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3714237035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3714237035},{"type":"v1","addr":"172.21.15.6:6833","nonce":3714237035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:36:27.950466+0000","modified":"2023-07-21T07:36:31.548780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5871},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5871":{"gid":5871,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3415849886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3415849886},{"type":"v1","addr":"172.21.15.6:6835","nonce":3415849886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-21T07:36:38.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.577+0000 7fb7eb53f700 1 -- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb7c806ad10 msgr2=0x7fb7c806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:38.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.577+0000 7fb7eb53f700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb7c806ad10 0x7fb7c806d1d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40c3050 tx=0x7fb7e0008030 comp rx=0 tx=0).stop 2023-07-21T07:36:38.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.577+0000 7fb7eb53f700 1 -- 172.21.15.6:0/700256345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e406a300 msgr2=0x7fb7e414f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.577+0000 7fb7eb53f700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e406a300 0x7fb7e414f0a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400ebe0 tx=0x7fb7d4009ec0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.577+0000 7fb7eb53f700 1 -- 172.21.15.6:0/700256345 shutdown_connections 2023-07-21T07:36:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.577+0000 7fb7eb53f700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb7c806ad10 0x7fb7c806d1d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.577+0000 7fb7eb53f700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7e4151be0 0x7fb7e40be2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.577+0000 7fb7eb53f700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e406a300 0x7fb7e414f0a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.577+0000 7fb7eb53f700 1 --2- 172.21.15.6:0/700256345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7e40c2bf0 0x7fb7e40bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:38.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.577+0000 7fb7eb53f700 1 -- 172.21.15.6:0/700256345 >> 172.21.15.6:0/700256345 conn(0x7fb7e40a8c90 msgr2=0x7fb7e406b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:38.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.577+0000 7fb7eb53f700 1 -- 172.21.15.6:0/700256345 shutdown_connections 2023-07-21T07:36:38.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:38.577+0000 7fb7eb53f700 1 -- 172.21.15.6:0/700256345 wait complete. 2023-07-21T07:36:38.635 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 33 2023-07-21T07:36:39.049 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T07:36:27.950466+0000', 'modified': '2023-07-21T07:36:31.548780+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5871}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5871': {'gid': 5871, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/3415849886', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6834', 'nonce': 3415849886}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 3415849886}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T07:36:39.050 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T07:36:39.050 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-21T07:36:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.125+0000 7fbdf48e0700 1 Processor -- start 2023-07-21T07:36:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.125+0000 7fbdf48e0700 1 -- start start 2023-07-21T07:36:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdf48e0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdf00c6c90 0x7fbdf00c5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdf48e0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdf0155110 0x7fbdf014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdf48e0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf00c5770 con 0x7fbdf00c1330 2023-07-21T07:36:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdf48e0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf00c4b70 con 0x7fbdf00c6c90 2023-07-21T07:36:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdf48e0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c17d0 con 0x7fbdf0155110 2023-07-21T07:36:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdee59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdf00c6c90 0x7fbdf00c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdedd9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbdf00c1330 0x7fbdf0151c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44154/0 (socket says 172.21.15.6:44154) 2023-07-21T07:36:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdedd9b700 1 -- 172.21.15.6:0/17355381 learned_addr learned my addr 172.21.15.6:0/17355381 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdeed9d700 1 --2- 172.21.15.6:0/17355381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdf0155110 0x7fbdf014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdee59c700 1 -- 172.21.15.6:0/17355381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdf0155110 msgr2=0x7fbdf014e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdee59c700 1 --2- 172.21.15.6:0/17355381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdf0155110 0x7fbdf014e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdee59c700 1 -- 172.21.15.6:0/17355381 >> v1:172.21.15.6:6789/0 conn(0x7fbdf00c1330 legacy=0x7fbdf0151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbded59a700 1 -- 172.21.15.6:0/17355381 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556810373 0 0) 0x7fbdf00c5770 con 0x7fbdf00c1330 2023-07-21T07:36:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdee59c700 1 -- 172.21.15.6:0/17355381 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf00c1ab0 con 0x7fbdf00c6c90 2023-07-21T07:36:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdeed9d700 1 --2- 172.21.15.6:0/17355381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdf0155110 0x7fbdf014e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.126+0000 7fbdee59c700 1 --2- 172.21.15.6:0/17355381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00c6c90 0x7fbdf00c5230 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009840 tx=0x7fbde0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce79b7ca783f2451 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.127+0000 7fbded59a700 1 -- 172.21.15.6:0/17355381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0011830 con 0x7fbdf00c6c90 2023-07-21T07:36:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.127+0000 7fbded59a700 1 -- 172.21.15.6:0/17355381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde0011990 con 0x7fbdf00c6c90 2023-07-21T07:36:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.127+0000 7fbded59a700 1 -- 172.21.15.6:0/17355381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0011d20 con 0x7fbdf00c6c90 2023-07-21T07:36:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.127+0000 7fbdf48e0700 1 -- 172.21.15.6:0/17355381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00c6c90 msgr2=0x7fbdf00c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.127+0000 7fbdf48e0700 1 --2- 172.21.15.6:0/17355381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00c6c90 0x7fbdf00c5230 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009840 tx=0x7fbde0009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.127+0000 7fbdf48e0700 1 -- 172.21.15.6:0/17355381 shutdown_connections 2023-07-21T07:36:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.127+0000 7fbdf48e0700 1 --2- 172.21.15.6:0/17355381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdf0155110 0x7fbdf014e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.127+0000 7fbdf48e0700 1 --2- 172.21.15.6:0/17355381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00c6c90 0x7fbdf00c5230 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.127+0000 7fbdf48e0700 1 -- 172.21.15.6:0/17355381 >> 172.21.15.6:0/17355381 conn(0x7fbdf006b1a0 msgr2=0x7fbdf006b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.127+0000 7fbdf48e0700 1 -- 172.21.15.6:0/17355381 shutdown_connections 2023-07-21T07:36:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.127+0000 7fbdf48e0700 1 -- 172.21.15.6:0/17355381 wait complete. 2023-07-21T07:36:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.129+0000 7fbdf48e0700 1 Processor -- start 2023-07-21T07:36:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.129+0000 7fbdf48e0700 1 -- start start 2023-07-21T07:36:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.129+0000 7fbdf48e0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdf00c1330 0x7fbdf00a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.129+0000 7fbdf48e0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00c6c90 0x7fbdf00c0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.129+0000 7fbdf48e0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdf0155110 0x7fbdf00abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.129+0000 7fbdf48e0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00be530 con 0x7fbdf00c6c90 2023-07-21T07:36:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.129+0000 7fbdf48e0700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf01e76d0 con 0x7fbdf00c1330 2023-07-21T07:36:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.129+0000 7fbdf48e0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00bdb20 con 0x7fbdf0155110 2023-07-21T07:36:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.129+0000 7fbdedd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00c6c90 0x7fbdf00c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.129+0000 7fbdedd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00c6c90 0x7fbdf00c0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36142/0 (socket says 172.21.15.6:36142) 2023-07-21T07:36:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.129+0000 7fbdedd9b700 1 -- 172.21.15.6:0/3565327496 learned_addr learned my addr 172.21.15.6:0/3565327496 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbdee59c700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdf00c1330 0x7fbdf00a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbdeed9d700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdf0155110 0x7fbdf00abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbdedd9b700 1 -- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdf0155110 msgr2=0x7fbdf00abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdf0155110 0x7fbdf00abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbdedd9b700 1 -- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdf00c1330 msgr2=0x7fbdf00a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdf00c1330 0x7fbdf00a9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbdedd9b700 1 -- 172.21.15.6:0/3565327496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde00094a0 con 0x7fbdf00c6c90 2023-07-21T07:36:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbdee59c700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdf00c1330 0x7fbdf00a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbdeed9d700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdf0155110 0x7fbdf00abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00c6c90 0x7fbdf00c0490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fbde40011e0 tx=0x7fbde400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbddeffd700 1 -- 172.21.15.6:0/3565327496 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4004c80 con 0x7fbdf00c6c90 2023-07-21T07:36:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbddeffd700 1 -- 172.21.15.6:0/3565327496 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde4004e00 con 0x7fbdf00c6c90 2023-07-21T07:36:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbdf48e0700 1 -- 172.21.15.6:0/3565327496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf00bde00 con 0x7fbdf00c6c90 2023-07-21T07:36:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbddeffd700 1 -- 172.21.15.6:0/3565327496 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4007310 con 0x7fbdf00c6c90 2023-07-21T07:36:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.130+0000 7fbdf48e0700 1 -- 172.21.15.6:0/3565327496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf014cb80 con 0x7fbdf00c6c90 2023-07-21T07:36:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.132+0000 7fbddeffd700 1 -- 172.21.15.6:0/3565327496 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbde4007470 con 0x7fbdf00c6c90 2023-07-21T07:36:39.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.132+0000 7fbddeffd700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbdd006ace0 0x7fbdd006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.132+0000 7fbddeffd700 1 -- 172.21.15.6:0/3565327496 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbde4089240 con 0x7fbdf00c6c90 2023-07-21T07:36:39.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.133+0000 7fbdee59c700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbdd006ace0 0x7fbdd006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.133+0000 7fbdee59c700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbdd006ace0 0x7fbdd006d1a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0072340 tx=0x7fbde0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:39.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.134+0000 7fbe00a78b80 1 Processor -- start 2023-07-21T07:36:39.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.134+0000 7fbe00a78b80 1 -- start start 2023-07-21T07:36:39.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbe00a78b80 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbc910 0x55ce50db7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbe00a78b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 0x55ce50e03570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbe00a78b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbccf0 0x55ce50e05670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbe00a78b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce50cb4b80 con 0x55ce50dbdc90 2023-07-21T07:36:39.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbe00a78b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce50d14540 con 0x55ce50dbccf0 2023-07-21T07:36:39.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbe00a78b80 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce50d11e60 con 0x55ce50dbc910 2023-07-21T07:36:39.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbdedd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 0x55ce50e03570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbdedd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 0x55ce50e03570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36150/0 (socket says 172.21.15.6:36150) 2023-07-21T07:36:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbdedd9b700 1 -- 172.21.15.6:0/3750866772 learned_addr learned my addr 172.21.15.6:0/3750866772 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbdeed9d700 1 --2- 172.21.15.6:0/3750866772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbccf0 0x55ce50e05670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbdee59c700 1 --2- 172.21.15.6:0/3750866772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbc910 0x55ce50db7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbdedd9b700 1 -- 172.21.15.6:0/3750866772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbc910 msgr2=0x55ce50db7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/3750866772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbc910 0x55ce50db7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbdedd9b700 1 -- 172.21.15.6:0/3750866772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbccf0 msgr2=0x55ce50e05670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:39.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/3750866772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbccf0 0x55ce50e05670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.135+0000 7fbdedd9b700 1 -- 172.21.15.6:0/3750866772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce50b8e5e0 con 0x55ce50dbdc90 2023-07-21T07:36:39.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.136+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/3750866772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 0x55ce50e03570 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fbde4087630 tx=0x7fbde40579e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507154dd3f3139a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:39.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.136+0000 7fbdcffff700 1 -- 172.21.15.6:0/3750866772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4089070 con 0x55ce50dbdc90 2023-07-21T07:36:39.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.136+0000 7fbdcffff700 1 -- 172.21.15.6:0/3750866772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde40560f0 con 0x55ce50dbdc90 2023-07-21T07:36:39.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.136+0000 7fbdcffff700 1 -- 172.21.15.6:0/3750866772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde40574a0 con 0x55ce50dbdc90 2023-07-21T07:36:39.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.136+0000 7fbe00a78b80 1 -- 172.21.15.6:0/3750866772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 msgr2=0x55ce50e03570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.136+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/3750866772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 0x55ce50e03570 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fbde4087630 tx=0x7fbde40579e0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.136+0000 7fbe00a78b80 1 -- 172.21.15.6:0/3750866772 shutdown_connections 2023-07-21T07:36:39.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.136+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/3750866772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbccf0 0x55ce50e05670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.137+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/3750866772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbc910 0x55ce50db7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.137+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/3750866772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 0x55ce50e03570 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.137+0000 7fbe00a78b80 1 -- 172.21.15.6:0/3750866772 >> 172.21.15.6:0/3750866772 conn(0x55ce50d19c80 msgr2=0x55ce50dba570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:39.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.137+0000 7fbe00a78b80 1 -- 172.21.15.6:0/3750866772 shutdown_connections 2023-07-21T07:36:39.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.137+0000 7fbe00a78b80 1 -- 172.21.15.6:0/3750866772 wait complete. 2023-07-21T07:36:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.137+0000 7fbe00a78b80 1 -- start start 2023-07-21T07:36:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.137+0000 7fbe00a78b80 1 Processor -- start 2023-07-21T07:36:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.138+0000 7fbe00a78b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbc910 0x55ce50df7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.138+0000 7fbe00a78b80 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbccf0 0x55ce50df8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.138+0000 7fbe00a78b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbdc90 0x55ce50dd6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.138+0000 7fbe00a78b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce50d0d750 con 0x55ce50dbc910 2023-07-21T07:36:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.138+0000 7fbe00a78b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce50caca70 con 0x55ce50dbdc90 2023-07-21T07:36:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.138+0000 7fbe00a78b80 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce50cac770 con 0x55ce50dbccf0 2023-07-21T07:36:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.138+0000 7fbe00a78b80 10 client.0 _ll_register_callbacks cb 0x55ce50caa630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T07:36:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.138+0000 7fbdee59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbc910 0x55ce50df7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.138+0000 7fbdee59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbc910 0x55ce50df7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36154/0 (socket says 172.21.15.6:36154) 2023-07-21T07:36:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.138+0000 7fbdee59c700 1 -- 172.21.15.6:0/2972227985 learned_addr learned my addr 172.21.15.6:0/2972227985 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.138+0000 7fbdeed9d700 1 --2- 172.21.15.6:0/2972227985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbdc90 0x55ce50dd6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.138+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/2972227985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbccf0 0x55ce50df8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbdee59c700 1 -- 172.21.15.6:0/2972227985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbccf0 msgr2=0x55ce50df8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbdee59c700 1 --2- 172.21.15.6:0/2972227985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbccf0 0x55ce50df8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbdee59c700 1 -- 172.21.15.6:0/2972227985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbdc90 msgr2=0x55ce50dd6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbdee59c700 1 --2- 172.21.15.6:0/2972227985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbdc90 0x55ce50dd6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbdee59c700 1 -- 172.21.15.6:0/2972227985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf014cb80 con 0x55ce50dbc910 2023-07-21T07:36:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbdee59c700 1 --2- 172.21.15.6:0/2972227985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbc910 0x55ce50df7890 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbde0013000 tx=0x7fbde00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd2c29bf8837bee server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbdcd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T07:36:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbdcd7fa700 1 -- 172.21.15.6:0/2972227985 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde002c070 con 0x55ce50dbc910 2023-07-21T07:36:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbe00a78b80 1 -- 172.21.15.6:0/2972227985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce50d8bb40 con 0x55ce50dbc910 2023-07-21T07:36:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbdcd7fa700 1 -- 172.21.15.6:0/2972227985 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbde00039f0 con 0x55ce50dbc910 2023-07-21T07:36:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbdcd7fa700 1 -- 172.21.15.6:0/2972227985 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbde0003bb0 con 0x55ce50dbc910 2023-07-21T07:36:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbe00a78b80 10 client.6051 fetch_fsmap learned FSMap version 33 2023-07-21T07:36:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbe00a78b80 1 -- 172.21.15.6:0/2972227985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x55ce50b3ad90 con 0x55ce50dbc910 2023-07-21T07:36:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbdcd7fa700 1 -- 172.21.15.6:0/2972227985 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce50d8bb40 con 0x55ce50dbc910 2023-07-21T07:36:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.139+0000 7fbdcd7fa700 1 -- 172.21.15.6:0/2972227985 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fbde0003d10 con 0x55ce50dbc910 2023-07-21T07:36:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.140+0000 7fbe00a78b80 10 client.6051 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T07:36:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.140+0000 7fbe00a78b80 10 client.6051 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-21T07:36:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.140+0000 7fbe00a78b80 20 client.6051 populate_metadata read hostname 'smithi006' 2023-07-21T07:36:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.140+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/2972227985 >> [v2:172.21.15.6:6834/3415849886,v1:172.21.15.6:6835/3415849886] conn(0x55ce50dd7240 0x55ce50e0f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.140+0000 7fbe00a78b80 4 client.6051 mds_command: new command op to 5871 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T07:36:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.140+0000 7fbe00a78b80 1 -- 172.21.15.6:0/2972227985 --> [v2:172.21.15.6:6834/3415849886,v1:172.21.15.6:6835/3415849886] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce50d37d40 con 0x55ce50dd7240 2023-07-21T07:36:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.140+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/2972227985 >> [v2:172.21.15.6:6834/3415849886,v1:172.21.15.6:6835/3415849886] conn(0x55ce50dd7240 0x55ce50e0f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.140+0000 7fbdcd7fa700 10 client.6051 ms_handle_connect on v2:172.21.15.6:6834/3415849886 2023-07-21T07:36:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.140+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/2972227985 >> [v2:172.21.15.6:6834/3415849886,v1:172.21.15.6:6835/3415849886] conn(0x55ce50dd7240 0x55ce50e0f810 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9baabaf6dd08db9e server_cookie=5ca7fbfa3e816b8d in_seq=0 out_seq=0 2023-07-21T07:36:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbdcd7fa700 1 -- 172.21.15.6:0/2972227985 <== mds.0 v2:172.21.15.6:6834/3415849886 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55ce50d37d40 con 0x55ce50dd7240 2023-07-21T07:36:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbdcd7fa700 10 client.6051 handle_command_reply: tid=0 2023-07-21T07:36:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbe00a78b80 1 client.6051 shutdown 2023-07-21T07:36:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbe00a78b80 1 -- 172.21.15.6:0/2972227985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbc910 msgr2=0x55ce50df7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/2972227985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbc910 0x55ce50df7890 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbde0013000 tx=0x7fbde00047c0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbe00a78b80 1 -- 172.21.15.6:0/2972227985 shutdown_connections 2023-07-21T07:36:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/2972227985 >> [v2:172.21.15.6:6834/3415849886,v1:172.21.15.6:6835/3415849886] conn(0x55ce50dd7240 0x55ce50e0f810 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/2972227985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbdc90 0x55ce50dd6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/2972227985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbc910 0x55ce50df7890 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbdcd7fa700 0 client.6051 ms_handle_reset on v2:172.21.15.6:6834/3415849886 2023-07-21T07:36:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/2972227985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbccf0 0x55ce50df8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbe00a78b80 1 -- 172.21.15.6:0/2972227985 >> 172.21.15.6:0/2972227985 conn(0x55ce50d19c80 msgr2=0x55ce50dba950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbe00a78b80 1 -- 172.21.15.6:0/2972227985 shutdown_connections 2023-07-21T07:36:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbe00a78b80 1 -- 172.21.15.6:0/2972227985 wait complete. 2023-07-21T07:36:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.141+0000 7fbe00a78b80 20 client.6051 trim_cache size 0 max 16384 2023-07-21T07:36:39.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.159+0000 7fbe00a78b80 1 Processor -- start 2023-07-21T07:36:39.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.159+0000 7fbe00a78b80 1 -- start start 2023-07-21T07:36:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbe00a78b80 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbc910 0x55ce50dfc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbe00a78b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbccf0 0x55ce50ddd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbe00a78b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbdc90 0x55ce50db6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbe00a78b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce50b908d0 con 0x55ce50dbccf0 2023-07-21T07:36:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbe00a78b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce50df6f00 con 0x55ce50dbdc90 2023-07-21T07:36:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbe00a78b80 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce50de1ad0 con 0x55ce50dbc910 2023-07-21T07:36:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbdedd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbccf0 0x55ce50ddd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbdedd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbccf0 0x55ce50ddd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36164/0 (socket says 172.21.15.6:36164) 2023-07-21T07:36:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbdedd9b700 1 -- 172.21.15.6:0/2000082184 learned_addr learned my addr 172.21.15.6:0/2000082184 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbdee59c700 1 --2- 172.21.15.6:0/2000082184 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbc910 0x55ce50dfc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbdeed9d700 1 --2- 172.21.15.6:0/2000082184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbdc90 0x55ce50db6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbdedd9b700 1 -- 172.21.15.6:0/2000082184 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbc910 msgr2=0x55ce50dfc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/2000082184 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbc910 0x55ce50dfc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbdedd9b700 1 -- 172.21.15.6:0/2000082184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbdc90 msgr2=0x55ce50db6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/2000082184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbdc90 0x55ce50db6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbdedd9b700 1 -- 172.21.15.6:0/2000082184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce50b23c10 con 0x55ce50dbccf0 2023-07-21T07:36:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/2000082184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbccf0 0x55ce50ddd9a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbde400cee0 tx=0x7fbde406d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ba14432a297383 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbddcff9700 1 -- 172.21.15.6:0/2000082184 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4057d80 con 0x55ce50dbccf0 2023-07-21T07:36:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.160+0000 7fbddcff9700 1 -- 172.21.15.6:0/2000082184 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde4056170 con 0x55ce50dbccf0 2023-07-21T07:36:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.161+0000 7fbddcff9700 1 -- 172.21.15.6:0/2000082184 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde40872a0 con 0x55ce50dbccf0 2023-07-21T07:36:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.161+0000 7fbe00a78b80 1 -- 172.21.15.6:0/2000082184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbccf0 msgr2=0x55ce50ddd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.161+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/2000082184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbccf0 0x55ce50ddd9a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbde400cee0 tx=0x7fbde406d000 comp rx=0 tx=0).stop 2023-07-21T07:36:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.161+0000 7fbe00a78b80 1 -- 172.21.15.6:0/2000082184 shutdown_connections 2023-07-21T07:36:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.161+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/2000082184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbdc90 0x55ce50db6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.161+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/2000082184 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbc910 0x55ce50dfc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.161+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/2000082184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbccf0 0x55ce50ddd9a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.161+0000 7fbe00a78b80 1 -- 172.21.15.6:0/2000082184 >> 172.21.15.6:0/2000082184 conn(0x55ce50d19c80 msgr2=0x55ce50db5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.161+0000 7fbe00a78b80 1 -- 172.21.15.6:0/2000082184 shutdown_connections 2023-07-21T07:36:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.161+0000 7fbe00a78b80 1 -- 172.21.15.6:0/2000082184 wait complete. 2023-07-21T07:36:39.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:36:39.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.162+0000 7fbe00a78b80 1 -- start start 2023-07-21T07:36:39.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.162+0000 7fbe00a78b80 1 Processor -- start 2023-07-21T07:36:39.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbe00a78b80 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbc910 0x55ce50e63220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbe00a78b80 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbccf0 0x55ce50dddda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbe00a78b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 0x55ce50e60380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbe00a78b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce50db6f00 con 0x55ce50dbdc90 2023-07-21T07:36:39.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbe00a78b80 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce50de00a0 con 0x55ce50dbc910 2023-07-21T07:36:39.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbe00a78b80 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce50e63a70 con 0x55ce50dbccf0 2023-07-21T07:36:39.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbe00a78b80 10 client.0 _ll_register_callbacks cb 0x55ce50caa630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T07:36:39.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdeed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 0x55ce50e60380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdeed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 0x55ce50e60380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36172/0 (socket says 172.21.15.6:36172) 2023-07-21T07:36:39.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdeed9d700 1 -- 172.21.15.6:0/3798100733 learned_addr learned my addr 172.21.15.6:0/3798100733 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:39.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdee59c700 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbc910 0x55ce50e63220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbccf0 0x55ce50dddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdeed9d700 1 -- 172.21.15.6:0/3798100733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbccf0 msgr2=0x55ce50dddda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:39.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdeed9d700 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbccf0 0x55ce50dddda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdeed9d700 1 -- 172.21.15.6:0/3798100733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbc910 msgr2=0x55ce50e63220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:39.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdeed9d700 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbc910 0x55ce50e63220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdeed9d700 1 -- 172.21.15.6:0/3798100733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce50b8e5e0 con 0x55ce50dbdc90 2023-07-21T07:36:39.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdedd9b700 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbccf0 0x55ce50dddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:39.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdeed9d700 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 0x55ce50e60380 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbde800fea0 tx=0x7fbde800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b145d54e7a599738 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:39.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdcd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T07:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdcd7fa700 1 -- 172.21.15.6:0/3798100733 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde801a5f0 con 0x55ce50dbdc90 2023-07-21T07:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbdcd7fa700 1 -- 172.21.15.6:0/3798100733 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbde801a750 con 0x55ce50dbdc90 2023-07-21T07:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.163+0000 7fbe00a78b80 1 -- 172.21.15.6:0/3798100733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce50daefe0 con 0x55ce50dbdc90 2023-07-21T07:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbdcd7fa700 1 -- 172.21.15.6:0/3798100733 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbde801a910 con 0x55ce50dbdc90 2023-07-21T07:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbe00a78b80 10 client.6057 fetch_fsmap learned FSMap version 33 2023-07-21T07:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbe00a78b80 1 -- 172.21.15.6:0/3798100733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x55ce50b61200 con 0x55ce50dbdc90 2023-07-21T07:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbdcd7fa700 1 -- 172.21.15.6:0/3798100733 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce50daefe0 con 0x55ce50dbdc90 2023-07-21T07:36:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbdcd7fa700 1 -- 172.21.15.6:0/3798100733 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fbde801aa70 con 0x55ce50dbdc90 2023-07-21T07:36:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbe00a78b80 10 client.6057 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T07:36:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbe00a78b80 10 client.6057 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-21T07:36:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbe00a78b80 20 client.6057 populate_metadata read hostname 'smithi006' 2023-07-21T07:36:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.6:6834/3415849886,v1:172.21.15.6:6835/3415849886] conn(0x55ce50e60ad0 0x55ce50dfb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbe00a78b80 4 client.6057 mds_command: new command op to 5871 tid=0[{"prefix": "status"}] 2023-07-21T07:36:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbe00a78b80 1 -- 172.21.15.6:0/3798100733 --> [v2:172.21.15.6:6834/3415849886,v1:172.21.15.6:6835/3415849886] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ce50d06730 con 0x55ce50e60ad0 2023-07-21T07:36:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbdee59c700 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.6:6834/3415849886,v1:172.21.15.6:6835/3415849886] conn(0x55ce50e60ad0 0x55ce50dfb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbdcd7fa700 10 client.6057 ms_handle_connect on v2:172.21.15.6:6834/3415849886 2023-07-21T07:36:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbdee59c700 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.6:6834/3415849886,v1:172.21.15.6:6835/3415849886] conn(0x55ce50e60ad0 0x55ce50dfb770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef6cd74167a08529 server_cookie=3f34b14dbbf6eeae in_seq=0 out_seq=0 2023-07-21T07:36:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbdcd7fa700 1 -- 172.21.15.6:0/3798100733 <== mds.0 v2:172.21.15.6:6834/3415849886 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55ce50d06730 con 0x55ce50e60ad0 2023-07-21T07:36:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbdcd7fa700 10 client.6057 handle_command_reply: tid=0 2023-07-21T07:36:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.164+0000 7fbe00a78b80 1 client.6057 shutdown 2023-07-21T07:36:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbe00a78b80 1 -- 172.21.15.6:0/3798100733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 msgr2=0x55ce50e60380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 0x55ce50e60380 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbde800fea0 tx=0x7fbde800e6c0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbe00a78b80 1 -- 172.21.15.6:0/3798100733 shutdown_connections 2023-07-21T07:36:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.6:6834/3415849886,v1:172.21.15.6:6835/3415849886] conn(0x55ce50e60ad0 0x55ce50dfb770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce50dbdc90 0x55ce50e60380 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbdcd7fa700 0 client.6057 ms_handle_reset on v2:172.21.15.6:6834/3415849886 2023-07-21T07:36:39.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ce50dbc910 0x55ce50e63220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbe00a78b80 1 --2- 172.21.15.6:0/3798100733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ce50dbccf0 0x55ce50dddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbe00a78b80 1 -- 172.21.15.6:0/3798100733 >> 172.21.15.6:0/3798100733 conn(0x55ce50d19c80 msgr2=0x55ce50dba950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:39.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbe00a78b80 1 -- 172.21.15.6:0/3798100733 shutdown_connections 2023-07-21T07:36:39.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbe00a78b80 1 -- 172.21.15.6:0/3798100733 wait complete. 2023-07-21T07:36:39.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbe00a78b80 20 client.6057 trim_cache size 0 max 16384 2023-07-21T07:36:39.232 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T07:36:39.232 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "8c602ac0-17b3-4df5-8928-640a7524b3b3", 2023-07-21T07:36:39.232 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T07:36:39.232 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5871, 2023-07-21T07:36:39.232 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T07:36:39.232 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T07:36:39.232 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T07:36:39.233 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.636909114, 2023-07-21T07:36:39.233 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 33, 2023-07-21T07:36:39.233 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 54, 2023-07-21T07:36:39.233 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 54, 2023-07-21T07:36:39.233 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.540349661 2023-07-21T07:36:39.233 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T07:36:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbdf48e0700 1 -- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbdd006ace0 msgr2=0x7fbdd006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbdf48e0700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbdd006ace0 0x7fbdd006d1a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0072340 tx=0x7fbde0008030 comp rx=0 tx=0).stop 2023-07-21T07:36:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbdf48e0700 1 -- 172.21.15.6:0/3565327496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00c6c90 msgr2=0x7fbdf00c0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbdf48e0700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00c6c90 0x7fbdf00c0490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fbde40011e0 tx=0x7fbde400cae0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbdf48e0700 1 -- 172.21.15.6:0/3565327496 shutdown_connections 2023-07-21T07:36:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbdf48e0700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbdd006ace0 0x7fbdd006d1a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbdf48e0700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdf0155110 0x7fbdf00abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbdf48e0700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdf00c1330 0x7fbdf00a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbdf48e0700 1 --2- 172.21.15.6:0/3565327496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00c6c90 0x7fbdf00c0490 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbdf48e0700 1 -- 172.21.15.6:0/3565327496 >> 172.21.15.6:0/3565327496 conn(0x7fbdf006b1a0 msgr2=0x7fbdf0153580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbdf48e0700 1 -- 172.21.15.6:0/3565327496 shutdown_connections 2023-07-21T07:36:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.165+0000 7fbdf48e0700 1 -- 172.21.15.6:0/3565327496 wait complete. 2023-07-21T07:36:39.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T07:36:39.238 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:36:39.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.347+0000 7f5b80d37700 1 Processor -- start 2023-07-21T07:36:39.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.347+0000 7f5b80d37700 1 -- start start 2023-07-21T07:36:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.348+0000 7f5b80d37700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b7c0c5360 0x7f5b7c06a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.348+0000 7f5b80d37700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b7c0c48d0 0x7f5b7c154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.348+0000 7f5b80d37700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c06a8e0 con 0x7f5b7c155200 2023-07-21T07:36:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.348+0000 7f5b80d37700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c0c1710 con 0x7f5b7c0c5360 2023-07-21T07:36:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.348+0000 7f5b80d37700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0c19f0 con 0x7f5b7c0c48d0 2023-07-21T07:36:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.348+0000 7f5b7a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b7c0c5360 0x7f5b7c06a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.348+0000 7f5b7ad9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5b7c155200 0x7f5b7c0c3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44200/0 (socket says 172.21.15.6:44200) 2023-07-21T07:36:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.348+0000 7f5b7ad9d700 1 -- 172.21.15.6:0/1368186998 learned_addr learned my addr 172.21.15.6:0/1368186998 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.348+0000 7f5b79d9b700 1 --2- 172.21.15.6:0/1368186998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b7c0c48d0 0x7f5b7c154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.348+0000 7f5b7a59c700 1 -- 172.21.15.6:0/1368186998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b7c0c48d0 msgr2=0x7f5b7c154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.348+0000 7f5b7a59c700 1 --2- 172.21.15.6:0/1368186998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b7c0c48d0 0x7f5b7c154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.348+0000 7f5b7a59c700 1 -- 172.21.15.6:0/1368186998 >> v1:172.21.15.6:6789/0 conn(0x7f5b7c155200 legacy=0x7f5b7c0c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.348+0000 7f5b7a59c700 1 -- 172.21.15.6:0/1368186998 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0c1cd0 con 0x7f5b7c0c5360 2023-07-21T07:36:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.349+0000 7f5b7a59c700 1 --2- 172.21.15.6:0/1368186998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c0c5360 0x7f5b7c06a090 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009840 tx=0x7f5b70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7575415f745a84d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.349+0000 7f5b7959a700 1 -- 172.21.15.6:0/1368186998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70011830 con 0x7f5b7c0c5360 2023-07-21T07:36:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.349+0000 7f5b7959a700 1 -- 172.21.15.6:0/1368186998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70011990 con 0x7f5b7c0c5360 2023-07-21T07:36:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.349+0000 7f5b7959a700 1 -- 172.21.15.6:0/1368186998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70011d20 con 0x7f5b7c0c5360 2023-07-21T07:36:39.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.349+0000 7f5b80d37700 1 -- 172.21.15.6:0/1368186998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c0c5360 msgr2=0x7f5b7c06a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.349+0000 7f5b80d37700 1 --2- 172.21.15.6:0/1368186998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c0c5360 0x7f5b7c06a090 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009840 tx=0x7f5b70009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:39.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.349+0000 7f5b80d37700 1 -- 172.21.15.6:0/1368186998 shutdown_connections 2023-07-21T07:36:39.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.349+0000 7f5b80d37700 1 --2- 172.21.15.6:0/1368186998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c0c5360 0x7f5b7c06a090 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.349+0000 7f5b80d37700 1 --2- 172.21.15.6:0/1368186998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b7c0c48d0 0x7f5b7c154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.349+0000 7f5b80d37700 1 -- 172.21.15.6:0/1368186998 >> 172.21.15.6:0/1368186998 conn(0x7f5b7c06b1a0 msgr2=0x7f5b7c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.349+0000 7f5b80d37700 1 -- 172.21.15.6:0/1368186998 shutdown_connections 2023-07-21T07:36:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.350+0000 7f5b80d37700 1 -- 172.21.15.6:0/1368186998 wait complete. 2023-07-21T07:36:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.351+0000 7f5b80d37700 1 Processor -- start 2023-07-21T07:36:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.351+0000 7f5b80d37700 1 -- start start 2023-07-21T07:36:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.351+0000 7f5b80d37700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b7c0c48d0 0x7f5b7c0bff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b80d37700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c0c5360 0x7f5b7c0a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b80d37700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b7c155200 0x7f5b7c1ec980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b80d37700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1e9410 con 0x7f5b7c0c5360 2023-07-21T07:36:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b80d37700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1ea3e0 con 0x7f5b7c155200 2023-07-21T07:36:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b80d37700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1e9f50 con 0x7f5b7c0c48d0 2023-07-21T07:36:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b79d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c0c5360 0x7f5b7c0a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b79d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c0c5360 0x7f5b7c0a9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36184/0 (socket says 172.21.15.6:36184) 2023-07-21T07:36:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b79d9b700 1 -- 172.21.15.6:0/4156743746 learned_addr learned my addr 172.21.15.6:0/4156743746 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b7ad9d700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b7c155200 0x7f5b7c1ec980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b7a59c700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b7c0c48d0 0x7f5b7c0bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b79d9b700 1 -- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b7c0c48d0 msgr2=0x7f5b7c0bff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b79d9b700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b7c0c48d0 0x7f5b7c0bff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b79d9b700 1 -- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b7c155200 msgr2=0x7f5b7c1ec980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b79d9b700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b7c155200 0x7f5b7c1ec980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b79d9b700 1 -- 172.21.15.6:0/4156743746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b700094a0 con 0x7f5b7c0c5360 2023-07-21T07:36:39.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b79d9b700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c0c5360 0x7f5b7c0a9d20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00e810 tx=0x7f5b6c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:39.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b6affd700 1 -- 172.21.15.6:0/4156743746 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c013610 con 0x7f5b7c0c5360 2023-07-21T07:36:39.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b6affd700 1 -- 172.21.15.6:0/4156743746 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c013770 con 0x7f5b7c0c5360 2023-07-21T07:36:39.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b6affd700 1 -- 172.21.15.6:0/4156743746 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c013b20 con 0x7f5b7c0c5360 2023-07-21T07:36:39.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b80d37700 1 -- 172.21.15.6:0/4156743746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c1e9620 con 0x7f5b7c0c5360 2023-07-21T07:36:39.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.352+0000 7f5b80d37700 1 -- 172.21.15.6:0/4156743746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c1e9be0 con 0x7f5b7c0c5360 2023-07-21T07:36:39.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.353+0000 7f5b80d37700 1 -- 172.21.15.6:0/4156743746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c074500 con 0x7f5b7c0c5360 2023-07-21T07:36:39.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.354+0000 7f5b6affd700 1 -- 172.21.15.6:0/4156743746 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b6c013c80 con 0x7f5b7c0c5360 2023-07-21T07:36:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.354+0000 7f5b6affd700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5b5c06ace0 0x7f5b5c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.354+0000 7f5b6affd700 1 -- 172.21.15.6:0/4156743746 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b6c0891b0 con 0x7f5b7c0c5360 2023-07-21T07:36:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.354+0000 7f5b7a59c700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5b5c06ace0 0x7f5b5c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.355+0000 7f5b7a59c700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5b5c06ace0 0x7f5b5c06d1a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5b700090b0 tx=0x7f5b70008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.358+0000 7f5b6affd700 1 -- 172.21.15.6:0/4156743746 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5b6c054270 con 0x7f5b7c0c5360 2023-07-21T07:36:39.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.606+0000 7f5b80d37700 1 -- 172.21.15.6:0/4156743746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5b7c1ea090 con 0x7f5b7c0c5360 2023-07-21T07:36:39.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.606+0000 7f5b6affd700 1 -- 172.21.15.6:0/4156743746 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5b6c057890 con 0x7f5b7c0c5360 2023-07-21T07:36:39.661 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T07:36:39.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.608+0000 7f5b80d37700 1 -- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5b5c06ace0 msgr2=0x7f5b5c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.608+0000 7f5b80d37700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5b5c06ace0 0x7f5b5c06d1a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5b700090b0 tx=0x7f5b70008030 comp rx=0 tx=0).stop 2023-07-21T07:36:39.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.608+0000 7f5b80d37700 1 -- 172.21.15.6:0/4156743746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c0c5360 msgr2=0x7f5b7c0a9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:39.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.608+0000 7f5b80d37700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c0c5360 0x7f5b7c0a9d20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00e810 tx=0x7f5b6c00ebd0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.608+0000 7f5b80d37700 1 -- 172.21.15.6:0/4156743746 shutdown_connections 2023-07-21T07:36:39.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.608+0000 7f5b80d37700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5b5c06ace0 0x7f5b5c06d1a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.608+0000 7f5b80d37700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b7c155200 0x7f5b7c1ec980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.608+0000 7f5b80d37700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b7c0c48d0 0x7f5b7c0bff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.608+0000 7f5b80d37700 1 --2- 172.21.15.6:0/4156743746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c0c5360 0x7f5b7c0a9d20 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:39.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.608+0000 7f5b80d37700 1 -- 172.21.15.6:0/4156743746 >> 172.21.15.6:0/4156743746 conn(0x7f5b7c06b1a0 msgr2=0x7f5b7c0a6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:39.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.609+0000 7f5b80d37700 1 -- 172.21.15.6:0/4156743746 shutdown_connections 2023-07-21T07:36:39.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:39.609+0000 7f5b80d37700 1 -- 172.21.15.6:0/4156743746 wait complete. 2023-07-21T07:36:39.675 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T07:36:39.675 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T07:36:39.676 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T07:36:39.676 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T07:36:39.676 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T07:36:39.677 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T07:36:39.677 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T07:36:39.677 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T07:36:39.677 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T07:36:39.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:39.678 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T07:36:39.695 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T07:36:39.696 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T07:36:39.696 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T07:36:39.696 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:39.696 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T07:36:39.696 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:39.697 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:36:39.697 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:39.697 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:36:39.697 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:39.697 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T07:36:39.697 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:39.697 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-21T07:36:39.697 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41809sec preferred_lft 41809sec 2023-07-21T07:36:39.698 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T07:36:39.698 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:39.698 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:36:39.698 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:39.698 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T07:36:39.698 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 92:ed:19:c0:57:d2 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:39.698 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T07:36:39.698 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:39.699 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::98ec:6eff:fe8a:86bb/64 scope link 2023-07-21T07:36:39.699 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:39.699 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T07:36:39.699 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 92:ed:19:c0:57:d2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T07:36:39.699 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::90ed:19ff:fec0:57d2/64 scope link 2023-07-21T07:36:39.699 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:39.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:39.700 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T07:36:39.762 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T07:36:39.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:39.763 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T07:36:39.821 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T07:36:39.822 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T07:36:39.822 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-21T07:36:39.822 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-21T07:36:39.822 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T07:36:39.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:39.823 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T07:36:39.823 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T07:36:39.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T07:36:39.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T07:36:39.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T07:36:39.824 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T07:36:39.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:39.930 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T07:36:39.947 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T07:36:39.947 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T07:36:39.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:39.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T07:36:40.014 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:36:40.015 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T07:36:40.072 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:36:40.072 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T07:36:40.128 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-21T07:36:40.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:40.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:40.215 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:40.215 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:36:40.246 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:40.246 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:36:40.247 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:36:40.247 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs=/ 2023-07-21T07:36:40.247 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:36:40.247 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:36:40.247 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:36:40.247 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:36:40.319 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:40.320 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:36:40.320 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:36:40.320 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs=/ 2023-07-21T07:36:40.320 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:36:40.320 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:36:40.320 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:36:40.320 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:36:40.321 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790" 2023-07-21T07:36:40.321 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2023-07-21T07:36:40.321 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=8c602ac0-17b3-4df5-8928-640a7524b3b3" will pass to kernel 2023-07-21T07:36:40.322 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T07:36:40.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:40.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T07:36:40.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:40.351 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T07:36:40.433 INFO:teuthology.orchestra.run.smithi006.stdout:client5734 2023-07-21T07:36:40.434 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:36:40.436 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:36:40.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T07:36:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.603+0000 7febbf756700 1 Processor -- start 2023-07-21T07:36:40.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.603+0000 7febbf756700 1 -- start start 2023-07-21T07:36:40.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbf756700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7febb814eb40 0x7febb8065fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:40.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbf756700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febb806b1a0 0x7febb80aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:40.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbf756700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb814ef20 con 0x7febb80abf50 2023-07-21T07:36:40.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbf756700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb806bbf0 con 0x7febb814eb40 2023-07-21T07:36:40.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbf756700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb8066520 con 0x7febb806b1a0 2023-07-21T07:36:40.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbd4f2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7febb814eb40 0x7febb8065fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:40.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbd4f2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7febb814eb40 0x7febb8065fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36194/0 (socket says 172.21.15.6:36194) 2023-07-21T07:36:40.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbd4f2700 1 -- 172.21.15.6:0/3523213225 learned_addr learned my addr 172.21.15.6:0/3523213225 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:40.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbccf1700 1 --2- 172.21.15.6:0/3523213225 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febb806b1a0 0x7febb80aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:40.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbd4f2700 1 -- 172.21.15.6:0/3523213225 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febb806b1a0 msgr2=0x7febb80aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:40.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbd4f2700 1 --2- 172.21.15.6:0/3523213225 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febb806b1a0 0x7febb80aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbd4f2700 1 -- 172.21.15.6:0/3523213225 >> v1:172.21.15.86:6789/0 conn(0x7febb80abf50 legacy=0x7febb8151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbd4f2700 1 -- 172.21.15.6:0/3523213225 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb8070310 con 0x7febb814eb40 2023-07-21T07:36:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febbd4f2700 1 --2- 172.21.15.6:0/3523213225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febb814eb40 0x7febb8065fe0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7febb40098f0 tx=0x7febb4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4000de0a71e09523 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febaffff700 1 -- 172.21.15.6:0/3523213225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4004230 con 0x7febb814eb40 2023-07-21T07:36:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febaffff700 1 -- 172.21.15.6:0/3523213225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb4004390 con 0x7febb814eb40 2023-07-21T07:36:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.604+0000 7febaffff700 1 -- 172.21.15.6:0/3523213225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb40036a0 con 0x7febb814eb40 2023-07-21T07:36:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.605+0000 7febbf756700 1 -- 172.21.15.6:0/3523213225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febb814eb40 msgr2=0x7febb8065fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:40.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.605+0000 7febbf756700 1 --2- 172.21.15.6:0/3523213225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febb814eb40 0x7febb8065fe0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7febb40098f0 tx=0x7febb4009c00 comp rx=0 tx=0).stop 2023-07-21T07:36:40.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.605+0000 7febbf756700 1 -- 172.21.15.6:0/3523213225 shutdown_connections 2023-07-21T07:36:40.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.605+0000 7febbf756700 1 --2- 172.21.15.6:0/3523213225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febb814eb40 0x7febb8065fe0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:40.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.605+0000 7febbf756700 1 --2- 172.21.15.6:0/3523213225 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febb806b1a0 0x7febb80aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:40.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.605+0000 7febbf756700 1 -- 172.21.15.6:0/3523213225 >> 172.21.15.6:0/3523213225 conn(0x7febb80c6140 msgr2=0x7febb80c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:40.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.605+0000 7febbf756700 1 -- 172.21.15.6:0/3523213225 shutdown_connections 2023-07-21T07:36:40.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.605+0000 7febbf756700 1 -- 172.21.15.6:0/3523213225 wait complete. 2023-07-21T07:36:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.606+0000 7febbf756700 1 Processor -- start 2023-07-21T07:36:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.606+0000 7febbf756700 1 -- start start 2023-07-21T07:36:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbf756700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febb80abf50 0x7febb814d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbf756700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febb814eb40 0x7febb813b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbf756700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febb813e0c0 0x7febb813b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbf756700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb813fb70 con 0x7febb814eb40 2023-07-21T07:36:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbf756700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb813f380 con 0x7febb813e0c0 2023-07-21T07:36:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbf756700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb813f0a0 con 0x7febb80abf50 2023-07-21T07:36:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbccf1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febb814eb40 0x7febb813b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbccf1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febb814eb40 0x7febb813b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36202/0 (socket says 172.21.15.6:36202) 2023-07-21T07:36:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbccf1700 1 -- 172.21.15.6:0/2132632776 learned_addr learned my addr 172.21.15.6:0/2132632776 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbd4f2700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febb80abf50 0x7febb814d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbdcf3700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febb813e0c0 0x7febb813b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbccf1700 1 -- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febb80abf50 msgr2=0x7febb814d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbccf1700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febb80abf50 0x7febb814d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbccf1700 1 -- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febb813e0c0 msgr2=0x7febb813b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbccf1700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febb813e0c0 0x7febb813b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbccf1700 1 -- 172.21.15.6:0/2132632776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb4009550 con 0x7febb814eb40 2023-07-21T07:36:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.607+0000 7febbdcf3700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febb813e0c0 0x7febb813b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.608+0000 7febbccf1700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febb814eb40 0x7febb813b230 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7feba800e810 tx=0x7feba800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:40.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.608+0000 7febadffb700 1 -- 172.21.15.6:0/2132632776 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba8013610 con 0x7febb814eb40 2023-07-21T07:36:40.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.608+0000 7febadffb700 1 -- 172.21.15.6:0/2132632776 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba8013770 con 0x7febb814eb40 2023-07-21T07:36:40.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.608+0000 7febbf756700 1 -- 172.21.15.6:0/2132632776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb813aa30 con 0x7febb814eb40 2023-07-21T07:36:40.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.608+0000 7febadffb700 1 -- 172.21.15.6:0/2132632776 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba8013b20 con 0x7febb814eb40 2023-07-21T07:36:40.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.608+0000 7febbf756700 1 -- 172.21.15.6:0/2132632776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb80c0420 con 0x7febb814eb40 2023-07-21T07:36:40.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.609+0000 7febbf756700 1 -- 172.21.15.6:0/2132632776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb813af50 con 0x7febb814eb40 2023-07-21T07:36:40.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.609+0000 7febadffb700 1 -- 172.21.15.6:0/2132632776 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feba8013c80 con 0x7febb814eb40 2023-07-21T07:36:40.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.610+0000 7febadffb700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7feb9c06ace0 0x7feb9c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:40.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.610+0000 7febadffb700 1 -- 172.21.15.6:0/2132632776 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feba8089110 con 0x7febb814eb40 2023-07-21T07:36:40.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.610+0000 7febbd4f2700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7feb9c06ace0 0x7feb9c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:40.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.610+0000 7febbd4f2700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7feb9c06ace0 0x7feb9c06d1a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7febb4009130 tx=0x7febb4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:40.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.614+0000 7febadffb700 1 -- 172.21.15.6:0/2132632776 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7febb813af50 con 0x7febb814eb40 2023-07-21T07:36:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.857+0000 7febbf756700 1 -- 172.21.15.6:0/2132632776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7febb813af50 con 0x7febb814eb40 2023-07-21T07:36:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.857+0000 7febadffb700 1 -- 172.21.15.6:0/2132632776 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7febb813af50 con 0x7febb814eb40 2023-07-21T07:36:40.912 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T07:36:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.859+0000 7febbf756700 1 -- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7feb9c06ace0 msgr2=0x7feb9c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.859+0000 7febbf756700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7feb9c06ace0 0x7feb9c06d1a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7febb4009130 tx=0x7febb4008030 comp rx=0 tx=0).stop 2023-07-21T07:36:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.859+0000 7febbf756700 1 -- 172.21.15.6:0/2132632776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febb814eb40 msgr2=0x7febb813b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.859+0000 7febbf756700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febb814eb40 0x7febb813b230 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7feba800e810 tx=0x7feba800ebd0 comp rx=0 tx=0).stop 2023-07-21T07:36:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.859+0000 7febbf756700 1 -- 172.21.15.6:0/2132632776 shutdown_connections 2023-07-21T07:36:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.859+0000 7febbf756700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7feb9c06ace0 0x7feb9c06d1a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.859+0000 7febbf756700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febb813e0c0 0x7febb813b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.859+0000 7febbf756700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febb80abf50 0x7febb814d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:40.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.859+0000 7febbf756700 1 --2- 172.21.15.6:0/2132632776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febb814eb40 0x7febb813b230 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:40.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.859+0000 7febbf756700 1 -- 172.21.15.6:0/2132632776 >> 172.21.15.6:0/2132632776 conn(0x7febb80c6140 msgr2=0x7febb81477a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:40.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.859+0000 7febbf756700 1 -- 172.21.15.6:0/2132632776 shutdown_connections 2023-07-21T07:36:40.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:40.859+0000 7febbf756700 1 -- 172.21.15.6:0/2132632776 wait complete. 2023-07-21T07:36:40.926 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T07:36:40.926 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T07:36:40.926 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-07-21T07:36:40.927 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-21T07:36:40.927 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-21T07:36:40.927 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T07:36:40.927 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T07:36:40.928 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T07:36:40.928 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:36:40.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:40.929 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-07-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:40.949 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-07-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:40.950 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T07:36:40.951 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:40.951 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-21T07:36:40.951 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41867sec preferred_lft 41867sec 2023-07-21T07:36:40.951 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::c182:1cf2:777e:c99f/64 scope link noprefixroute 2023-07-21T07:36:40.951 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:40.951 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T07:36:40.951 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 6e:29:3e:ed:f1:91 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:40.952 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T07:36:40.952 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:40.952 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::88c2:92ff:fec4:e7d6/64 scope link 2023-07-21T07:36:40.952 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:40.952 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T07:36:40.952 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 6e:29:3e:ed:f1:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-21T07:36:40.952 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::6c29:3eff:feed:f191/64 scope link 2023-07-21T07:36:40.952 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:40.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:40.953 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T07:36:41.018 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-07-21T07:36:41.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:41.020 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-07-21T07:36:41.080 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-07-21T07:36:41.080 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T07:36:41.080 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T07:36:41.080 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-21T07:36:41.081 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T07:36:41.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:41.081 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-07-21T07:36:41.082 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-07-21T07:36:41.082 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T07:36:41.082 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T07:36:41.083 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T07:36:41.083 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-07-21T07:36:41.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:41.189 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-07-21T07:36:41.207 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-21T07:36:41.207 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:36:41.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:41.209 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-07-21T07:36:41.274 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:36:41.275 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-21T07:36:41.331 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:36:41.332 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:36:41.332 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-21T07:36:41.387 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-21T07:36:41.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:41.389 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:41.472 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:41.473 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:36:41.495 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:41.495 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:36:41.495 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:36:41.496 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 1@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs=/ 2023-07-21T07:36:41.496 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:36:41.496 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:36:41.496 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:36:41.496 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:36:41.521 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:41.521 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:36:41.521 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:36:41.521 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 1@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs=/ 2023-07-21T07:36:41.522 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:36:41.522 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:36:41.522 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:36:41.522 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:36:41.522 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790" 2023-07-21T07:36:41.522 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2023-07-21T07:36:41.522 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=8c602ac0-17b3-4df5-8928-640a7524b3b3" will pass to kernel 2023-07-21T07:36:41.525 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T07:36:41.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:41.526 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-21T07:36:41.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:41.558 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T07:36:41.629 INFO:teuthology.orchestra.run.smithi086.stdout:client5336 2023-07-21T07:36:41.630 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:36:41.630 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:36:41.686 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-07-21T07:36:41.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.772+0000 7f7a5ddbd700 1 Processor -- start 2023-07-21T07:36:41.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.772+0000 7f7a5ddbd700 1 -- start start 2023-07-21T07:36:41.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.773+0000 7f7a5ddbd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7a58155110 0x7f7a5814e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.773+0000 7f7a5ddbd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a580c4b70 con 0x7f7a580c1330 2023-07-21T07:36:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.773+0000 7f7a5ddbd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a580c17d0 con 0x7f7a580c6c90 2023-07-21T07:36:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.773+0000 7f7a5ddbd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a580c1ab0 con 0x7f7a58155110 2023-07-21T07:36:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.773+0000 7f7a57fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7a58155110 0x7f7a5814e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.773+0000 7f7a56ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7a580c1330 0x7f7a58151c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44228/0 (socket says 172.21.15.6:44228) 2023-07-21T07:36:41.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.773+0000 7f7a56ffd700 1 -- 172.21.15.6:0/3874602758 learned_addr learned my addr 172.21.15.6:0/3874602758 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.773+0000 7f7a57fff700 1 -- 172.21.15.6:0/3874602758 >> v1:172.21.15.86:6789/0 conn(0x7f7a580c6c90 legacy=0x7f7a580c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.773+0000 7f7a57fff700 1 -- 172.21.15.6:0/3874602758 >> v1:172.21.15.6:6789/0 conn(0x7f7a580c1330 legacy=0x7f7a58151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.773+0000 7f7a57fff700 1 -- 172.21.15.6:0/3874602758 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a58154910 con 0x7f7a58155110 2023-07-21T07:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.773+0000 7f7a57fff700 1 --2- 172.21.15.6:0/3874602758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a58155110 0x7f7a5814e5c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009d90 tx=0x7f7a5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57df9e9354cab1df server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.774+0000 7f7a567fc700 1 -- 172.21.15.6:0/3874602758 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000e070 con 0x7f7a58155110 2023-07-21T07:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.774+0000 7f7a567fc700 1 -- 172.21.15.6:0/3874602758 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5000bbd0 con 0x7f7a58155110 2023-07-21T07:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.774+0000 7f7a567fc700 1 -- 172.21.15.6:0/3874602758 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50012430 con 0x7f7a58155110 2023-07-21T07:36:41.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.774+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/3874602758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a58155110 msgr2=0x7f7a5814e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:41.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.774+0000 7f7a5ddbd700 1 --2- 172.21.15.6:0/3874602758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a58155110 0x7f7a5814e5c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009d90 tx=0x7f7a5000b330 comp rx=0 tx=0).stop 2023-07-21T07:36:41.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.774+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/3874602758 shutdown_connections 2023-07-21T07:36:41.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.774+0000 7f7a5ddbd700 1 --2- 172.21.15.6:0/3874602758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a58155110 0x7f7a5814e5c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:41.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.774+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/3874602758 >> 172.21.15.6:0/3874602758 conn(0x7f7a5806b1a0 msgr2=0x7f7a5806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:41.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.774+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/3874602758 shutdown_connections 2023-07-21T07:36:41.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.774+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/3874602758 wait complete. 2023-07-21T07:36:41.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.775+0000 7f7a5ddbd700 1 Processor -- start 2023-07-21T07:36:41.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.776+0000 7f7a5ddbd700 1 -- start start 2023-07-21T07:36:41.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.776+0000 7f7a5ddbd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a580c1330 0x7f7a58153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.776+0000 7f7a5ddbd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a580c6c90 0x7f7a581edb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.776+0000 7f7a5ddbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a58155110 0x7f7a581ee0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.776+0000 7f7a5ddbd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a581dbe70 con 0x7f7a58155110 2023-07-21T07:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.776+0000 7f7a5ddbd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a58152f50 con 0x7f7a580c1330 2023-07-21T07:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.776+0000 7f7a5ddbd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a581ee5e0 con 0x7f7a580c6c90 2023-07-21T07:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a58155110 0x7f7a581ee0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a58155110 0x7f7a581ee0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36216/0 (socket says 172.21.15.6:36216) 2023-07-21T07:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a57fff700 1 -- 172.21.15.6:0/149332568 learned_addr learned my addr 172.21.15.6:0/149332568 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a577fe700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a580c1330 0x7f7a58153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a56ffd700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a580c6c90 0x7f7a581edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a57fff700 1 -- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a580c6c90 msgr2=0x7f7a581edb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a57fff700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a580c6c90 0x7f7a581edb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a57fff700 1 -- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a580c1330 msgr2=0x7f7a58153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a57fff700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a580c1330 0x7f7a58153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a57fff700 1 -- 172.21.15.6:0/149332568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a50009a70 con 0x7f7a58155110 2023-07-21T07:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a57fff700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a58155110 0x7f7a581ee0a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7a580c7870 tx=0x7f7a50004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a4ffff700 1 -- 172.21.15.6:0/149332568 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50012430 con 0x7f7a58155110 2023-07-21T07:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a4ffff700 1 -- 172.21.15.6:0/149332568 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a50020070 con 0x7f7a58155110 2023-07-21T07:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/149332568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a58153140 con 0x7f7a58155110 2023-07-21T07:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a4ffff700 1 -- 172.21.15.6:0/149332568 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50004280 con 0x7f7a58155110 2023-07-21T07:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.777+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/149332568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a580a6d60 con 0x7f7a58155110 2023-07-21T07:36:41.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.778+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/149332568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a581ed6d0 con 0x7f7a58155110 2023-07-21T07:36:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.779+0000 7f7a4ffff700 1 -- 172.21.15.6:0/149332568 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a500043e0 con 0x7f7a58155110 2023-07-21T07:36:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.779+0000 7f7a4ffff700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7a3806ace0 0x7f7a3806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.779+0000 7f7a4ffff700 1 -- 172.21.15.6:0/149332568 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a50022070 con 0x7f7a58155110 2023-07-21T07:36:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.779+0000 7f7a577fe700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7a3806ace0 0x7f7a3806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.780+0000 7f7a577fe700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7a3806ace0 0x7f7a3806d1a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7a48007fd0 tx=0x7f7a48009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:41.784+0000 7f7a4ffff700 1 -- 172.21.15.6:0/149332568 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a50056680 con 0x7f7a58155110 2023-07-21T07:36:42.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.067+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/149332568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f7a581ed880 con 0x7f7a58155110 2023-07-21T07:36:42.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.068+0000 7f7a4ffff700 1 -- 172.21.15.6:0/149332568 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v13) v1 ==== 84+0+0 (secure 0 0 0) 0x7f7a581ed880 con 0x7f7a58155110 2023-07-21T07:36:42.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.069+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7a3806ace0 msgr2=0x7f7a3806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.070+0000 7f7a5ddbd700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7a3806ace0 0x7f7a3806d1a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7a48007fd0 tx=0x7f7a48009040 comp rx=0 tx=0).stop 2023-07-21T07:36:42.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.070+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/149332568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a58155110 msgr2=0x7f7a581ee0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.070+0000 7f7a5ddbd700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a58155110 0x7f7a581ee0a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7a580c7870 tx=0x7f7a50004ad0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.070+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/149332568 shutdown_connections 2023-07-21T07:36:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.070+0000 7f7a5ddbd700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f7a3806ace0 0x7f7a3806d1a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.070+0000 7f7a5ddbd700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a58155110 0x7f7a581ee0a0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.070+0000 7f7a5ddbd700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a580c1330 0x7f7a58153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.070+0000 7f7a5ddbd700 1 --2- 172.21.15.6:0/149332568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a580c6c90 0x7f7a581edb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.070+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/149332568 >> 172.21.15.6:0/149332568 conn(0x7f7a5806b1a0 msgr2=0x7f7a5806a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.070+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/149332568 shutdown_connections 2023-07-21T07:36:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.070+0000 7f7a5ddbd700 1 -- 172.21.15.6:0/149332568 wait complete. 2023-07-21T07:36:42.137 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.208+0000 7fd978827700 1 Processor -- start 2023-07-21T07:36:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.208+0000 7fd978827700 1 -- start start 2023-07-21T07:36:42.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.208+0000 7fd978827700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd97414fa60 0x7fd97406a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.208+0000 7fd978827700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd97406bf00 0x7fd9740c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.208+0000 7fd978827700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd97406b8b0 0x7fd9740c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.208+0000 7fd978827700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd974152d80 con 0x7fd97406b8b0 2023-07-21T07:36:42.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.208+0000 7fd978827700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9740c4b00 con 0x7fd97414fa60 2023-07-21T07:36:42.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.208+0000 7fd978827700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd974153270 con 0x7fd97406bf00 2023-07-21T07:36:42.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd972d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd97406b8b0 0x7fd9740c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd972d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd97406b8b0 0x7fd9740c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36224/0 (socket says 172.21.15.6:36224) 2023-07-21T07:36:42.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd972d9d700 1 -- 172.21.15.6:0/1352105112 learned_addr learned my addr 172.21.15.6:0/1352105112 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:42.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd971d9b700 1 --2- 172.21.15.6:0/1352105112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd97406bf00 0x7fd9740c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd97259c700 1 --2- 172.21.15.6:0/1352105112 >> v2:172.21.15.86:3300/0 conn(0x7fd97414fa60 0x7fd97406a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd972d9d700 1 -- 172.21.15.6:0/1352105112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd97406bf00 msgr2=0x7fd9740c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:42.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd972d9d700 1 --2- 172.21.15.6:0/1352105112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd97406bf00 0x7fd9740c4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd972d9d700 1 -- 172.21.15.6:0/1352105112 >> v2:172.21.15.86:3300/0 conn(0x7fd97414fa60 msgr2=0x7fd97406a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:42.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd972d9d700 1 --2- 172.21.15.6:0/1352105112 >> v2:172.21.15.86:3300/0 conn(0x7fd97414fa60 0x7fd97406a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd972d9d700 1 -- 172.21.15.6:0/1352105112 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97406de30 con 0x7fd97406b8b0 2023-07-21T07:36:42.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd972d9d700 1 --2- 172.21.15.6:0/1352105112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97406b8b0 0x7fd9740c5490 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd9740c4590 tx=0x7fd96c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d033282f5c5d5248 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:42.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd97159a700 1 -- 172.21.15.6:0/1352105112 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c00e070 con 0x7fd97406b8b0 2023-07-21T07:36:42.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd97159a700 1 -- 172.21.15.6:0/1352105112 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96c00b9c0 con 0x7fd97406b8b0 2023-07-21T07:36:42.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.209+0000 7fd97159a700 1 -- 172.21.15.6:0/1352105112 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c00bd70 con 0x7fd97406b8b0 2023-07-21T07:36:42.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.210+0000 7fd978827700 1 -- 172.21.15.6:0/1352105112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97406b8b0 msgr2=0x7fd9740c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.210+0000 7fd978827700 1 --2- 172.21.15.6:0/1352105112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97406b8b0 0x7fd9740c5490 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd9740c4590 tx=0x7fd96c00b330 comp rx=0 tx=0).stop 2023-07-21T07:36:42.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.210+0000 7fd978827700 1 -- 172.21.15.6:0/1352105112 shutdown_connections 2023-07-21T07:36:42.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.210+0000 7fd978827700 1 --2- 172.21.15.6:0/1352105112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97406b8b0 0x7fd9740c5490 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.210+0000 7fd978827700 1 --2- 172.21.15.6:0/1352105112 >> v2:172.21.15.86:3300/0 conn(0x7fd97414fa60 0x7fd97406a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.210+0000 7fd978827700 1 --2- 172.21.15.6:0/1352105112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd97406bf00 0x7fd9740c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.210+0000 7fd978827700 1 -- 172.21.15.6:0/1352105112 >> 172.21.15.6:0/1352105112 conn(0x7fd9740a8c90 msgr2=0x7fd97406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.210+0000 7fd978827700 1 -- 172.21.15.6:0/1352105112 shutdown_connections 2023-07-21T07:36:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.210+0000 7fd978827700 1 -- 172.21.15.6:0/1352105112 wait complete. 2023-07-21T07:36:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.211+0000 7fd978827700 1 Processor -- start 2023-07-21T07:36:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.211+0000 7fd978827700 1 -- start start 2023-07-21T07:36:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd978827700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97406b8b0 0x7fd9741516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd978827700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd97406bf00 0x7fd9740bdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd978827700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd97414fa60 0x7fd9740be4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd978827700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9741551b0 con 0x7fd97406b8b0 2023-07-21T07:36:42.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd978827700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97414e1e0 con 0x7fd97406bf00 2023-07-21T07:36:42.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd978827700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97414e430 con 0x7fd97414fa60 2023-07-21T07:36:42.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd97259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97406b8b0 0x7fd9741516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd97259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97406b8b0 0x7fd9741516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36226/0 (socket says 172.21.15.6:36226) 2023-07-21T07:36:42.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd97259c700 1 -- 172.21.15.6:0/2759811926 learned_addr learned my addr 172.21.15.6:0/2759811926 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:42.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd972d9d700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd97414fa60 0x7fd9740be4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd971d9b700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd97406bf00 0x7fd9740bdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd97259c700 1 -- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd97414fa60 msgr2=0x7fd9740be4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd97259c700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd97414fa60 0x7fd9740be4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd97259c700 1 -- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd97406bf00 msgr2=0x7fd9740bdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd97259c700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd97406bf00 0x7fd9740bdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd97259c700 1 -- 172.21.15.6:0/2759811926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c009b30 con 0x7fd97406b8b0 2023-07-21T07:36:42.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd972d9d700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd97414fa60 0x7fd9740be4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:42.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd971d9b700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd97406bf00 0x7fd9740bdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:42.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.212+0000 7fd97259c700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97406b8b0 0x7fd9741516a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd96400c7f0 tx=0x7fd96400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:42.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.213+0000 7fd96affd700 1 -- 172.21.15.6:0/2759811926 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964011800 con 0x7fd97406b8b0 2023-07-21T07:36:42.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.213+0000 7fd96affd700 1 -- 172.21.15.6:0/2759811926 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964011960 con 0x7fd97406b8b0 2023-07-21T07:36:42.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.213+0000 7fd978827700 1 -- 172.21.15.6:0/2759811926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9740a6440 con 0x7fd97406b8b0 2023-07-21T07:36:42.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.213+0000 7fd96affd700 1 -- 172.21.15.6:0/2759811926 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964011cf0 con 0x7fd97406b8b0 2023-07-21T07:36:42.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.213+0000 7fd978827700 1 -- 172.21.15.6:0/2759811926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9740c0680 con 0x7fd97406b8b0 2023-07-21T07:36:42.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.214+0000 7fd978827700 1 -- 172.21.15.6:0/2759811926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd974074500 con 0x7fd97406b8b0 2023-07-21T07:36:42.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.214+0000 7fd96affd700 1 -- 172.21.15.6:0/2759811926 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd964018360 con 0x7fd97406b8b0 2023-07-21T07:36:42.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.214+0000 7fd96affd700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd95406ace0 0x7fd95406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.215+0000 7fd96affd700 1 -- 172.21.15.6:0/2759811926 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd964089350 con 0x7fd97406b8b0 2023-07-21T07:36:42.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.215+0000 7fd971d9b700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd95406ace0 0x7fd95406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.215+0000 7fd971d9b700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd95406ace0 0x7fd95406d1a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd9740b5910 tx=0x7fd95c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:42.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.219+0000 7fd96affd700 1 -- 172.21.15.6:0/2759811926 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd964054490 con 0x7fd97406b8b0 2023-07-21T07:36:42.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.416+0000 7fd978827700 1 -- 172.21.15.6:0/2759811926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd97406e520 con 0x7fd97406b8b0 2023-07-21T07:36:42.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.417+0000 7fd96affd700 1 -- 172.21.15.6:0/2759811926 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18185 (secure 0 0 0) 0x7fd964057ab0 con 0x7fd97406b8b0 2023-07-21T07:36:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:42.472 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":54,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:36:29.536326+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:36:26.204826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T07:36:26.916497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.420+0000 7fd978827700 1 -- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd95406ace0 msgr2=0x7fd95406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.420+0000 7fd978827700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd95406ace0 0x7fd95406d1a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd9740b5910 tx=0x7fd95c008040 comp rx=0 tx=0).stop 2023-07-21T07:36:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.420+0000 7fd978827700 1 -- 172.21.15.6:0/2759811926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97406b8b0 msgr2=0x7fd9741516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.420+0000 7fd978827700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97406b8b0 0x7fd9741516a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd96400c7f0 tx=0x7fd96400cbb0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.420+0000 7fd978827700 1 -- 172.21.15.6:0/2759811926 shutdown_connections 2023-07-21T07:36:42.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.420+0000 7fd978827700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd95406ace0 0x7fd95406d1a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.420+0000 7fd978827700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd97414fa60 0x7fd9740be4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.420+0000 7fd978827700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97406b8b0 0x7fd9741516a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.420+0000 7fd978827700 1 --2- 172.21.15.6:0/2759811926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd97406bf00 0x7fd9740bdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.420+0000 7fd978827700 1 -- 172.21.15.6:0/2759811926 >> 172.21.15.6:0/2759811926 conn(0x7fd9740a8c90 msgr2=0x7fd9740a70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:42.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.420+0000 7fd978827700 1 -- 172.21.15.6:0/2759811926 shutdown_connections 2023-07-21T07:36:42.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.420+0000 7fd978827700 1 -- 172.21.15.6:0/2759811926 wait complete. 2023-07-21T07:36:42.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:36:26.204826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:36:26.916497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:36:42.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:36:42.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.560+0000 7f4177a15700 1 Processor -- start 2023-07-21T07:36:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.560+0000 7f4177a15700 1 -- start start 2023-07-21T07:36:42.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.561+0000 7f4177a15700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41700c1860 0x7f4170151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.561+0000 7f4177a15700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41701517c0 con 0x7f41700c3f80 2023-07-21T07:36:42.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.561+0000 7f4177a15700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41700c4e50 con 0x7f41700c5260 2023-07-21T07:36:42.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.561+0000 7f4177a15700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41701519f0 con 0x7f41700c1860 2023-07-21T07:36:42.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.561+0000 7f4175fb2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f41700c3f80 0x7f41700c3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44258/0 (socket says 172.21.15.6:44258) 2023-07-21T07:36:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.561+0000 7f4175fb2700 1 -- 172.21.15.6:0/1902231890 learned_addr learned my addr 172.21.15.6:0/1902231890 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.561+0000 7f41757b1700 1 --2- 172.21.15.6:0/1902231890 >> v2:172.21.15.86:3300/0 conn(0x7f41700c1860 0x7f4170151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.562+0000 7f4167fff700 1 -- 172.21.15.6:0/1902231890 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291788897 0 0) 0x7f41701517c0 con 0x7f41700c3f80 2023-07-21T07:36:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.562+0000 7f4167fff700 1 -- 172.21.15.6:0/1902231890 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f415c0035b0 con 0x7f41700c3f80 2023-07-21T07:36:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.562+0000 7f4167fff700 1 -- 172.21.15.6:0/1902231890 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99374107 0 0) 0x7f41700c4e50 con 0x7f41700c5260 2023-07-21T07:36:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.562+0000 7f4167fff700 1 -- 172.21.15.6:0/1902231890 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41701517c0 con 0x7f41700c5260 2023-07-21T07:36:42.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.562+0000 7f4167fff700 1 -- 172.21.15.6:0/1902231890 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 627431761 0 0) 0x7f415c0035b0 con 0x7f41700c3f80 2023-07-21T07:36:42.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.562+0000 7f41757b1700 1 -- 172.21.15.6:0/1902231890 >> v1:172.21.15.86:6789/0 conn(0x7f41700c5260 legacy=0x7f417006dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.562+0000 7f41757b1700 1 -- 172.21.15.6:0/1902231890 >> v1:172.21.15.6:6789/0 conn(0x7f41700c3f80 legacy=0x7f41700c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.562+0000 7f41757b1700 1 -- 172.21.15.6:0/1902231890 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170151cd0 con 0x7f41700c1860 2023-07-21T07:36:42.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.562+0000 7f41757b1700 1 --2- 172.21.15.6:0/1902231890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41700c1860 0x7f4170151280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4160009840 tx=0x7f4160009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e57dc607b2bd8a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:42.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.562+0000 7f4167fff700 1 -- 172.21.15.6:0/1902231890 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41680019f0 con 0x7f41700c1860 2023-07-21T07:36:42.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.562+0000 7f4167fff700 1 -- 172.21.15.6:0/1902231890 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4160004030 con 0x7f41700c1860 2023-07-21T07:36:42.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.562+0000 7f4167fff700 1 -- 172.21.15.6:0/1902231890 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41600043c0 con 0x7f41700c1860 2023-07-21T07:36:42.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.563+0000 7f4177a15700 1 -- 172.21.15.6:0/1902231890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41700c1860 msgr2=0x7f4170151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.563+0000 7f4177a15700 1 --2- 172.21.15.6:0/1902231890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41700c1860 0x7f4170151280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4160009840 tx=0x7f4160009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:42.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.563+0000 7f4177a15700 1 -- 172.21.15.6:0/1902231890 shutdown_connections 2023-07-21T07:36:42.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.563+0000 7f4177a15700 1 --2- 172.21.15.6:0/1902231890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41700c1860 0x7f4170151280 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.563+0000 7f4177a15700 1 -- 172.21.15.6:0/1902231890 >> 172.21.15.6:0/1902231890 conn(0x7f41700a8660 msgr2=0x7f41700a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:42.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.563+0000 7f4177a15700 1 -- 172.21.15.6:0/1902231890 shutdown_connections 2023-07-21T07:36:42.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.563+0000 7f4177a15700 1 -- 172.21.15.6:0/1902231890 wait complete. 2023-07-21T07:36:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.564+0000 7f4177a15700 1 Processor -- start 2023-07-21T07:36:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.564+0000 7f4177a15700 1 -- start start 2023-07-21T07:36:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4177a15700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41700c1860 0x7f41701ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4177a15700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41700c3f80 0x7f41700bcff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4177a15700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41700c5260 0x7f41701ded20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4177a15700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41700bafc0 con 0x7f41700c3f80 2023-07-21T07:36:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4177a15700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41701e9750 con 0x7f41700c5260 2023-07-21T07:36:42.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4177a15700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41700be210 con 0x7f41700c1860 2023-07-21T07:36:42.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4174fb0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41700c3f80 0x7f41700bcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4174fb0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41700c3f80 0x7f41700bcff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36242/0 (socket says 172.21.15.6:36242) 2023-07-21T07:36:42.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4174fb0700 1 -- 172.21.15.6:0/3386718698 learned_addr learned my addr 172.21.15.6:0/3386718698 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:42.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f41757b1700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41700c1860 0x7f41701ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4175fb2700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41700c5260 0x7f41701ded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4174fb0700 1 -- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41700c1860 msgr2=0x7f41701ed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4174fb0700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41700c1860 0x7f41701ed6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4174fb0700 1 -- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41700c5260 msgr2=0x7f41701ded20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4174fb0700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41700c5260 0x7f41701ded20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4174fb0700 1 -- 172.21.15.6:0/3386718698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41600094a0 con 0x7f41700c3f80 2023-07-21T07:36:42.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f41757b1700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41700c1860 0x7f41701ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:42.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.565+0000 7f4174fb0700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41700c3f80 0x7f41700bcff0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c520 tx=0x7f416c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:42.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.566+0000 7f4165ffb700 1 -- 172.21.15.6:0/3386718698 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c0052d0 con 0x7f41700c3f80 2023-07-21T07:36:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.566+0000 7f4165ffb700 1 -- 172.21.15.6:0/3386718698 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c005430 con 0x7f41700c3f80 2023-07-21T07:36:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.566+0000 7f4177a15700 1 -- 172.21.15.6:0/3386718698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41700be4f0 con 0x7f41700c3f80 2023-07-21T07:36:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.566+0000 7f4165ffb700 1 -- 172.21.15.6:0/3386718698 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c0038c0 con 0x7f41700c3f80 2023-07-21T07:36:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.566+0000 7f4177a15700 1 -- 172.21.15.6:0/3386718698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41700bf270 con 0x7f41700c3f80 2023-07-21T07:36:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.567+0000 7f4177a15700 1 -- 172.21.15.6:0/3386718698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41701e9910 con 0x7f41700c3f80 2023-07-21T07:36:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.567+0000 7f4165ffb700 1 -- 172.21.15.6:0/3386718698 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f416c003a20 con 0x7f41700c3f80 2023-07-21T07:36:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.568+0000 7f4165ffb700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f415406ace0 0x7f415406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.568+0000 7f4165ffb700 1 -- 172.21.15.6:0/3386718698 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f416c088af0 con 0x7f41700c3f80 2023-07-21T07:36:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.568+0000 7f41757b1700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f415406ace0 0x7f415406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.568+0000 7f41757b1700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f415406ace0 0x7f415406d1a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4160009b90 tx=0x7f4160013040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.572+0000 7f4165ffb700 1 -- 172.21.15.6:0/3386718698 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f416c053b10 con 0x7f41700c3f80 2023-07-21T07:36:42.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.768+0000 7f4177a15700 1 -- 172.21.15.6:0/3386718698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4170074500 con 0x7f41700c3f80 2023-07-21T07:36:42.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.768+0000 7f4165ffb700 1 -- 172.21.15.6:0/3386718698 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f416c057130 con 0x7f41700c3f80 2023-07-21T07:36:42.823 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:36:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.770+0000 7f4177a15700 1 -- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f415406ace0 msgr2=0x7f415406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.770+0000 7f4177a15700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f415406ace0 0x7f415406d1a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4160009b90 tx=0x7f4160013040 comp rx=0 tx=0).stop 2023-07-21T07:36:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.770+0000 7f4177a15700 1 -- 172.21.15.6:0/3386718698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41700c3f80 msgr2=0x7f41700bcff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.771+0000 7f4177a15700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41700c3f80 0x7f41700bcff0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c520 tx=0x7f416c00c8e0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.771+0000 7f4177a15700 1 -- 172.21.15.6:0/3386718698 shutdown_connections 2023-07-21T07:36:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.771+0000 7f4177a15700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f415406ace0 0x7f415406d1a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.771+0000 7f4177a15700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41700c5260 0x7f41701ded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.771+0000 7f4177a15700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41700c1860 0x7f41701ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.771+0000 7f4177a15700 1 --2- 172.21.15.6:0/3386718698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41700c3f80 0x7f41700bcff0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.771+0000 7f4177a15700 1 -- 172.21.15.6:0/3386718698 >> 172.21.15.6:0/3386718698 conn(0x7f41700a8660 msgr2=0x7f41700a7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.771+0000 7f4177a15700 1 -- 172.21.15.6:0/3386718698 shutdown_connections 2023-07-21T07:36:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.771+0000 7f4177a15700 1 -- 172.21.15.6:0/3386718698 wait complete. 2023-07-21T07:36:42.837 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:36:42.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.912+0000 7fc95ea94700 1 Processor -- start 2023-07-21T07:36:42.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.912+0000 7fc95ea94700 1 -- start start 2023-07-21T07:36:42.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.912+0000 7fc95ea94700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9580c5260 0x7fc958151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.912+0000 7fc95ea94700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9581517c0 con 0x7fc9580c1860 2023-07-21T07:36:42.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.912+0000 7fc95ea94700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9580c4e50 con 0x7fc9580c3f80 2023-07-21T07:36:42.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.912+0000 7fc95ea94700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9581519f0 con 0x7fc9580c5260 2023-07-21T07:36:42.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc95c830700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc9580c1860 0x7fc95806dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44268/0 (socket says 172.21.15.6:44268) 2023-07-21T07:36:42.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc95c830700 1 -- 172.21.15.6:0/4175932467 learned_addr learned my addr 172.21.15.6:0/4175932467 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:42.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc957fff700 1 --2- 172.21.15.6:0/4175932467 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9580c5260 0x7fc958151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158039282 0 0) 0x7fc9581517c0 con 0x7fc9580c1860 2023-07-21T07:36:42.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9480035b0 con 0x7fc9580c1860 2023-07-21T07:36:42.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4219311936 0 0) 0x7fc9480035b0 con 0x7fc9580c1860 2023-07-21T07:36:42.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9580c5260 msgr2=0x7fc958151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:42.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 --2- 172.21.15.6:0/4175932467 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9580c5260 0x7fc958151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 >> v1:172.21.15.86:6789/0 conn(0x7fc9580c3f80 legacy=0x7fc9580c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc958151cd0 con 0x7fc9580c1860 2023-07-21T07:36:42.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7fc94c001670 con 0x7fc9580c1860 2023-07-21T07:36:42.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 >> v1:172.21.15.6:6789/0 conn(0x7fc9580c1860 legacy=0x7fc95806dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 --2- 172.21.15.6:0/4175932467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc948003a30 0x7fc948003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 --2- 172.21.15.6:0/4175932467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9480043e0 0x7fc9480048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 --2- 172.21.15.6:0/4175932467 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9580c5260 0x7fc948005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9581519f0 con 0x7fc948003a30 2023-07-21T07:36:42.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94800dc20 con 0x7fc9480043e0 2023-07-21T07:36:42.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94800dde0 con 0x7fc9580c5260 2023-07-21T07:36:42.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc95c830700 1 --2- 172.21.15.6:0/4175932467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc948003a30 0x7fc948003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc957fff700 1 --2- 172.21.15.6:0/4175932467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9480043e0 0x7fc9480048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.913+0000 7fc95d031700 1 --2- 172.21.15.6:0/4175932467 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9580c5260 0x7fc948005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95c830700 1 -- 172.21.15.6:0/4175932467 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9580c5260 msgr2=0x7fc948005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:42.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95c830700 1 --2- 172.21.15.6:0/4175932467 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9580c5260 0x7fc948005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95c830700 1 -- 172.21.15.6:0/4175932467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9480043e0 msgr2=0x7fc9480048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95c830700 1 --2- 172.21.15.6:0/4175932467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9480043e0 0x7fc9480048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95c830700 1 -- 172.21.15.6:0/4175932467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480035b0 con 0x7fc948003a30 2023-07-21T07:36:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95d031700 1 --2- 172.21.15.6:0/4175932467 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9580c5260 0x7fc948005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95c830700 1 --2- 172.21.15.6:0/4175932467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc948003a30 0x7fc948003e10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00c2f0 tx=0x7fc948005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c30b15810df343 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c00ce30 con 0x7fc948003a30 2023-07-21T07:36:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c005960 con 0x7fc948003a30 2023-07-21T07:36:42.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc9577fe700 1 -- 172.21.15.6:0/4175932467 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c005cf0 con 0x7fc948003a30 2023-07-21T07:36:42.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95ea94700 1 -- 172.21.15.6:0/4175932467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc948003a30 msgr2=0x7fc948003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95ea94700 1 --2- 172.21.15.6:0/4175932467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc948003a30 0x7fc948003e10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00c2f0 tx=0x7fc948005880 comp rx=0 tx=0).stop 2023-07-21T07:36:42.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95d031700 1 -- 172.21.15.6:0/4175932467 reap_dead start 2023-07-21T07:36:42.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95ea94700 1 -- 172.21.15.6:0/4175932467 shutdown_connections 2023-07-21T07:36:42.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95ea94700 1 -- 172.21.15.6:0/4175932467 >> 172.21.15.6:0/4175932467 conn(0x7fc9580a8660 msgr2=0x7fc9580a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:42.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95ea94700 1 -- 172.21.15.6:0/4175932467 shutdown_connections 2023-07-21T07:36:42.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.914+0000 7fc95ea94700 1 -- 172.21.15.6:0/4175932467 wait complete. 2023-07-21T07:36:42.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.916+0000 7fc95ea94700 1 Processor -- start 2023-07-21T07:36:42.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.916+0000 7fc95ea94700 1 -- start start 2023-07-21T07:36:42.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.916+0000 7fc95ea94700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc948003a30 0x7fc9580c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.916+0000 7fc95ea94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9580a7ab0 0x7fc9581e5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.916+0000 7fc95ea94700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9580bce60 0x7fc9581e6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.916+0000 7fc95ea94700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9580a9720 con 0x7fc9580a7ab0 2023-07-21T07:36:42.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc95ea94700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9580bd310 con 0x7fc9580bce60 2023-07-21T07:36:42.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc95ea94700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9580a5f80 con 0x7fc948003a30 2023-07-21T07:36:42.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc957fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9580a7ab0 0x7fc9581e5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc95c830700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc948003a30 0x7fc9580c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc95c830700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc948003a30 0x7fc9580c02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.6:33654/0 (socket says 172.21.15.6:33654) 2023-07-21T07:36:42.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc95c830700 1 -- 172.21.15.6:0/2464006379 learned_addr learned my addr 172.21.15.6:0/2464006379 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:42.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc95d031700 1 --2- 172.21.15.6:0/2464006379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9580bce60 0x7fc9581e6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc957fff700 1 -- 172.21.15.6:0/2464006379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc948003a30 msgr2=0x7fc9580c02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc957fff700 1 --2- 172.21.15.6:0/2464006379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc948003a30 0x7fc9580c02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc957fff700 1 -- 172.21.15.6:0/2464006379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9580bce60 msgr2=0x7fc9581e6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:42.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc957fff700 1 --2- 172.21.15.6:0/2464006379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9580bce60 0x7fc9581e6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:42.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc957fff700 1 -- 172.21.15.6:0/2464006379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580bcb80 con 0x7fc9580a7ab0 2023-07-21T07:36:42.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc957fff700 1 --2- 172.21.15.6:0/2464006379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9580a7ab0 0x7fc9581e5e50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc944011930 tx=0x7fc944011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc9557fa700 1 -- 172.21.15.6:0/2464006379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944004300 con 0x7fc9580a7ab0 2023-07-21T07:36:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc9557fa700 1 -- 172.21.15.6:0/2464006379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc944004460 con 0x7fc9580a7ab0 2023-07-21T07:36:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc95ea94700 1 -- 172.21.15.6:0/2464006379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9580c0800 con 0x7fc9580a7ab0 2023-07-21T07:36:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc9557fa700 1 -- 172.21.15.6:0/2464006379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440038c0 con 0x7fc9580a7ab0 2023-07-21T07:36:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.917+0000 7fc95ea94700 1 -- 172.21.15.6:0/2464006379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9580a76d0 con 0x7fc9580a7ab0 2023-07-21T07:36:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.918+0000 7fc95ea94700 1 -- 172.21.15.6:0/2464006379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9580c4680 con 0x7fc9580a7ab0 2023-07-21T07:36:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.919+0000 7fc9557fa700 1 -- 172.21.15.6:0/2464006379 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc944003a20 con 0x7fc9580a7ab0 2023-07-21T07:36:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.919+0000 7fc9557fa700 1 --2- 172.21.15.6:0/2464006379 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc93c06ace0 0x7fc93c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.919+0000 7fc9557fa700 1 -- 172.21.15.6:0/2464006379 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9440896c0 con 0x7fc9580a7ab0 2023-07-21T07:36:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.919+0000 7fc95c830700 1 --2- 172.21.15.6:0/2464006379 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc93c06ace0 0x7fc93c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.920+0000 7fc95c830700 1 --2- 172.21.15.6:0/2464006379 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc93c06ace0 0x7fc93c06d1a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc94c015040 tx=0x7fc94c007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:42.924+0000 7fc9557fa700 1 -- 172.21.15.6:0/2464006379 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc944054800 con 0x7fc9580a7ab0 2023-07-21T07:36:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.119+0000 7fc95ea94700 1 -- 172.21.15.6:0/2464006379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc95806c260 con 0x7fc9580a7ab0 2023-07-21T07:36:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.120+0000 7fc9557fa700 1 -- 172.21.15.6:0/2464006379 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc944057e20 con 0x7fc9580a7ab0 2023-07-21T07:36:43.174 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:36:43.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.122+0000 7fc95ea94700 1 -- 172.21.15.6:0/2464006379 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc93c06ace0 msgr2=0x7fc93c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.122+0000 7fc95ea94700 1 --2- 172.21.15.6:0/2464006379 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc93c06ace0 0x7fc93c06d1a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc94c015040 tx=0x7fc94c007000 comp rx=0 tx=0).stop 2023-07-21T07:36:43.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.122+0000 7fc95ea94700 1 -- 172.21.15.6:0/2464006379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9580a7ab0 msgr2=0x7fc9581e5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.122+0000 7fc95ea94700 1 --2- 172.21.15.6:0/2464006379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9580a7ab0 0x7fc9581e5e50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc944011930 tx=0x7fc944011c40 comp rx=0 tx=0).stop 2023-07-21T07:36:43.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.122+0000 7fc95ea94700 1 -- 172.21.15.6:0/2464006379 shutdown_connections 2023-07-21T07:36:43.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.122+0000 7fc95ea94700 1 --2- 172.21.15.6:0/2464006379 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc93c06ace0 0x7fc93c06d1a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.122+0000 7fc95ea94700 1 --2- 172.21.15.6:0/2464006379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9580bce60 0x7fc9581e6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.122+0000 7fc95ea94700 1 --2- 172.21.15.6:0/2464006379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc948003a30 0x7fc9580c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.122+0000 7fc95ea94700 1 --2- 172.21.15.6:0/2464006379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9580a7ab0 0x7fc9581e5e50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.122+0000 7fc95ea94700 1 -- 172.21.15.6:0/2464006379 >> 172.21.15.6:0/2464006379 conn(0x7fc9580a8660 msgr2=0x7fc95806a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:43.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.122+0000 7fc95ea94700 1 -- 172.21.15.6:0/2464006379 shutdown_connections 2023-07-21T07:36:43.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.122+0000 7fc95ea94700 1 -- 172.21.15.6:0/2464006379 wait complete. 2023-07-21T07:36:43.188 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:36:43.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.261+0000 7fb2c553f700 1 Processor -- start 2023-07-21T07:36:43.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.261+0000 7fb2c553f700 1 -- start start 2023-07-21T07:36:43.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2c553f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2c0151d80 0x7fb2c00c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2c553f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb2c00bd360 0x7fb2c006b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2c553f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c0154dc0 con 0x7fb2c00c7bd0 2023-07-21T07:36:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2c553f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c006ad50 con 0x7fb2c0151d80 2023-07-21T07:36:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2c553f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c01552f0 con 0x7fb2c00bd360 2023-07-21T07:36:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2beffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2c0151d80 0x7fb2c00c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2be7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb2c00c7bd0 0x7fb2c006b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44290/0 (socket says 172.21.15.6:44290) 2023-07-21T07:36:43.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2be7fc700 1 -- 172.21.15.6:0/1807791580 learned_addr learned my addr 172.21.15.6:0/1807791580 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:43.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2bf7fe700 1 --2- 172.21.15.6:0/1807791580 >> v2:172.21.15.86:3300/0 conn(0x7fb2c00bd360 0x7fb2c006b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2beffd700 1 -- 172.21.15.6:0/1807791580 >> v2:172.21.15.86:3300/0 conn(0x7fb2c00bd360 msgr2=0x7fb2c006b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:43.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2beffd700 1 --2- 172.21.15.6:0/1807791580 >> v2:172.21.15.86:3300/0 conn(0x7fb2c00bd360 0x7fb2c006b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2beffd700 1 -- 172.21.15.6:0/1807791580 >> v1:172.21.15.6:6789/0 conn(0x7fb2c00c7bd0 legacy=0x7fb2c006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2beffd700 1 -- 172.21.15.6:0/1807791580 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c0155010 con 0x7fb2c0151d80 2023-07-21T07:36:43.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2bdffb700 1 -- 172.21.15.6:0/1807791580 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014685350 0 0) 0x7fb2c0154dc0 con 0x7fb2c00c7bd0 2023-07-21T07:36:43.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.262+0000 7fb2beffd700 1 --2- 172.21.15.6:0/1807791580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0151d80 0x7fb2c00c4650 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb2c008be30 tx=0x7fb2b0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ae7eda4f5d4236 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:43.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.263+0000 7fb2bdffb700 1 -- 172.21.15.6:0/1807791580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0011830 con 0x7fb2c0151d80 2023-07-21T07:36:43.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.263+0000 7fb2bdffb700 1 -- 172.21.15.6:0/1807791580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b0011990 con 0x7fb2c0151d80 2023-07-21T07:36:43.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.263+0000 7fb2bdffb700 1 -- 172.21.15.6:0/1807791580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0011d20 con 0x7fb2c0151d80 2023-07-21T07:36:43.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.263+0000 7fb2c553f700 1 -- 172.21.15.6:0/1807791580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0151d80 msgr2=0x7fb2c00c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.263+0000 7fb2c553f700 1 --2- 172.21.15.6:0/1807791580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0151d80 0x7fb2c00c4650 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb2c008be30 tx=0x7fb2b0009b20 comp rx=0 tx=0).stop 2023-07-21T07:36:43.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.263+0000 7fb2c553f700 1 -- 172.21.15.6:0/1807791580 shutdown_connections 2023-07-21T07:36:43.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.263+0000 7fb2c553f700 1 --2- 172.21.15.6:0/1807791580 >> v2:172.21.15.86:3300/0 conn(0x7fb2c00bd360 0x7fb2c006b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.263+0000 7fb2c553f700 1 --2- 172.21.15.6:0/1807791580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0151d80 0x7fb2c00c4650 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.263+0000 7fb2c553f700 1 -- 172.21.15.6:0/1807791580 >> 172.21.15.6:0/1807791580 conn(0x7fb2c00c9cd0 msgr2=0x7fb2c00ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:43.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.263+0000 7fb2c553f700 1 -- 172.21.15.6:0/1807791580 shutdown_connections 2023-07-21T07:36:43.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.263+0000 7fb2c553f700 1 -- 172.21.15.6:0/1807791580 wait complete. 2023-07-21T07:36:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.264+0000 7fb2c553f700 1 Processor -- start 2023-07-21T07:36:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.265+0000 7fb2c553f700 1 -- start start 2023-07-21T07:36:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.265+0000 7fb2c553f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2c00bd360 0x7fb2c01538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.265+0000 7fb2c553f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2c00c7bd0 0x7fb2c00bec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.265+0000 7fb2c553f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0151d80 0x7fb2c00bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.265+0000 7fb2c553f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00c1390 con 0x7fb2c0151d80 2023-07-21T07:36:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.265+0000 7fb2c553f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00bf6f0 con 0x7fb2c00bd360 2023-07-21T07:36:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.265+0000 7fb2c553f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00be7e0 con 0x7fb2c00c7bd0 2023-07-21T07:36:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.265+0000 7fb2bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0151d80 0x7fb2c00bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.265+0000 7fb2bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0151d80 0x7fb2c00bf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36278/0 (socket says 172.21.15.6:36278) 2023-07-21T07:36:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.265+0000 7fb2bf7fe700 1 -- 172.21.15.6:0/1527537268 learned_addr learned my addr 172.21.15.6:0/1527537268 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:43.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.265+0000 7fb2beffd700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2c00bd360 0x7fb2c01538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.265+0000 7fb2be7fc700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2c00c7bd0 0x7fb2c00bec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.266+0000 7fb2bf7fe700 1 -- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2c00c7bd0 msgr2=0x7fb2c00bec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.266+0000 7fb2bf7fe700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2c00c7bd0 0x7fb2c00bec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.266+0000 7fb2bf7fe700 1 -- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2c00bd360 msgr2=0x7fb2c01538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.266+0000 7fb2bf7fe700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2c00bd360 0x7fb2c01538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.266+0000 7fb2bf7fe700 1 -- 172.21.15.6:0/1527537268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00094a0 con 0x7fb2c0151d80 2023-07-21T07:36:43.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.266+0000 7fb2bf7fe700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0151d80 0x7fb2c00bf1b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800cc30 tx=0x7fb2b800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:43.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.266+0000 7fb2a77fe700 1 -- 172.21.15.6:0/1527537268 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b800aa50 con 0x7fb2c0151d80 2023-07-21T07:36:43.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.266+0000 7fb2a77fe700 1 -- 172.21.15.6:0/1527537268 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b800abb0 con 0x7fb2c0151d80 2023-07-21T07:36:43.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.266+0000 7fb2c553f700 1 -- 172.21.15.6:0/1527537268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c01ea350 con 0x7fb2c0151d80 2023-07-21T07:36:43.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.266+0000 7fb2a77fe700 1 -- 172.21.15.6:0/1527537268 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8003a20 con 0x7fb2c0151d80 2023-07-21T07:36:43.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.266+0000 7fb2c553f700 1 -- 172.21.15.6:0/1527537268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c01ea910 con 0x7fb2c0151d80 2023-07-21T07:36:43.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.267+0000 7fb2c553f700 1 -- 172.21.15.6:0/1527537268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c00be990 con 0x7fb2c0151d80 2023-07-21T07:36:43.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.267+0000 7fb2a77fe700 1 -- 172.21.15.6:0/1527537268 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb2b800f3f0 con 0x7fb2c0151d80 2023-07-21T07:36:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.268+0000 7fb2a77fe700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb2ac06ace0 0x7fb2ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.268+0000 7fb2a77fe700 1 -- 172.21.15.6:0/1527537268 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2b80894b0 con 0x7fb2c0151d80 2023-07-21T07:36:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.268+0000 7fb2beffd700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb2ac06ace0 0x7fb2ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.268+0000 7fb2beffd700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb2ac06ace0 0x7fb2ac06d1a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00090b0 tx=0x7fb2b0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.272+0000 7fb2a77fe700 1 -- 172.21.15.6:0/1527537268 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb2c00be990 con 0x7fb2c0151d80 2023-07-21T07:36:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.468+0000 7fb2c553f700 1 -- 172.21.15.6:0/1527537268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2c00be990 con 0x7fb2c0151d80 2023-07-21T07:36:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.469+0000 7fb2a77fe700 1 -- 172.21.15.6:0/1527537268 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2c00be990 con 0x7fb2c0151d80 2023-07-21T07:36:43.523 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:36:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.470+0000 7fb2c553f700 1 -- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb2ac06ace0 msgr2=0x7fb2ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.470+0000 7fb2c553f700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb2ac06ace0 0x7fb2ac06d1a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00090b0 tx=0x7fb2b0008030 comp rx=0 tx=0).stop 2023-07-21T07:36:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.470+0000 7fb2c553f700 1 -- 172.21.15.6:0/1527537268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0151d80 msgr2=0x7fb2c00bf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.470+0000 7fb2c553f700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0151d80 0x7fb2c00bf1b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800cc30 tx=0x7fb2b800cf40 comp rx=0 tx=0).stop 2023-07-21T07:36:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.470+0000 7fb2c553f700 1 -- 172.21.15.6:0/1527537268 shutdown_connections 2023-07-21T07:36:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.470+0000 7fb2c553f700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb2ac06ace0 0x7fb2ac06d1a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.470+0000 7fb2c553f700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c0151d80 0x7fb2c00bf1b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.470+0000 7fb2c553f700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2c00bd360 0x7fb2c01538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.470+0000 7fb2c553f700 1 --2- 172.21.15.6:0/1527537268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2c00c7bd0 0x7fb2c00bec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.470+0000 7fb2c553f700 1 -- 172.21.15.6:0/1527537268 >> 172.21.15.6:0/1527537268 conn(0x7fb2c00c9cd0 msgr2=0x7fb2c00a9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.471+0000 7fb2c553f700 1 -- 172.21.15.6:0/1527537268 shutdown_connections 2023-07-21T07:36:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.471+0000 7fb2c553f700 1 -- 172.21.15.6:0/1527537268 wait complete. 2023-07-21T07:36:43.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:36:43.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.612+0000 7eff31b7a700 1 Processor -- start 2023-07-21T07:36:43.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.612+0000 7eff31b7a700 1 -- start start 2023-07-21T07:36:43.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.612+0000 7eff31b7a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7eff2c14ed60 0x7eff2c151720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.612+0000 7eff31b7a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c0664e0 con 0x7eff2c06ff90 2023-07-21T07:36:43.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.612+0000 7eff31b7a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c06b760 con 0x7eff2c0abc30 2023-07-21T07:36:43.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.612+0000 7eff31b7a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c071ba0 con 0x7eff2c14ed60 2023-07-21T07:36:43.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7eff2c06ff90 0x7eff2c151c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44306/0 (socket says 172.21.15.6:44306) 2023-07-21T07:36:43.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2bfff700 1 -- 172.21.15.6:0/3131855140 learned_addr learned my addr 172.21.15.6:0/3131855140 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:43.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2affd700 1 --2- 172.21.15.6:0/3131855140 >> v2:172.21.15.86:3300/0 conn(0x7eff2c14ed60 0x7eff2c151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680385952 0 0) 0x7eff2c0664e0 con 0x7eff2c06ff90 2023-07-21T07:36:43.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff140035b0 con 0x7eff2c06ff90 2023-07-21T07:36:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3722660502 0 0) 0x7eff140035b0 con 0x7eff2c06ff90 2023-07-21T07:36:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 >> v2:172.21.15.86:3300/0 conn(0x7eff2c14ed60 msgr2=0x7eff2c151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 --2- 172.21.15.6:0/3131855140 >> v2:172.21.15.86:3300/0 conn(0x7eff2c14ed60 0x7eff2c151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 >> v1:172.21.15.86:6789/0 conn(0x7eff2c0abc30 legacy=0x7eff2c14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c065f60 con 0x7eff2c06ff90 2023-07-21T07:36:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7eff240019f0 con 0x7eff2c06ff90 2023-07-21T07:36:43.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 >> v1:172.21.15.6:6789/0 conn(0x7eff2c06ff90 legacy=0x7eff2c151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 --2- 172.21.15.6:0/3131855140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff14003a00 0x7eff14003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 --2- 172.21.15.6:0/3131855140 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff14004400 0x7eff140048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 --2- 172.21.15.6:0/3131855140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff14005170 0x7eff1400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1400c080 con 0x7eff14003a00 2023-07-21T07:36:43.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1400c1f0 con 0x7eff14005170 2023-07-21T07:36:43.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1400c3b0 con 0x7eff14004400 2023-07-21T07:36:43.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2b7fe700 1 --2- 172.21.15.6:0/3131855140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff14003a00 0x7eff14003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2bfff700 1 --2- 172.21.15.6:0/3131855140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff14005170 0x7eff1400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.613+0000 7eff2affd700 1 --2- 172.21.15.6:0/3131855140 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff14004400 0x7eff140048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff2b7fe700 1 -- 172.21.15.6:0/3131855140 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff14004400 msgr2=0x7eff140048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:43.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff2b7fe700 1 --2- 172.21.15.6:0/3131855140 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff14004400 0x7eff140048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff2b7fe700 1 -- 172.21.15.6:0/3131855140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff14005170 msgr2=0x7eff1400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:43.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff2b7fe700 1 --2- 172.21.15.6:0/3131855140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff14005170 0x7eff1400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff2b7fe700 1 -- 172.21.15.6:0/3131855140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff140035b0 con 0x7eff14003a00 2023-07-21T07:36:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff2bfff700 1 -- 172.21.15.6:0/3131855140 reap_dead start 2023-07-21T07:36:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff2b7fe700 1 --2- 172.21.15.6:0/3131855140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff14003a00 0x7eff14003de0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0018d0 tx=0x7eff14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bd7d7873fb9a65 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0052d0 con 0x7eff14003a00 2023-07-21T07:36:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c005430 con 0x7eff14003a00 2023-07-21T07:36:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff2a7fc700 1 -- 172.21.15.6:0/3131855140 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0038c0 con 0x7eff14003a00 2023-07-21T07:36:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff31b7a700 1 -- 172.21.15.6:0/3131855140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff14003a00 msgr2=0x7eff14003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff31b7a700 1 --2- 172.21.15.6:0/3131855140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff14003a00 0x7eff14003de0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0018d0 tx=0x7eff14005880 comp rx=0 tx=0).stop 2023-07-21T07:36:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff31b7a700 1 -- 172.21.15.6:0/3131855140 shutdown_connections 2023-07-21T07:36:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff31b7a700 1 --2- 172.21.15.6:0/3131855140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff14003a00 0x7eff14003de0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff31b7a700 1 -- 172.21.15.6:0/3131855140 >> 172.21.15.6:0/3131855140 conn(0x7eff2c0c2c20 msgr2=0x7eff2c0c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.614+0000 7eff31b7a700 1 -- 172.21.15.6:0/3131855140 shutdown_connections 2023-07-21T07:36:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.615+0000 7eff31b7a700 1 -- 172.21.15.6:0/3131855140 wait complete. 2023-07-21T07:36:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.616+0000 7eff31b7a700 1 Processor -- start 2023-07-21T07:36:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.616+0000 7eff31b7a700 1 -- start start 2023-07-21T07:36:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.616+0000 7eff31b7a700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff14003a00 0x7eff2c0aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.616+0000 7eff31b7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2c1475d0 0x7eff2c147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff31b7a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff2c140a50 0x7eff2c140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff31b7a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c141410 con 0x7eff2c1475d0 2023-07-21T07:36:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff31b7a700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0c4f40 con 0x7eff14003a00 2023-07-21T07:36:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff31b7a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0c5220 con 0x7eff2c140a50 2023-07-21T07:36:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff2affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2c1475d0 0x7eff2c147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff2affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2c1475d0 0x7eff2c147a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36296/0 (socket says 172.21.15.6:36296) 2023-07-21T07:36:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff2affd700 1 -- 172.21.15.6:0/2373934955 learned_addr learned my addr 172.21.15.6:0/2373934955 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff2b7fe700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff14003a00 0x7eff2c0aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff2bfff700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff2c140a50 0x7eff2c140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff2affd700 1 -- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff2c140a50 msgr2=0x7eff2c140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff2affd700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff2c140a50 0x7eff2c140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff2affd700 1 -- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff14003a00 msgr2=0x7eff2c0aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff2affd700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff14003a00 0x7eff2c0aaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff2affd700 1 -- 172.21.15.6:0/2373934955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0c5500 con 0x7eff2c1475d0 2023-07-21T07:36:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff2affd700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2c1475d0 0x7eff2c147a50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7eff20011aa0 tx=0x7eff20011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff13fff700 1 -- 172.21.15.6:0/2373934955 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000f980 con 0x7eff2c1475d0 2023-07-21T07:36:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff13fff700 1 -- 172.21.15.6:0/2373934955 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2000fb00 con 0x7eff2c1475d0 2023-07-21T07:36:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff31b7a700 1 -- 172.21.15.6:0/2373934955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2c0c57e0 con 0x7eff2c1475d0 2023-07-21T07:36:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff13fff700 1 -- 172.21.15.6:0/2373934955 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000feb0 con 0x7eff2c1475d0 2023-07-21T07:36:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.617+0000 7eff31b7a700 1 -- 172.21.15.6:0/2373934955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c0c4bd0 con 0x7eff2c1475d0 2023-07-21T07:36:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.618+0000 7eff31b7a700 1 -- 172.21.15.6:0/2373934955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2c1e8830 con 0x7eff2c1475d0 2023-07-21T07:36:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.619+0000 7eff13fff700 1 -- 172.21.15.6:0/2373934955 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff20014440 con 0x7eff2c1475d0 2023-07-21T07:36:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.619+0000 7eff13fff700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff1806ace0 0x7eff1806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.619+0000 7eff13fff700 1 -- 172.21.15.6:0/2373934955 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff20089b90 con 0x7eff2c1475d0 2023-07-21T07:36:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.619+0000 7eff2b7fe700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff1806ace0 0x7eff1806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.620+0000 7eff2b7fe700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff1806ace0 0x7eff1806d1a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7eff1c000c00 tx=0x7eff1c005000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.624+0000 7eff13fff700 1 -- 172.21.15.6:0/2373934955 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7eff20054db0 con 0x7eff2c1475d0 2023-07-21T07:36:43.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.820+0000 7eff31b7a700 1 -- 172.21.15.6:0/2373934955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff2c0c5970 con 0x7eff2c1475d0 2023-07-21T07:36:43.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.820+0000 7eff13fff700 1 -- 172.21.15.6:0/2373934955 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff200220a0 con 0x7eff2c1475d0 2023-07-21T07:36:43.875 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:36:43.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.822+0000 7eff31b7a700 1 -- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff1806ace0 msgr2=0x7eff1806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.822+0000 7eff31b7a700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff1806ace0 0x7eff1806d1a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7eff1c000c00 tx=0x7eff1c005000 comp rx=0 tx=0).stop 2023-07-21T07:36:43.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.822+0000 7eff31b7a700 1 -- 172.21.15.6:0/2373934955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2c1475d0 msgr2=0x7eff2c147a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:43.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.822+0000 7eff31b7a700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2c1475d0 0x7eff2c147a50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7eff20011aa0 tx=0x7eff20011e60 comp rx=0 tx=0).stop 2023-07-21T07:36:43.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.822+0000 7eff31b7a700 1 -- 172.21.15.6:0/2373934955 shutdown_connections 2023-07-21T07:36:43.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.822+0000 7eff31b7a700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff1806ace0 0x7eff1806d1a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.822+0000 7eff31b7a700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff2c140a50 0x7eff2c140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.822+0000 7eff31b7a700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff14003a00 0x7eff2c0aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.822+0000 7eff31b7a700 1 --2- 172.21.15.6:0/2373934955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2c1475d0 0x7eff2c147a50 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:43.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.822+0000 7eff31b7a700 1 -- 172.21.15.6:0/2373934955 >> 172.21.15.6:0/2373934955 conn(0x7eff2c0c2c20 msgr2=0x7eff2c1da8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:43.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.822+0000 7eff31b7a700 1 -- 172.21.15.6:0/2373934955 shutdown_connections 2023-07-21T07:36:43.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.822+0000 7eff31b7a700 1 -- 172.21.15.6:0/2373934955 wait complete. 2023-07-21T07:36:43.889 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T07:36:44.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.961+0000 7f8e02567700 1 Processor -- start 2023-07-21T07:36:44.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.961+0000 7f8e02567700 1 -- start start 2023-07-21T07:36:44.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.961+0000 7f8e02567700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dfc0c6170 0x7f8dfc14ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:44.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.961+0000 7f8e02567700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dfc0c53e0 0x7f8dfc154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.961+0000 7f8e02567700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc0ba440 con 0x7f8dfc0c3750 2023-07-21T07:36:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.961+0000 7f8e02567700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc0c15d0 con 0x7f8dfc0c6170 2023-07-21T07:36:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.961+0000 7f8e02567700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0c18b0 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.962+0000 7f8dfb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dfc0c6170 0x7f8dfc14ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.962+0000 7f8dfb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dfc0c6170 0x7f8dfc14ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36304/0 (socket says 172.21.15.6:36304) 2023-07-21T07:36:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.962+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/2891868301 learned_addr learned my addr 172.21.15.6:0/2891868301 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.962+0000 7f8e00b04700 1 --2- 172.21.15.6:0/2891868301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dfc0c53e0 0x7f8dfc154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:44.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.962+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/2891868301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dfc0c53e0 msgr2=0x7f8dfc154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:44.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.962+0000 7f8dfb7fe700 1 --2- 172.21.15.6:0/2891868301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dfc0c53e0 0x7f8dfc154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.962+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/2891868301 >> v1:172.21.15.86:6789/0 conn(0x7f8dfc0c3750 legacy=0x7f8dfc14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:44.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.962+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/2891868301 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc0c1b90 con 0x7f8dfc0c6170 2023-07-21T07:36:44.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.962+0000 7f8dfb7fe700 1 --2- 172.21.15.6:0/2891868301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0c6170 0x7f8dfc14ed60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8df00098f0 tx=0x7f8df0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f156e23338fcb5d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:44.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.962+0000 7f8dfaffd700 1 -- 172.21.15.6:0/2891868301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df000b8a0 con 0x7f8dfc0c6170 2023-07-21T07:36:44.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.962+0000 7f8dfaffd700 1 -- 172.21.15.6:0/2891868301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df000ba00 con 0x7f8dfc0c6170 2023-07-21T07:36:44.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.962+0000 7f8dfaffd700 1 -- 172.21.15.6:0/2891868301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df000bd90 con 0x7f8dfc0c6170 2023-07-21T07:36:44.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.963+0000 7f8e02567700 1 -- 172.21.15.6:0/2891868301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0c6170 msgr2=0x7f8dfc14ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.963+0000 7f8e02567700 1 --2- 172.21.15.6:0/2891868301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0c6170 0x7f8dfc14ed60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8df00098f0 tx=0x7f8df0009c00 comp rx=0 tx=0).stop 2023-07-21T07:36:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.963+0000 7f8e02567700 1 -- 172.21.15.6:0/2891868301 shutdown_connections 2023-07-21T07:36:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.963+0000 7f8e02567700 1 --2- 172.21.15.6:0/2891868301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dfc0c53e0 0x7f8dfc154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.963+0000 7f8e02567700 1 --2- 172.21.15.6:0/2891868301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0c6170 0x7f8dfc14ed60 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.963+0000 7f8e02567700 1 -- 172.21.15.6:0/2891868301 >> 172.21.15.6:0/2891868301 conn(0x7f8dfc0a8c90 msgr2=0x7f8dfc06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.963+0000 7f8e02567700 1 -- 172.21.15.6:0/2891868301 shutdown_connections 2023-07-21T07:36:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.963+0000 7f8e02567700 1 -- 172.21.15.6:0/2891868301 wait complete. 2023-07-21T07:36:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.964+0000 7f8e02567700 1 Processor -- start 2023-07-21T07:36:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.964+0000 7f8e02567700 1 -- start start 2023-07-21T07:36:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8e02567700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dfc0c3750 0x7f8dfc1edb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8e02567700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0c53e0 0x7f8dfc071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8e02567700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dfc0c6170 0x7f8dfc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8e02567700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc06a570 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8e02567700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1537b0 con 0x7f8dfc0c6170 2023-07-21T07:36:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8e02567700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc153a90 con 0x7f8dfc0c3750 2023-07-21T07:36:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8dfb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0c53e0 0x7f8dfc071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8dfb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0c53e0 0x7f8dfc071ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36310/0 (socket says 172.21.15.6:36310) 2023-07-21T07:36:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/1598229969 learned_addr learned my addr 172.21.15.6:0/1598229969 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8dfbfff700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dfc0c3750 0x7f8dfc1edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8e00b04700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dfc0c6170 0x7f8dfc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dfc0c3750 msgr2=0x7f8dfc1edb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8dfb7fe700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dfc0c3750 0x7f8dfc1edb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dfc0c6170 msgr2=0x7f8dfc0a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8dfb7fe700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dfc0c6170 0x7f8dfc0a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/1598229969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df0009550 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.965+0000 7f8e00b04700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dfc0c6170 0x7f8dfc0a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.966+0000 7f8dfb7fe700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0c53e0 0x7f8dfc071ad0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8df0009c40 tx=0x7f8df0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.966+0000 7f8df8ff9700 1 -- 172.21.15.6:0/1598229969 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0004590 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.966+0000 7f8df8ff9700 1 -- 172.21.15.6:0/1598229969 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df001e070 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.966+0000 7f8e02567700 1 -- 172.21.15.6:0/1598229969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc153d70 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.966+0000 7f8df8ff9700 1 -- 172.21.15.6:0/1598229969 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df00038e0 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.966+0000 7f8e02567700 1 -- 172.21.15.6:0/1598229969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc1534b0 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.967+0000 7f8e02567700 1 -- 172.21.15.6:0/1598229969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc074500 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.967+0000 7f8df8ff9700 1 -- 172.21.15.6:0/1598229969 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8df0003a40 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.968+0000 7f8df8ff9700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8de806ace0 0x7f8de806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.968+0000 7f8df8ff9700 1 -- 172.21.15.6:0/1598229969 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8df0020070 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.968+0000 7f8dfbfff700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8de806ace0 0x7f8de806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.968+0000 7f8dfbfff700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8de806ace0 0x7f8de806d1a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8dec007fd0 tx=0x7f8dec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:44.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:43.972+0000 7f8df8ff9700 1 -- 172.21.15.6:0/1598229969 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8df0055a00 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.172+0000 7f8e02567700 1 -- 172.21.15.6:0/1598229969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8dfc0c2d10 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.172+0000 7f8df8ff9700 1 -- 172.21.15.6:0/1598229969 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v54) v1 ==== 84+0+269 (secure 0 0 0) 0x7f8df0059020 con 0x7f8dfc0c53e0 2023-07-21T07:36:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:44.227 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T07:36:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T07:36:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T07:36:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T07:36:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T07:36:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 9, 2023-07-21T07:36:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "cephfs_metadata" 2023-07-21T07:36:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T07:36:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T07:36:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 10, 2023-07-21T07:36:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "cephfs_data" 2023-07-21T07:36:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T07:36:44.230 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T07:36:44.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.174+0000 7f8e02567700 1 -- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8de806ace0 msgr2=0x7f8de806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:44.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.174+0000 7f8e02567700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8de806ace0 0x7f8de806d1a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8dec007fd0 tx=0x7f8dec009040 comp rx=0 tx=0).stop 2023-07-21T07:36:44.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.174+0000 7f8e02567700 1 -- 172.21.15.6:0/1598229969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0c53e0 msgr2=0x7f8dfc071ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:44.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.174+0000 7f8e02567700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0c53e0 0x7f8dfc071ad0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8df0009c40 tx=0x7f8df0004750 comp rx=0 tx=0).stop 2023-07-21T07:36:44.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.175+0000 7f8e02567700 1 -- 172.21.15.6:0/1598229969 shutdown_connections 2023-07-21T07:36:44.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.175+0000 7f8e02567700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8de806ace0 0x7f8de806d1a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.175+0000 7f8e02567700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dfc0c6170 0x7f8dfc0a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.175+0000 7f8e02567700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dfc0c3750 0x7f8dfc1edb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.175+0000 7f8e02567700 1 --2- 172.21.15.6:0/1598229969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0c53e0 0x7f8dfc071ad0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.175+0000 7f8e02567700 1 -- 172.21.15.6:0/1598229969 >> 172.21.15.6:0/1598229969 conn(0x7f8dfc0a8c90 msgr2=0x7f8dfc06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:44.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.175+0000 7f8e02567700 1 -- 172.21.15.6:0/1598229969 shutdown_connections 2023-07-21T07:36:44.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.175+0000 7f8e02567700 1 -- 172.21.15.6:0/1598229969 wait complete. 2023-07-21T07:36:44.241 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-07-21T07:36:44.241 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-07-21T07:36:44.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.316+0000 7f6017aa7700 1 Processor -- start 2023-07-21T07:36:44.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.316+0000 7f6017aa7700 1 -- start start 2023-07-21T07:36:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6017aa7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6010151ee0 0x7f60100a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6017aa7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6010154f90 0x7f60100c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6017aa7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60100716f0 con 0x7f60100c1ea0 2023-07-21T07:36:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6017aa7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60100c2320 con 0x7f6010154f90 2023-07-21T07:36:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6017aa7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60101522c0 con 0x7f6010151ee0 2023-07-21T07:36:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6015042700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f60100c1ea0 0x7f6010154880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44336/0 (socket says 172.21.15.6:44336) 2023-07-21T07:36:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6015042700 1 -- 172.21.15.6:0/1502390945 learned_addr learned my addr 172.21.15.6:0/1502390945 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6016044700 1 --2- 172.21.15.6:0/1502390945 >> v2:172.21.15.6:3300/0 conn(0x7f6010154f90 0x7f60100c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6015843700 1 --2- 172.21.15.6:0/1502390945 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6010151ee0 0x7f60100a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6014841700 1 -- 172.21.15.6:0/1502390945 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480735956 0 0) 0x7f60100716f0 con 0x7f60100c1ea0 2023-07-21T07:36:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6014841700 1 -- 172.21.15.6:0/1502390945 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ffc0035b0 con 0x7f60100c1ea0 2023-07-21T07:36:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6016044700 1 -- 172.21.15.6:0/1502390945 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6010151ee0 msgr2=0x7f60100a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6016044700 1 --2- 172.21.15.6:0/1502390945 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6010151ee0 0x7f60100a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6016044700 1 -- 172.21.15.6:0/1502390945 >> v1:172.21.15.6:6789/0 conn(0x7f60100c1ea0 legacy=0x7f6010154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:44.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6016044700 1 -- 172.21.15.6:0/1502390945 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60100c1bf0 con 0x7f6010154f90 2023-07-21T07:36:44.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.317+0000 7f6016044700 1 --2- 172.21.15.6:0/1502390945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6010154f90 0x7f60100c56f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6008009d90 tx=0x7f600800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966fd66eb7112ef1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:44.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.318+0000 7f6014841700 1 -- 172.21.15.6:0/1502390945 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600800e070 con 0x7f6010154f90 2023-07-21T07:36:44.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.318+0000 7f6014841700 1 -- 172.21.15.6:0/1502390945 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600800bb20 con 0x7f6010154f90 2023-07-21T07:36:44.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.318+0000 7f6014841700 1 -- 172.21.15.6:0/1502390945 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008012430 con 0x7f6010154f90 2023-07-21T07:36:44.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.318+0000 7f6017aa7700 1 -- 172.21.15.6:0/1502390945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6010154f90 msgr2=0x7f60100c56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:44.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.318+0000 7f6017aa7700 1 --2- 172.21.15.6:0/1502390945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6010154f90 0x7f60100c56f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6008009d90 tx=0x7f600800b330 comp rx=0 tx=0).stop 2023-07-21T07:36:44.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.318+0000 7f6017aa7700 1 -- 172.21.15.6:0/1502390945 shutdown_connections 2023-07-21T07:36:44.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.318+0000 7f6017aa7700 1 --2- 172.21.15.6:0/1502390945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6010154f90 0x7f60100c56f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.318+0000 7f6017aa7700 1 --2- 172.21.15.6:0/1502390945 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6010151ee0 0x7f60100a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.318+0000 7f6017aa7700 1 -- 172.21.15.6:0/1502390945 >> 172.21.15.6:0/1502390945 conn(0x7f60100c36f0 msgr2=0x7f60100c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:44.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.318+0000 7f6017aa7700 1 -- 172.21.15.6:0/1502390945 shutdown_connections 2023-07-21T07:36:44.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.318+0000 7f6017aa7700 1 -- 172.21.15.6:0/1502390945 wait complete. 2023-07-21T07:36:44.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.319+0000 7f6017aa7700 1 Processor -- start 2023-07-21T07:36:44.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.319+0000 7f6017aa7700 1 -- start start 2023-07-21T07:36:44.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6017aa7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60100c1ea0 0x7f60101e85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:44.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6017aa7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6010151ee0 0x7f6010099e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:44.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6017aa7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6010154f90 0x7f60100a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:44.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6017aa7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601009a360 con 0x7f60100c1ea0 2023-07-21T07:36:44.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6017aa7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60100beed0 con 0x7f6010151ee0 2023-07-21T07:36:44.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6017aa7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601009a590 con 0x7f6010154f90 2023-07-21T07:36:44.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6015843700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60100c1ea0 0x7f60101e85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:44.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6015843700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60100c1ea0 0x7f60101e85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36322/0 (socket says 172.21.15.6:36322) 2023-07-21T07:36:44.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6015843700 1 -- 172.21.15.6:0/1558097338 learned_addr learned my addr 172.21.15.6:0/1558097338 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:44.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6015843700 1 -- 172.21.15.6:0/1558097338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6010154f90 msgr2=0x7f60100a55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:44.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6015843700 1 --2- 172.21.15.6:0/1558097338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6010154f90 0x7f60100a55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6015843700 1 -- 172.21.15.6:0/1558097338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6010151ee0 msgr2=0x7f6010099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:44.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6015843700 1 --2- 172.21.15.6:0/1558097338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6010151ee0 0x7f6010099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.320+0000 7f6015843700 1 -- 172.21.15.6:0/1558097338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6008009a70 con 0x7f60100c1ea0 2023-07-21T07:36:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.321+0000 7f6015843700 1 --2- 172.21.15.6:0/1558097338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60100c1ea0 0x7f60101e85e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f600c00e9b0 tx=0x7f600c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.321+0000 7f60067fc700 1 -- 172.21.15.6:0/1558097338 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c009710 con 0x7f60100c1ea0 2023-07-21T07:36:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.321+0000 7f60067fc700 1 -- 172.21.15.6:0/1558097338 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c00c850 con 0x7f60100c1ea0 2023-07-21T07:36:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.321+0000 7f6017aa7700 1 -- 172.21.15.6:0/1558097338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60100bf170 con 0x7f60100c1ea0 2023-07-21T07:36:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.321+0000 7f60067fc700 1 -- 172.21.15.6:0/1558097338 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c00cbc0 con 0x7f60100c1ea0 2023-07-21T07:36:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.321+0000 7f6017aa7700 1 -- 172.21.15.6:0/1558097338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601009a870 con 0x7f60100c1ea0 2023-07-21T07:36:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.322+0000 7f6017aa7700 1 -- 172.21.15.6:0/1558097338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60100bf7c0 con 0x7f60100c1ea0 2023-07-21T07:36:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.322+0000 7f60067fc700 1 -- 172.21.15.6:0/1558097338 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f600c00cd20 con 0x7f60100c1ea0 2023-07-21T07:36:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.323+0000 7f60067fc700 1 --2- 172.21.15.6:0/1558097338 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5ff406ace0 0x7f5ff406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.323+0000 7f60067fc700 1 -- 172.21.15.6:0/1558097338 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f600c089500 con 0x7f60100c1ea0 2023-07-21T07:36:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.323+0000 7f6015042700 1 --2- 172.21.15.6:0/1558097338 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5ff406ace0 0x7f5ff406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:44.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.323+0000 7f6015042700 1 --2- 172.21.15.6:0/1558097338 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5ff406ace0 0x7f5ff406d1a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f601009ad10 tx=0x7f60000079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:44.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.327+0000 7f60067fc700 1 -- 172.21.15.6:0/1558097338 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f600c0580d0 con 0x7f60100c1ea0 2023-07-21T07:36:44.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.526+0000 7f6017aa7700 1 -- 172.21.15.6:0/1558097338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6010074500 con 0x7f60100c1ea0 2023-07-21T07:36:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.890+0000 7f60067fc700 1 -- 172.21.15.6:0/1558097338 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v55) v1 ==== 140+0+0 (secure 0 0 0) 0x7f600c057c60 con 0x7f60100c1ea0 2023-07-21T07:36:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.894+0000 7f6017aa7700 1 -- 172.21.15.6:0/1558097338 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5ff406ace0 msgr2=0x7f5ff406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.894+0000 7f6017aa7700 1 --2- 172.21.15.6:0/1558097338 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5ff406ace0 0x7f5ff406d1a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f601009ad10 tx=0x7f60000079c0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.894+0000 7f6017aa7700 1 -- 172.21.15.6:0/1558097338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60100c1ea0 msgr2=0x7f60101e85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.894+0000 7f6017aa7700 1 --2- 172.21.15.6:0/1558097338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60100c1ea0 0x7f60101e85e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f600c00e9b0 tx=0x7f600c00ed70 comp rx=0 tx=0).stop 2023-07-21T07:36:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.895+0000 7f6017aa7700 1 -- 172.21.15.6:0/1558097338 shutdown_connections 2023-07-21T07:36:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.895+0000 7f6017aa7700 1 --2- 172.21.15.6:0/1558097338 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5ff406ace0 0x7f5ff406d1a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.895+0000 7f6017aa7700 1 --2- 172.21.15.6:0/1558097338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6010154f90 0x7f60100a55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.895+0000 7f6017aa7700 1 --2- 172.21.15.6:0/1558097338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60100c1ea0 0x7f60101e85e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.895+0000 7f6017aa7700 1 --2- 172.21.15.6:0/1558097338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6010151ee0 0x7f6010099e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:44.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.895+0000 7f6017aa7700 1 -- 172.21.15.6:0/1558097338 >> 172.21.15.6:0/1558097338 conn(0x7f60100c36f0 msgr2=0x7f601006de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:44.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.895+0000 7f6017aa7700 1 -- 172.21.15.6:0/1558097338 shutdown_connections 2023-07-21T07:36:44.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:44.895+0000 7f6017aa7700 1 -- 172.21.15.6:0/1558097338 wait complete. 2023-07-21T07:36:44.951 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs2_metadata' created 2023-07-21T07:36:44.963 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T07:36:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.041+0000 7f34fb308700 1 Processor -- start 2023-07-21T07:36:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.042+0000 7f34fb308700 1 -- start start 2023-07-21T07:36:45.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.042+0000 7f34fb308700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c5260 0x7f34f4151280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:45.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.042+0000 7f34fb308700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f34f40c3f80 0x7f34f40c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:45.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.042+0000 7f34fb308700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f41517c0 con 0x7f34f40c1860 2023-07-21T07:36:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.042+0000 7f34fb308700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f40c4e50 con 0x7f34f40c3f80 2023-07-21T07:36:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.042+0000 7f34fb308700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41519f0 con 0x7f34f40c5260 2023-07-21T07:36:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34f90a4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f34f40c1860 0x7f34f406dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44350/0 (socket says 172.21.15.6:44350) 2023-07-21T07:36:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34f90a4700 1 -- 172.21.15.6:0/2598757031 learned_addr learned my addr 172.21.15.6:0/2598757031 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34f88a3700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c5260 0x7f34f4151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34f98a5700 1 --2- 172.21.15.6:0/2598757031 >> v2:172.21.15.86:3300/0 conn(0x7f34f40c3f80 0x7f34f40c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902149920 0 0) 0x7f34f41517c0 con 0x7f34f40c1860 2023-07-21T07:36:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e00035b0 con 0x7f34f40c1860 2023-07-21T07:36:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2071029817 0 0) 0x7f34e00035b0 con 0x7f34f40c1860 2023-07-21T07:36:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c5260 msgr2=0x7f34f4151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c5260 0x7f34f4151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 >> v2:172.21.15.86:3300/0 conn(0x7f34f40c3f80 msgr2=0x7f34f40c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 --2- 172.21.15.6:0/2598757031 >> v2:172.21.15.86:3300/0 conn(0x7f34f40c3f80 0x7f34f40c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f4151cd0 con 0x7f34f40c1860 2023-07-21T07:36:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f34e4001670 con 0x7f34f40c1860 2023-07-21T07:36:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 >> v1:172.21.15.6:6789/0 conn(0x7f34f40c1860 legacy=0x7f34f406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c5260 0x7f34e0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34e0003f80 0x7f34e0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e0004d90 0x7f34e0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f40c4e50 con 0x7f34e0003f80 2023-07-21T07:36:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41519f0 con 0x7f34e0004d90 2023-07-21T07:36:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e000ba10 con 0x7f34f40c5260 2023-07-21T07:36:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34f98a5700 1 --2- 172.21.15.6:0/2598757031 >> v2:172.21.15.86:3300/0 conn(0x7f34f40c3f80 0x7f34f40c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34f88a3700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34e0003f80 0x7f34e0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34f90a4700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c5260 0x7f34e0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.043+0000 7f34f98a5700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e0004d90 0x7f34e0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34f88a3700 1 -- 172.21.15.6:0/2598757031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c5260 msgr2=0x7f34e0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34f88a3700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c5260 0x7f34e0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34f88a3700 1 -- 172.21.15.6:0/2598757031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e0004d90 msgr2=0x7f34e0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34f88a3700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e0004d90 0x7f34e0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34f88a3700 1 -- 172.21.15.6:0/2598757031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e00035b0 con 0x7f34e0003f80 2023-07-21T07:36:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34f98a5700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e0004d90 0x7f34e0005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34f90a4700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c5260 0x7f34e0003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34f88a3700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34e0003f80 0x7f34e0004850 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009b30 tx=0x7f34e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5f65205055fb52 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f000e660 con 0x7f34e0003f80 2023-07-21T07:36:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f000e7c0 con 0x7f34e0003f80 2023-07-21T07:36:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34ebfff700 1 -- 172.21.15.6:0/2598757031 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f000eb30 con 0x7f34e0003f80 2023-07-21T07:36:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34fb308700 1 -- 172.21.15.6:0/2598757031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34e0003f80 msgr2=0x7f34e0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34fb308700 1 --2- 172.21.15.6:0/2598757031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34e0003f80 0x7f34e0004850 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009b30 tx=0x7f34e0005880 comp rx=0 tx=0).stop 2023-07-21T07:36:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34f98a5700 1 -- 172.21.15.6:0/2598757031 reap_dead start 2023-07-21T07:36:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34fb308700 1 -- 172.21.15.6:0/2598757031 shutdown_connections 2023-07-21T07:36:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.044+0000 7f34fb308700 1 -- 172.21.15.6:0/2598757031 >> 172.21.15.6:0/2598757031 conn(0x7f34f40a8660 msgr2=0x7f34f40a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.045+0000 7f34fb308700 1 -- 172.21.15.6:0/2598757031 shutdown_connections 2023-07-21T07:36:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.045+0000 7f34fb308700 1 -- 172.21.15.6:0/2598757031 wait complete. 2023-07-21T07:36:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.046+0000 7f34fb308700 1 Processor -- start 2023-07-21T07:36:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.046+0000 7f34fb308700 1 -- start start 2023-07-21T07:36:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34fb308700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e0003f80 0x7f34f414dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34fb308700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c64d0 0x7f34f40bf820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34fb308700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f40bfd60 0x7f34f406a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34fb308700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41eab50 con 0x7f34f40bfd60 2023-07-21T07:36:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34fb308700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f4148b10 con 0x7f34e0003f80 2023-07-21T07:36:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34fb308700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41eadf0 con 0x7f34f40c64d0 2023-07-21T07:36:45.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34f98a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f40bfd60 0x7f34f406a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34f98a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f40bfd60 0x7f34f406a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36346/0 (socket says 172.21.15.6:36346) 2023-07-21T07:36:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34f98a5700 1 -- 172.21.15.6:0/2966282926 learned_addr learned my addr 172.21.15.6:0/2966282926 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34f90a4700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e0003f80 0x7f34f414dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34f88a3700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c64d0 0x7f34f40bf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34f98a5700 1 -- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c64d0 msgr2=0x7f34f40bf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34f98a5700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c64d0 0x7f34f40bf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:45.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34f98a5700 1 -- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e0003f80 msgr2=0x7f34f414dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34f98a5700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e0003f80 0x7f34f414dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34f98a5700 1 -- 172.21.15.6:0/2966282926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f4148d80 con 0x7f34f40bfd60 2023-07-21T07:36:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34f98a5700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f40bfd60 0x7f34f406a090 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f34f40c4430 tx=0x7f34ec0114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34e9ffb700 1 -- 172.21.15.6:0/2966282926 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec00e030 con 0x7f34f40bfd60 2023-07-21T07:36:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34e9ffb700 1 -- 172.21.15.6:0/2966282926 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec011ba0 con 0x7f34f40bfd60 2023-07-21T07:36:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34fb308700 1 -- 172.21.15.6:0/2966282926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f4148ff0 con 0x7f34f40bfd60 2023-07-21T07:36:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.047+0000 7f34e9ffb700 1 -- 172.21.15.6:0/2966282926 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec016470 con 0x7f34f40bfd60 2023-07-21T07:36:45.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.048+0000 7f34fb308700 1 -- 172.21.15.6:0/2966282926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f414e230 con 0x7f34f40bfd60 2023-07-21T07:36:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.049+0000 7f34fb308700 1 -- 172.21.15.6:0/2966282926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f406e400 con 0x7f34f40bfd60 2023-07-21T07:36:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.050+0000 7f34e9ffb700 1 -- 172.21.15.6:0/2966282926 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34ec0165d0 con 0x7f34f40bfd60 2023-07-21T07:36:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.050+0000 7f34e9ffb700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f34d806ace0 0x7f34d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.050+0000 7f34e9ffb700 1 -- 172.21.15.6:0/2966282926 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f34ec00f070 con 0x7f34f40bfd60 2023-07-21T07:36:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.051+0000 7f34f90a4700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f34d806ace0 0x7f34d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.051+0000 7f34f90a4700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f34d806ace0 0x7f34d806d1a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f34e4001820 tx=0x7f34e4007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:45.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.054+0000 7f34e9ffb700 1 -- 172.21.15.6:0/2966282926 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f34ec0554d0 con 0x7f34f40bfd60 2023-07-21T07:36:45.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.252+0000 7f34fb308700 1 -- 172.21.15.6:0/2966282926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f34f40669d0 con 0x7f34f40bfd60 2023-07-21T07:36:45.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.891+0000 7f34e9ffb700 1 -- 172.21.15.6:0/2966282926 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v56) v1 ==== 172+0+0 (secure 0 0 0) 0x7f34f40669d0 con 0x7f34f40bfd60 2023-07-21T07:36:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.909+0000 7f34fb308700 1 -- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f34d806ace0 msgr2=0x7f34d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.909+0000 7f34fb308700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f34d806ace0 0x7f34d806d1a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f34e4001820 tx=0x7f34e4007040 comp rx=0 tx=0).stop 2023-07-21T07:36:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.909+0000 7f34fb308700 1 -- 172.21.15.6:0/2966282926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f40bfd60 msgr2=0x7f34f406a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.909+0000 7f34fb308700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f40bfd60 0x7f34f406a090 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f34f40c4430 tx=0x7f34ec0114b0 comp rx=0 tx=0).stop 2023-07-21T07:36:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.910+0000 7f34fb308700 1 -- 172.21.15.6:0/2966282926 shutdown_connections 2023-07-21T07:36:45.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.910+0000 7f34fb308700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f34d806ace0 0x7f34d806d1a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:45.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.910+0000 7f34fb308700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f40bfd60 0x7f34f406a090 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:45.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.910+0000 7f34fb308700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34e0003f80 0x7f34f414dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:45.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.910+0000 7f34fb308700 1 --2- 172.21.15.6:0/2966282926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34f40c64d0 0x7f34f40bf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:45.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.910+0000 7f34fb308700 1 -- 172.21.15.6:0/2966282926 >> 172.21.15.6:0/2966282926 conn(0x7f34f40a8660 msgr2=0x7f34f414ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:45.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.911+0000 7f34fb308700 1 -- 172.21.15.6:0/2966282926 shutdown_connections 2023-07-21T07:36:45.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:45.911+0000 7f34fb308700 1 -- 172.21.15.6:0/2966282926 wait complete. 2023-07-21T07:36:45.968 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs2_data' created 2023-07-21T07:36:45.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-07-21T07:36:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.061+0000 7f5d5c22c700 1 Processor -- start 2023-07-21T07:36:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.061+0000 7f5d5c22c700 1 -- start start 2023-07-21T07:36:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d5c22c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d540abc30 0x7f5d5414e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d5c22c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d5406ff90 0x7f5d5414eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d5c22c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d540704e0 0x7f5d54151720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d5c22c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d54071ba0 con 0x7f5d5406ff90 2023-07-21T07:36:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d5c22c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d540664e0 con 0x7f5d540abc30 2023-07-21T07:36:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d5c22c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5406b760 con 0x7f5d540704e0 2023-07-21T07:36:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d597c7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d5406ff90 0x7f5d5414eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d597c7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d5406ff90 0x7f5d5414eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36352/0 (socket says 172.21.15.6:36352) 2023-07-21T07:36:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d597c7700 1 -- 172.21.15.6:0/151566177 learned_addr learned my addr 172.21.15.6:0/151566177 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d5a7c9700 1 --2- 172.21.15.6:0/151566177 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d540704e0 0x7f5d54151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d59fc8700 1 --2- 172.21.15.6:0/151566177 >> v2:172.21.15.86:3300/0 conn(0x7f5d540abc30 0x7f5d5414e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d597c7700 1 -- 172.21.15.6:0/151566177 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d540704e0 msgr2=0x7f5d54151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d597c7700 1 --2- 172.21.15.6:0/151566177 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d540704e0 0x7f5d54151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d597c7700 1 -- 172.21.15.6:0/151566177 >> v2:172.21.15.86:3300/0 conn(0x7f5d540abc30 msgr2=0x7f5d5414e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d597c7700 1 --2- 172.21.15.6:0/151566177 >> v2:172.21.15.86:3300/0 conn(0x7f5d540abc30 0x7f5d5414e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d597c7700 1 -- 172.21.15.6:0/151566177 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d54065f60 con 0x7f5d5406ff90 2023-07-21T07:36:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.062+0000 7f5d597c7700 1 --2- 172.21.15.6:0/151566177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d5406ff90 0x7f5d5414eb90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5d5406ff40 tx=0x7f5d44009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2079206d5ed956c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.063+0000 7f5d58fc6700 1 -- 172.21.15.6:0/151566177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400b870 con 0x7f5d5406ff90 2023-07-21T07:36:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.063+0000 7f5d58fc6700 1 -- 172.21.15.6:0/151566177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4400b9d0 con 0x7f5d5406ff90 2023-07-21T07:36:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.063+0000 7f5d58fc6700 1 -- 172.21.15.6:0/151566177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400bd60 con 0x7f5d5406ff90 2023-07-21T07:36:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.063+0000 7f5d5c22c700 1 -- 172.21.15.6:0/151566177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d5406ff90 msgr2=0x7f5d5414eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.063+0000 7f5d5c22c700 1 --2- 172.21.15.6:0/151566177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d5406ff90 0x7f5d5414eb90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5d5406ff40 tx=0x7f5d44009bd0 comp rx=0 tx=0).stop 2023-07-21T07:36:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.063+0000 7f5d5c22c700 1 -- 172.21.15.6:0/151566177 shutdown_connections 2023-07-21T07:36:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.063+0000 7f5d5c22c700 1 --2- 172.21.15.6:0/151566177 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d540704e0 0x7f5d54151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.063+0000 7f5d5c22c700 1 --2- 172.21.15.6:0/151566177 >> v2:172.21.15.86:3300/0 conn(0x7f5d540abc30 0x7f5d5414e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.063+0000 7f5d5c22c700 1 --2- 172.21.15.6:0/151566177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d5406ff90 0x7f5d5414eb90 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.063+0000 7f5d5c22c700 1 -- 172.21.15.6:0/151566177 >> 172.21.15.6:0/151566177 conn(0x7f5d540c2c20 msgr2=0x7f5d540c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.063+0000 7f5d5c22c700 1 -- 172.21.15.6:0/151566177 shutdown_connections 2023-07-21T07:36:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.063+0000 7f5d5c22c700 1 -- 172.21.15.6:0/151566177 wait complete. 2023-07-21T07:36:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.064+0000 7f5d5c22c700 1 Processor -- start 2023-07-21T07:36:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.064+0000 7f5d5c22c700 1 -- start start 2023-07-21T07:36:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.065+0000 7f5d5c22c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d5406ff90 0x7f5d5414cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.065+0000 7f5d5c22c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d540704e0 0x7f5d540c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.065+0000 7f5d5c22c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d540abc30 0x7f5d5414d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.065+0000 7f5d5c22c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d541dc2a0 con 0x7f5d540704e0 2023-07-21T07:36:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.065+0000 7f5d5c22c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d541dca50 con 0x7f5d540abc30 2023-07-21T07:36:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.065+0000 7f5d5c22c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d541dba00 con 0x7f5d5406ff90 2023-07-21T07:36:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.065+0000 7f5d597c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d540704e0 0x7f5d540c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.065+0000 7f5d597c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d540704e0 0x7f5d540c3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36358/0 (socket says 172.21.15.6:36358) 2023-07-21T07:36:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.065+0000 7f5d597c7700 1 -- 172.21.15.6:0/2540656221 learned_addr learned my addr 172.21.15.6:0/2540656221 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.065+0000 7f5d59fc8700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d5406ff90 0x7f5d5414cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.065+0000 7f5d5a7c9700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d540abc30 0x7f5d5414d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.066+0000 7f5d597c7700 1 -- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d5406ff90 msgr2=0x7f5d5414cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.066+0000 7f5d597c7700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d5406ff90 0x7f5d5414cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.066+0000 7f5d597c7700 1 -- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d540abc30 msgr2=0x7f5d5414d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.066+0000 7f5d597c7700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d540abc30 0x7f5d5414d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.066+0000 7f5d597c7700 1 -- 172.21.15.6:0/2540656221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d44009550 con 0x7f5d540704e0 2023-07-21T07:36:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.066+0000 7f5d597c7700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d540704e0 0x7f5d540c3fa0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5d44000c00 tx=0x7f5d44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.066+0000 7f5d4a7fc700 1 -- 172.21.15.6:0/2540656221 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44011830 con 0x7f5d540704e0 2023-07-21T07:36:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.066+0000 7f5d4a7fc700 1 -- 172.21.15.6:0/2540656221 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4401e070 con 0x7f5d540704e0 2023-07-21T07:36:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.066+0000 7f5d4a7fc700 1 -- 172.21.15.6:0/2540656221 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44011bb0 con 0x7f5d540704e0 2023-07-21T07:36:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.066+0000 7f5d5c22c700 1 -- 172.21.15.6:0/2540656221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d541dbce0 con 0x7f5d540704e0 2023-07-21T07:36:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.066+0000 7f5d5c22c700 1 -- 172.21.15.6:0/2540656221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5414d400 con 0x7f5d540704e0 2023-07-21T07:36:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.067+0000 7f5d5c22c700 1 -- 172.21.15.6:0/2540656221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d54074500 con 0x7f5d540704e0 2023-07-21T07:36:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.068+0000 7f5d4a7fc700 1 -- 172.21.15.6:0/2540656221 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d44011d10 con 0x7f5d540704e0 2023-07-21T07:36:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.068+0000 7f5d4a7fc700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5d3806ace0 0x7f5d3806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.068+0000 7f5d4a7fc700 1 -- 172.21.15.6:0/2540656221 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6816+0+0 (secure 0 0 0) 0x7f5d44020070 con 0x7f5d540704e0 2023-07-21T07:36:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.068+0000 7f5d59fc8700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5d3806ace0 0x7f5d3806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.069+0000 7f5d59fc8700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5d3806ace0 0x7f5d3806d1a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5d54148170 tx=0x7f5d50008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.073+0000 7f5d4a7fc700 1 -- 172.21.15.6:0/2540656221 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5d44055900 con 0x7f5d540704e0 2023-07-21T07:36:46.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.318+0000 7f5d5c22c700 1 -- 172.21.15.6:0/2540656221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f5d540c05b0 con 0x7f5d540704e0 2023-07-21T07:36:46.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.919+0000 7f5d4a7fc700 1 -- 172.21.15.6:0/2540656221 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 11 and data pool 12 v34) v1 ==== 177+0+0 (secure 0 0 0) 0x7f5d44058f20 con 0x7f5d540704e0 2023-07-21T07:36:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.930+0000 7f5d5c22c700 1 -- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5d3806ace0 msgr2=0x7f5d3806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.930+0000 7f5d5c22c700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5d3806ace0 0x7f5d3806d1a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5d54148170 tx=0x7f5d50008040 comp rx=0 tx=0).stop 2023-07-21T07:36:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.930+0000 7f5d5c22c700 1 -- 172.21.15.6:0/2540656221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d540704e0 msgr2=0x7f5d540c3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.930+0000 7f5d5c22c700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d540704e0 0x7f5d540c3fa0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5d44000c00 tx=0x7f5d44004750 comp rx=0 tx=0).stop 2023-07-21T07:36:46.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.930+0000 7f5d5c22c700 1 -- 172.21.15.6:0/2540656221 shutdown_connections 2023-07-21T07:36:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.930+0000 7f5d5c22c700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f5d3806ace0 0x7f5d3806d1a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.930+0000 7f5d5c22c700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d540abc30 0x7f5d5414d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.930+0000 7f5d5c22c700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d5406ff90 0x7f5d5414cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.930+0000 7f5d5c22c700 1 --2- 172.21.15.6:0/2540656221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d540704e0 0x7f5d540c3fa0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.930+0000 7f5d5c22c700 1 -- 172.21.15.6:0/2540656221 >> 172.21.15.6:0/2540656221 conn(0x7f5d540c2c20 msgr2=0x7f5d54144e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.930+0000 7f5d5c22c700 1 -- 172.21.15.6:0/2540656221 shutdown_connections 2023-07-21T07:36:46.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:46.930+0000 7f5d5c22c700 1 -- 172.21.15.6:0/2540656221 wait complete. 2023-07-21T07:36:46.987 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 11 and data pool 12 2023-07-21T07:36:47.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:47.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.082+0000 7eff8e4fd700 1 Processor -- start 2023-07-21T07:36:47.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.082+0000 7eff8e4fd700 1 -- start start 2023-07-21T07:36:47.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.083+0000 7eff8e4fd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff880c3750 0x7eff880c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff8e4fd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff880c6170 0x7eff8814e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff8e4fd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff880ba440 con 0x7eff8814eb90 2023-07-21T07:36:47.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff8e4fd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff880c15d0 con 0x7eff880c3750 2023-07-21T07:36:47.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff8e4fd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff880c18b0 con 0x7eff880c6170 2023-07-21T07:36:47.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff87fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff880c3750 0x7eff880c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff87fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff880c3750 0x7eff880c53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36378/0 (socket says 172.21.15.6:36378) 2023-07-21T07:36:47.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff87fff700 1 -- 172.21.15.6:0/1403251798 learned_addr learned my addr 172.21.15.6:0/1403251798 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:47.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff877fe700 1 --2- 172.21.15.6:0/1403251798 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff880c6170 0x7eff8814e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff87fff700 1 -- 172.21.15.6:0/1403251798 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff880c6170 msgr2=0x7eff8814e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:47.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff87fff700 1 --2- 172.21.15.6:0/1403251798 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff880c6170 0x7eff8814e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff87fff700 1 -- 172.21.15.6:0/1403251798 >> v1:172.21.15.86:6789/0 conn(0x7eff8814eb90 legacy=0x7eff88154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff87fff700 1 -- 172.21.15.6:0/1403251798 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff880c1b90 con 0x7eff880c3750 2023-07-21T07:36:47.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff87fff700 1 --2- 172.21.15.6:0/1403251798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff880c3750 0x7eff880c53e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7eff780098f0 tx=0x7eff78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbab877b45ecce04 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:47.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff86ffd700 1 -- 172.21.15.6:0/1403251798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7800b8a0 con 0x7eff880c3750 2023-07-21T07:36:47.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff86ffd700 1 -- 172.21.15.6:0/1403251798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7800ba00 con 0x7eff880c3750 2023-07-21T07:36:47.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.084+0000 7eff86ffd700 1 -- 172.21.15.6:0/1403251798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7800bd90 con 0x7eff880c3750 2023-07-21T07:36:47.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.085+0000 7eff8e4fd700 1 -- 172.21.15.6:0/1403251798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff880c3750 msgr2=0x7eff880c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.085+0000 7eff8e4fd700 1 --2- 172.21.15.6:0/1403251798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff880c3750 0x7eff880c53e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7eff780098f0 tx=0x7eff78009c00 comp rx=0 tx=0).stop 2023-07-21T07:36:47.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.085+0000 7eff8e4fd700 1 -- 172.21.15.6:0/1403251798 shutdown_connections 2023-07-21T07:36:47.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.085+0000 7eff8e4fd700 1 --2- 172.21.15.6:0/1403251798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff880c3750 0x7eff880c53e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.085+0000 7eff8e4fd700 1 --2- 172.21.15.6:0/1403251798 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff880c6170 0x7eff8814e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.085+0000 7eff8e4fd700 1 -- 172.21.15.6:0/1403251798 >> 172.21.15.6:0/1403251798 conn(0x7eff880a8c90 msgr2=0x7eff8806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:47.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.085+0000 7eff8e4fd700 1 -- 172.21.15.6:0/1403251798 shutdown_connections 2023-07-21T07:36:47.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.085+0000 7eff8e4fd700 1 -- 172.21.15.6:0/1403251798 wait complete. 2023-07-21T07:36:47.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.086+0000 7eff8e4fd700 1 Processor -- start 2023-07-21T07:36:47.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.086+0000 7eff8e4fd700 1 -- start start 2023-07-21T07:36:47.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.087+0000 7eff8e4fd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff880c3750 0x7eff8814cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.087+0000 7eff8e4fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff880c6170 0x7eff881ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.087+0000 7eff8e4fd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff8814eb90 0x7eff881eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.087+0000 7eff8e4fd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff88153d80 con 0x7eff880c6170 2023-07-21T07:36:47.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.087+0000 7eff8e4fd700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8815e5c0 con 0x7eff880c3750 2023-07-21T07:36:47.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.087+0000 7eff8e4fd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff880c6830 con 0x7eff8814eb90 2023-07-21T07:36:47.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.087+0000 7eff877fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff880c6170 0x7eff881ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.087+0000 7eff877fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff880c6170 0x7eff881ed550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36386/0 (socket says 172.21.15.6:36386) 2023-07-21T07:36:47.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.087+0000 7eff877fe700 1 -- 172.21.15.6:0/366195514 learned_addr learned my addr 172.21.15.6:0/366195514 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:47.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.087+0000 7eff87fff700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff880c3750 0x7eff8814cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.087+0000 7eff8ca9a700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff8814eb90 0x7eff881eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.088+0000 7eff877fe700 1 -- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff8814eb90 msgr2=0x7eff881eda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.088+0000 7eff877fe700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff8814eb90 0x7eff881eda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.088+0000 7eff877fe700 1 -- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff880c3750 msgr2=0x7eff8814cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.088+0000 7eff877fe700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff880c3750 0x7eff8814cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.088+0000 7eff877fe700 1 -- 172.21.15.6:0/366195514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff78009550 con 0x7eff880c6170 2023-07-21T07:36:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.088+0000 7eff877fe700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff880c6170 0x7eff881ed550 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00e810 tx=0x7eff7c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.088+0000 7eff84ff9700 1 -- 172.21.15.6:0/366195514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c013610 con 0x7eff880c6170 2023-07-21T07:36:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.088+0000 7eff84ff9700 1 -- 172.21.15.6:0/366195514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c013770 con 0x7eff880c6170 2023-07-21T07:36:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.088+0000 7eff8e4fd700 1 -- 172.21.15.6:0/366195514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff88154540 con 0x7eff880c6170 2023-07-21T07:36:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.088+0000 7eff84ff9700 1 -- 172.21.15.6:0/366195514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c013b20 con 0x7eff880c6170 2023-07-21T07:36:47.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.088+0000 7eff8e4fd700 1 -- 172.21.15.6:0/366195514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8815e0a0 con 0x7eff880c6170 2023-07-21T07:36:47.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.089+0000 7eff8e4fd700 1 -- 172.21.15.6:0/366195514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8815e2c0 con 0x7eff880c6170 2023-07-21T07:36:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.089+0000 7eff84ff9700 1 -- 172.21.15.6:0/366195514 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff7c013c80 con 0x7eff880c6170 2023-07-21T07:36:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.090+0000 7eff84ff9700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff7406ace0 0x7eff7406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.090+0000 7eff84ff9700 1 -- 172.21.15.6:0/366195514 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6918+0+0 (secure 0 0 0) 0x7eff7c0894b0 con 0x7eff880c6170 2023-07-21T07:36:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.090+0000 7eff87fff700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff7406ace0 0x7eff7406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.090+0000 7eff87fff700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff7406ace0 0x7eff7406d1a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7eff78009c40 tx=0x7eff78008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:47.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.094+0000 7eff84ff9700 1 -- 172.21.15.6:0/366195514 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7eff7c057d20 con 0x7eff880c6170 2023-07-21T07:36:47.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.293+0000 7eff8e4fd700 1 -- 172.21.15.6:0/366195514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff8804e470 con 0x7eff880c6170 2023-07-21T07:36:47.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.295+0000 7eff84ff9700 1 -- 172.21.15.6:0/366195514 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+21916 (secure 0 0 0) 0x7eff7c0578b0 con 0x7eff880c6170 2023-07-21T07:36:47.349 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:47.349 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":57,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:36:46.320519+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:36:26.204826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T07:36:26.916497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:36:44.559566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:36:45.284485+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:47.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.297+0000 7eff8e4fd700 1 -- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff7406ace0 msgr2=0x7eff7406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.297+0000 7eff8e4fd700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff7406ace0 0x7eff7406d1a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7eff78009c40 tx=0x7eff78008030 comp rx=0 tx=0).stop 2023-07-21T07:36:47.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.297+0000 7eff8e4fd700 1 -- 172.21.15.6:0/366195514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff880c6170 msgr2=0x7eff881ed550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.297+0000 7eff8e4fd700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff880c6170 0x7eff881ed550 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00e810 tx=0x7eff7c00ebd0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.297+0000 7eff8e4fd700 1 -- 172.21.15.6:0/366195514 shutdown_connections 2023-07-21T07:36:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.297+0000 7eff8e4fd700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7eff7406ace0 0x7eff7406d1a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.297+0000 7eff8e4fd700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff8814eb90 0x7eff881eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.297+0000 7eff8e4fd700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff880c3750 0x7eff8814cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.297+0000 7eff8e4fd700 1 --2- 172.21.15.6:0/366195514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff880c6170 0x7eff881ed550 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.297+0000 7eff8e4fd700 1 -- 172.21.15.6:0/366195514 >> 172.21.15.6:0/366195514 conn(0x7eff880a8c90 msgr2=0x7eff880a66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.297+0000 7eff8e4fd700 1 -- 172.21.15.6:0/366195514 shutdown_connections 2023-07-21T07:36:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.297+0000 7eff8e4fd700 1 -- 172.21.15.6:0/366195514 wait complete. 2023-07-21T07:36:47.364 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.434+0000 7ff6fdd13700 1 Processor -- start 2023-07-21T07:36:47.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.434+0000 7ff6fdd13700 1 -- start start 2023-07-21T07:36:47.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.435+0000 7ff6fdd13700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6f8158210 0x7ff6f8151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.435+0000 7ff6fdd13700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f80c3120 con 0x7ff6f81516a0 2023-07-21T07:36:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.435+0000 7ff6fdd13700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f8154860 con 0x7ff6f806a300 2023-07-21T07:36:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.435+0000 7ff6fdd13700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80c1e60 con 0x7ff6f8158210 2023-07-21T07:36:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.435+0000 7ff6f6ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff6f81516a0 0x7ff6f8157b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44414/0 (socket says 172.21.15.6:44414) 2023-07-21T07:36:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.435+0000 7ff6f6ffd700 1 -- 172.21.15.6:0/1478844888 learned_addr learned my addr 172.21.15.6:0/1478844888 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.435+0000 7ff6f7fff700 1 --2- 172.21.15.6:0/1478844888 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6f8158210 0x7ff6f8151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.435+0000 7ff6f67fc700 1 -- 172.21.15.6:0/1478844888 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887038329 0 0) 0x7ff6f80c3120 con 0x7ff6f81516a0 2023-07-21T07:36:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.435+0000 7ff6f67fc700 1 -- 172.21.15.6:0/1478844888 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e40035b0 con 0x7ff6f81516a0 2023-07-21T07:36:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.435+0000 7ff6f67fc700 1 -- 172.21.15.6:0/1478844888 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019329643 0 0) 0x7ff6f8154860 con 0x7ff6f806a300 2023-07-21T07:36:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.436+0000 7ff6f67fc700 1 -- 172.21.15.6:0/1478844888 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6f80c3120 con 0x7ff6f806a300 2023-07-21T07:36:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.436+0000 7ff6f67fc700 1 -- 172.21.15.6:0/1478844888 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3731837178 0 0) 0x7ff6e40035b0 con 0x7ff6f81516a0 2023-07-21T07:36:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.436+0000 7ff6f7fff700 1 -- 172.21.15.6:0/1478844888 >> v1:172.21.15.86:6789/0 conn(0x7ff6f806a300 legacy=0x7ff6f80c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.436+0000 7ff6f7fff700 1 -- 172.21.15.6:0/1478844888 >> v1:172.21.15.6:6789/0 conn(0x7ff6f81516a0 legacy=0x7ff6f8157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.436+0000 7ff6f7fff700 1 -- 172.21.15.6:0/1478844888 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8154b40 con 0x7ff6f8158210 2023-07-21T07:36:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.436+0000 7ff6f7fff700 1 --2- 172.21.15.6:0/1478844888 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6f8158210 0x7ff6f8151b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009dc0 tx=0x7ff6f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adfd11874b222754 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.436+0000 7ff6f67fc700 1 -- 172.21.15.6:0/1478844888 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f000e070 con 0x7ff6f8158210 2023-07-21T07:36:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.436+0000 7ff6f67fc700 1 -- 172.21.15.6:0/1478844888 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0003a20 con 0x7ff6f8158210 2023-07-21T07:36:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.436+0000 7ff6f67fc700 1 -- 172.21.15.6:0/1478844888 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0001670 con 0x7ff6f8158210 2023-07-21T07:36:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.436+0000 7ff6fdd13700 1 -- 172.21.15.6:0/1478844888 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6f8158210 msgr2=0x7ff6f8151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.436+0000 7ff6fdd13700 1 --2- 172.21.15.6:0/1478844888 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6f8158210 0x7ff6f8151b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009dc0 tx=0x7ff6f000b330 comp rx=0 tx=0).stop 2023-07-21T07:36:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.437+0000 7ff6fdd13700 1 -- 172.21.15.6:0/1478844888 shutdown_connections 2023-07-21T07:36:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.437+0000 7ff6fdd13700 1 --2- 172.21.15.6:0/1478844888 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6f8158210 0x7ff6f8151b20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.437+0000 7ff6fdd13700 1 -- 172.21.15.6:0/1478844888 >> 172.21.15.6:0/1478844888 conn(0x7ff6f80a8c90 msgr2=0x7ff6f806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.437+0000 7ff6fdd13700 1 -- 172.21.15.6:0/1478844888 shutdown_connections 2023-07-21T07:36:47.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.437+0000 7ff6fdd13700 1 -- 172.21.15.6:0/1478844888 wait complete. 2023-07-21T07:36:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.438+0000 7ff6fdd13700 1 Processor -- start 2023-07-21T07:36:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.438+0000 7ff6fdd13700 1 -- start start 2023-07-21T07:36:47.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6fdd13700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f806a300 0x7ff6f81ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6fdd13700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6f81516a0 0x7ff6f80c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6fdd13700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6f8158210 0x7ff6f80bebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6fdd13700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f81e9c40 con 0x7ff6f806a300 2023-07-21T07:36:47.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6fdd13700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f81e95f0 con 0x7ff6f81516a0 2023-07-21T07:36:47.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6fdd13700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80bcb20 con 0x7ff6f8158210 2023-07-21T07:36:47.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f806a300 0x7ff6f81ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f806a300 0x7ff6f81ea060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36398/0 (socket says 172.21.15.6:36398) 2023-07-21T07:36:47.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6f77fe700 1 -- 172.21.15.6:0/2886787924 learned_addr learned my addr 172.21.15.6:0/2886787924 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:47.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6f7fff700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6f8158210 0x7ff6f80bebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6f6ffd700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6f81516a0 0x7ff6f80c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6f77fe700 1 -- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6f8158210 msgr2=0x7ff6f80bebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6f77fe700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6f8158210 0x7ff6f80bebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6f77fe700 1 -- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6f81516a0 msgr2=0x7ff6f80c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6f77fe700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6f81516a0 0x7ff6f80c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6f77fe700 1 -- 172.21.15.6:0/2886787924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f0009a70 con 0x7ff6f806a300 2023-07-21T07:36:47.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6f6ffd700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6f81516a0 0x7ff6f80c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:47.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6f7fff700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6f8158210 0x7ff6f80bebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:47.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.439+0000 7ff6f77fe700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f806a300 0x7ff6f81ea060 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800c550 tx=0x7ff6e800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:47.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.440+0000 7ff6effff700 1 -- 172.21.15.6:0/2886787924 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80052d0 con 0x7ff6f806a300 2023-07-21T07:36:47.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.440+0000 7ff6effff700 1 -- 172.21.15.6:0/2886787924 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e8005430 con 0x7ff6f806a300 2023-07-21T07:36:47.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.440+0000 7ff6effff700 1 -- 172.21.15.6:0/2886787924 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80038c0 con 0x7ff6f806a300 2023-07-21T07:36:47.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.440+0000 7ff6fdd13700 1 -- 172.21.15.6:0/2886787924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f81e9860 con 0x7ff6f806a300 2023-07-21T07:36:47.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.440+0000 7ff6fdd13700 1 -- 172.21.15.6:0/2886787924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f80bce00 con 0x7ff6f806a300 2023-07-21T07:36:47.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.441+0000 7ff6fdd13700 1 -- 172.21.15.6:0/2886787924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f806e810 con 0x7ff6f806a300 2023-07-21T07:36:47.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.441+0000 7ff6effff700 1 -- 172.21.15.6:0/2886787924 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6e8003a20 con 0x7ff6f806a300 2023-07-21T07:36:47.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.441+0000 7ff6effff700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff6d806ace0 0x7ff6d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.442+0000 7ff6effff700 1 -- 172.21.15.6:0/2886787924 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6918+0+0 (secure 0 0 0) 0x7ff6e8088d10 con 0x7ff6f806a300 2023-07-21T07:36:47.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.442+0000 7ff6f6ffd700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff6d806ace0 0x7ff6d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.442+0000 7ff6f6ffd700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff6d806ace0 0x7ff6d806d1a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0001eb0 tx=0x7ff6e0001c20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:47.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.446+0000 7ff6effff700 1 -- 172.21.15.6:0/2886787924 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff6e8053af0 con 0x7ff6f806a300 2023-07-21T07:36:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.642+0000 7ff6fdd13700 1 -- 172.21.15.6:0/2886787924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6f81e9d80 con 0x7ff6f806a300 2023-07-21T07:36:47.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.644+0000 7ff6effff700 1 -- 172.21.15.6:0/2886787924 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+21916 (secure 0 0 0) 0x7ff6f81e9d80 con 0x7ff6f806a300 2023-07-21T07:36:47.699 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:47.700 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":57,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:36:46.320519+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:36:26.204826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T07:36:26.916497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:36:44.559566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:36:45.284485+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:47.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.646+0000 7ff6fdd13700 1 -- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff6d806ace0 msgr2=0x7ff6d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.646+0000 7ff6fdd13700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff6d806ace0 0x7ff6d806d1a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0001eb0 tx=0x7ff6e0001c20 comp rx=0 tx=0).stop 2023-07-21T07:36:47.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.646+0000 7ff6fdd13700 1 -- 172.21.15.6:0/2886787924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f806a300 msgr2=0x7ff6f81ea060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.646+0000 7ff6fdd13700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f806a300 0x7ff6f81ea060 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800c550 tx=0x7ff6e800c910 comp rx=0 tx=0).stop 2023-07-21T07:36:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.646+0000 7ff6fdd13700 1 -- 172.21.15.6:0/2886787924 shutdown_connections 2023-07-21T07:36:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.646+0000 7ff6fdd13700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ff6d806ace0 0x7ff6d806d1a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.646+0000 7ff6fdd13700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6f8158210 0x7ff6f80bebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.646+0000 7ff6fdd13700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f806a300 0x7ff6f81ea060 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.646+0000 7ff6fdd13700 1 --2- 172.21.15.6:0/2886787924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6f81516a0 0x7ff6f80c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.646+0000 7ff6fdd13700 1 -- 172.21.15.6:0/2886787924 >> 172.21.15.6:0/2886787924 conn(0x7ff6f80a8c90 msgr2=0x7ff6f80c6660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.646+0000 7ff6fdd13700 1 -- 172.21.15.6:0/2886787924 shutdown_connections 2023-07-21T07:36:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.646+0000 7ff6fdd13700 1 -- 172.21.15.6:0/2886787924 wait complete. 2023-07-21T07:36:47.713 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-07-21T07:36:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.787+0000 7f56758e6700 1 Processor -- start 2023-07-21T07:36:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.787+0000 7f56758e6700 1 -- start start 2023-07-21T07:36:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.788+0000 7f56758e6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f56700c7bd0 0x7f567006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.788+0000 7f56758e6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5670154dc0 con 0x7f5670151d80 2023-07-21T07:36:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.788+0000 7f56758e6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567006ad50 con 0x7f56700bd360 2023-07-21T07:36:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.788+0000 7f56758e6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56701552f0 con 0x7f56700c7bd0 2023-07-21T07:36:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.788+0000 7f566effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5670151d80 0x7f56700c4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44426/0 (socket says 172.21.15.6:44426) 2023-07-21T07:36:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.788+0000 7f566effd700 1 -- 172.21.15.6:0/1518075223 learned_addr learned my addr 172.21.15.6:0/1518075223 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.788+0000 7f566e7fc700 1 --2- 172.21.15.6:0/1518075223 >> v2:172.21.15.86:3300/0 conn(0x7f56700c7bd0 0x7f567006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.788+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007615330 0 0) 0x7f5670154dc0 con 0x7f5670151d80 2023-07-21T07:36:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.788+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56580035b0 con 0x7f5670151d80 2023-07-21T07:36:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.788+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3951275272 0 0) 0x7f56580035b0 con 0x7f5670151d80 2023-07-21T07:36:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.788+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 >> v2:172.21.15.86:3300/0 conn(0x7f56700c7bd0 msgr2=0x7f567006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 --2- 172.21.15.6:0/1518075223 >> v2:172.21.15.86:3300/0 conn(0x7f56700c7bd0 0x7f567006b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 >> v1:172.21.15.86:6789/0 conn(0x7f56700bd360 legacy=0x7f567006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5670155010 con 0x7f5670151d80 2023-07-21T07:36:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f5664001670 con 0x7f5670151d80 2023-07-21T07:36:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566e7fc700 1 --2- 172.21.15.6:0/1518075223 >> v2:172.21.15.86:3300/0 conn(0x7f56700c7bd0 0x7f567006b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 >> v1:172.21.15.6:6789/0 conn(0x7f5670151d80 legacy=0x7f56700c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 --2- 172.21.15.6:0/1518075223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5658003a00 0x7f5658003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 --2- 172.21.15.6:0/1518075223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5658004850 0x7f5658004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 --2- 172.21.15.6:0/1518075223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5658005330 0x7f565800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56701552f0 con 0x7f5658005330 2023-07-21T07:36:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565800c200 con 0x7f5658004850 2023-07-21T07:36:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565800c3c0 con 0x7f5658003a00 2023-07-21T07:36:47.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566f7fe700 1 --2- 172.21.15.6:0/1518075223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5658005330 0x7f565800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566e7fc700 1 --2- 172.21.15.6:0/1518075223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5658004850 0x7f5658004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566effd700 1 --2- 172.21.15.6:0/1518075223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5658003a00 0x7f5658003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566f7fe700 1 -- 172.21.15.6:0/1518075223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5658003a00 msgr2=0x7f5658003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:47.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566f7fe700 1 --2- 172.21.15.6:0/1518075223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5658003a00 0x7f5658003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566f7fe700 1 -- 172.21.15.6:0/1518075223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5658004850 msgr2=0x7f5658004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:47.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566f7fe700 1 --2- 172.21.15.6:0/1518075223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5658004850 0x7f5658004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566f7fe700 1 -- 172.21.15.6:0/1518075223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56580035b0 con 0x7f5658005330 2023-07-21T07:36:47.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566e7fc700 1 --2- 172.21.15.6:0/1518075223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5658004850 0x7f5658004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:47.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566f7fe700 1 -- 172.21.15.6:0/1518075223 reap_dead start 2023-07-21T07:36:47.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566f7fe700 1 --2- 172.21.15.6:0/1518075223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5658005330 0x7f565800ba10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f566800c210 tx=0x7f5658005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a906f5d56f52d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:47.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668001df0 con 0x7f5658005330 2023-07-21T07:36:47.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566800cd70 con 0x7f5658005330 2023-07-21T07:36:47.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.789+0000 7f566dffb700 1 -- 172.21.15.6:0/1518075223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668003c40 con 0x7f5658005330 2023-07-21T07:36:47.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.790+0000 7f56758e6700 1 -- 172.21.15.6:0/1518075223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5658005330 msgr2=0x7f565800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.790+0000 7f56758e6700 1 --2- 172.21.15.6:0/1518075223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5658005330 0x7f565800ba10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f566800c210 tx=0x7f5658005880 comp rx=0 tx=0).stop 2023-07-21T07:36:47.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.790+0000 7f56758e6700 1 -- 172.21.15.6:0/1518075223 shutdown_connections 2023-07-21T07:36:47.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.790+0000 7f56758e6700 1 --2- 172.21.15.6:0/1518075223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5658005330 0x7f565800ba10 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.790+0000 7f56758e6700 1 -- 172.21.15.6:0/1518075223 >> 172.21.15.6:0/1518075223 conn(0x7f56700c9cd0 msgr2=0x7f56700ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.790+0000 7f56758e6700 1 -- 172.21.15.6:0/1518075223 shutdown_connections 2023-07-21T07:36:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.790+0000 7f56758e6700 1 -- 172.21.15.6:0/1518075223 wait complete. 2023-07-21T07:36:47.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.792+0000 7f56758e6700 1 Processor -- start 2023-07-21T07:36:47.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.792+0000 7f56758e6700 1 -- start start 2023-07-21T07:36:47.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f56758e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5658005330 0x7f567014dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f56758e6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56700c03a0 0x7f567014e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f56758e6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56701ed290 0x7f56701ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f56758e6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56700c11b0 con 0x7f5658005330 2023-07-21T07:36:47.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f56758e6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56700bf930 con 0x7f56700c03a0 2023-07-21T07:36:47.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f56758e6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56700bfc10 con 0x7f56701ed290 2023-07-21T07:36:47.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f566effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5658005330 0x7f567014dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f566effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5658005330 0x7f567014dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36418/0 (socket says 172.21.15.6:36418) 2023-07-21T07:36:47.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f566effd700 1 -- 172.21.15.6:0/2653444964 learned_addr learned my addr 172.21.15.6:0/2653444964 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:47.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f566effd700 1 -- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56701ed290 msgr2=0x7f56701ed710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f566f7fe700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56701ed290 0x7f56701ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f566e7fc700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56700c03a0 0x7f567014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f566effd700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56701ed290 0x7f56701ed710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f566effd700 1 -- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56700c03a0 msgr2=0x7f567014e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:47.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f566effd700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56700c03a0 0x7f567014e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:47.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f566effd700 1 -- 172.21.15.6:0/2653444964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56700c0e40 con 0x7f5658005330 2023-07-21T07:36:47.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f566f7fe700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56701ed290 0x7f56701ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:47.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f566e7fc700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56700c03a0 0x7f567014e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:47.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f566effd700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5658005330 0x7f567014dd00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f56640072c0 tx=0x7f5664007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:47.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.793+0000 7f5657fff700 1 -- 172.21.15.6:0/2653444964 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56640077a0 con 0x7f5658005330 2023-07-21T07:36:47.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.794+0000 7f5657fff700 1 -- 172.21.15.6:0/2653444964 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566400f8d0 con 0x7f5658005330 2023-07-21T07:36:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.794+0000 7f56758e6700 1 -- 172.21.15.6:0/2653444964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56700bfef0 con 0x7f5658005330 2023-07-21T07:36:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.794+0000 7f5657fff700 1 -- 172.21.15.6:0/2653444964 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566400fc80 con 0x7f5658005330 2023-07-21T07:36:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.794+0000 7f56758e6700 1 -- 172.21.15.6:0/2653444964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56701edc50 con 0x7f5658005330 2023-07-21T07:36:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.794+0000 7f56758e6700 1 -- 172.21.15.6:0/2653444964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5670074500 con 0x7f5658005330 2023-07-21T07:36:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.795+0000 7f5657fff700 1 -- 172.21.15.6:0/2653444964 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f566401d460 con 0x7f5658005330 2023-07-21T07:36:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.795+0000 7f5657fff700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f565c06ace0 0x7f565c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.796+0000 7f5657fff700 1 -- 172.21.15.6:0/2653444964 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f5664089740 con 0x7f5658005330 2023-07-21T07:36:47.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.796+0000 7f566e7fc700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f565c06ace0 0x7f565c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:47.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.796+0000 7f566e7fc700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f565c06ace0 0x7f565c06d1a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f56700ae180 tx=0x7f5660008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:47.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:47.800+0000 7f5657fff700 1 -- 172.21.15.6:0/2653444964 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5664054520 con 0x7f5658005330 2023-07-21T07:36:48.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.046+0000 7f56758e6700 1 -- 172.21.15.6:0/2653444964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f56700c0fd0 con 0x7f5658005330 2023-07-21T07:36:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.934+0000 7f5657fff700 1 -- 172.21.15.6:0/2653444964 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 119+0+0 (secure 0 0 0) 0x7f5664057b40 con 0x7f5658005330 2023-07-21T07:36:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.937+0000 7f56758e6700 1 -- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f565c06ace0 msgr2=0x7f565c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.937+0000 7f56758e6700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f565c06ace0 0x7f565c06d1a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f56700ae180 tx=0x7f5660008040 comp rx=0 tx=0).stop 2023-07-21T07:36:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.937+0000 7f56758e6700 1 -- 172.21.15.6:0/2653444964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5658005330 msgr2=0x7f567014dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.937+0000 7f56758e6700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5658005330 0x7f567014dd00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f56640072c0 tx=0x7f5664007680 comp rx=0 tx=0).stop 2023-07-21T07:36:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.937+0000 7f56758e6700 1 -- 172.21.15.6:0/2653444964 shutdown_connections 2023-07-21T07:36:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.937+0000 7f56758e6700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f565c06ace0 0x7f565c06d1a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.937+0000 7f56758e6700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56701ed290 0x7f56701ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.937+0000 7f56758e6700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5658005330 0x7f567014dd00 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.937+0000 7f56758e6700 1 --2- 172.21.15.6:0/2653444964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56700c03a0 0x7f567014e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.937+0000 7f56758e6700 1 -- 172.21.15.6:0/2653444964 >> 172.21.15.6:0/2653444964 conn(0x7f56700c9cd0 msgr2=0x7f56700ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.937+0000 7f56758e6700 1 -- 172.21.15.6:0/2653444964 shutdown_connections 2023-07-21T07:36:48.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:48.937+0000 7f56758e6700 1 -- 172.21.15.6:0/2653444964 wait complete. 2023-07-21T07:36:49.007 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T07:36:49.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-07-21T07:36:49.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.087+0000 7fd428e4b700 1 Processor -- start 2023-07-21T07:36:49.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.087+0000 7fd428e4b700 1 -- start start 2023-07-21T07:36:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.088+0000 7fd428e4b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd42406a7a0 0x7fd4240c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:49.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.088+0000 7fd428e4b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4240c0b20 con 0x7fd4240c18c0 2023-07-21T07:36:49.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.088+0000 7fd428e4b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd424151820 con 0x7fd4240703f0 2023-07-21T07:36:49.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.088+0000 7fd428e4b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4240c0de0 con 0x7fd42406a7a0 2023-07-21T07:36:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.089+0000 7fd422d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd42406a7a0 0x7fd4240c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.089+0000 7fd421d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd4240c18c0 0x7fd42406a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44448/0 (socket says 172.21.15.6:44448) 2023-07-21T07:36:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.089+0000 7fd421d9b700 1 -- 172.21.15.6:0/754077718 learned_addr learned my addr 172.21.15.6:0/754077718 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.089+0000 7fd422d9d700 1 -- 172.21.15.6:0/754077718 >> v1:172.21.15.86:6789/0 conn(0x7fd4240703f0 legacy=0x7fd42414dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.089+0000 7fd422d9d700 1 -- 172.21.15.6:0/754077718 >> v1:172.21.15.6:6789/0 conn(0x7fd4240c18c0 legacy=0x7fd42406a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.089+0000 7fd42159a700 1 -- 172.21.15.6:0/754077718 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429750099 0 0) 0x7fd4240c0b20 con 0x7fd4240c18c0 2023-07-21T07:36:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.089+0000 7fd422d9d700 1 -- 172.21.15.6:0/754077718 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4240c10c0 con 0x7fd42406a7a0 2023-07-21T07:36:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.089+0000 7fd422d9d700 1 --2- 172.21.15.6:0/754077718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd42406a7a0 0x7fd4240c25f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009d90 tx=0x7fd41c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cff1585e9e7666 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:49.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.089+0000 7fd42159a700 1 -- 172.21.15.6:0/754077718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00e070 con 0x7fd42406a7a0 2023-07-21T07:36:49.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.089+0000 7fd42159a700 1 -- 172.21.15.6:0/754077718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c00bbd0 con 0x7fd42406a7a0 2023-07-21T07:36:49.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.089+0000 7fd42159a700 1 -- 172.21.15.6:0/754077718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c012430 con 0x7fd42406a7a0 2023-07-21T07:36:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.090+0000 7fd428e4b700 1 -- 172.21.15.6:0/754077718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd42406a7a0 msgr2=0x7fd4240c25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.090+0000 7fd428e4b700 1 --2- 172.21.15.6:0/754077718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd42406a7a0 0x7fd4240c25f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009d90 tx=0x7fd41c00b330 comp rx=0 tx=0).stop 2023-07-21T07:36:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.090+0000 7fd428e4b700 1 -- 172.21.15.6:0/754077718 shutdown_connections 2023-07-21T07:36:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.090+0000 7fd428e4b700 1 --2- 172.21.15.6:0/754077718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd42406a7a0 0x7fd4240c25f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.090+0000 7fd428e4b700 1 -- 172.21.15.6:0/754077718 >> 172.21.15.6:0/754077718 conn(0x7fd4240c2c20 msgr2=0x7fd4240c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.090+0000 7fd428e4b700 1 -- 172.21.15.6:0/754077718 shutdown_connections 2023-07-21T07:36:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.090+0000 7fd428e4b700 1 -- 172.21.15.6:0/754077718 wait complete. 2023-07-21T07:36:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.091+0000 7fd428e4b700 1 Processor -- start 2023-07-21T07:36:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.091+0000 7fd428e4b700 1 -- start start 2023-07-21T07:36:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd428e4b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4240703f0 0x7fd4240aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd428e4b700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4240c18c0 0x7fd424140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd428e4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd424154a90 0x7fd424141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd428e4b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd424150170 con 0x7fd424154a90 2023-07-21T07:36:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd428e4b700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd424148460 con 0x7fd4240c18c0 2023-07-21T07:36:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd428e4b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4240ac2c0 con 0x7fd4240703f0 2023-07-21T07:36:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd422d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd424154a90 0x7fd424141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:49.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd422d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd424154a90 0x7fd424141020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36436/0 (socket says 172.21.15.6:36436) 2023-07-21T07:36:49.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd422d9d700 1 -- 172.21.15.6:0/3774904446 learned_addr learned my addr 172.21.15.6:0/3774904446 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:49.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd42259c700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4240703f0 0x7fd4240aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:49.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd421d9b700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4240c18c0 0x7fd424140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:49.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd422d9d700 1 -- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4240703f0 msgr2=0x7fd4240aa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:49.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd422d9d700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4240703f0 0x7fd4240aa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:49.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd422d9d700 1 -- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4240c18c0 msgr2=0x7fd424140ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:49.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd422d9d700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4240c18c0 0x7fd424140ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:49.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.092+0000 7fd422d9d700 1 -- 172.21.15.6:0/3774904446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c009a70 con 0x7fd424154a90 2023-07-21T07:36:49.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.093+0000 7fd422d9d700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd424154a90 0x7fd424141020 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd41c014040 tx=0x7fd41c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.093+0000 7fd412ffd700 1 -- 172.21.15.6:0/3774904446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c01b810 con 0x7fd424154a90 2023-07-21T07:36:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.093+0000 7fd412ffd700 1 -- 172.21.15.6:0/3774904446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c020070 con 0x7fd424154a90 2023-07-21T07:36:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.093+0000 7fd428e4b700 1 -- 172.21.15.6:0/3774904446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4240abfe0 con 0x7fd424154a90 2023-07-21T07:36:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.093+0000 7fd412ffd700 1 -- 172.21.15.6:0/3774904446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c01bbb0 con 0x7fd424154a90 2023-07-21T07:36:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.093+0000 7fd428e4b700 1 -- 172.21.15.6:0/3774904446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4240c4c10 con 0x7fd424154a90 2023-07-21T07:36:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.094+0000 7fd428e4b700 1 -- 172.21.15.6:0/3774904446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd424074500 con 0x7fd424154a90 2023-07-21T07:36:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.094+0000 7fd412ffd700 1 -- 172.21.15.6:0/3774904446 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd41c01bd10 con 0x7fd424154a90 2023-07-21T07:36:49.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.095+0000 7fd412ffd700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd40406ace0 0x7fd40406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:49.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.095+0000 7fd412ffd700 1 -- 172.21.15.6:0/3774904446 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fd41c022070 con 0x7fd424154a90 2023-07-21T07:36:49.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.095+0000 7fd42259c700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd40406ace0 0x7fd40406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:49.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.095+0000 7fd42259c700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd40406ace0 0x7fd40406d1a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd414000f60 tx=0x7fd414009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:49.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.099+0000 7fd412ffd700 1 -- 172.21.15.6:0/3774904446 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd41c0be310 con 0x7fd424154a90 2023-07-21T07:36:49.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.345+0000 7fd428e4b700 1 -- 172.21.15.6:0/3774904446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd42406e420 con 0x7fd424154a90 2023-07-21T07:36:49.569 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-07-21T07:36:49.515+0000 7f4f640a3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T07:36:49.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.938+0000 7fd412ffd700 1 -- 172.21.15.6:0/3774904446 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v38) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd41c05a9f0 con 0x7fd424154a90 2023-07-21T07:36:49.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.941+0000 7fd428e4b700 1 -- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd40406ace0 msgr2=0x7fd40406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:49.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.941+0000 7fd428e4b700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd40406ace0 0x7fd40406d1a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd414000f60 tx=0x7fd414009040 comp rx=0 tx=0).stop 2023-07-21T07:36:49.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.941+0000 7fd428e4b700 1 -- 172.21.15.6:0/3774904446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd424154a90 msgr2=0x7fd424141020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:49.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.941+0000 7fd428e4b700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd424154a90 0x7fd424141020 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd41c014040 tx=0x7fd41c004ad0 comp rx=0 tx=0).stop 2023-07-21T07:36:49.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.941+0000 7fd428e4b700 1 -- 172.21.15.6:0/3774904446 shutdown_connections 2023-07-21T07:36:49.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.941+0000 7fd428e4b700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fd40406ace0 0x7fd40406d1a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:49.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.941+0000 7fd428e4b700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd424154a90 0x7fd424141020 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:49.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.941+0000 7fd428e4b700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4240703f0 0x7fd4240aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:49.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.941+0000 7fd428e4b700 1 --2- 172.21.15.6:0/3774904446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4240c18c0 0x7fd424140ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:49.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.941+0000 7fd428e4b700 1 -- 172.21.15.6:0/3774904446 >> 172.21.15.6:0/3774904446 conn(0x7fd4240c2c20 msgr2=0x7fd42406a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:49.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.942+0000 7fd428e4b700 1 -- 172.21.15.6:0/3774904446 shutdown_connections 2023-07-21T07:36:49.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:49.942+0000 7fd428e4b700 1 -- 172.21.15.6:0/3774904446 wait complete. 2023-07-21T07:36:50.011 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-07-21T07:36:50.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T07:36:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.090+0000 7f638cc32700 1 Processor -- start 2023-07-21T07:36:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.090+0000 7f638cc32700 1 -- start start 2023-07-21T07:36:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.090+0000 7f638cc32700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63880c6170 0x7f638814ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.090+0000 7f638cc32700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f63880c53e0 0x7f6388154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.090+0000 7f638cc32700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63880ba440 con 0x7f63880c3750 2023-07-21T07:36:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.090+0000 7f638cc32700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63880c15d0 con 0x7f63880c53e0 2023-07-21T07:36:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.090+0000 7f638cc32700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63880c18b0 con 0x7f63880c6170 2023-07-21T07:36:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f63880c3750 0x7f638814e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44460/0 (socket says 172.21.15.6:44460) 2023-07-21T07:36:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638659c700 1 -- 172.21.15.6:0/987269606 learned_addr learned my addr 172.21.15.6:0/987269606 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f6385d9b700 1 --2- 172.21.15.6:0/987269606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63880c6170 0x7f638814ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f6386d9d700 1 --2- 172.21.15.6:0/987269606 >> v2:172.21.15.86:3300/0 conn(0x7f63880c53e0 0x7f6388154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691687912 0 0) 0x7f63880ba440 con 0x7f63880c3750 2023-07-21T07:36:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63700057c0 con 0x7f63880c3750 2023-07-21T07:36:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3638488997 0 0) 0x7f63700057c0 con 0x7f63880c3750 2023-07-21T07:36:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63880c6170 msgr2=0x7f638814ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 --2- 172.21.15.6:0/987269606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63880c6170 0x7f638814ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 >> v2:172.21.15.86:3300/0 conn(0x7f63880c53e0 msgr2=0x7f6388154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 --2- 172.21.15.6:0/987269606 >> v2:172.21.15.86:3300/0 conn(0x7f63880c53e0 0x7f6388154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63880c1b90 con 0x7f63880c3750 2023-07-21T07:36:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7f6378001670 con 0x7f63880c3750 2023-07-21T07:36:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 >> v1:172.21.15.6:6789/0 conn(0x7f63880c3750 legacy=0x7f638814e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 --2- 172.21.15.6:0/987269606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63880c6170 0x7f6370005c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 --2- 172.21.15.6:0/987269606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6370006190 0x7f6370006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 --2- 172.21.15.6:0/987269606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6370006fa0 0x7f6370007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63880c15d0 con 0x7f6370006fa0 2023-07-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63880c18b0 con 0x7f6370006190 2023-07-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637000dc20 con 0x7f63880c6170 2023-07-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f6386d9d700 1 --2- 172.21.15.6:0/987269606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6370006fa0 0x7f6370007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f638659c700 1 --2- 172.21.15.6:0/987269606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63880c6170 0x7f6370005c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.091+0000 7f6385d9b700 1 --2- 172.21.15.6:0/987269606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6370006190 0x7f6370006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.092+0000 7f6386d9d700 1 -- 172.21.15.6:0/987269606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63880c6170 msgr2=0x7f6370005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:50.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.092+0000 7f6386d9d700 1 --2- 172.21.15.6:0/987269606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63880c6170 0x7f6370005c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.092+0000 7f6386d9d700 1 -- 172.21.15.6:0/987269606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6370006190 msgr2=0x7f6370006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.092+0000 7f6386d9d700 1 --2- 172.21.15.6:0/987269606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6370006190 0x7f6370006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.092+0000 7f6386d9d700 1 -- 172.21.15.6:0/987269606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700057c0 con 0x7f6370006fa0 2023-07-21T07:36:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.092+0000 7f6386d9d700 1 --2- 172.21.15.6:0/987269606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6370006fa0 0x7f6370007420 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6380009fc0 tx=0x7f6370007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4090f384d6b67c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.092+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638000ebd0 con 0x7f6370006fa0 2023-07-21T07:36:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.092+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638000f040 con 0x7f6370006fa0 2023-07-21T07:36:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.092+0000 7f638559a700 1 -- 172.21.15.6:0/987269606 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380014480 con 0x7f6370006fa0 2023-07-21T07:36:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.093+0000 7f638cc32700 1 -- 172.21.15.6:0/987269606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6370006fa0 msgr2=0x7f6370007420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.093+0000 7f638cc32700 1 --2- 172.21.15.6:0/987269606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6370006fa0 0x7f6370007420 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6380009fc0 tx=0x7f6370007a90 comp rx=0 tx=0).stop 2023-07-21T07:36:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.093+0000 7f6386d9d700 1 -- 172.21.15.6:0/987269606 reap_dead start 2023-07-21T07:36:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.093+0000 7f638cc32700 1 -- 172.21.15.6:0/987269606 shutdown_connections 2023-07-21T07:36:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.093+0000 7f638cc32700 1 -- 172.21.15.6:0/987269606 >> 172.21.15.6:0/987269606 conn(0x7f63880a8c90 msgr2=0x7f638806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.093+0000 7f638cc32700 1 -- 172.21.15.6:0/987269606 shutdown_connections 2023-07-21T07:36:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.093+0000 7f638cc32700 1 -- 172.21.15.6:0/987269606 wait complete. 2023-07-21T07:36:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.094+0000 7f638cc32700 1 Processor -- start 2023-07-21T07:36:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.094+0000 7f638cc32700 1 -- start start 2023-07-21T07:36:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f638cc32700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6370006fa0 0x7f63880b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f638cc32700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63880b9710 0x7f6388071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f638cc32700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63880722e0 0x7f63881e5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f638cc32700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63881e5520 con 0x7f63880722e0 2023-07-21T07:36:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f638cc32700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63880b6f70 con 0x7f63880b9710 2023-07-21T07:36:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f638cc32700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6388150930 con 0x7f6370006fa0 2023-07-21T07:36:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f6386d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63880722e0 0x7f63881e5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f6386d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63880722e0 0x7f63881e5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36456/0 (socket says 172.21.15.6:36456) 2023-07-21T07:36:50.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f6386d9d700 1 -- 172.21.15.6:0/909104921 learned_addr learned my addr 172.21.15.6:0/909104921 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:50.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f638659c700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6370006fa0 0x7f63880b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f6385d9b700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63880b9710 0x7f6388071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f6386d9d700 1 -- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6370006fa0 msgr2=0x7f63880b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f6386d9d700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6370006fa0 0x7f63880b6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f6386d9d700 1 -- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63880b9710 msgr2=0x7f6388071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f6386d9d700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63880b9710 0x7f6388071da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f6386d9d700 1 -- 172.21.15.6:0/909104921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6388150c10 con 0x7f63880722e0 2023-07-21T07:36:50.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f6386d9d700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63880722e0 0x7f63881e5a00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6380016000 tx=0x7f6380009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:50.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.095+0000 7f6376ffd700 1 -- 172.21.15.6:0/909104921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380007000 con 0x7f63880722e0 2023-07-21T07:36:50.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.096+0000 7f6376ffd700 1 -- 172.21.15.6:0/909104921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6380004450 con 0x7f63880722e0 2023-07-21T07:36:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.096+0000 7f6376ffd700 1 -- 172.21.15.6:0/909104921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380004800 con 0x7f63880722e0 2023-07-21T07:36:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.096+0000 7f638cc32700 1 -- 172.21.15.6:0/909104921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6388150ef0 con 0x7f63880722e0 2023-07-21T07:36:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.096+0000 7f638cc32700 1 -- 172.21.15.6:0/909104921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638814eee0 con 0x7f63880722e0 2023-07-21T07:36:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.097+0000 7f638cc32700 1 -- 172.21.15.6:0/909104921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6388074500 con 0x7f63880722e0 2023-07-21T07:36:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.097+0000 7f6376ffd700 1 -- 172.21.15.6:0/909104921 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6380014480 con 0x7f63880722e0 2023-07-21T07:36:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.098+0000 7f6376ffd700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f636806ace0 0x7f636806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.098+0000 7f6376ffd700 1 -- 172.21.15.6:0/909104921 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f638008af70 con 0x7f63880722e0 2023-07-21T07:36:50.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.098+0000 7f638659c700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f636806ace0 0x7f636806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.099+0000 7f638659c700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f636806ace0 0x7f636806d1a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f63780015d0 tx=0x7f6378009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:50.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.102+0000 7f6376ffd700 1 -- 172.21.15.6:0/909104921 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6380055d50 con 0x7f63880722e0 2023-07-21T07:36:50.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.347+0000 7f638cc32700 1 -- 172.21.15.6:0/909104921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63880bd960 con 0x7f63880722e0 2023-07-21T07:36:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.348+0000 7f6376ffd700 1 -- 172.21.15.6:0/909104921 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+5804 (secure 0 0 0) 0x7f6380059370 con 0x7f63880722e0 2023-07-21T07:36:50.403 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:50.403 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/853425943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":853425943},{"type":"v1","addr":"172.21.15.86:6837","nonce":853425943}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5599,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/99889473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":99889473},{"type":"v1","addr":"172.21.15.86:6836","nonce":99889473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:36:27.950466+0000","modified":"2023-07-21T07:36:31.548780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5871},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5871":{"gid":5871,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3415849886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3415849886},{"type":"v1","addr":"172.21.15.6:6835","nonce":3415849886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T07:36:46.320834+0000","modified":"2023-07-21T07:36:49.934442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":8,"addr":"172.21.15.6:6833/3714237035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3714237035},{"type":"v1","addr":"172.21.15.6:6833","nonce":3714237035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-21T07:36:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.350+0000 7f638cc32700 1 -- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f636806ace0 msgr2=0x7f636806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.350+0000 7f638cc32700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f636806ace0 0x7f636806d1a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f63780015d0 tx=0x7f6378009040 comp rx=0 tx=0).stop 2023-07-21T07:36:50.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.350+0000 7f638cc32700 1 -- 172.21.15.6:0/909104921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63880722e0 msgr2=0x7f63881e5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.350+0000 7f638cc32700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63880722e0 0x7f63881e5a00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6380016000 tx=0x7f6380009750 comp rx=0 tx=0).stop 2023-07-21T07:36:50.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.350+0000 7f638cc32700 1 -- 172.21.15.6:0/909104921 shutdown_connections 2023-07-21T07:36:50.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.350+0000 7f638cc32700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f636806ace0 0x7f636806d1a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.350+0000 7f638cc32700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63880722e0 0x7f63881e5a00 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.350+0000 7f638cc32700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6370006fa0 0x7f63880b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.350+0000 7f638cc32700 1 --2- 172.21.15.6:0/909104921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63880b9710 0x7f6388071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.350+0000 7f638cc32700 1 -- 172.21.15.6:0/909104921 >> 172.21.15.6:0/909104921 conn(0x7f63880a8c90 msgr2=0x7f63880a65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:50.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.350+0000 7f638cc32700 1 -- 172.21.15.6:0/909104921 shutdown_connections 2023-07-21T07:36:50.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.350+0000 7f638cc32700 1 -- 172.21.15.6:0/909104921 wait complete. 2023-07-21T07:36:50.406 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 38 2023-07-21T07:36:50.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.487+0000 7f9dfcaf5700 1 Processor -- start 2023-07-21T07:36:50.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.487+0000 7f9dfcaf5700 1 -- start start 2023-07-21T07:36:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9dfcaf5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9df806a300 0x7f9df80c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9dfcaf5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9df80c2bf0 0x7f9df81516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9dfcaf5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df80c3120 con 0x7f9df8151be0 2023-07-21T07:36:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9dfcaf5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df80c1e60 con 0x7f9df806a300 2023-07-21T07:36:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9dfcaf5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df8154860 con 0x7f9df80c2bf0 2023-07-21T07:36:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9df659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9df806a300 0x7f9df80c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9df5d9b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9df80c2bf0 0x7f9df81516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9df6d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9df8151be0 0x7f9df8157b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:47726/0 (socket says 172.21.15.6:47726) 2023-07-21T07:36:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9df6d9d700 1 -- 172.21.15.6:0/3051950098 learned_addr learned my addr 172.21.15.6:0/3051950098 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9df5d9b700 1 -- 172.21.15.6:0/3051950098 >> v2:172.21.15.86:3300/0 conn(0x7f9df806a300 msgr2=0x7f9df80c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9df5d9b700 1 --2- 172.21.15.6:0/3051950098 >> v2:172.21.15.86:3300/0 conn(0x7f9df806a300 0x7f9df80c26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9df5d9b700 1 -- 172.21.15.6:0/3051950098 >> v1:172.21.15.86:6789/0 conn(0x7f9df8151be0 legacy=0x7f9df8157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9df5d9b700 1 -- 172.21.15.6:0/3051950098 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df8154b40 con 0x7f9df80c2bf0 2023-07-21T07:36:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9df559a700 1 -- 172.21.15.6:0/3051950098 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048250116 0 0) 0x7f9df80c3120 con 0x7f9df8151be0 2023-07-21T07:36:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.488+0000 7f9df659c700 1 --2- 172.21.15.6:0/3051950098 >> v2:172.21.15.86:3300/0 conn(0x7f9df806a300 0x7f9df80c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.489+0000 7f9df5d9b700 1 --2- 172.21.15.6:0/3051950098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9df80c2bf0 0x7f9df81516a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009840 tx=0x7f9dec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=966d00d3c2f11f20 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.489+0000 7f9df559a700 1 -- 172.21.15.6:0/3051950098 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec011830 con 0x7f9df80c2bf0 2023-07-21T07:36:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.489+0000 7f9df559a700 1 -- 172.21.15.6:0/3051950098 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec011990 con 0x7f9df80c2bf0 2023-07-21T07:36:50.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.489+0000 7f9df559a700 1 -- 172.21.15.6:0/3051950098 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec011d20 con 0x7f9df80c2bf0 2023-07-21T07:36:50.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.489+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/3051950098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9df80c2bf0 msgr2=0x7f9df81516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.489+0000 7f9dfcaf5700 1 --2- 172.21.15.6:0/3051950098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9df80c2bf0 0x7f9df81516a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009840 tx=0x7f9dec009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:50.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.489+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/3051950098 shutdown_connections 2023-07-21T07:36:50.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.489+0000 7f9dfcaf5700 1 --2- 172.21.15.6:0/3051950098 >> v2:172.21.15.86:3300/0 conn(0x7f9df806a300 0x7f9df80c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.489+0000 7f9dfcaf5700 1 --2- 172.21.15.6:0/3051950098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9df80c2bf0 0x7f9df81516a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.489+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/3051950098 >> 172.21.15.6:0/3051950098 conn(0x7f9df80a8c90 msgr2=0x7f9df806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:50.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.489+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/3051950098 shutdown_connections 2023-07-21T07:36:50.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.490+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/3051950098 wait complete. 2023-07-21T07:36:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.491+0000 7f9dfcaf5700 1 Processor -- start 2023-07-21T07:36:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.491+0000 7f9dfcaf5700 1 -- start start 2023-07-21T07:36:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.492+0000 7f9dfcaf5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9df806a300 0x7f9df814f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.492+0000 7f9dfcaf5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9df80c2bf0 0x7f9df81e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.492+0000 7f9dfcaf5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df8151be0 0x7f9df81e9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.492+0000 7f9dfcaf5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80bffd0 con 0x7f9df8151be0 2023-07-21T07:36:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.492+0000 7f9dfcaf5700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df81ed550 con 0x7f9df80c2bf0 2023-07-21T07:36:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.492+0000 7f9dfcaf5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df8072160 con 0x7f9df806a300 2023-07-21T07:36:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.492+0000 7f9df6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df8151be0 0x7f9df81e9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.492+0000 7f9df6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df8151be0 0x7f9df81e9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36470/0 (socket says 172.21.15.6:36470) 2023-07-21T07:36:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.492+0000 7f9df6d9d700 1 -- 172.21.15.6:0/214816965 learned_addr learned my addr 172.21.15.6:0/214816965 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.492+0000 7f9df5d9b700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9df80c2bf0 0x7f9df81e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.492+0000 7f9df659c700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9df806a300 0x7f9df814f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.493+0000 7f9df6d9d700 1 -- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9df806a300 msgr2=0x7f9df814f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.493+0000 7f9df6d9d700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9df806a300 0x7f9df814f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.493+0000 7f9df6d9d700 1 -- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9df80c2bf0 msgr2=0x7f9df81e96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.493+0000 7f9df6d9d700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9df80c2bf0 0x7f9df81e96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.493+0000 7f9df6d9d700 1 -- 172.21.15.6:0/214816965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de80094a0 con 0x7f9df8151be0 2023-07-21T07:36:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.493+0000 7f9df5d9b700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9df80c2bf0 0x7f9df81e96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.493+0000 7f9df659c700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9df806a300 0x7f9df814f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.493+0000 7f9df6d9d700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df8151be0 0x7f9df81e9c10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9df000cbd0 tx=0x7f9df000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.493+0000 7f9de6ffd700 1 -- 172.21.15.6:0/214816965 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df000ab70 con 0x7f9df8151be0 2023-07-21T07:36:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.493+0000 7f9de6ffd700 1 -- 172.21.15.6:0/214816965 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df000acf0 con 0x7f9df8151be0 2023-07-21T07:36:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.493+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/214816965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec0094a0 con 0x7f9df8151be0 2023-07-21T07:36:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.493+0000 7f9de6ffd700 1 -- 172.21.15.6:0/214816965 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0007310 con 0x7f9df8151be0 2023-07-21T07:36:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.493+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/214816965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df80723b0 con 0x7f9df8151be0 2023-07-21T07:36:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.494+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/214816965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df81ed690 con 0x7f9df8151be0 2023-07-21T07:36:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.494+0000 7f9de6ffd700 1 -- 172.21.15.6:0/214816965 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9df0007470 con 0x7f9df8151be0 2023-07-21T07:36:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.495+0000 7f9de6ffd700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9dd806ace0 0x7f9dd806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.495+0000 7f9de6ffd700 1 -- 172.21.15.6:0/214816965 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f9df00895b0 con 0x7f9df8151be0 2023-07-21T07:36:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.495+0000 7f9df659c700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9dd806ace0 0x7f9dd806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.496+0000 7f9df659c700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9dd806ace0 0x7f9dd806d1a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009dc0 tx=0x7f9de8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:50.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.499+0000 7f9de6ffd700 1 -- 172.21.15.6:0/214816965 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9df81ed690 con 0x7f9df8151be0 2023-07-21T07:36:50.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.699+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/214816965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9df81ed690 con 0x7f9df8151be0 2023-07-21T07:36:50.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.700+0000 7f9de6ffd700 1 -- 172.21.15.6:0/214816965 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+21903 (secure 0 0 0) 0x7f9df81ed690 con 0x7f9df8151be0 2023-07-21T07:36:50.755 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:50.755 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":58,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:36:47.910087+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:36:26.204826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T07:36:26.916497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:36:44.559566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:36:45.284485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:50.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.702+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9dd806ace0 msgr2=0x7f9dd806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.702+0000 7f9dfcaf5700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9dd806ace0 0x7f9dd806d1a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009dc0 tx=0x7f9de8008040 comp rx=0 tx=0).stop 2023-07-21T07:36:50.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.702+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/214816965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df8151be0 msgr2=0x7f9df81e9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.702+0000 7f9dfcaf5700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df8151be0 0x7f9df81e9c10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9df000cbd0 tx=0x7f9df000cf90 comp rx=0 tx=0).stop 2023-07-21T07:36:50.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.702+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/214816965 shutdown_connections 2023-07-21T07:36:50.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.702+0000 7f9dfcaf5700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9dd806ace0 0x7f9dd806d1a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.702+0000 7f9dfcaf5700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df8151be0 0x7f9df81e9c10 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.702+0000 7f9dfcaf5700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9df806a300 0x7f9df814f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.702+0000 7f9dfcaf5700 1 --2- 172.21.15.6:0/214816965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9df80c2bf0 0x7f9df81e96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.702+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/214816965 >> 172.21.15.6:0/214816965 conn(0x7f9df80a8c90 msgr2=0x7f9df80c59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:50.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.703+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/214816965 shutdown_connections 2023-07-21T07:36:50.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.703+0000 7f9dfcaf5700 1 -- 172.21.15.6:0/214816965 wait complete. 2023-07-21T07:36:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T07:36:50.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:36:50.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.840+0000 7f9014389700 1 Processor -- start 2023-07-21T07:36:50.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.840+0000 7f9014389700 1 -- start start 2023-07-21T07:36:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.841+0000 7f9014389700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f900c06a090 0x7f900c06a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.841+0000 7f9014389700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900c0c4930 con 0x7f900c0c5660 2023-07-21T07:36:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.841+0000 7f9014389700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900c0c51d0 con 0x7f900c151b10 2023-07-21T07:36:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.841+0000 7f9014389700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900c06da60 con 0x7f900c06a090 2023-07-21T07:36:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.841+0000 7f9011924700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f900c06a090 0x7f900c06a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.841+0000 7f9012926700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f900c0c5660 0x7f900c0c5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44498/0 (socket says 172.21.15.6:44498) 2023-07-21T07:36:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.841+0000 7f9012926700 1 -- 172.21.15.6:0/2582760281 learned_addr learned my addr 172.21.15.6:0/2582760281 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.841+0000 7f9011924700 1 -- 172.21.15.6:0/2582760281 >> v1:172.21.15.86:6789/0 conn(0x7f900c151b10 legacy=0x7f900c154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.841+0000 7f9011924700 1 -- 172.21.15.6:0/2582760281 >> v1:172.21.15.6:6789/0 conn(0x7f900c0c5660 legacy=0x7f900c0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.841+0000 7f9011123700 1 -- 172.21.15.6:0/2582760281 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432064912 0 0) 0x7f900c0c4930 con 0x7f900c0c5660 2023-07-21T07:36:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.841+0000 7f9011924700 1 -- 172.21.15.6:0/2582760281 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c0c4b80 con 0x7f900c06a090 2023-07-21T07:36:50.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.842+0000 7f9011924700 1 --2- 172.21.15.6:0/2582760281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900c06a090 0x7f900c06a510 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9008009840 tx=0x7f9008009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce67d6bd4cea6f7d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:50.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.842+0000 7f9011123700 1 -- 172.21.15.6:0/2582760281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008004230 con 0x7f900c06a090 2023-07-21T07:36:50.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.842+0000 7f9011123700 1 -- 172.21.15.6:0/2582760281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9008004390 con 0x7f900c06a090 2023-07-21T07:36:50.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.842+0000 7f9011123700 1 -- 172.21.15.6:0/2582760281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080036a0 con 0x7f900c06a090 2023-07-21T07:36:50.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.842+0000 7f9014389700 1 -- 172.21.15.6:0/2582760281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900c06a090 msgr2=0x7f900c06a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.842+0000 7f9014389700 1 --2- 172.21.15.6:0/2582760281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900c06a090 0x7f900c06a510 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9008009840 tx=0x7f9008009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.842+0000 7f9014389700 1 -- 172.21.15.6:0/2582760281 shutdown_connections 2023-07-21T07:36:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.842+0000 7f9014389700 1 --2- 172.21.15.6:0/2582760281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900c06a090 0x7f900c06a510 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.842+0000 7f9014389700 1 -- 172.21.15.6:0/2582760281 >> 172.21.15.6:0/2582760281 conn(0x7f900c0a8660 msgr2=0x7f900c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:50.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.842+0000 7f9014389700 1 -- 172.21.15.6:0/2582760281 shutdown_connections 2023-07-21T07:36:50.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.842+0000 7f9014389700 1 -- 172.21.15.6:0/2582760281 wait complete. 2023-07-21T07:36:50.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.844+0000 7f9014389700 1 Processor -- start 2023-07-21T07:36:50.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.844+0000 7f9014389700 1 -- start start 2023-07-21T07:36:50.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.844+0000 7f9014389700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f900c06a090 0x7f900c1edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.844+0000 7f9014389700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f900c0c5660 0x7f900c071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.844+0000 7f9014389700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900c151b10 0x7f900c145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.844+0000 7f9014389700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c153760 con 0x7f900c151b10 2023-07-21T07:36:50.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.844+0000 7f9014389700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c1ee080 con 0x7f900c06a090 2023-07-21T07:36:50.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.844+0000 7f9014389700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c1559f0 con 0x7f900c0c5660 2023-07-21T07:36:50.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.844+0000 7f9012926700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900c151b10 0x7f900c145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.844+0000 7f9012926700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900c151b10 0x7f900c145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36484/0 (socket says 172.21.15.6:36484) 2023-07-21T07:36:50.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.844+0000 7f9012926700 1 -- 172.21.15.6:0/11778688 learned_addr learned my addr 172.21.15.6:0/11778688 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:50.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9012125700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f900c06a090 0x7f900c1edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9011924700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f900c0c5660 0x7f900c071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9012926700 1 -- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f900c0c5660 msgr2=0x7f900c071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9012926700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f900c0c5660 0x7f900c071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9012926700 1 -- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f900c06a090 msgr2=0x7f900c1edb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:50.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9012926700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f900c06a090 0x7f900c1edb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:50.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9012926700 1 -- 172.21.15.6:0/11778688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90080094a0 con 0x7f900c151b10 2023-07-21T07:36:50.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9011924700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f900c0c5660 0x7f900c071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:50.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9012926700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900c151b10 0x7f900c145ba0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f900400cb60 tx=0x7f900400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:50.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9002ffd700 1 -- 172.21.15.6:0/11778688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900400ab50 con 0x7f900c151b10 2023-07-21T07:36:50.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9002ffd700 1 -- 172.21.15.6:0/11778688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900400acb0 con 0x7f900c151b10 2023-07-21T07:36:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9014389700 1 -- 172.21.15.6:0/11778688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900c158100 con 0x7f900c151b10 2023-07-21T07:36:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9002ffd700 1 -- 172.21.15.6:0/11778688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9004007310 con 0x7f900c151b10 2023-07-21T07:36:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.845+0000 7f9014389700 1 -- 172.21.15.6:0/11778688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900c1586c0 con 0x7f900c151b10 2023-07-21T07:36:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.846+0000 7f9014389700 1 -- 172.21.15.6:0/11778688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900c06e400 con 0x7f900c151b10 2023-07-21T07:36:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.847+0000 7f9002ffd700 1 -- 172.21.15.6:0/11778688 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9004007470 con 0x7f900c151b10 2023-07-21T07:36:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.847+0000 7f9002ffd700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8ff006ace0 0x7f8ff006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.847+0000 7f9002ffd700 1 -- 172.21.15.6:0/11778688 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f9004089580 con 0x7f900c151b10 2023-07-21T07:36:50.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.848+0000 7f9012125700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8ff006ace0 0x7f8ff006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:50.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.848+0000 7f9012125700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8ff006ace0 0x7f8ff006d1a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009870 tx=0x7f8ffc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:50.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:50.852+0000 7f9002ffd700 1 -- 172.21.15.6:0/11778688 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f900c06e400 con 0x7f900c151b10 2023-07-21T07:36:51.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.045+0000 7f9014389700 1 -- 172.21.15.6:0/11778688 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f900c0c4e60 con 0x7f8ff006ace0 2023-07-21T07:36:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.060+0000 7f9002ffd700 1 -- 172.21.15.6:0/11778688 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+550400 (secure 0 0 0) 0x7f8ffc0123e0 con 0x7f8ff006ace0 2023-07-21T07:36:51.120 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:51.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.064+0000 7f9014389700 1 -- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8ff006ace0 msgr2=0x7f8ff006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:51.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.064+0000 7f9014389700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8ff006ace0 0x7f8ff006d1a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009870 tx=0x7f8ffc008040 comp rx=0 tx=0).stop 2023-07-21T07:36:51.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.064+0000 7f9014389700 1 -- 172.21.15.6:0/11778688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900c151b10 msgr2=0x7f900c145ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:51.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.064+0000 7f9014389700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900c151b10 0x7f900c145ba0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f900400cb60 tx=0x7f900400cf20 comp rx=0 tx=0).stop 2023-07-21T07:36:51.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.065+0000 7f9014389700 1 -- 172.21.15.6:0/11778688 shutdown_connections 2023-07-21T07:36:51.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.065+0000 7f9014389700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8ff006ace0 0x7f8ff006d1a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.065+0000 7f9014389700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f900c151b10 0x7f900c145ba0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.065+0000 7f9014389700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f900c06a090 0x7f900c1edb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.065+0000 7f9014389700 1 --2- 172.21.15.6:0/11778688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f900c0c5660 0x7f900c071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.065+0000 7f9014389700 1 -- 172.21.15.6:0/11778688 >> 172.21.15.6:0/11778688 conn(0x7f900c0a8660 msgr2=0x7f900c1510d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:51.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.065+0000 7f9014389700 1 -- 172.21.15.6:0/11778688 shutdown_connections 2023-07-21T07:36:51.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.065+0000 7f9014389700 1 -- 172.21.15.6:0/11778688 wait complete. 2023-07-21T07:36:51.127 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:36:51.131 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2023-07-21T07:36:50.725314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596599,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":312,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222808,"kb_used_data":6632,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754751912,"statfs":{"total":773094113280,"available":772865957888,"internally_reserved":0,"allocated":6791168,"data_stored":3667230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.835894"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938663+0000","last_change":"2023-07-21T07:36:46.929149+0000","last_active":"2023-07-21T07:36:46.938663+0000","last_peered":"2023-07-21T07:36:46.938663+0000","last_clean":"2023-07-21T07:36:46.938663+0000","last_became_active":"2023-07-21T07:36:46.928624+0000","last_became_peered":"2023-07-21T07:36:46.928624+0000","last_unstale":"2023-07-21T07:36:46.938663+0000","last_undegraded":"2023-07-21T07:36:46.938663+0000","last_fullsized":"2023-07-21T07:36:46.938663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:59:25.823663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907893+0000","last_change":"2023-07-21T07:36:28.546426+0000","last_active":"2023-07-21T07:36:46.907893+0000","last_peered":"2023-07-21T07:36:46.907893+0000","last_clean":"2023-07-21T07:36:46.907893+0000","last_became_active":"2023-07-21T07:36:28.546106+0000","last_became_peered":"2023-07-21T07:36:28.546106+0000","last_unstale":"2023-07-21T07:36:46.907893+0000","last_undegraded":"2023-07-21T07:36:46.907893+0000","last_fullsized":"2023-07-21T07:36:46.907893+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:54:48.032678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.924393+0000","last_change":"2023-07-21T07:36:46.919847+0000","last_active":"2023-07-21T07:36:46.924393+0000","last_peered":"2023-07-21T07:36:46.924393+0000","last_clean":"2023-07-21T07:36:46.924393+0000","last_became_active":"2023-07-21T07:36:46.919552+0000","last_became_peered":"2023-07-21T07:36:46.919552+0000","last_unstale":"2023-07-21T07:36:46.924393+0000","last_undegraded":"2023-07-21T07:36:46.924393+0000","last_fullsized":"2023-07-21T07:36:46.924393+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:03:14.366312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907496+0000","last_change":"2023-07-21T07:36:28.553546+0000","last_active":"2023-07-21T07:36:46.907496+0000","last_peered":"2023-07-21T07:36:46.907496+0000","last_clean":"2023-07-21T07:36:46.907496+0000","last_became_active":"2023-07-21T07:36:28.553260+0000","last_became_peered":"2023-07-21T07:36:28.553260+0000","last_unstale":"2023-07-21T07:36:46.907496+0000","last_undegraded":"2023-07-21T07:36:46.907496+0000","last_fullsized":"2023-07-21T07:36:46.907496+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:52:36.692277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.929183+0000","last_change":"2023-07-21T07:36:46.919212+0000","last_active":"2023-07-21T07:36:46.929183+0000","last_peered":"2023-07-21T07:36:46.929183+0000","last_clean":"2023-07-21T07:36:46.929183+0000","last_became_active":"2023-07-21T07:36:46.918812+0000","last_became_peered":"2023-07-21T07:36:46.918812+0000","last_unstale":"2023-07-21T07:36:46.929183+0000","last_undegraded":"2023-07-21T07:36:46.929183+0000","last_fullsized":"2023-07-21T07:36:46.929183+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:01:54.936247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914190+0000","last_change":"2023-07-21T07:36:28.554364+0000","last_active":"2023-07-21T07:36:46.914190+0000","last_peered":"2023-07-21T07:36:46.914190+0000","last_clean":"2023-07-21T07:36:46.914190+0000","last_became_active":"2023-07-21T07:36:28.554095+0000","last_became_peered":"2023-07-21T07:36:28.554095+0000","last_unstale":"2023-07-21T07:36:46.914190+0000","last_undegraded":"2023-07-21T07:36:46.914190+0000","last_fullsized":"2023-07-21T07:36:46.914190+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:21:55.516958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.922830+0000","last_change":"2023-07-21T07:36:46.916502+0000","last_active":"2023-07-21T07:36:46.922830+0000","last_peered":"2023-07-21T07:36:46.922830+0000","last_clean":"2023-07-21T07:36:46.922830+0000","last_became_active":"2023-07-21T07:36:46.916137+0000","last_became_peered":"2023-07-21T07:36:46.916137+0000","last_unstale":"2023-07-21T07:36:46.922830+0000","last_undegraded":"2023-07-21T07:36:46.922830+0000","last_fullsized":"2023-07-21T07:36:46.922830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:04:18.558921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905703+0000","last_change":"2023-07-21T07:36:28.553233+0000","last_active":"2023-07-21T07:36:46.905703+0000","last_peered":"2023-07-21T07:36:46.905703+0000","last_clean":"2023-07-21T07:36:46.905703+0000","last_became_active":"2023-07-21T07:36:28.552984+0000","last_became_peered":"2023-07-21T07:36:28.552984+0000","last_unstale":"2023-07-21T07:36:46.905703+0000","last_undegraded":"2023-07-21T07:36:46.905703+0000","last_fullsized":"2023-07-21T07:36:46.905703+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:41:31.754173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.944282+0000","last_change":"2023-07-21T07:36:46.943362+0000","last_active":"2023-07-21T07:36:46.944282+0000","last_peered":"2023-07-21T07:36:46.944282+0000","last_clean":"2023-07-21T07:36:46.944282+0000","last_became_active":"2023-07-21T07:36:46.943065+0000","last_became_peered":"2023-07-21T07:36:46.943065+0000","last_unstale":"2023-07-21T07:36:46.944282+0000","last_undegraded":"2023-07-21T07:36:46.944282+0000","last_fullsized":"2023-07-21T07:36:46.944282+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:14:07.210742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913715+0000","last_change":"2023-07-21T07:36:28.555196+0000","last_active":"2023-07-21T07:36:46.913715+0000","last_peered":"2023-07-21T07:36:46.913715+0000","last_clean":"2023-07-21T07:36:46.913715+0000","last_became_active":"2023-07-21T07:36:28.554805+0000","last_became_peered":"2023-07-21T07:36:28.554805+0000","last_unstale":"2023-07-21T07:36:46.913715+0000","last_undegraded":"2023-07-21T07:36:46.913715+0000","last_fullsized":"2023-07-21T07:36:46.913715+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:51:09.771177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.924772+0000","last_change":"2023-07-21T07:36:46.918562+0000","last_active":"2023-07-21T07:36:46.924772+0000","last_peered":"2023-07-21T07:36:46.924772+0000","last_clean":"2023-07-21T07:36:46.924772+0000","last_became_active":"2023-07-21T07:36:46.918291+0000","last_became_peered":"2023-07-21T07:36:46.918291+0000","last_unstale":"2023-07-21T07:36:46.924772+0000","last_undegraded":"2023-07-21T07:36:46.924772+0000","last_fullsized":"2023-07-21T07:36:46.924772+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:38:56.965556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911631+0000","last_change":"2023-07-21T07:36:28.557651+0000","last_active":"2023-07-21T07:36:46.911631+0000","last_peered":"2023-07-21T07:36:46.911631+0000","last_clean":"2023-07-21T07:36:46.911631+0000","last_became_active":"2023-07-21T07:36:28.557396+0000","last_became_peered":"2023-07-21T07:36:28.557396+0000","last_unstale":"2023-07-21T07:36:46.911631+0000","last_undegraded":"2023-07-21T07:36:46.911631+0000","last_fullsized":"2023-07-21T07:36:46.911631+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:23:24.859339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.927768+0000","last_change":"2023-07-21T07:36:46.924168+0000","last_active":"2023-07-21T07:36:46.927768+0000","last_peered":"2023-07-21T07:36:46.927768+0000","last_clean":"2023-07-21T07:36:46.927768+0000","last_became_active":"2023-07-21T07:36:46.923821+0000","last_became_peered":"2023-07-21T07:36:46.923821+0000","last_unstale":"2023-07-21T07:36:46.927768+0000","last_undegraded":"2023-07-21T07:36:46.927768+0000","last_fullsized":"2023-07-21T07:36:46.927768+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:02:43.605562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.909166+0000","last_change":"2023-07-21T07:36:28.557367+0000","last_active":"2023-07-21T07:36:46.909166+0000","last_peered":"2023-07-21T07:36:46.909166+0000","last_clean":"2023-07-21T07:36:46.909166+0000","last_became_active":"2023-07-21T07:36:28.557060+0000","last_became_peered":"2023-07-21T07:36:28.557060+0000","last_unstale":"2023-07-21T07:36:46.909166+0000","last_undegraded":"2023-07-21T07:36:46.909166+0000","last_fullsized":"2023-07-21T07:36:46.909166+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:07:09.045197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.941322+0000","last_change":"2023-07-21T07:36:46.938931+0000","last_active":"2023-07-21T07:36:46.941322+0000","last_peered":"2023-07-21T07:36:46.941322+0000","last_clean":"2023-07-21T07:36:46.941322+0000","last_became_active":"2023-07-21T07:36:46.938595+0000","last_became_peered":"2023-07-21T07:36:46.938595+0000","last_unstale":"2023-07-21T07:36:46.941322+0000","last_undegraded":"2023-07-21T07:36:46.941322+0000","last_fullsized":"2023-07-21T07:36:46.941322+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:54:20.782814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911378+0000","last_change":"2023-07-21T07:36:28.550020+0000","last_active":"2023-07-21T07:36:46.911378+0000","last_peered":"2023-07-21T07:36:46.911378+0000","last_clean":"2023-07-21T07:36:46.911378+0000","last_became_active":"2023-07-21T07:36:28.549706+0000","last_became_peered":"2023-07-21T07:36:28.549706+0000","last_unstale":"2023-07-21T07:36:46.911378+0000","last_undegraded":"2023-07-21T07:36:46.911378+0000","last_fullsized":"2023-07-21T07:36:46.911378+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:39:18.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.937924+0000","last_change":"2023-07-21T07:36:46.927194+0000","last_active":"2023-07-21T07:36:46.937924+0000","last_peered":"2023-07-21T07:36:46.937924+0000","last_clean":"2023-07-21T07:36:46.937924+0000","last_became_active":"2023-07-21T07:36:46.921059+0000","last_became_peered":"2023-07-21T07:36:46.921059+0000","last_unstale":"2023-07-21T07:36:46.937924+0000","last_undegraded":"2023-07-21T07:36:46.937924+0000","last_fullsized":"2023-07-21T07:36:46.937924+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:41:57.632713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914507+0000","last_change":"2023-07-21T07:36:28.553926+0000","last_active":"2023-07-21T07:36:46.914507+0000","last_peered":"2023-07-21T07:36:46.914507+0000","last_clean":"2023-07-21T07:36:46.914507+0000","last_became_active":"2023-07-21T07:36:28.552424+0000","last_became_peered":"2023-07-21T07:36:28.552424+0000","last_unstale":"2023-07-21T07:36:46.914507+0000","last_undegraded":"2023-07-21T07:36:46.914507+0000","last_fullsized":"2023-07-21T07:36:46.914507+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:56:02.291385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932447+0000","last_change":"2023-07-21T07:36:46.925625+0000","last_active":"2023-07-21T07:36:46.932447+0000","last_peered":"2023-07-21T07:36:46.932447+0000","last_clean":"2023-07-21T07:36:46.932447+0000","last_became_active":"2023-07-21T07:36:46.925156+0000","last_became_peered":"2023-07-21T07:36:46.925156+0000","last_unstale":"2023-07-21T07:36:46.932447+0000","last_undegraded":"2023-07-21T07:36:46.932447+0000","last_fullsized":"2023-07-21T07:36:46.932447+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:25:23.390482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912089+0000","last_change":"2023-07-21T07:36:28.551408+0000","last_active":"2023-07-21T07:36:46.912089+0000","last_peered":"2023-07-21T07:36:46.912089+0000","last_clean":"2023-07-21T07:36:46.912089+0000","last_became_active":"2023-07-21T07:36:28.551138+0000","last_became_peered":"2023-07-21T07:36:28.551138+0000","last_unstale":"2023-07-21T07:36:46.912089+0000","last_undegraded":"2023-07-21T07:36:46.912089+0000","last_fullsized":"2023-07-21T07:36:46.912089+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:19.298788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938138+0000","last_change":"2023-07-21T07:36:46.924927+0000","last_active":"2023-07-21T07:36:46.938138+0000","last_peered":"2023-07-21T07:36:46.938138+0000","last_clean":"2023-07-21T07:36:46.938138+0000","last_became_active":"2023-07-21T07:36:46.924422+0000","last_became_peered":"2023-07-21T07:36:46.924422+0000","last_unstale":"2023-07-21T07:36:46.938138+0000","last_undegraded":"2023-07-21T07:36:46.938138+0000","last_fullsized":"2023-07-21T07:36:46.938138+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:14:49.090853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905924+0000","last_change":"2023-07-21T07:36:28.550836+0000","last_active":"2023-07-21T07:36:46.905924+0000","last_peered":"2023-07-21T07:36:46.905924+0000","last_clean":"2023-07-21T07:36:46.905924+0000","last_became_active":"2023-07-21T07:36:28.550559+0000","last_became_peered":"2023-07-21T07:36:28.550559+0000","last_unstale":"2023-07-21T07:36:46.905924+0000","last_undegraded":"2023-07-21T07:36:46.905924+0000","last_fullsized":"2023-07-21T07:36:46.905924+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:47:50.154203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.922784+0000","last_change":"2023-07-21T07:36:46.910662+0000","last_active":"2023-07-21T07:36:46.922784+0000","last_peered":"2023-07-21T07:36:46.922784+0000","last_clean":"2023-07-21T07:36:46.922784+0000","last_became_active":"2023-07-21T07:36:46.910263+0000","last_became_peered":"2023-07-21T07:36:46.910263+0000","last_unstale":"2023-07-21T07:36:46.922784+0000","last_undegraded":"2023-07-21T07:36:46.922784+0000","last_fullsized":"2023-07-21T07:36:46.922784+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:48:52.254857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914041+0000","last_change":"2023-07-21T07:36:28.550059+0000","last_active":"2023-07-21T07:36:46.914041+0000","last_peered":"2023-07-21T07:36:46.914041+0000","last_clean":"2023-07-21T07:36:46.914041+0000","last_became_active":"2023-07-21T07:36:28.549772+0000","last_became_peered":"2023-07-21T07:36:28.549772+0000","last_unstale":"2023-07-21T07:36:46.914041+0000","last_undegraded":"2023-07-21T07:36:46.914041+0000","last_fullsized":"2023-07-21T07:36:46.914041+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:14:37.136009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.944222+0000","last_change":"2023-07-21T07:36:46.942968+0000","last_active":"2023-07-21T07:36:46.944222+0000","last_peered":"2023-07-21T07:36:46.944222+0000","last_clean":"2023-07-21T07:36:46.944222+0000","last_became_active":"2023-07-21T07:36:46.942662+0000","last_became_peered":"2023-07-21T07:36:46.942662+0000","last_unstale":"2023-07-21T07:36:46.944222+0000","last_undegraded":"2023-07-21T07:36:46.944222+0000","last_fullsized":"2023-07-21T07:36:46.944222+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:21:58.590181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911515+0000","last_change":"2023-07-21T07:36:28.548999+0000","last_active":"2023-07-21T07:36:46.911515+0000","last_peered":"2023-07-21T07:36:46.911515+0000","last_clean":"2023-07-21T07:36:46.911515+0000","last_became_active":"2023-07-21T07:36:28.548721+0000","last_became_peered":"2023-07-21T07:36:28.548721+0000","last_unstale":"2023-07-21T07:36:46.911515+0000","last_undegraded":"2023-07-21T07:36:46.911515+0000","last_fullsized":"2023-07-21T07:36:46.911515+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:24:02.750880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.939011+0000","last_change":"2023-07-21T07:36:46.934546+0000","last_active":"2023-07-21T07:36:46.939011+0000","last_peered":"2023-07-21T07:36:46.939011+0000","last_clean":"2023-07-21T07:36:46.939011+0000","last_became_active":"2023-07-21T07:36:46.934287+0000","last_became_peered":"2023-07-21T07:36:46.934287+0000","last_unstale":"2023-07-21T07:36:46.939011+0000","last_undegraded":"2023-07-21T07:36:46.939011+0000","last_fullsized":"2023-07-21T07:36:46.939011+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:58:22.838750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911876+0000","last_change":"2023-07-21T07:36:28.551943+0000","last_active":"2023-07-21T07:36:46.911876+0000","last_peered":"2023-07-21T07:36:46.911876+0000","last_clean":"2023-07-21T07:36:46.911876+0000","last_became_active":"2023-07-21T07:36:28.551690+0000","last_became_peered":"2023-07-21T07:36:28.551690+0000","last_unstale":"2023-07-21T07:36:46.911876+0000","last_undegraded":"2023-07-21T07:36:46.911876+0000","last_fullsized":"2023-07-21T07:36:46.911876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:07:33.542398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914895+0000","last_change":"2023-07-21T07:36:46.910906+0000","last_active":"2023-07-21T07:36:46.914895+0000","last_peered":"2023-07-21T07:36:46.914895+0000","last_clean":"2023-07-21T07:36:46.914895+0000","last_became_active":"2023-07-21T07:36:46.910639+0000","last_became_peered":"2023-07-21T07:36:46.910639+0000","last_unstale":"2023-07-21T07:36:46.914895+0000","last_undegraded":"2023-07-21T07:36:46.914895+0000","last_fullsized":"2023-07-21T07:36:46.914895+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:59:09.641133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911273+0000","last_change":"2023-07-21T07:36:28.551052+0000","last_active":"2023-07-21T07:36:46.911273+0000","last_peered":"2023-07-21T07:36:46.911273+0000","last_clean":"2023-07-21T07:36:46.911273+0000","last_became_active":"2023-07-21T07:36:28.550737+0000","last_became_peered":"2023-07-21T07:36:28.550737+0000","last_unstale":"2023-07-21T07:36:46.911273+0000","last_undegraded":"2023-07-21T07:36:46.911273+0000","last_fullsized":"2023-07-21T07:36:46.911273+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:58:04.474332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932791+0000","last_change":"2023-07-21T07:36:46.927236+0000","last_active":"2023-07-21T07:36:46.932791+0000","last_peered":"2023-07-21T07:36:46.932791+0000","last_clean":"2023-07-21T07:36:46.932791+0000","last_became_active":"2023-07-21T07:36:46.926976+0000","last_became_peered":"2023-07-21T07:36:46.926976+0000","last_unstale":"2023-07-21T07:36:46.932791+0000","last_undegraded":"2023-07-21T07:36:46.932791+0000","last_fullsized":"2023-07-21T07:36:46.932791+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:15:56.867282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911055+0000","last_change":"2023-07-21T07:36:28.561905+0000","last_active":"2023-07-21T07:36:46.911055+0000","last_peered":"2023-07-21T07:36:46.911055+0000","last_clean":"2023-07-21T07:36:46.911055+0000","last_became_active":"2023-07-21T07:36:28.561351+0000","last_became_peered":"2023-07-21T07:36:28.561351+0000","last_unstale":"2023-07-21T07:36:46.911055+0000","last_undegraded":"2023-07-21T07:36:46.911055+0000","last_fullsized":"2023-07-21T07:36:46.911055+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:59:11.060456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.924873+0000","last_change":"2023-07-21T07:36:46.918054+0000","last_active":"2023-07-21T07:36:46.924873+0000","last_peered":"2023-07-21T07:36:46.924873+0000","last_clean":"2023-07-21T07:36:46.924873+0000","last_became_active":"2023-07-21T07:36:46.917793+0000","last_became_peered":"2023-07-21T07:36:46.917793+0000","last_unstale":"2023-07-21T07:36:46.924873+0000","last_undegraded":"2023-07-21T07:36:46.924873+0000","last_fullsized":"2023-07-21T07:36:46.924873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:15:37.959979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907557+0000","last_change":"2023-07-21T07:36:28.550124+0000","last_active":"2023-07-21T07:36:46.907557+0000","last_peered":"2023-07-21T07:36:46.907557+0000","last_clean":"2023-07-21T07:36:46.907557+0000","last_became_active":"2023-07-21T07:36:28.549862+0000","last_became_peered":"2023-07-21T07:36:28.549862+0000","last_unstale":"2023-07-21T07:36:46.907557+0000","last_undegraded":"2023-07-21T07:36:46.907557+0000","last_fullsized":"2023-07-21T07:36:46.907557+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:41:42.818636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938043+0000","last_change":"2023-07-21T07:36:46.926809+0000","last_active":"2023-07-21T07:36:46.938043+0000","last_peered":"2023-07-21T07:36:46.938043+0000","last_clean":"2023-07-21T07:36:46.938043+0000","last_became_active":"2023-07-21T07:36:46.926500+0000","last_became_peered":"2023-07-21T07:36:46.926500+0000","last_unstale":"2023-07-21T07:36:46.938043+0000","last_undegraded":"2023-07-21T07:36:46.938043+0000","last_fullsized":"2023-07-21T07:36:46.938043+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:41:30.594611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906108+0000","last_change":"2023-07-21T07:36:28.552922+0000","last_active":"2023-07-21T07:36:46.906108+0000","last_peered":"2023-07-21T07:36:46.906108+0000","last_clean":"2023-07-21T07:36:46.906108+0000","last_became_active":"2023-07-21T07:36:28.552646+0000","last_became_peered":"2023-07-21T07:36:28.552646+0000","last_unstale":"2023-07-21T07:36:46.906108+0000","last_undegraded":"2023-07-21T07:36:46.906108+0000","last_fullsized":"2023-07-21T07:36:46.906108+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:14:45.455549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.922497+0000","last_change":"2023-07-21T07:36:46.914534+0000","last_active":"2023-07-21T07:36:46.922497+0000","last_peered":"2023-07-21T07:36:46.922497+0000","last_clean":"2023-07-21T07:36:46.922497+0000","last_became_active":"2023-07-21T07:36:46.914133+0000","last_became_peered":"2023-07-21T07:36:46.914133+0000","last_unstale":"2023-07-21T07:36:46.922497+0000","last_undegraded":"2023-07-21T07:36:46.922497+0000","last_fullsized":"2023-07-21T07:36:46.922497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:55:37.466273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.918138+0000","last_change":"2023-07-21T07:36:28.554910+0000","last_active":"2023-07-21T07:36:46.918138+0000","last_peered":"2023-07-21T07:36:46.918138+0000","last_clean":"2023-07-21T07:36:46.918138+0000","last_became_active":"2023-07-21T07:36:28.554628+0000","last_became_peered":"2023-07-21T07:36:28.554628+0000","last_unstale":"2023-07-21T07:36:46.918138+0000","last_undegraded":"2023-07-21T07:36:46.918138+0000","last_fullsized":"2023-07-21T07:36:46.918138+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:43.040440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.939808+0000","last_change":"2023-07-21T07:36:46.929954+0000","last_active":"2023-07-21T07:36:46.939808+0000","last_peered":"2023-07-21T07:36:46.939808+0000","last_clean":"2023-07-21T07:36:46.939808+0000","last_became_active":"2023-07-21T07:36:46.929659+0000","last_became_peered":"2023-07-21T07:36:46.929659+0000","last_unstale":"2023-07-21T07:36:46.939808+0000","last_undegraded":"2023-07-21T07:36:46.939808+0000","last_fullsized":"2023-07-21T07:36:46.939808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:35.901936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904803+0000","last_change":"2023-07-21T07:36:28.547134+0000","last_active":"2023-07-21T07:36:46.904803+0000","last_peered":"2023-07-21T07:36:46.904803+0000","last_clean":"2023-07-21T07:36:46.904803+0000","last_became_active":"2023-07-21T07:36:28.546821+0000","last_became_peered":"2023-07-21T07:36:28.546821+0000","last_unstale":"2023-07-21T07:36:46.904803+0000","last_undegraded":"2023-07-21T07:36:46.904803+0000","last_fullsized":"2023-07-21T07:36:46.904803+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:23:24.859339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.934430+0000","last_change":"2023-07-21T07:36:46.926697+0000","last_active":"2023-07-21T07:36:46.934430+0000","last_peered":"2023-07-21T07:36:46.934430+0000","last_clean":"2023-07-21T07:36:46.934430+0000","last_became_active":"2023-07-21T07:36:46.926338+0000","last_became_peered":"2023-07-21T07:36:46.926338+0000","last_unstale":"2023-07-21T07:36:46.934430+0000","last_undegraded":"2023-07-21T07:36:46.934430+0000","last_fullsized":"2023-07-21T07:36:46.934430+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:30:42.278569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911498+0000","last_change":"2023-07-21T07:36:28.546888+0000","last_active":"2023-07-21T07:36:46.911498+0000","last_peered":"2023-07-21T07:36:46.911498+0000","last_clean":"2023-07-21T07:36:46.911498+0000","last_became_active":"2023-07-21T07:36:28.546615+0000","last_became_peered":"2023-07-21T07:36:28.546615+0000","last_unstale":"2023-07-21T07:36:46.911498+0000","last_undegraded":"2023-07-21T07:36:46.911498+0000","last_fullsized":"2023-07-21T07:36:46.911498+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:26:49.024923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.939772+0000","last_change":"2023-07-21T07:36:46.929045+0000","last_active":"2023-07-21T07:36:46.939772+0000","last_peered":"2023-07-21T07:36:46.939772+0000","last_clean":"2023-07-21T07:36:46.939772+0000","last_became_active":"2023-07-21T07:36:46.928729+0000","last_became_peered":"2023-07-21T07:36:46.928729+0000","last_unstale":"2023-07-21T07:36:46.939772+0000","last_undegraded":"2023-07-21T07:36:46.939772+0000","last_fullsized":"2023-07-21T07:36:46.939772+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:36:40.339739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905874+0000","last_change":"2023-07-21T07:36:28.551413+0000","last_active":"2023-07-21T07:36:46.905874+0000","last_peered":"2023-07-21T07:36:46.905874+0000","last_clean":"2023-07-21T07:36:46.905874+0000","last_became_active":"2023-07-21T07:36:28.551080+0000","last_became_peered":"2023-07-21T07:36:28.551080+0000","last_unstale":"2023-07-21T07:36:46.905874+0000","last_undegraded":"2023-07-21T07:36:46.905874+0000","last_fullsized":"2023-07-21T07:36:46.905874+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:40:31.805910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.940211+0000","last_change":"2023-07-21T07:36:46.935202+0000","last_active":"2023-07-21T07:36:46.940211+0000","last_peered":"2023-07-21T07:36:46.940211+0000","last_clean":"2023-07-21T07:36:46.940211+0000","last_became_active":"2023-07-21T07:36:46.934903+0000","last_became_peered":"2023-07-21T07:36:46.934903+0000","last_unstale":"2023-07-21T07:36:46.940211+0000","last_undegraded":"2023-07-21T07:36:46.940211+0000","last_fullsized":"2023-07-21T07:36:46.940211+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:24:52.408043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906974+0000","last_change":"2023-07-21T07:36:28.551886+0000","last_active":"2023-07-21T07:36:46.906974+0000","last_peered":"2023-07-21T07:36:46.906974+0000","last_clean":"2023-07-21T07:36:46.906974+0000","last_became_active":"2023-07-21T07:36:28.551565+0000","last_became_peered":"2023-07-21T07:36:28.551565+0000","last_unstale":"2023-07-21T07:36:46.906974+0000","last_undegraded":"2023-07-21T07:36:46.906974+0000","last_fullsized":"2023-07-21T07:36:46.906974+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:56:59.066697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.920264+0000","last_change":"2023-07-21T07:36:46.917418+0000","last_active":"2023-07-21T07:36:46.920264+0000","last_peered":"2023-07-21T07:36:46.920264+0000","last_clean":"2023-07-21T07:36:46.920264+0000","last_became_active":"2023-07-21T07:36:46.917210+0000","last_became_peered":"2023-07-21T07:36:46.917210+0000","last_unstale":"2023-07-21T07:36:46.920264+0000","last_undegraded":"2023-07-21T07:36:46.920264+0000","last_fullsized":"2023-07-21T07:36:46.920264+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:30:55.049913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911551+0000","last_change":"2023-07-21T07:36:28.558221+0000","last_active":"2023-07-21T07:36:46.911551+0000","last_peered":"2023-07-21T07:36:46.911551+0000","last_clean":"2023-07-21T07:36:46.911551+0000","last_became_active":"2023-07-21T07:36:28.557198+0000","last_became_peered":"2023-07-21T07:36:28.557198+0000","last_unstale":"2023-07-21T07:36:46.911551+0000","last_undegraded":"2023-07-21T07:36:46.911551+0000","last_fullsized":"2023-07-21T07:36:46.911551+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:13:24.378572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.934517+0000","last_change":"2023-07-21T07:36:46.930279+0000","last_active":"2023-07-21T07:36:46.934517+0000","last_peered":"2023-07-21T07:36:46.934517+0000","last_clean":"2023-07-21T07:36:46.934517+0000","last_became_active":"2023-07-21T07:36:46.929957+0000","last_became_peered":"2023-07-21T07:36:46.929957+0000","last_unstale":"2023-07-21T07:36:46.934517+0000","last_undegraded":"2023-07-21T07:36:46.934517+0000","last_fullsized":"2023-07-21T07:36:46.934517+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:04:11.675967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911635+0000","last_change":"2023-07-21T07:36:28.557669+0000","last_active":"2023-07-21T07:36:46.911635+0000","last_peered":"2023-07-21T07:36:46.911635+0000","last_clean":"2023-07-21T07:36:46.911635+0000","last_became_active":"2023-07-21T07:36:28.557198+0000","last_became_peered":"2023-07-21T07:36:28.557198+0000","last_unstale":"2023-07-21T07:36:46.911635+0000","last_undegraded":"2023-07-21T07:36:46.911635+0000","last_fullsized":"2023-07-21T07:36:46.911635+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:42:03.223977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.922779+0000","last_change":"2023-07-21T07:36:46.920006+0000","last_active":"2023-07-21T07:36:46.922779+0000","last_peered":"2023-07-21T07:36:46.922779+0000","last_clean":"2023-07-21T07:36:46.922779+0000","last_became_active":"2023-07-21T07:36:46.919741+0000","last_became_peered":"2023-07-21T07:36:46.919741+0000","last_unstale":"2023-07-21T07:36:46.922779+0000","last_undegraded":"2023-07-21T07:36:46.922779+0000","last_fullsized":"2023-07-21T07:36:46.922779+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:24:01.077385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912318+0000","last_change":"2023-07-21T07:36:28.556248+0000","last_active":"2023-07-21T07:36:46.912318+0000","last_peered":"2023-07-21T07:36:46.912318+0000","last_clean":"2023-07-21T07:36:46.912318+0000","last_became_active":"2023-07-21T07:36:28.556010+0000","last_became_peered":"2023-07-21T07:36:28.556010+0000","last_unstale":"2023-07-21T07:36:46.912318+0000","last_undegraded":"2023-07-21T07:36:46.912318+0000","last_fullsized":"2023-07-21T07:36:46.912318+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:01:35.593787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938142+0000","last_change":"2023-07-21T07:36:46.931353+0000","last_active":"2023-07-21T07:36:46.938142+0000","last_peered":"2023-07-21T07:36:46.938142+0000","last_clean":"2023-07-21T07:36:46.938142+0000","last_became_active":"2023-07-21T07:36:46.931042+0000","last_became_peered":"2023-07-21T07:36:46.931042+0000","last_unstale":"2023-07-21T07:36:46.938142+0000","last_undegraded":"2023-07-21T07:36:46.938142+0000","last_fullsized":"2023-07-21T07:36:46.938142+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:45:36.090178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906039+0000","last_change":"2023-07-21T07:36:28.554107+0000","last_active":"2023-07-21T07:36:46.906039+0000","last_peered":"2023-07-21T07:36:46.906039+0000","last_clean":"2023-07-21T07:36:46.906039+0000","last_became_active":"2023-07-21T07:36:28.553824+0000","last_became_peered":"2023-07-21T07:36:28.553824+0000","last_unstale":"2023-07-21T07:36:46.906039+0000","last_undegraded":"2023-07-21T07:36:46.906039+0000","last_fullsized":"2023-07-21T07:36:46.906039+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:10:58.291575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.925652+0000","last_change":"2023-07-21T07:36:46.922000+0000","last_active":"2023-07-21T07:36:46.925652+0000","last_peered":"2023-07-21T07:36:46.925652+0000","last_clean":"2023-07-21T07:36:46.925652+0000","last_became_active":"2023-07-21T07:36:46.921752+0000","last_became_peered":"2023-07-21T07:36:46.921752+0000","last_unstale":"2023-07-21T07:36:46.925652+0000","last_undegraded":"2023-07-21T07:36:46.925652+0000","last_fullsized":"2023-07-21T07:36:46.925652+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:33:39.431098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907394+0000","last_change":"2023-07-21T07:36:28.544714+0000","last_active":"2023-07-21T07:36:46.907394+0000","last_peered":"2023-07-21T07:36:46.907394+0000","last_clean":"2023-07-21T07:36:46.907394+0000","last_became_active":"2023-07-21T07:36:28.544330+0000","last_became_peered":"2023-07-21T07:36:28.544330+0000","last_unstale":"2023-07-21T07:36:46.907394+0000","last_undegraded":"2023-07-21T07:36:46.907394+0000","last_fullsized":"2023-07-21T07:36:46.907394+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:21:11.273627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932510+0000","last_change":"2023-07-21T07:36:46.925505+0000","last_active":"2023-07-21T07:36:46.932510+0000","last_peered":"2023-07-21T07:36:46.932510+0000","last_clean":"2023-07-21T07:36:46.932510+0000","last_became_active":"2023-07-21T07:36:46.925207+0000","last_became_peered":"2023-07-21T07:36:46.925207+0000","last_unstale":"2023-07-21T07:36:46.932510+0000","last_undegraded":"2023-07-21T07:36:46.932510+0000","last_fullsized":"2023-07-21T07:36:46.932510+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:49:48.657150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912006+0000","last_change":"2023-07-21T07:36:28.553757+0000","last_active":"2023-07-21T07:36:46.912006+0000","last_peered":"2023-07-21T07:36:46.912006+0000","last_clean":"2023-07-21T07:36:46.912006+0000","last_became_active":"2023-07-21T07:36:28.553520+0000","last_became_peered":"2023-07-21T07:36:28.553520+0000","last_unstale":"2023-07-21T07:36:46.912006+0000","last_undegraded":"2023-07-21T07:36:46.912006+0000","last_fullsized":"2023-07-21T07:36:46.912006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:24:02.750880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.925675+0000","last_change":"2023-07-21T07:36:46.921847+0000","last_active":"2023-07-21T07:36:46.925675+0000","last_peered":"2023-07-21T07:36:46.925675+0000","last_clean":"2023-07-21T07:36:46.925675+0000","last_became_active":"2023-07-21T07:36:46.921538+0000","last_became_peered":"2023-07-21T07:36:46.921538+0000","last_unstale":"2023-07-21T07:36:46.925675+0000","last_undegraded":"2023-07-21T07:36:46.925675+0000","last_fullsized":"2023-07-21T07:36:46.925675+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:44:35.066491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911101+0000","last_change":"2023-07-21T07:36:28.546337+0000","last_active":"2023-07-21T07:36:46.911101+0000","last_peered":"2023-07-21T07:36:46.911101+0000","last_clean":"2023-07-21T07:36:46.911101+0000","last_became_active":"2023-07-21T07:36:28.546061+0000","last_became_peered":"2023-07-21T07:36:28.546061+0000","last_unstale":"2023-07-21T07:36:46.911101+0000","last_undegraded":"2023-07-21T07:36:46.911101+0000","last_fullsized":"2023-07-21T07:36:46.911101+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:54:09.794907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.944497+0000","last_change":"2023-07-21T07:36:46.926794+0000","last_active":"2023-07-21T07:36:46.944497+0000","last_peered":"2023-07-21T07:36:46.944497+0000","last_clean":"2023-07-21T07:36:46.944497+0000","last_became_active":"2023-07-21T07:36:46.926408+0000","last_became_peered":"2023-07-21T07:36:46.926408+0000","last_unstale":"2023-07-21T07:36:46.944497+0000","last_undegraded":"2023-07-21T07:36:46.944497+0000","last_fullsized":"2023-07-21T07:36:46.944497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:27:02.660082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905321+0000","last_change":"2023-07-21T07:36:28.553711+0000","last_active":"2023-07-21T07:36:46.905321+0000","last_peered":"2023-07-21T07:36:46.905321+0000","last_clean":"2023-07-21T07:36:46.905321+0000","last_became_active":"2023-07-21T07:36:28.553426+0000","last_became_peered":"2023-07-21T07:36:28.553426+0000","last_unstale":"2023-07-21T07:36:46.905321+0000","last_undegraded":"2023-07-21T07:36:46.905321+0000","last_fullsized":"2023-07-21T07:36:46.905321+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:24.687597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932812+0000","last_change":"2023-07-21T07:36:46.927835+0000","last_active":"2023-07-21T07:36:46.932812+0000","last_peered":"2023-07-21T07:36:46.932812+0000","last_clean":"2023-07-21T07:36:46.932812+0000","last_became_active":"2023-07-21T07:36:46.927574+0000","last_became_peered":"2023-07-21T07:36:46.927574+0000","last_unstale":"2023-07-21T07:36:46.932812+0000","last_undegraded":"2023-07-21T07:36:46.932812+0000","last_fullsized":"2023-07-21T07:36:46.932812+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:01:03.330143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913970+0000","last_change":"2023-07-21T07:36:28.557219+0000","last_active":"2023-07-21T07:36:46.913970+0000","last_peered":"2023-07-21T07:36:46.913970+0000","last_clean":"2023-07-21T07:36:46.913970+0000","last_became_active":"2023-07-21T07:36:28.556584+0000","last_became_peered":"2023-07-21T07:36:28.556584+0000","last_unstale":"2023-07-21T07:36:46.913970+0000","last_undegraded":"2023-07-21T07:36:46.913970+0000","last_fullsized":"2023-07-21T07:36:46.913970+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:45:36.038414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.917944+0000","last_change":"2023-07-21T07:36:46.914172+0000","last_active":"2023-07-21T07:36:46.917944+0000","last_peered":"2023-07-21T07:36:46.917944+0000","last_clean":"2023-07-21T07:36:46.917944+0000","last_became_active":"2023-07-21T07:36:46.913040+0000","last_became_peered":"2023-07-21T07:36:46.913040+0000","last_unstale":"2023-07-21T07:36:46.917944+0000","last_undegraded":"2023-07-21T07:36:46.917944+0000","last_fullsized":"2023-07-21T07:36:46.917944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:17:13.881677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.943112+0000","last_change":"2023-07-21T07:36:45.913909+0000","last_active":"2023-07-21T07:36:46.943112+0000","last_peered":"2023-07-21T07:36:46.943112+0000","last_clean":"2023-07-21T07:36:46.943112+0000","last_became_active":"2023-07-21T07:36:45.913622+0000","last_became_peered":"2023-07-21T07:36:45.913622+0000","last_unstale":"2023-07-21T07:36:46.943112+0000","last_undegraded":"2023-07-21T07:36:46.943112+0000","last_fullsized":"2023-07-21T07:36:46.943112+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:37:19.528849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.920596+0000","last_change":"2023-07-21T07:36:28.554012+0000","last_active":"2023-07-21T07:36:46.920596+0000","last_peered":"2023-07-21T07:36:46.920596+0000","last_clean":"2023-07-21T07:36:46.920596+0000","last_became_active":"2023-07-21T07:36:28.553737+0000","last_became_peered":"2023-07-21T07:36:28.553737+0000","last_unstale":"2023-07-21T07:36:46.920596+0000","last_undegraded":"2023-07-21T07:36:46.920596+0000","last_fullsized":"2023-07-21T07:36:46.920596+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:22:40.174027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"53'4","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907363+0000","last_change":"2023-07-21T07:36:27.542913+0000","last_active":"2023-07-21T07:36:46.907363+0000","last_peered":"2023-07-21T07:36:46.907363+0000","last_clean":"2023-07-21T07:36:46.907363+0000","last_became_active":"2023-07-21T07:36:27.542352+0000","last_became_peered":"2023-07-21T07:36:27.542352+0000","last_unstale":"2023-07-21T07:36:46.907363+0000","last_undegraded":"2023-07-21T07:36:46.907363+0000","last_fullsized":"2023-07-21T07:36:46.907363+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:54:48.273335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.917897+0000","last_change":"2023-07-21T07:36:46.914406+0000","last_active":"2023-07-21T07:36:46.917897+0000","last_peered":"2023-07-21T07:36:46.917897+0000","last_clean":"2023-07-21T07:36:46.917897+0000","last_became_active":"2023-07-21T07:36:46.913766+0000","last_became_peered":"2023-07-21T07:36:46.913766+0000","last_unstale":"2023-07-21T07:36:46.917897+0000","last_undegraded":"2023-07-21T07:36:46.917897+0000","last_fullsized":"2023-07-21T07:36:46.917897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:10:37.483435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.933020+0000","last_change":"2023-07-21T07:36:45.909492+0000","last_active":"2023-07-21T07:36:46.933020+0000","last_peered":"2023-07-21T07:36:46.933020+0000","last_clean":"2023-07-21T07:36:46.933020+0000","last_became_active":"2023-07-21T07:36:45.909234+0000","last_became_peered":"2023-07-21T07:36:45.909234+0000","last_unstale":"2023-07-21T07:36:46.933020+0000","last_undegraded":"2023-07-21T07:36:46.933020+0000","last_fullsized":"2023-07-21T07:36:46.933020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:44:10.346087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906082+0000","last_change":"2023-07-21T07:36:28.549909+0000","last_active":"2023-07-21T07:36:46.906082+0000","last_peered":"2023-07-21T07:36:46.906082+0000","last_clean":"2023-07-21T07:36:46.906082+0000","last_became_active":"2023-07-21T07:36:28.549643+0000","last_became_peered":"2023-07-21T07:36:28.549643+0000","last_unstale":"2023-07-21T07:36:46.906082+0000","last_undegraded":"2023-07-21T07:36:46.906082+0000","last_fullsized":"2023-07-21T07:36:46.906082+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:48:02.004368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"53'1","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915763+0000","last_change":"2023-07-21T07:36:27.544173+0000","last_active":"2023-07-21T07:36:46.915763+0000","last_peered":"2023-07-21T07:36:46.915763+0000","last_clean":"2023-07-21T07:36:46.915763+0000","last_became_active":"2023-07-21T07:36:27.543806+0000","last_became_peered":"2023-07-21T07:36:27.543806+0000","last_unstale":"2023-07-21T07:36:46.915763+0000","last_undegraded":"2023-07-21T07:36:46.915763+0000","last_fullsized":"2023-07-21T07:36:46.915763+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:54:31.837115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.920234+0000","last_change":"2023-07-21T07:36:46.915860+0000","last_active":"2023-07-21T07:36:46.920234+0000","last_peered":"2023-07-21T07:36:46.920234+0000","last_clean":"2023-07-21T07:36:46.920234+0000","last_became_active":"2023-07-21T07:36:46.915579+0000","last_became_peered":"2023-07-21T07:36:46.915579+0000","last_unstale":"2023-07-21T07:36:46.920234+0000","last_undegraded":"2023-07-21T07:36:46.920234+0000","last_fullsized":"2023-07-21T07:36:46.920234+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:56:08.681349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"57'4","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.941616+0000","last_change":"2023-07-21T07:36:45.912403+0000","last_active":"2023-07-21T07:36:46.941616+0000","last_peered":"2023-07-21T07:36:46.941616+0000","last_clean":"2023-07-21T07:36:46.941616+0000","last_became_active":"2023-07-21T07:36:45.912058+0000","last_became_peered":"2023-07-21T07:36:45.912058+0000","last_unstale":"2023-07-21T07:36:46.941616+0000","last_undegraded":"2023-07-21T07:36:46.941616+0000","last_fullsized":"2023-07-21T07:36:46.941616+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:46:08.990070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915914+0000","last_change":"2023-07-21T07:36:28.553914+0000","last_active":"2023-07-21T07:36:46.915914+0000","last_peered":"2023-07-21T07:36:46.915914+0000","last_clean":"2023-07-21T07:36:46.915914+0000","last_became_active":"2023-07-21T07:36:28.553610+0000","last_became_peered":"2023-07-21T07:36:28.553610+0000","last_unstale":"2023-07-21T07:36:46.915914+0000","last_undegraded":"2023-07-21T07:36:46.915914+0000","last_fullsized":"2023-07-21T07:36:46.915914+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:24:31.633925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"53'2","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913248+0000","last_change":"2023-07-21T07:36:27.548717+0000","last_active":"2023-07-21T07:36:46.913248+0000","last_peered":"2023-07-21T07:36:46.913248+0000","last_clean":"2023-07-21T07:36:46.913248+0000","last_became_active":"2023-07-21T07:36:27.548229+0000","last_became_peered":"2023-07-21T07:36:27.548229+0000","last_unstale":"2023-07-21T07:36:46.913248+0000","last_undegraded":"2023-07-21T07:36:46.913248+0000","last_fullsized":"2023-07-21T07:36:46.913248+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:15:15.775784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932224+0000","last_change":"2023-07-21T07:36:46.920123+0000","last_active":"2023-07-21T07:36:46.932224+0000","last_peered":"2023-07-21T07:36:46.932224+0000","last_clean":"2023-07-21T07:36:46.932224+0000","last_became_active":"2023-07-21T07:36:46.919800+0000","last_became_peered":"2023-07-21T07:36:46.919800+0000","last_unstale":"2023-07-21T07:36:46.932224+0000","last_undegraded":"2023-07-21T07:36:46.932224+0000","last_fullsized":"2023-07-21T07:36:46.932224+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:11:41.659131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938816+0000","last_change":"2023-07-21T07:36:45.914046+0000","last_active":"2023-07-21T07:36:46.938816+0000","last_peered":"2023-07-21T07:36:46.938816+0000","last_clean":"2023-07-21T07:36:46.938816+0000","last_became_active":"2023-07-21T07:36:45.913746+0000","last_became_peered":"2023-07-21T07:36:45.913746+0000","last_unstale":"2023-07-21T07:36:46.938816+0000","last_undegraded":"2023-07-21T07:36:46.938816+0000","last_fullsized":"2023-07-21T07:36:46.938816+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:39:36.356734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914914+0000","last_change":"2023-07-21T07:36:28.551204+0000","last_active":"2023-07-21T07:36:46.914914+0000","last_peered":"2023-07-21T07:36:46.914914+0000","last_clean":"2023-07-21T07:36:46.914914+0000","last_became_active":"2023-07-21T07:36:28.550896+0000","last_became_peered":"2023-07-21T07:36:28.550896+0000","last_unstale":"2023-07-21T07:36:46.914914+0000","last_undegraded":"2023-07-21T07:36:46.914914+0000","last_fullsized":"2023-07-21T07:36:46.914914+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:04:08.888934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"53'2","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914550+0000","last_change":"2023-07-21T07:36:27.550565+0000","last_active":"2023-07-21T07:36:46.914550+0000","last_peered":"2023-07-21T07:36:46.914550+0000","last_clean":"2023-07-21T07:36:46.914550+0000","last_became_active":"2023-07-21T07:36:27.550235+0000","last_became_peered":"2023-07-21T07:36:27.550235+0000","last_unstale":"2023-07-21T07:36:46.914550+0000","last_undegraded":"2023-07-21T07:36:46.914550+0000","last_fullsized":"2023-07-21T07:36:46.914550+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:16:55.790478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915134+0000","last_change":"2023-07-21T07:36:46.911104+0000","last_active":"2023-07-21T07:36:46.915134+0000","last_peered":"2023-07-21T07:36:46.915134+0000","last_clean":"2023-07-21T07:36:46.915134+0000","last_became_active":"2023-07-21T07:36:46.910615+0000","last_became_peered":"2023-07-21T07:36:46.910615+0000","last_unstale":"2023-07-21T07:36:46.915134+0000","last_undegraded":"2023-07-21T07:36:46.915134+0000","last_fullsized":"2023-07-21T07:36:46.915134+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:45:42.579561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914115+0000","last_change":"2023-07-21T07:36:45.908037+0000","last_active":"2023-07-21T07:36:46.914115+0000","last_peered":"2023-07-21T07:36:46.914115+0000","last_clean":"2023-07-21T07:36:46.914115+0000","last_became_active":"2023-07-21T07:36:45.907753+0000","last_became_peered":"2023-07-21T07:36:45.907753+0000","last_unstale":"2023-07-21T07:36:46.914115+0000","last_undegraded":"2023-07-21T07:36:46.914115+0000","last_fullsized":"2023-07-21T07:36:46.914115+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:57:16.424489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911209+0000","last_change":"2023-07-21T07:36:28.564622+0000","last_active":"2023-07-21T07:36:46.911209+0000","last_peered":"2023-07-21T07:36:46.911209+0000","last_clean":"2023-07-21T07:36:46.911209+0000","last_became_active":"2023-07-21T07:36:28.564322+0000","last_became_peered":"2023-07-21T07:36:28.564322+0000","last_unstale":"2023-07-21T07:36:46.911209+0000","last_undegraded":"2023-07-21T07:36:46.911209+0000","last_fullsized":"2023-07-21T07:36:46.911209+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:55.153453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"53'1","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905173+0000","last_change":"2023-07-21T07:36:27.548030+0000","last_active":"2023-07-21T07:36:46.905173+0000","last_peered":"2023-07-21T07:36:46.905173+0000","last_clean":"2023-07-21T07:36:46.905173+0000","last_became_active":"2023-07-21T07:36:27.547734+0000","last_became_peered":"2023-07-21T07:36:27.547734+0000","last_unstale":"2023-07-21T07:36:46.905173+0000","last_undegraded":"2023-07-21T07:36:46.905173+0000","last_fullsized":"2023-07-21T07:36:46.905173+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:32:20.547301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.939921+0000","last_change":"2023-07-21T07:36:46.938741+0000","last_active":"2023-07-21T07:36:46.939921+0000","last_peered":"2023-07-21T07:36:46.939921+0000","last_clean":"2023-07-21T07:36:46.939921+0000","last_became_active":"2023-07-21T07:36:46.938457+0000","last_became_peered":"2023-07-21T07:36:46.938457+0000","last_unstale":"2023-07-21T07:36:46.939921+0000","last_undegraded":"2023-07-21T07:36:46.939921+0000","last_fullsized":"2023-07-21T07:36:46.939921+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:10:44.421155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.910892+0000","last_change":"2023-07-21T07:36:45.901685+0000","last_active":"2023-07-21T07:36:46.910892+0000","last_peered":"2023-07-21T07:36:46.910892+0000","last_clean":"2023-07-21T07:36:46.910892+0000","last_became_active":"2023-07-21T07:36:45.901385+0000","last_became_peered":"2023-07-21T07:36:45.901385+0000","last_unstale":"2023-07-21T07:36:46.910892+0000","last_undegraded":"2023-07-21T07:36:46.910892+0000","last_fullsized":"2023-07-21T07:36:46.910892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:20:30.015376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904853+0000","last_change":"2023-07-21T07:36:28.561529+0000","last_active":"2023-07-21T07:36:46.904853+0000","last_peered":"2023-07-21T07:36:46.904853+0000","last_clean":"2023-07-21T07:36:46.904853+0000","last_became_active":"2023-07-21T07:36:28.561238+0000","last_became_peered":"2023-07-21T07:36:28.561238+0000","last_unstale":"2023-07-21T07:36:46.904853+0000","last_undegraded":"2023-07-21T07:36:46.904853+0000","last_fullsized":"2023-07-21T07:36:46.904853+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:08:56.057233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"53'1","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905528+0000","last_change":"2023-07-21T07:36:27.543128+0000","last_active":"2023-07-21T07:36:46.905528+0000","last_peered":"2023-07-21T07:36:46.905528+0000","last_clean":"2023-07-21T07:36:46.905528+0000","last_became_active":"2023-07-21T07:36:27.542777+0000","last_became_peered":"2023-07-21T07:36:27.542777+0000","last_unstale":"2023-07-21T07:36:46.905528+0000","last_undegraded":"2023-07-21T07:36:46.905528+0000","last_fullsized":"2023-07-21T07:36:46.905528+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:41:38.262822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.941319+0000","last_change":"2023-07-21T07:36:46.938955+0000","last_active":"2023-07-21T07:36:46.941319+0000","last_peered":"2023-07-21T07:36:46.941319+0000","last_clean":"2023-07-21T07:36:46.941319+0000","last_became_active":"2023-07-21T07:36:46.938688+0000","last_became_peered":"2023-07-21T07:36:46.938688+0000","last_unstale":"2023-07-21T07:36:46.941319+0000","last_undegraded":"2023-07-21T07:36:46.941319+0000","last_fullsized":"2023-07-21T07:36:46.941319+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:50:05.920137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.935496+0000","last_change":"2023-07-21T07:36:45.912305+0000","last_active":"2023-07-21T07:36:46.935496+0000","last_peered":"2023-07-21T07:36:46.935496+0000","last_clean":"2023-07-21T07:36:46.935496+0000","last_became_active":"2023-07-21T07:36:45.912005+0000","last_became_peered":"2023-07-21T07:36:45.912005+0000","last_unstale":"2023-07-21T07:36:46.935496+0000","last_undegraded":"2023-07-21T07:36:46.935496+0000","last_fullsized":"2023-07-21T07:36:46.935496+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:13:29.344323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915602+0000","last_change":"2023-07-21T07:36:28.552687+0000","last_active":"2023-07-21T07:36:46.915602+0000","last_peered":"2023-07-21T07:36:46.915602+0000","last_clean":"2023-07-21T07:36:46.915602+0000","last_became_active":"2023-07-21T07:36:28.552238+0000","last_became_peered":"2023-07-21T07:36:28.552238+0000","last_unstale":"2023-07-21T07:36:46.915602+0000","last_undegraded":"2023-07-21T07:36:46.915602+0000","last_fullsized":"2023-07-21T07:36:46.915602+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:31:51.872997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906653+0000","last_change":"2023-07-21T07:36:27.545649+0000","last_active":"2023-07-21T07:36:46.906653+0000","last_peered":"2023-07-21T07:36:46.906653+0000","last_clean":"2023-07-21T07:36:46.906653+0000","last_became_active":"2023-07-21T07:36:27.545358+0000","last_became_peered":"2023-07-21T07:36:27.545358+0000","last_unstale":"2023-07-21T07:36:46.906653+0000","last_undegraded":"2023-07-21T07:36:46.906653+0000","last_fullsized":"2023-07-21T07:36:46.906653+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:58:26.522998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.944243+0000","last_change":"2023-07-21T07:36:46.943327+0000","last_active":"2023-07-21T07:36:46.944243+0000","last_peered":"2023-07-21T07:36:46.944243+0000","last_clean":"2023-07-21T07:36:46.944243+0000","last_became_active":"2023-07-21T07:36:46.942960+0000","last_became_peered":"2023-07-21T07:36:46.942960+0000","last_unstale":"2023-07-21T07:36:46.944243+0000","last_undegraded":"2023-07-21T07:36:46.944243+0000","last_fullsized":"2023-07-21T07:36:46.944243+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:49:26.415109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938384+0000","last_change":"2023-07-21T07:36:45.913557+0000","last_active":"2023-07-21T07:36:46.938384+0000","last_peered":"2023-07-21T07:36:46.938384+0000","last_clean":"2023-07-21T07:36:46.938384+0000","last_became_active":"2023-07-21T07:36:45.913101+0000","last_became_peered":"2023-07-21T07:36:45.913101+0000","last_unstale":"2023-07-21T07:36:46.938384+0000","last_undegraded":"2023-07-21T07:36:46.938384+0000","last_fullsized":"2023-07-21T07:36:46.938384+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:13:41.736364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905002+0000","last_change":"2023-07-21T07:36:28.551678+0000","last_active":"2023-07-21T07:36:46.905002+0000","last_peered":"2023-07-21T07:36:46.905002+0000","last_clean":"2023-07-21T07:36:46.905002+0000","last_became_active":"2023-07-21T07:36:28.551150+0000","last_became_peered":"2023-07-21T07:36:28.551150+0000","last_unstale":"2023-07-21T07:36:46.905002+0000","last_undegraded":"2023-07-21T07:36:46.905002+0000","last_fullsized":"2023-07-21T07:36:46.905002+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:49:08.050691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.916414+0000","last_change":"2023-07-21T07:36:27.549188+0000","last_active":"2023-07-21T07:36:46.916414+0000","last_peered":"2023-07-21T07:36:46.916414+0000","last_clean":"2023-07-21T07:36:46.916414+0000","last_became_active":"2023-07-21T07:36:27.548866+0000","last_became_peered":"2023-07-21T07:36:27.548866+0000","last_unstale":"2023-07-21T07:36:46.916414+0000","last_undegraded":"2023-07-21T07:36:46.916414+0000","last_fullsized":"2023-07-21T07:36:46.916414+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:47:05.576287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.922808+0000","last_change":"2023-07-21T07:36:46.911238+0000","last_active":"2023-07-21T07:36:46.922808+0000","last_peered":"2023-07-21T07:36:46.922808+0000","last_clean":"2023-07-21T07:36:46.922808+0000","last_became_active":"2023-07-21T07:36:46.910958+0000","last_became_peered":"2023-07-21T07:36:46.910958+0000","last_unstale":"2023-07-21T07:36:46.922808+0000","last_undegraded":"2023-07-21T07:36:46.922808+0000","last_fullsized":"2023-07-21T07:36:46.922808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:40:32.179748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"57'3","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.942214+0000","last_change":"2023-07-21T07:36:45.908665+0000","last_active":"2023-07-21T07:36:46.942214+0000","last_peered":"2023-07-21T07:36:46.942214+0000","last_clean":"2023-07-21T07:36:46.942214+0000","last_became_active":"2023-07-21T07:36:45.908321+0000","last_became_peered":"2023-07-21T07:36:45.908321+0000","last_unstale":"2023-07-21T07:36:46.942214+0000","last_undegraded":"2023-07-21T07:36:46.942214+0000","last_fullsized":"2023-07-21T07:36:46.942214+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:16:16.179184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907038+0000","last_change":"2023-07-21T07:36:28.561022+0000","last_active":"2023-07-21T07:36:46.907038+0000","last_peered":"2023-07-21T07:36:46.907038+0000","last_clean":"2023-07-21T07:36:46.907038+0000","last_became_active":"2023-07-21T07:36:28.560541+0000","last_became_peered":"2023-07-21T07:36:28.560541+0000","last_unstale":"2023-07-21T07:36:46.907038+0000","last_undegraded":"2023-07-21T07:36:46.907038+0000","last_fullsized":"2023-07-21T07:36:46.907038+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:51:47.425948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914646+0000","last_change":"2023-07-21T07:36:27.541612+0000","last_active":"2023-07-21T07:36:46.914646+0000","last_peered":"2023-07-21T07:36:46.914646+0000","last_clean":"2023-07-21T07:36:46.914646+0000","last_became_active":"2023-07-21T07:36:27.541373+0000","last_became_peered":"2023-07-21T07:36:27.541373+0000","last_unstale":"2023-07-21T07:36:46.914646+0000","last_undegraded":"2023-07-21T07:36:46.914646+0000","last_fullsized":"2023-07-21T07:36:46.914646+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:01:56.804032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.940960+0000","last_change":"2023-07-21T07:36:46.938540+0000","last_active":"2023-07-21T07:36:46.940960+0000","last_peered":"2023-07-21T07:36:46.940960+0000","last_clean":"2023-07-21T07:36:46.940960+0000","last_became_active":"2023-07-21T07:36:46.938198+0000","last_became_peered":"2023-07-21T07:36:46.938198+0000","last_unstale":"2023-07-21T07:36:46.940960+0000","last_undegraded":"2023-07-21T07:36:46.940960+0000","last_fullsized":"2023-07-21T07:36:46.940960+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:35:35.671358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"57'6","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.939933+0000","last_change":"2023-07-21T07:36:45.900626+0000","last_active":"2023-07-21T07:36:46.939933+0000","last_peered":"2023-07-21T07:36:46.939933+0000","last_clean":"2023-07-21T07:36:46.939933+0000","last_became_active":"2023-07-21T07:36:45.900367+0000","last_became_peered":"2023-07-21T07:36:45.900367+0000","last_unstale":"2023-07-21T07:36:46.939933+0000","last_undegraded":"2023-07-21T07:36:46.939933+0000","last_fullsized":"2023-07-21T07:36:46.939933+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:33:45.465886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904426+0000","last_change":"2023-07-21T07:36:28.547366+0000","last_active":"2023-07-21T07:36:46.904426+0000","last_peered":"2023-07-21T07:36:46.904426+0000","last_clean":"2023-07-21T07:36:46.904426+0000","last_became_active":"2023-07-21T07:36:28.547029+0000","last_became_peered":"2023-07-21T07:36:28.547029+0000","last_unstale":"2023-07-21T07:36:46.904426+0000","last_undegraded":"2023-07-21T07:36:46.904426+0000","last_fullsized":"2023-07-21T07:36:46.904426+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:49:33.261990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906459+0000","last_change":"2023-07-21T07:36:27.547744+0000","last_active":"2023-07-21T07:36:46.906459+0000","last_peered":"2023-07-21T07:36:46.906459+0000","last_clean":"2023-07-21T07:36:46.906459+0000","last_became_active":"2023-07-21T07:36:27.547463+0000","last_became_peered":"2023-07-21T07:36:27.547463+0000","last_unstale":"2023-07-21T07:36:46.906459+0000","last_undegraded":"2023-07-21T07:36:46.906459+0000","last_fullsized":"2023-07-21T07:36:46.906459+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:04:47.446026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.936711+0000","last_change":"2023-07-21T07:36:46.921997+0000","last_active":"2023-07-21T07:36:46.936711+0000","last_peered":"2023-07-21T07:36:46.936711+0000","last_clean":"2023-07-21T07:36:46.936711+0000","last_became_active":"2023-07-21T07:36:46.921703+0000","last_became_peered":"2023-07-21T07:36:46.921703+0000","last_unstale":"2023-07-21T07:36:46.936711+0000","last_undegraded":"2023-07-21T07:36:46.936711+0000","last_fullsized":"2023-07-21T07:36:46.936711+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:32:39.917192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914405+0000","last_change":"2023-07-21T07:36:45.915581+0000","last_active":"2023-07-21T07:36:46.914405+0000","last_peered":"2023-07-21T07:36:46.914405+0000","last_clean":"2023-07-21T07:36:46.914405+0000","last_became_active":"2023-07-21T07:36:45.915296+0000","last_became_peered":"2023-07-21T07:36:45.915296+0000","last_unstale":"2023-07-21T07:36:46.914405+0000","last_undegraded":"2023-07-21T07:36:46.914405+0000","last_fullsized":"2023-07-21T07:36:46.914405+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:34.457862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.920489+0000","last_change":"2023-07-21T07:36:28.542046+0000","last_active":"2023-07-21T07:36:46.920489+0000","last_peered":"2023-07-21T07:36:46.920489+0000","last_clean":"2023-07-21T07:36:46.920489+0000","last_became_active":"2023-07-21T07:36:28.541690+0000","last_became_peered":"2023-07-21T07:36:28.541690+0000","last_unstale":"2023-07-21T07:36:46.920489+0000","last_undegraded":"2023-07-21T07:36:46.920489+0000","last_fullsized":"2023-07-21T07:36:46.920489+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:14:51.106285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"53'3","reported_seq":22,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914129+0000","last_change":"2023-07-21T07:36:27.542236+0000","last_active":"2023-07-21T07:36:46.914129+0000","last_peered":"2023-07-21T07:36:46.914129+0000","last_clean":"2023-07-21T07:36:46.914129+0000","last_became_active":"2023-07-21T07:36:27.541799+0000","last_became_peered":"2023-07-21T07:36:27.541799+0000","last_unstale":"2023-07-21T07:36:46.914129+0000","last_undegraded":"2023-07-21T07:36:46.914129+0000","last_fullsized":"2023-07-21T07:36:46.914129+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:48:31.993058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.922601+0000","last_change":"2023-07-21T07:36:46.917096+0000","last_active":"2023-07-21T07:36:46.922601+0000","last_peered":"2023-07-21T07:36:46.922601+0000","last_clean":"2023-07-21T07:36:46.922601+0000","last_became_active":"2023-07-21T07:36:46.916811+0000","last_became_peered":"2023-07-21T07:36:46.916811+0000","last_unstale":"2023-07-21T07:36:46.922601+0000","last_undegraded":"2023-07-21T07:36:46.922601+0000","last_fullsized":"2023-07-21T07:36:46.922601+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:33:39.431098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915205+0000","last_change":"2023-07-21T07:36:45.908177+0000","last_active":"2023-07-21T07:36:46.915205+0000","last_peered":"2023-07-21T07:36:46.915205+0000","last_clean":"2023-07-21T07:36:46.915205+0000","last_became_active":"2023-07-21T07:36:45.907636+0000","last_became_peered":"2023-07-21T07:36:45.907636+0000","last_unstale":"2023-07-21T07:36:46.915205+0000","last_undegraded":"2023-07-21T07:36:46.915205+0000","last_fullsized":"2023-07-21T07:36:46.915205+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:34.457862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906547+0000","last_change":"2023-07-21T07:36:28.555407+0000","last_active":"2023-07-21T07:36:46.906547+0000","last_peered":"2023-07-21T07:36:46.906547+0000","last_clean":"2023-07-21T07:36:46.906547+0000","last_became_active":"2023-07-21T07:36:28.552229+0000","last_became_peered":"2023-07-21T07:36:28.552229+0000","last_unstale":"2023-07-21T07:36:46.906547+0000","last_undegraded":"2023-07-21T07:36:46.906547+0000","last_fullsized":"2023-07-21T07:36:46.906547+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:29:23.804284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"54'8","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907229+0000","last_change":"2023-07-21T07:36:27.546185+0000","last_active":"2023-07-21T07:36:46.907229+0000","last_peered":"2023-07-21T07:36:46.907229+0000","last_clean":"2023-07-21T07:36:46.907229+0000","last_became_active":"2023-07-21T07:36:27.545925+0000","last_became_peered":"2023-07-21T07:36:27.545925+0000","last_unstale":"2023-07-21T07:36:46.907229+0000","last_undegraded":"2023-07-21T07:36:46.907229+0000","last_fullsized":"2023-07-21T07:36:46.907229+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:12:01.355660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938655+0000","last_change":"2023-07-21T07:36:46.929136+0000","last_active":"2023-07-21T07:36:46.938655+0000","last_peered":"2023-07-21T07:36:46.938655+0000","last_clean":"2023-07-21T07:36:46.938655+0000","last_became_active":"2023-07-21T07:36:46.928864+0000","last_became_peered":"2023-07-21T07:36:46.928864+0000","last_unstale":"2023-07-21T07:36:46.938655+0000","last_undegraded":"2023-07-21T07:36:46.938655+0000","last_fullsized":"2023-07-21T07:36:46.938655+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:57:35.868513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.909034+0000","last_change":"2023-07-21T07:36:45.912368+0000","last_active":"2023-07-21T07:36:46.909034+0000","last_peered":"2023-07-21T07:36:46.909034+0000","last_clean":"2023-07-21T07:36:46.909034+0000","last_became_active":"2023-07-21T07:36:45.912044+0000","last_became_peered":"2023-07-21T07:36:45.912044+0000","last_unstale":"2023-07-21T07:36:46.909034+0000","last_undegraded":"2023-07-21T07:36:46.909034+0000","last_fullsized":"2023-07-21T07:36:46.909034+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:36:27.392107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904968+0000","last_change":"2023-07-21T07:36:28.549175+0000","last_active":"2023-07-21T07:36:46.904968+0000","last_peered":"2023-07-21T07:36:46.904968+0000","last_clean":"2023-07-21T07:36:46.904968+0000","last_became_active":"2023-07-21T07:36:28.548904+0000","last_became_peered":"2023-07-21T07:36:28.548904+0000","last_unstale":"2023-07-21T07:36:46.904968+0000","last_undegraded":"2023-07-21T07:36:46.904968+0000","last_fullsized":"2023-07-21T07:36:46.904968+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:28:58.739292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"53'2","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913664+0000","last_change":"2023-07-21T07:36:27.544775+0000","last_active":"2023-07-21T07:36:46.913664+0000","last_peered":"2023-07-21T07:36:46.913664+0000","last_clean":"2023-07-21T07:36:46.913664+0000","last_became_active":"2023-07-21T07:36:27.544495+0000","last_became_peered":"2023-07-21T07:36:27.544495+0000","last_unstale":"2023-07-21T07:36:46.913664+0000","last_undegraded":"2023-07-21T07:36:46.913664+0000","last_fullsized":"2023-07-21T07:36:46.913664+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:05:27.853733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938955+0000","last_change":"2023-07-21T07:36:46.929448+0000","last_active":"2023-07-21T07:36:46.938955+0000","last_peered":"2023-07-21T07:36:46.938955+0000","last_clean":"2023-07-21T07:36:46.938955+0000","last_became_active":"2023-07-21T07:36:46.929148+0000","last_became_peered":"2023-07-21T07:36:46.929148+0000","last_unstale":"2023-07-21T07:36:46.938955+0000","last_undegraded":"2023-07-21T07:36:46.938955+0000","last_fullsized":"2023-07-21T07:36:46.938955+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:53.348683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"57'8","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.941039+0000","last_change":"2023-07-21T07:36:45.905226+0000","last_active":"2023-07-21T07:36:46.941039+0000","last_peered":"2023-07-21T07:36:46.941039+0000","last_clean":"2023-07-21T07:36:46.941039+0000","last_became_active":"2023-07-21T07:36:45.904788+0000","last_became_peered":"2023-07-21T07:36:45.904788+0000","last_unstale":"2023-07-21T07:36:46.941039+0000","last_undegraded":"2023-07-21T07:36:46.941039+0000","last_fullsized":"2023-07-21T07:36:46.941039+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:45:53.791995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911814+0000","last_change":"2023-07-21T07:36:28.553926+0000","last_active":"2023-07-21T07:36:46.911814+0000","last_peered":"2023-07-21T07:36:46.911814+0000","last_clean":"2023-07-21T07:36:46.911814+0000","last_became_active":"2023-07-21T07:36:28.551968+0000","last_became_peered":"2023-07-21T07:36:28.551968+0000","last_unstale":"2023-07-21T07:36:46.911814+0000","last_undegraded":"2023-07-21T07:36:46.911814+0000","last_fullsized":"2023-07-21T07:36:46.911814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:29:18.047828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911198+0000","last_change":"2023-07-21T07:36:27.550743+0000","last_active":"2023-07-21T07:36:46.911198+0000","last_peered":"2023-07-21T07:36:46.911198+0000","last_clean":"2023-07-21T07:36:46.911198+0000","last_became_active":"2023-07-21T07:36:27.550521+0000","last_became_peered":"2023-07-21T07:36:27.550521+0000","last_unstale":"2023-07-21T07:36:46.911198+0000","last_undegraded":"2023-07-21T07:36:46.911198+0000","last_fullsized":"2023-07-21T07:36:46.911198+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:03:43.154046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.928081+0000","last_change":"2023-07-21T07:36:46.924125+0000","last_active":"2023-07-21T07:36:46.928081+0000","last_peered":"2023-07-21T07:36:46.928081+0000","last_clean":"2023-07-21T07:36:46.928081+0000","last_became_active":"2023-07-21T07:36:46.923846+0000","last_became_peered":"2023-07-21T07:36:46.923846+0000","last_unstale":"2023-07-21T07:36:46.928081+0000","last_undegraded":"2023-07-21T07:36:46.928081+0000","last_fullsized":"2023-07-21T07:36:46.928081+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:25:23.390482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938850+0000","last_change":"2023-07-21T07:36:45.906228+0000","last_active":"2023-07-21T07:36:46.938850+0000","last_peered":"2023-07-21T07:36:46.938850+0000","last_clean":"2023-07-21T07:36:46.938850+0000","last_became_active":"2023-07-21T07:36:45.905786+0000","last_became_peered":"2023-07-21T07:36:45.905786+0000","last_unstale":"2023-07-21T07:36:46.938850+0000","last_undegraded":"2023-07-21T07:36:46.938850+0000","last_fullsized":"2023-07-21T07:36:46.938850+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:08:44.625597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915416+0000","last_change":"2023-07-21T07:36:28.555482+0000","last_active":"2023-07-21T07:36:46.915416+0000","last_peered":"2023-07-21T07:36:46.915416+0000","last_clean":"2023-07-21T07:36:46.915416+0000","last_became_active":"2023-07-21T07:36:28.554468+0000","last_became_peered":"2023-07-21T07:36:28.554468+0000","last_unstale":"2023-07-21T07:36:46.915416+0000","last_undegraded":"2023-07-21T07:36:46.915416+0000","last_fullsized":"2023-07-21T07:36:46.915416+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:13:46.845837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911396+0000","last_change":"2023-07-21T07:36:27.542687+0000","last_active":"2023-07-21T07:36:46.911396+0000","last_peered":"2023-07-21T07:36:46.911396+0000","last_clean":"2023-07-21T07:36:46.911396+0000","last_became_active":"2023-07-21T07:36:27.542483+0000","last_became_peered":"2023-07-21T07:36:27.542483+0000","last_unstale":"2023-07-21T07:36:46.911396+0000","last_undegraded":"2023-07-21T07:36:46.911396+0000","last_fullsized":"2023-07-21T07:36:46.911396+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:54:08.789435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932382+0000","last_change":"2023-07-21T07:36:46.926213+0000","last_active":"2023-07-21T07:36:46.932382+0000","last_peered":"2023-07-21T07:36:46.932382+0000","last_clean":"2023-07-21T07:36:46.932382+0000","last_became_active":"2023-07-21T07:36:46.925900+0000","last_became_peered":"2023-07-21T07:36:46.925900+0000","last_unstale":"2023-07-21T07:36:46.932382+0000","last_undegraded":"2023-07-21T07:36:46.932382+0000","last_fullsized":"2023-07-21T07:36:46.932382+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:14:35.977107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911671+0000","last_change":"2023-07-21T07:36:45.912078+0000","last_active":"2023-07-21T07:36:46.911671+0000","last_peered":"2023-07-21T07:36:46.911671+0000","last_clean":"2023-07-21T07:36:46.911671+0000","last_became_active":"2023-07-21T07:36:45.911771+0000","last_became_peered":"2023-07-21T07:36:45.911771+0000","last_unstale":"2023-07-21T07:36:46.911671+0000","last_undegraded":"2023-07-21T07:36:46.911671+0000","last_fullsized":"2023-07-21T07:36:46.911671+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:04:01.517310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906824+0000","last_change":"2023-07-21T07:36:28.546081+0000","last_active":"2023-07-21T07:36:46.906824+0000","last_peered":"2023-07-21T07:36:46.906824+0000","last_clean":"2023-07-21T07:36:46.906824+0000","last_became_active":"2023-07-21T07:36:28.545781+0000","last_became_peered":"2023-07-21T07:36:28.545781+0000","last_unstale":"2023-07-21T07:36:46.906824+0000","last_undegraded":"2023-07-21T07:36:46.906824+0000","last_fullsized":"2023-07-21T07:36:46.906824+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:05:32.290531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'8","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905041+0000","last_change":"2023-07-21T07:36:27.549363+0000","last_active":"2023-07-21T07:36:46.905041+0000","last_peered":"2023-07-21T07:36:46.905041+0000","last_clean":"2023-07-21T07:36:46.905041+0000","last_became_active":"2023-07-21T07:36:27.548945+0000","last_became_peered":"2023-07-21T07:36:27.548945+0000","last_unstale":"2023-07-21T07:36:46.905041+0000","last_undegraded":"2023-07-21T07:36:46.905041+0000","last_fullsized":"2023-07-21T07:36:46.905041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:19:21.744719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.917925+0000","last_change":"2023-07-21T07:36:46.913112+0000","last_active":"2023-07-21T07:36:46.917925+0000","last_peered":"2023-07-21T07:36:46.917925+0000","last_clean":"2023-07-21T07:36:46.917925+0000","last_became_active":"2023-07-21T07:36:46.912683+0000","last_became_peered":"2023-07-21T07:36:46.912683+0000","last_unstale":"2023-07-21T07:36:46.917925+0000","last_undegraded":"2023-07-21T07:36:46.917925+0000","last_fullsized":"2023-07-21T07:36:46.917925+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:34.821586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914094+0000","last_change":"2023-07-21T07:36:45.915569+0000","last_active":"2023-07-21T07:36:46.914094+0000","last_peered":"2023-07-21T07:36:46.914094+0000","last_clean":"2023-07-21T07:36:46.914094+0000","last_became_active":"2023-07-21T07:36:45.915252+0000","last_became_peered":"2023-07-21T07:36:45.915252+0000","last_unstale":"2023-07-21T07:36:46.914094+0000","last_undegraded":"2023-07-21T07:36:46.914094+0000","last_fullsized":"2023-07-21T07:36:46.914094+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:01:52.951579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914743+0000","last_change":"2023-07-21T07:36:28.551178+0000","last_active":"2023-07-21T07:36:46.914743+0000","last_peered":"2023-07-21T07:36:46.914743+0000","last_clean":"2023-07-21T07:36:46.914743+0000","last_became_active":"2023-07-21T07:36:28.550868+0000","last_became_peered":"2023-07-21T07:36:28.550868+0000","last_unstale":"2023-07-21T07:36:46.914743+0000","last_undegraded":"2023-07-21T07:36:46.914743+0000","last_fullsized":"2023-07-21T07:36:46.914743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:56:51.273123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"53'2","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912159+0000","last_change":"2023-07-21T07:36:27.550087+0000","last_active":"2023-07-21T07:36:46.912159+0000","last_peered":"2023-07-21T07:36:46.912159+0000","last_clean":"2023-07-21T07:36:46.912159+0000","last_became_active":"2023-07-21T07:36:27.549834+0000","last_became_peered":"2023-07-21T07:36:27.549834+0000","last_unstale":"2023-07-21T07:36:46.912159+0000","last_undegraded":"2023-07-21T07:36:46.912159+0000","last_fullsized":"2023-07-21T07:36:46.912159+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:37:01.165584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.937812+0000","last_change":"2023-07-21T07:36:46.926262+0000","last_active":"2023-07-21T07:36:46.937812+0000","last_peered":"2023-07-21T07:36:46.937812+0000","last_clean":"2023-07-21T07:36:46.937812+0000","last_became_active":"2023-07-21T07:36:46.925980+0000","last_became_peered":"2023-07-21T07:36:46.925980+0000","last_unstale":"2023-07-21T07:36:46.937812+0000","last_undegraded":"2023-07-21T07:36:46.937812+0000","last_fullsized":"2023-07-21T07:36:46.937812+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:58:37.500627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911962+0000","last_change":"2023-07-21T07:36:45.912625+0000","last_active":"2023-07-21T07:36:46.911962+0000","last_peered":"2023-07-21T07:36:46.911962+0000","last_clean":"2023-07-21T07:36:46.911962+0000","last_became_active":"2023-07-21T07:36:45.912346+0000","last_became_peered":"2023-07-21T07:36:45.912346+0000","last_unstale":"2023-07-21T07:36:46.911962+0000","last_undegraded":"2023-07-21T07:36:46.911962+0000","last_fullsized":"2023-07-21T07:36:46.911962+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:27:06.382716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915995+0000","last_change":"2023-07-21T07:36:28.554479+0000","last_active":"2023-07-21T07:36:46.915995+0000","last_peered":"2023-07-21T07:36:46.915995+0000","last_clean":"2023-07-21T07:36:46.915995+0000","last_became_active":"2023-07-21T07:36:28.554145+0000","last_became_peered":"2023-07-21T07:36:28.554145+0000","last_unstale":"2023-07-21T07:36:46.915995+0000","last_undegraded":"2023-07-21T07:36:46.915995+0000","last_fullsized":"2023-07-21T07:36:46.915995+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:34:55.973265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'1","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912580+0000","last_change":"2023-07-21T07:36:27.545216+0000","last_active":"2023-07-21T07:36:46.912580+0000","last_peered":"2023-07-21T07:36:46.912580+0000","last_clean":"2023-07-21T07:36:46.912580+0000","last_became_active":"2023-07-21T07:36:27.544952+0000","last_became_peered":"2023-07-21T07:36:27.544952+0000","last_unstale":"2023-07-21T07:36:46.912580+0000","last_undegraded":"2023-07-21T07:36:46.912580+0000","last_fullsized":"2023-07-21T07:36:46.912580+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:21:54.511486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932809+0000","last_change":"2023-07-21T07:36:46.926727+0000","last_active":"2023-07-21T07:36:46.932809+0000","last_peered":"2023-07-21T07:36:46.932809+0000","last_clean":"2023-07-21T07:36:46.932809+0000","last_became_active":"2023-07-21T07:36:46.926439+0000","last_became_peered":"2023-07-21T07:36:46.926439+0000","last_unstale":"2023-07-21T07:36:46.932809+0000","last_undegraded":"2023-07-21T07:36:46.932809+0000","last_fullsized":"2023-07-21T07:36:46.932809+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:08.986337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938415+0000","last_change":"2023-07-21T07:36:45.908888+0000","last_active":"2023-07-21T07:36:46.938415+0000","last_peered":"2023-07-21T07:36:46.938415+0000","last_clean":"2023-07-21T07:36:46.938415+0000","last_became_active":"2023-07-21T07:36:45.908578+0000","last_became_peered":"2023-07-21T07:36:45.908578+0000","last_unstale":"2023-07-21T07:36:46.938415+0000","last_undegraded":"2023-07-21T07:36:46.938415+0000","last_fullsized":"2023-07-21T07:36:46.938415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:36.656580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912441+0000","last_change":"2023-07-21T07:36:28.554762+0000","last_active":"2023-07-21T07:36:46.912441+0000","last_peered":"2023-07-21T07:36:46.912441+0000","last_clean":"2023-07-21T07:36:46.912441+0000","last_became_active":"2023-07-21T07:36:28.554473+0000","last_became_peered":"2023-07-21T07:36:28.554473+0000","last_unstale":"2023-07-21T07:36:46.912441+0000","last_undegraded":"2023-07-21T07:36:46.912441+0000","last_fullsized":"2023-07-21T07:36:46.912441+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:48:32.998531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913808+0000","last_change":"2023-07-21T07:36:27.548955+0000","last_active":"2023-07-21T07:36:46.913808+0000","last_peered":"2023-07-21T07:36:46.913808+0000","last_clean":"2023-07-21T07:36:46.913808+0000","last_became_active":"2023-07-21T07:36:27.548615+0000","last_became_peered":"2023-07-21T07:36:27.548615+0000","last_unstale":"2023-07-21T07:36:46.913808+0000","last_undegraded":"2023-07-21T07:36:46.913808+0000","last_fullsized":"2023-07-21T07:36:46.913808+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:58:26.522998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938689+0000","last_change":"2023-07-21T07:36:46.929176+0000","last_active":"2023-07-21T07:36:46.938689+0000","last_peered":"2023-07-21T07:36:46.938689+0000","last_clean":"2023-07-21T07:36:46.938689+0000","last_became_active":"2023-07-21T07:36:46.928843+0000","last_became_peered":"2023-07-21T07:36:46.928843+0000","last_unstale":"2023-07-21T07:36:46.938689+0000","last_undegraded":"2023-07-21T07:36:46.938689+0000","last_fullsized":"2023-07-21T07:36:46.938689+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:59:11.721376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.916104+0000","last_change":"2023-07-21T07:36:45.905106+0000","last_active":"2023-07-21T07:36:46.916104+0000","last_peered":"2023-07-21T07:36:46.916104+0000","last_clean":"2023-07-21T07:36:46.916104+0000","last_became_active":"2023-07-21T07:36:45.904792+0000","last_became_peered":"2023-07-21T07:36:45.904792+0000","last_unstale":"2023-07-21T07:36:46.916104+0000","last_undegraded":"2023-07-21T07:36:46.916104+0000","last_fullsized":"2023-07-21T07:36:46.916104+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:02:11.282261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.921513+0000","last_change":"2023-07-21T07:36:28.553270+0000","last_active":"2023-07-21T07:36:46.921513+0000","last_peered":"2023-07-21T07:36:46.921513+0000","last_clean":"2023-07-21T07:36:46.921513+0000","last_became_active":"2023-07-21T07:36:28.552988+0000","last_became_peered":"2023-07-21T07:36:28.552988+0000","last_unstale":"2023-07-21T07:36:46.921513+0000","last_undegraded":"2023-07-21T07:36:46.921513+0000","last_fullsized":"2023-07-21T07:36:46.921513+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:34:34.121910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906887+0000","last_change":"2023-07-21T07:36:27.546128+0000","last_active":"2023-07-21T07:36:46.906887+0000","last_peered":"2023-07-21T07:36:46.906887+0000","last_clean":"2023-07-21T07:36:46.906887+0000","last_became_active":"2023-07-21T07:36:27.545829+0000","last_became_peered":"2023-07-21T07:36:27.545829+0000","last_unstale":"2023-07-21T07:36:46.906887+0000","last_undegraded":"2023-07-21T07:36:46.906887+0000","last_fullsized":"2023-07-21T07:36:46.906887+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:06:49.609054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.941610+0000","last_change":"2023-07-21T07:36:46.938815+0000","last_active":"2023-07-21T07:36:46.941610+0000","last_peered":"2023-07-21T07:36:46.941610+0000","last_clean":"2023-07-21T07:36:46.941610+0000","last_became_active":"2023-07-21T07:36:46.938526+0000","last_became_peered":"2023-07-21T07:36:46.938526+0000","last_unstale":"2023-07-21T07:36:46.941610+0000","last_undegraded":"2023-07-21T07:36:46.941610+0000","last_fullsized":"2023-07-21T07:36:46.941610+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:47:55.446543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.921860+0000","last_change":"2023-07-21T07:36:45.912513+0000","last_active":"2023-07-21T07:36:46.921860+0000","last_peered":"2023-07-21T07:36:46.921860+0000","last_clean":"2023-07-21T07:36:46.921860+0000","last_became_active":"2023-07-21T07:36:45.912233+0000","last_became_peered":"2023-07-21T07:36:45.912233+0000","last_unstale":"2023-07-21T07:36:46.921860+0000","last_undegraded":"2023-07-21T07:36:46.921860+0000","last_fullsized":"2023-07-21T07:36:46.921860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:38:58.574437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.916315+0000","last_change":"2023-07-21T07:36:28.550679+0000","last_active":"2023-07-21T07:36:46.916315+0000","last_peered":"2023-07-21T07:36:46.916315+0000","last_clean":"2023-07-21T07:36:46.916315+0000","last_became_active":"2023-07-21T07:36:28.550320+0000","last_became_peered":"2023-07-21T07:36:28.550320+0000","last_unstale":"2023-07-21T07:36:46.916315+0000","last_undegraded":"2023-07-21T07:36:46.916315+0000","last_fullsized":"2023-07-21T07:36:46.916315+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:11:32.617795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913796+0000","last_change":"2023-07-21T07:36:27.542890+0000","last_active":"2023-07-21T07:36:46.913796+0000","last_peered":"2023-07-21T07:36:46.913796+0000","last_clean":"2023-07-21T07:36:46.913796+0000","last_became_active":"2023-07-21T07:36:27.542614+0000","last_became_peered":"2023-07-21T07:36:27.542614+0000","last_unstale":"2023-07-21T07:36:46.913796+0000","last_undegraded":"2023-07-21T07:36:46.913796+0000","last_fullsized":"2023-07-21T07:36:46.913796+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:06:38.366991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.920742+0000","last_change":"2023-07-21T07:36:46.919077+0000","last_active":"2023-07-21T07:36:46.920742+0000","last_peered":"2023-07-21T07:36:46.920742+0000","last_clean":"2023-07-21T07:36:46.920742+0000","last_became_active":"2023-07-21T07:36:46.918716+0000","last_became_peered":"2023-07-21T07:36:46.918716+0000","last_unstale":"2023-07-21T07:36:46.920742+0000","last_undegraded":"2023-07-21T07:36:46.920742+0000","last_fullsized":"2023-07-21T07:36:46.920742+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:04:16.159951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.903719+0000","last_change":"2023-07-21T07:36:45.910989+0000","last_active":"2023-07-21T07:36:46.903719+0000","last_peered":"2023-07-21T07:36:46.903719+0000","last_clean":"2023-07-21T07:36:46.903719+0000","last_became_active":"2023-07-21T07:36:45.910672+0000","last_became_peered":"2023-07-21T07:36:45.910672+0000","last_unstale":"2023-07-21T07:36:46.903719+0000","last_undegraded":"2023-07-21T07:36:46.903719+0000","last_fullsized":"2023-07-21T07:36:46.903719+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:45.969257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905368+0000","last_change":"2023-07-21T07:36:28.549203+0000","last_active":"2023-07-21T07:36:46.905368+0000","last_peered":"2023-07-21T07:36:46.905368+0000","last_clean":"2023-07-21T07:36:46.905368+0000","last_became_active":"2023-07-21T07:36:28.548933+0000","last_became_peered":"2023-07-21T07:36:28.548933+0000","last_unstale":"2023-07-21T07:36:46.905368+0000","last_undegraded":"2023-07-21T07:36:46.905368+0000","last_fullsized":"2023-07-21T07:36:46.905368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:19:38.268923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905713+0000","last_change":"2023-07-21T07:36:27.535134+0000","last_active":"2023-07-21T07:36:46.905713+0000","last_peered":"2023-07-21T07:36:46.905713+0000","last_clean":"2023-07-21T07:36:46.905713+0000","last_became_active":"2023-07-21T07:36:27.534830+0000","last_became_peered":"2023-07-21T07:36:27.534830+0000","last_unstale":"2023-07-21T07:36:46.905713+0000","last_undegraded":"2023-07-21T07:36:46.905713+0000","last_fullsized":"2023-07-21T07:36:46.905713+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:15:15.775784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938705+0000","last_change":"2023-07-21T07:36:46.929815+0000","last_active":"2023-07-21T07:36:46.938705+0000","last_peered":"2023-07-21T07:36:46.938705+0000","last_clean":"2023-07-21T07:36:46.938705+0000","last_became_active":"2023-07-21T07:36:46.929571+0000","last_became_peered":"2023-07-21T07:36:46.929571+0000","last_unstale":"2023-07-21T07:36:46.938705+0000","last_undegraded":"2023-07-21T07:36:46.938705+0000","last_fullsized":"2023-07-21T07:36:46.938705+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:20:17.567282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915086+0000","last_change":"2023-07-21T07:36:45.910749+0000","last_active":"2023-07-21T07:36:46.915086+0000","last_peered":"2023-07-21T07:36:46.915086+0000","last_clean":"2023-07-21T07:36:46.915086+0000","last_became_active":"2023-07-21T07:36:45.910493+0000","last_became_peered":"2023-07-21T07:36:45.910493+0000","last_unstale":"2023-07-21T07:36:46.915086+0000","last_undegraded":"2023-07-21T07:36:46.915086+0000","last_fullsized":"2023-07-21T07:36:46.915086+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:57:15.389224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904308+0000","last_change":"2023-07-21T07:36:28.549213+0000","last_active":"2023-07-21T07:36:46.904308+0000","last_peered":"2023-07-21T07:36:46.904308+0000","last_clean":"2023-07-21T07:36:46.904308+0000","last_became_active":"2023-07-21T07:36:28.548890+0000","last_became_peered":"2023-07-21T07:36:28.548890+0000","last_unstale":"2023-07-21T07:36:46.904308+0000","last_undegraded":"2023-07-21T07:36:46.904308+0000","last_fullsized":"2023-07-21T07:36:46.904308+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:25:51.809023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905285+0000","last_change":"2023-07-21T07:36:27.545372+0000","last_active":"2023-07-21T07:36:46.905285+0000","last_peered":"2023-07-21T07:36:46.905285+0000","last_clean":"2023-07-21T07:36:46.905285+0000","last_became_active":"2023-07-21T07:36:27.544933+0000","last_became_peered":"2023-07-21T07:36:27.544933+0000","last_unstale":"2023-07-21T07:36:46.905285+0000","last_undegraded":"2023-07-21T07:36:46.905285+0000","last_fullsized":"2023-07-21T07:36:46.905285+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:21:39.220291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938632+0000","last_change":"2023-07-21T07:36:46.929374+0000","last_active":"2023-07-21T07:36:46.938632+0000","last_peered":"2023-07-21T07:36:46.938632+0000","last_clean":"2023-07-21T07:36:46.938632+0000","last_became_active":"2023-07-21T07:36:46.928599+0000","last_became_peered":"2023-07-21T07:36:46.928599+0000","last_unstale":"2023-07-21T07:36:46.938632+0000","last_undegraded":"2023-07-21T07:36:46.938632+0000","last_fullsized":"2023-07-21T07:36:46.938632+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:25:00.200344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911111+0000","last_change":"2023-07-21T07:36:45.913121+0000","last_active":"2023-07-21T07:36:46.911111+0000","last_peered":"2023-07-21T07:36:46.911111+0000","last_clean":"2023-07-21T07:36:46.911111+0000","last_became_active":"2023-07-21T07:36:45.912788+0000","last_became_peered":"2023-07-21T07:36:45.912788+0000","last_unstale":"2023-07-21T07:36:46.911111+0000","last_undegraded":"2023-07-21T07:36:46.911111+0000","last_fullsized":"2023-07-21T07:36:46.911111+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:52:27.782378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911920+0000","last_change":"2023-07-21T07:36:28.561703+0000","last_active":"2023-07-21T07:36:46.911920+0000","last_peered":"2023-07-21T07:36:46.911920+0000","last_clean":"2023-07-21T07:36:46.911920+0000","last_became_active":"2023-07-21T07:36:28.561400+0000","last_became_peered":"2023-07-21T07:36:28.561400+0000","last_unstale":"2023-07-21T07:36:46.911920+0000","last_undegraded":"2023-07-21T07:36:46.911920+0000","last_fullsized":"2023-07-21T07:36:46.911920+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:19:27.442967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904752+0000","last_change":"2023-07-21T07:36:27.542037+0000","last_active":"2023-07-21T07:36:46.904752+0000","last_peered":"2023-07-21T07:36:46.904752+0000","last_clean":"2023-07-21T07:36:46.904752+0000","last_became_active":"2023-07-21T07:36:27.541783+0000","last_became_peered":"2023-07-21T07:36:27.541783+0000","last_unstale":"2023-07-21T07:36:46.904752+0000","last_undegraded":"2023-07-21T07:36:46.904752+0000","last_fullsized":"2023-07-21T07:36:46.904752+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:00:46.576555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.939897+0000","last_change":"2023-07-21T07:36:46.936155+0000","last_active":"2023-07-21T07:36:46.939897+0000","last_peered":"2023-07-21T07:36:46.939897+0000","last_clean":"2023-07-21T07:36:46.939897+0000","last_became_active":"2023-07-21T07:36:46.930622+0000","last_became_peered":"2023-07-21T07:36:46.930622+0000","last_unstale":"2023-07-21T07:36:46.939897+0000","last_undegraded":"2023-07-21T07:36:46.939897+0000","last_fullsized":"2023-07-21T07:36:46.939897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:28:23.578836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.934748+0000","last_change":"2023-07-21T07:36:45.903139+0000","last_active":"2023-07-21T07:36:46.934748+0000","last_peered":"2023-07-21T07:36:46.934748+0000","last_clean":"2023-07-21T07:36:46.934748+0000","last_became_active":"2023-07-21T07:36:45.902866+0000","last_became_peered":"2023-07-21T07:36:45.902866+0000","last_unstale":"2023-07-21T07:36:46.934748+0000","last_undegraded":"2023-07-21T07:36:46.934748+0000","last_fullsized":"2023-07-21T07:36:46.934748+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:16:56.213120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.921386+0000","last_change":"2023-07-21T07:36:28.553251+0000","last_active":"2023-07-21T07:36:46.921386+0000","last_peered":"2023-07-21T07:36:46.921386+0000","last_clean":"2023-07-21T07:36:46.921386+0000","last_became_active":"2023-07-21T07:36:28.552971+0000","last_became_peered":"2023-07-21T07:36:28.552971+0000","last_unstale":"2023-07-21T07:36:46.921386+0000","last_undegraded":"2023-07-21T07:36:46.921386+0000","last_fullsized":"2023-07-21T07:36:46.921386+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:36:39.371874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904769+0000","last_change":"2023-07-21T07:36:27.548492+0000","last_active":"2023-07-21T07:36:46.904769+0000","last_peered":"2023-07-21T07:36:46.904769+0000","last_clean":"2023-07-21T07:36:46.904769+0000","last_became_active":"2023-07-21T07:36:27.548083+0000","last_became_peered":"2023-07-21T07:36:27.548083+0000","last_unstale":"2023-07-21T07:36:46.904769+0000","last_undegraded":"2023-07-21T07:36:46.904769+0000","last_fullsized":"2023-07-21T07:36:46.904769+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:26:43.290192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.921406+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:36:46.921406+0000","last_peered":"2023-07-21T07:36:46.921406+0000","last_clean":"2023-07-21T07:36:46.921406+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:36:46.921406+0000","last_undegraded":"2023-07-21T07:36:46.921406+0000","last_fullsized":"2023-07-21T07:36:46.921406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:04:00.375284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.934479+0000","last_change":"2023-07-21T07:36:46.926559+0000","last_active":"2023-07-21T07:36:46.934479+0000","last_peered":"2023-07-21T07:36:46.934479+0000","last_clean":"2023-07-21T07:36:46.934479+0000","last_became_active":"2023-07-21T07:36:46.926261+0000","last_became_peered":"2023-07-21T07:36:46.926261+0000","last_unstale":"2023-07-21T07:36:46.934479+0000","last_undegraded":"2023-07-21T07:36:46.934479+0000","last_fullsized":"2023-07-21T07:36:46.934479+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:04:42.863647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932477+0000","last_change":"2023-07-21T07:36:45.914430+0000","last_active":"2023-07-21T07:36:46.932477+0000","last_peered":"2023-07-21T07:36:46.932477+0000","last_clean":"2023-07-21T07:36:46.932477+0000","last_became_active":"2023-07-21T07:36:45.914164+0000","last_became_peered":"2023-07-21T07:36:45.914164+0000","last_unstale":"2023-07-21T07:36:46.932477+0000","last_undegraded":"2023-07-21T07:36:46.932477+0000","last_fullsized":"2023-07-21T07:36:46.932477+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:35:30.630333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906355+0000","last_change":"2023-07-21T07:36:28.550245+0000","last_active":"2023-07-21T07:36:46.906355+0000","last_peered":"2023-07-21T07:36:46.906355+0000","last_clean":"2023-07-21T07:36:46.906355+0000","last_became_active":"2023-07-21T07:36:28.548746+0000","last_became_peered":"2023-07-21T07:36:28.548746+0000","last_unstale":"2023-07-21T07:36:46.906355+0000","last_undegraded":"2023-07-21T07:36:46.906355+0000","last_fullsized":"2023-07-21T07:36:46.906355+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:21:56.390688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"53'1","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914277+0000","last_change":"2023-07-21T07:36:27.542066+0000","last_active":"2023-07-21T07:36:46.914277+0000","last_peered":"2023-07-21T07:36:46.914277+0000","last_clean":"2023-07-21T07:36:46.914277+0000","last_became_active":"2023-07-21T07:36:27.541789+0000","last_became_peered":"2023-07-21T07:36:27.541789+0000","last_unstale":"2023-07-21T07:36:46.914277+0000","last_undegraded":"2023-07-21T07:36:46.914277+0000","last_fullsized":"2023-07-21T07:36:46.914277+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:14:36.130537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907246+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:36:46.907246+0000","last_peered":"2023-07-21T07:36:46.907246+0000","last_clean":"2023-07-21T07:36:46.907246+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:36:46.907246+0000","last_undegraded":"2023-07-21T07:36:46.907246+0000","last_fullsized":"2023-07-21T07:36:46.907246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:48:51.310800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.934652+0000","last_change":"2023-07-21T07:36:46.927246+0000","last_active":"2023-07-21T07:36:46.934652+0000","last_peered":"2023-07-21T07:36:46.934652+0000","last_clean":"2023-07-21T07:36:46.934652+0000","last_became_active":"2023-07-21T07:36:46.927005+0000","last_became_peered":"2023-07-21T07:36:46.927005+0000","last_unstale":"2023-07-21T07:36:46.934652+0000","last_undegraded":"2023-07-21T07:36:46.934652+0000","last_fullsized":"2023-07-21T07:36:46.934652+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:15:59.794291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906779+0000","last_change":"2023-07-21T07:36:45.906637+0000","last_active":"2023-07-21T07:36:46.906779+0000","last_peered":"2023-07-21T07:36:46.906779+0000","last_clean":"2023-07-21T07:36:46.906779+0000","last_became_active":"2023-07-21T07:36:45.906341+0000","last_became_peered":"2023-07-21T07:36:45.906341+0000","last_unstale":"2023-07-21T07:36:46.906779+0000","last_undegraded":"2023-07-21T07:36:46.906779+0000","last_fullsized":"2023-07-21T07:36:46.906779+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:54:27.443317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.920649+0000","last_change":"2023-07-21T07:36:28.555257+0000","last_active":"2023-07-21T07:36:46.920649+0000","last_peered":"2023-07-21T07:36:46.920649+0000","last_clean":"2023-07-21T07:36:46.920649+0000","last_became_active":"2023-07-21T07:36:28.554356+0000","last_became_peered":"2023-07-21T07:36:28.554356+0000","last_unstale":"2023-07-21T07:36:46.920649+0000","last_undegraded":"2023-07-21T07:36:46.920649+0000","last_fullsized":"2023-07-21T07:36:46.920649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:47:53.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"53'2","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913838+0000","last_change":"2023-07-21T07:36:27.547064+0000","last_active":"2023-07-21T07:36:46.913838+0000","last_peered":"2023-07-21T07:36:46.913838+0000","last_clean":"2023-07-21T07:36:46.913838+0000","last_became_active":"2023-07-21T07:36:27.546817+0000","last_became_peered":"2023-07-21T07:36:27.546817+0000","last_unstale":"2023-07-21T07:36:46.913838+0000","last_undegraded":"2023-07-21T07:36:46.913838+0000","last_fullsized":"2023-07-21T07:36:46.913838+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:40:52.003756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914710+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:36:46.914710+0000","last_peered":"2023-07-21T07:36:46.914710+0000","last_clean":"2023-07-21T07:36:46.914710+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:36:46.914710+0000","last_undegraded":"2023-07-21T07:36:46.914710+0000","last_fullsized":"2023-07-21T07:36:46.914710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:11:54.052982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.937877+0000","last_change":"2023-07-21T07:36:46.927118+0000","last_active":"2023-07-21T07:36:46.937877+0000","last_peered":"2023-07-21T07:36:46.937877+0000","last_clean":"2023-07-21T07:36:46.937877+0000","last_became_active":"2023-07-21T07:36:46.926381+0000","last_became_peered":"2023-07-21T07:36:46.926381+0000","last_unstale":"2023-07-21T07:36:46.937877+0000","last_undegraded":"2023-07-21T07:36:46.937877+0000","last_fullsized":"2023-07-21T07:36:46.937877+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:08:51.913795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906869+0000","last_change":"2023-07-21T07:36:45.912075+0000","last_active":"2023-07-21T07:36:46.906869+0000","last_peered":"2023-07-21T07:36:46.906869+0000","last_clean":"2023-07-21T07:36:46.906869+0000","last_became_active":"2023-07-21T07:36:45.911775+0000","last_became_peered":"2023-07-21T07:36:45.911775+0000","last_unstale":"2023-07-21T07:36:46.906869+0000","last_undegraded":"2023-07-21T07:36:46.906869+0000","last_fullsized":"2023-07-21T07:36:46.906869+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:45:53.396207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914120+0000","last_change":"2023-07-21T07:36:28.556796+0000","last_active":"2023-07-21T07:36:46.914120+0000","last_peered":"2023-07-21T07:36:46.914120+0000","last_clean":"2023-07-21T07:36:46.914120+0000","last_became_active":"2023-07-21T07:36:28.556511+0000","last_became_peered":"2023-07-21T07:36:28.556511+0000","last_unstale":"2023-07-21T07:36:46.914120+0000","last_undegraded":"2023-07-21T07:36:46.914120+0000","last_fullsized":"2023-07-21T07:36:46.914120+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:38:38.862110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"53'2","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.919754+0000","last_change":"2023-07-21T07:36:27.546993+0000","last_active":"2023-07-21T07:36:46.919754+0000","last_peered":"2023-07-21T07:36:46.919754+0000","last_clean":"2023-07-21T07:36:46.919754+0000","last_became_active":"2023-07-21T07:36:27.546675+0000","last_became_peered":"2023-07-21T07:36:27.546675+0000","last_unstale":"2023-07-21T07:36:46.919754+0000","last_undegraded":"2023-07-21T07:36:46.919754+0000","last_fullsized":"2023-07-21T07:36:46.919754+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:27.605993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911729+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:36:46.911729+0000","last_peered":"2023-07-21T07:36:46.911729+0000","last_clean":"2023-07-21T07:36:46.911729+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:36:46.911729+0000","last_undegraded":"2023-07-21T07:36:46.911729+0000","last_fullsized":"2023-07-21T07:36:46.911729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:33.583998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.925576+0000","last_change":"2023-07-21T07:36:46.922129+0000","last_active":"2023-07-21T07:36:46.925576+0000","last_peered":"2023-07-21T07:36:46.925576+0000","last_clean":"2023-07-21T07:36:46.925576+0000","last_became_active":"2023-07-21T07:36:46.921833+0000","last_became_peered":"2023-07-21T07:36:46.921833+0000","last_unstale":"2023-07-21T07:36:46.925576+0000","last_undegraded":"2023-07-21T07:36:46.925576+0000","last_fullsized":"2023-07-21T07:36:46.925576+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:42:21.588395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906087+0000","last_change":"2023-07-21T07:36:45.914841+0000","last_active":"2023-07-21T07:36:46.906087+0000","last_peered":"2023-07-21T07:36:46.906087+0000","last_clean":"2023-07-21T07:36:46.906087+0000","last_became_active":"2023-07-21T07:36:45.914515+0000","last_became_peered":"2023-07-21T07:36:45.914515+0000","last_unstale":"2023-07-21T07:36:46.906087+0000","last_undegraded":"2023-07-21T07:36:46.906087+0000","last_fullsized":"2023-07-21T07:36:46.906087+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:45:53.791995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915176+0000","last_change":"2023-07-21T07:36:28.550594+0000","last_active":"2023-07-21T07:36:46.915176+0000","last_peered":"2023-07-21T07:36:46.915176+0000","last_clean":"2023-07-21T07:36:46.915176+0000","last_became_active":"2023-07-21T07:36:28.550307+0000","last_became_peered":"2023-07-21T07:36:28.550307+0000","last_unstale":"2023-07-21T07:36:46.915176+0000","last_undegraded":"2023-07-21T07:36:46.915176+0000","last_fullsized":"2023-07-21T07:36:46.915176+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:31:12.174896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904734+0000","last_change":"2023-07-21T07:36:27.545082+0000","last_active":"2023-07-21T07:36:46.904734+0000","last_peered":"2023-07-21T07:36:46.904734+0000","last_clean":"2023-07-21T07:36:46.904734+0000","last_became_active":"2023-07-21T07:36:27.544787+0000","last_became_peered":"2023-07-21T07:36:27.544787+0000","last_unstale":"2023-07-21T07:36:46.904734+0000","last_undegraded":"2023-07-21T07:36:46.904734+0000","last_fullsized":"2023-07-21T07:36:46.904734+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:11:22.289241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":230,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914379+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:36:46.914379+0000","last_peered":"2023-07-21T07:36:46.914379+0000","last_clean":"2023-07-21T07:36:46.914379+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:36:46.914379+0000","last_undegraded":"2023-07-21T07:36:46.914379+0000","last_fullsized":"2023-07-21T07:36:46.914379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:30:16.542890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":76,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911617+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:36:46.911617+0000","last_peered":"2023-07-21T07:36:46.911617+0000","last_clean":"2023-07-21T07:36:46.911617+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:36:46.911617+0000","last_undegraded":"2023-07-21T07:36:46.911617+0000","last_fullsized":"2023-07-21T07:36:46.911617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:21:49.029160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938656+0000","last_change":"2023-07-21T07:36:46.928849+0000","last_active":"2023-07-21T07:36:46.938656+0000","last_peered":"2023-07-21T07:36:46.938656+0000","last_clean":"2023-07-21T07:36:46.938656+0000","last_became_active":"2023-07-21T07:36:46.928501+0000","last_became_peered":"2023-07-21T07:36:46.928501+0000","last_unstale":"2023-07-21T07:36:46.938656+0000","last_undegraded":"2023-07-21T07:36:46.938656+0000","last_fullsized":"2023-07-21T07:36:46.938656+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:39:44.154529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904611+0000","last_change":"2023-07-21T07:36:45.911915+0000","last_active":"2023-07-21T07:36:46.904611+0000","last_peered":"2023-07-21T07:36:46.904611+0000","last_clean":"2023-07-21T07:36:46.904611+0000","last_became_active":"2023-07-21T07:36:45.911608+0000","last_became_peered":"2023-07-21T07:36:45.911608+0000","last_unstale":"2023-07-21T07:36:46.904611+0000","last_undegraded":"2023-07-21T07:36:46.904611+0000","last_fullsized":"2023-07-21T07:36:46.904611+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:48:09.579584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911955+0000","last_change":"2023-07-21T07:36:28.555760+0000","last_active":"2023-07-21T07:36:46.911955+0000","last_peered":"2023-07-21T07:36:46.911955+0000","last_clean":"2023-07-21T07:36:46.911955+0000","last_became_active":"2023-07-21T07:36:28.555505+0000","last_became_peered":"2023-07-21T07:36:28.555505+0000","last_unstale":"2023-07-21T07:36:46.911955+0000","last_undegraded":"2023-07-21T07:36:46.911955+0000","last_fullsized":"2023-07-21T07:36:46.911955+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:05:28.859205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911321+0000","last_change":"2023-07-21T07:36:27.550572+0000","last_active":"2023-07-21T07:36:46.911321+0000","last_peered":"2023-07-21T07:36:46.911321+0000","last_clean":"2023-07-21T07:36:46.911321+0000","last_became_active":"2023-07-21T07:36:27.550195+0000","last_became_peered":"2023-07-21T07:36:27.550195+0000","last_unstale":"2023-07-21T07:36:46.911321+0000","last_undegraded":"2023-07-21T07:36:46.911321+0000","last_fullsized":"2023-07-21T07:36:46.911321+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:06:38.366991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.909291+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:36:46.909291+0000","last_peered":"2023-07-21T07:36:46.909291+0000","last_clean":"2023-07-21T07:36:46.909291+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:36:46.909291+0000","last_undegraded":"2023-07-21T07:36:46.909291+0000","last_fullsized":"2023-07-21T07:36:46.909291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:29:16.542188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.936768+0000","last_change":"2023-07-21T07:36:46.924427+0000","last_active":"2023-07-21T07:36:46.936768+0000","last_peered":"2023-07-21T07:36:46.936768+0000","last_clean":"2023-07-21T07:36:46.936768+0000","last_became_active":"2023-07-21T07:36:46.924193+0000","last_became_peered":"2023-07-21T07:36:46.924193+0000","last_unstale":"2023-07-21T07:36:46.936768+0000","last_undegraded":"2023-07-21T07:36:46.936768+0000","last_fullsized":"2023-07-21T07:36:46.936768+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:20:25.172699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.937104+0000","last_change":"2023-07-21T07:36:45.911172+0000","last_active":"2023-07-21T07:36:46.937104+0000","last_peered":"2023-07-21T07:36:46.937104+0000","last_clean":"2023-07-21T07:36:46.937104+0000","last_became_active":"2023-07-21T07:36:45.910442+0000","last_became_peered":"2023-07-21T07:36:45.910442+0000","last_unstale":"2023-07-21T07:36:46.937104+0000","last_undegraded":"2023-07-21T07:36:46.937104+0000","last_fullsized":"2023-07-21T07:36:46.937104+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:41:29.587985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915561+0000","last_change":"2023-07-21T07:36:28.552513+0000","last_active":"2023-07-21T07:36:46.915561+0000","last_peered":"2023-07-21T07:36:46.915561+0000","last_clean":"2023-07-21T07:36:46.915561+0000","last_became_active":"2023-07-21T07:36:28.551895+0000","last_became_peered":"2023-07-21T07:36:28.551895+0000","last_unstale":"2023-07-21T07:36:46.915561+0000","last_undegraded":"2023-07-21T07:36:46.915561+0000","last_fullsized":"2023-07-21T07:36:46.915561+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:20:04.242746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913256+0000","last_change":"2023-07-21T07:36:27.544373+0000","last_active":"2023-07-21T07:36:46.913256+0000","last_peered":"2023-07-21T07:36:46.913256+0000","last_clean":"2023-07-21T07:36:46.913256+0000","last_became_active":"2023-07-21T07:36:27.544074+0000","last_became_peered":"2023-07-21T07:36:27.544074+0000","last_unstale":"2023-07-21T07:36:46.913256+0000","last_undegraded":"2023-07-21T07:36:46.913256+0000","last_fullsized":"2023-07-21T07:36:46.913256+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:40:30.800437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":76,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911392+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:36:46.911392+0000","last_peered":"2023-07-21T07:36:46.911392+0000","last_clean":"2023-07-21T07:36:46.911392+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:36:46.911392+0000","last_undegraded":"2023-07-21T07:36:46.911392+0000","last_fullsized":"2023-07-21T07:36:46.911392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:05:39.858592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.942129+0000","last_change":"2023-07-21T07:36:46.937977+0000","last_active":"2023-07-21T07:36:46.942129+0000","last_peered":"2023-07-21T07:36:46.942129+0000","last_clean":"2023-07-21T07:36:46.942129+0000","last_became_active":"2023-07-21T07:36:46.937507+0000","last_became_peered":"2023-07-21T07:36:46.937507+0000","last_unstale":"2023-07-21T07:36:46.942129+0000","last_undegraded":"2023-07-21T07:36:46.942129+0000","last_fullsized":"2023-07-21T07:36:46.942129+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:31:43.603585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.942317+0000","last_change":"2023-07-21T07:36:45.901611+0000","last_active":"2023-07-21T07:36:46.942317+0000","last_peered":"2023-07-21T07:36:46.942317+0000","last_clean":"2023-07-21T07:36:46.942317+0000","last_became_active":"2023-07-21T07:36:45.901298+0000","last_became_peered":"2023-07-21T07:36:45.901298+0000","last_unstale":"2023-07-21T07:36:46.942317+0000","last_undegraded":"2023-07-21T07:36:46.942317+0000","last_fullsized":"2023-07-21T07:36:46.942317+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:15:15.471784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913488+0000","last_change":"2023-07-21T07:36:28.553427+0000","last_active":"2023-07-21T07:36:46.913488+0000","last_peered":"2023-07-21T07:36:46.913488+0000","last_clean":"2023-07-21T07:36:46.913488+0000","last_became_active":"2023-07-21T07:36:28.553096+0000","last_became_peered":"2023-07-21T07:36:28.553096+0000","last_unstale":"2023-07-21T07:36:46.913488+0000","last_undegraded":"2023-07-21T07:36:46.913488+0000","last_fullsized":"2023-07-21T07:36:46.913488+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:29:18.047828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"53'1","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912104+0000","last_change":"2023-07-21T07:36:27.550570+0000","last_active":"2023-07-21T07:36:46.912104+0000","last_peered":"2023-07-21T07:36:46.912104+0000","last_clean":"2023-07-21T07:36:46.912104+0000","last_became_active":"2023-07-21T07:36:27.550296+0000","last_became_peered":"2023-07-21T07:36:27.550296+0000","last_unstale":"2023-07-21T07:36:46.912104+0000","last_undegraded":"2023-07-21T07:36:46.912104+0000","last_fullsized":"2023-07-21T07:36:46.912104+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:40:52.003756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906803+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:36:46.906803+0000","last_peered":"2023-07-21T07:36:46.906803+0000","last_clean":"2023-07-21T07:36:46.906803+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:36:46.906803+0000","last_undegraded":"2023-07-21T07:36:46.906803+0000","last_fullsized":"2023-07-21T07:36:46.906803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:53:59.711057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3869,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1298432,"data_stored":900420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.71999999999999997,"5min":0.876,"15min":0.876},"last":0.371}]},{"osd":1,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.75,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.67800000000000005,"5min":0.871,"15min":0.871},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.44400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72899999999999998,"5min":0.878,"15min":0.878},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.64600000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60199999999999998,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71499999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.56299999999999994}]},{"osd":4,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71399999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57899999999999996}]},{"osd":5,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.622}]},{"osd":6,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86799999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":310852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.84399999999999997,"15min":0.89400000000000002},"min":{"1min":0.34000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69599999999999995,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.65400000000000003,"15min":0.67400000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70799999999999996,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.34599999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48699999999999999,"15min":0.47699999999999998},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.746,"15min":0.77500000000000002},"min":{"1min":0.39400000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.71299999999999997,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.64100000000000001}]},{"osd":3,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.40500000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73699999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.46500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85799999999999998,"5min":1.319,"15min":1.319},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79600000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40100000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81799999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.376},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73099999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56200000000000006}]},{"osd":7,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.622,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76200000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":313201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34699999999999998,"15min":0.35099999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.502,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.249,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.49399999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.32100000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.34699999999999998,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.44700000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.436,"15min":0.436},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.34100000000000003}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.57499999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.40600000000000003,"15min":0.41199999999999998},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56299999999999994,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.372}]},{"osd":4,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59699999999999998,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89300000000000002,"5min":1.006,"15min":1.006},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73599999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48299999999999998}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63400000000000001,"15min":0.64600000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80500000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.504},{"interface":"front","average":{"1min":0.62,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82699999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.64000000000000001,"15min":0.65500000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68600000000000005,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.69099999999999995,"15min":0.70899999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85299999999999998,"5min":1.339,"15min":1.339},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.747,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1277952,"data_stored":899622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.373,"15min":0.378},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52000000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.497,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.377,"15min":0.376},"min":{"1min":0.26800000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.60599999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.371}]},{"osd":3,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.37,"15min":0.372},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51500000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66100000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69699999999999995,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83999999999999997,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81299999999999994,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.76400000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.77600000000000002,"15min":0.80800000000000005},"min":{"1min":0.47499999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.751,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79400000000000004,"5min":1.002,"15min":1.002},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85999999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.504,"5min":0.433,"15min":0.433},"max":{"1min":0.72899999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":696320,"data_stored":309996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.35399999999999998},"min":{"1min":0.23599999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45900000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34899999999999998,"15min":0.34999999999999998},"min":{"1min":0.249,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.33000000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.29499999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.49199999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.51900000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.32800000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60099999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.38500000000000001}]},{"osd":4,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.434,"5min":0.379,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82199999999999995,"5min":1.127,"15min":1.127},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76000000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.46000000000000002}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":1.109,"15min":1.109},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.622,"15min":0.61299999999999999},"min":{"1min":0.501,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88400000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.60299999999999998},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84699999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":309836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35399999999999998,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.224,"15min":0.224},"max":{"1min":0.56999999999999995,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.41299999999999998},"min":{"1min":0.29599999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60799999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.378,"15min":0.378},"min":{"1min":0.27700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.47899999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64600000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.38500000000000001}]},{"osd":4,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.47899999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.49399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82399999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.627}]},{"osd":6,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81499999999999995,"5min":1.05,"15min":1.05},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85499999999999998,"5min":1.008,"15min":1.008},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.44600000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.89800000000000002,"5min":1.222,"15min":1.222},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90800000000000003,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.76300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":313993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":1.008,"15min":1.0920000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66700000000000004,"5min":10.18,"15min":10.18},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.98099999999999998,"15min":1.0549999999999999},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.71299999999999997,"5min":10.207000000000001,"15min":10.207000000000001},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66900000000000004,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.58599999999999997,"15min":0.59999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64600000000000002,"5min":1.198,"15min":1.198},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.64500000000000002,"15min":0.66200000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70999999999999996,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.69299999999999995,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":0.80700000000000005}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.68899999999999995,"15min":0.71099999999999997},"min":{"1min":0.36199999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72899999999999998,"5min":1.179,"15min":1.179},"last":0.754}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.42199999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.505},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.624}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.497,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77500000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.64600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":309310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64400000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.38700000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70399999999999996,"5min":0.751,"15min":0.751},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53900000000000003,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.68700000000000006,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.67300000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.70399999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.42199999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.623,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.47199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.62,"15min":0.624},"min":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.67300000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.501}]},{"osd":4,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.72599999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.42599999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69299999999999995,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.70999999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.72499999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.75,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:36:51.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T07:36:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.242+0000 7fbbb7896700 1 Processor -- start 2023-07-21T07:36:51.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.242+0000 7fbbb7896700 1 -- start start 2023-07-21T07:36:51.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb7896700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbbb0151b10 0x7fbbb0154f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:51.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb7896700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb006a090 0x7fbbb006a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb7896700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb00c4930 con 0x7fbbb00c5660 2023-07-21T07:36:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb7896700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb00c51d0 con 0x7fbbb0151b10 2023-07-21T07:36:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb7896700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb006da60 con 0x7fbbb006a090 2023-07-21T07:36:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb5632700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbbb0151b10 0x7fbbb0154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb5632700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbbb0151b10 0x7fbbb0154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36488/0 (socket says 172.21.15.6:36488) 2023-07-21T07:36:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb5632700 1 -- 172.21.15.6:0/3377431274 learned_addr learned my addr 172.21.15.6:0/3377431274 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb4e31700 1 --2- 172.21.15.6:0/3377431274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb006a090 0x7fbbb006a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:51.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb5632700 1 -- 172.21.15.6:0/3377431274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb006a090 msgr2=0x7fbbb006a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:51.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb5632700 1 --2- 172.21.15.6:0/3377431274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb006a090 0x7fbbb006a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb5632700 1 -- 172.21.15.6:0/3377431274 >> v1:172.21.15.86:6789/0 conn(0x7fbbb00c5660 legacy=0x7fbbb00c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:51.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb5632700 1 -- 172.21.15.6:0/3377431274 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00c4b80 con 0x7fbbb0151b10 2023-07-21T07:36:51.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbbb5632700 1 --2- 172.21.15.6:0/3377431274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb0151b10 0x7fbbb0154f90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0098f0 tx=0x7fbbac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d6c2ff5dde7f1b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:51.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbba7fff700 1 -- 172.21.15.6:0/3377431274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac00b8a0 con 0x7fbbb0151b10 2023-07-21T07:36:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbba7fff700 1 -- 172.21.15.6:0/3377431274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac00ba00 con 0x7fbbb0151b10 2023-07-21T07:36:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.243+0000 7fbba7fff700 1 -- 172.21.15.6:0/3377431274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac00bd90 con 0x7fbbb0151b10 2023-07-21T07:36:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.244+0000 7fbbb7896700 1 -- 172.21.15.6:0/3377431274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb0151b10 msgr2=0x7fbbb0154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.244+0000 7fbbb7896700 1 --2- 172.21.15.6:0/3377431274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb0151b10 0x7fbbb0154f90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0098f0 tx=0x7fbbac009c00 comp rx=0 tx=0).stop 2023-07-21T07:36:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.244+0000 7fbbb7896700 1 -- 172.21.15.6:0/3377431274 shutdown_connections 2023-07-21T07:36:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.244+0000 7fbbb7896700 1 --2- 172.21.15.6:0/3377431274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb0151b10 0x7fbbb0154f90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.244+0000 7fbbb7896700 1 --2- 172.21.15.6:0/3377431274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb006a090 0x7fbbb006a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.244+0000 7fbbb7896700 1 -- 172.21.15.6:0/3377431274 >> 172.21.15.6:0/3377431274 conn(0x7fbbb00a8660 msgr2=0x7fbbb00a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.244+0000 7fbbb7896700 1 -- 172.21.15.6:0/3377431274 shutdown_connections 2023-07-21T07:36:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.244+0000 7fbbb7896700 1 -- 172.21.15.6:0/3377431274 wait complete. 2023-07-21T07:36:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.245+0000 7fbbb7896700 1 Processor -- start 2023-07-21T07:36:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.245+0000 7fbbb7896700 1 -- start start 2023-07-21T07:36:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb7896700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb006a090 0x7fbbb01eb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb7896700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb00c5660 0x7fbbb0157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb7896700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb0151b10 0x7fbbb0150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb7896700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb01ebb30 con 0x7fbbb006a090 2023-07-21T07:36:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb7896700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb0157700 con 0x7fbbb0151b10 2023-07-21T07:36:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb7896700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00bdca0 con 0x7fbbb00c5660 2023-07-21T07:36:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb5632700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb006a090 0x7fbbb01eb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb5632700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb006a090 0x7fbbb01eb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36494/0 (socket says 172.21.15.6:36494) 2023-07-21T07:36:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb5632700 1 -- 172.21.15.6:0/1011767395 learned_addr learned my addr 172.21.15.6:0/1011767395 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:51.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb4e31700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb00c5660 0x7fbbb0157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:51.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb5e33700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb0151b10 0x7fbbb0150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:51.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb5632700 1 -- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb00c5660 msgr2=0x7fbbb0157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:51.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb5632700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb00c5660 0x7fbbb0157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb5632700 1 -- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb0151b10 msgr2=0x7fbbb0150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:51.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb5632700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb0151b10 0x7fbbb0150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb5632700 1 -- 172.21.15.6:0/1011767395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac009550 con 0x7fbbb006a090 2023-07-21T07:36:51.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.246+0000 7fbbb4e31700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb00c5660 0x7fbbb0157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.247+0000 7fbbb5632700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb006a090 0x7fbbb01eb5f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fbbac014040 tx=0x7fbbac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.247+0000 7fbba5ffb700 1 -- 172.21.15.6:0/1011767395 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0036a0 con 0x7fbbb006a090 2023-07-21T07:36:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.247+0000 7fbba5ffb700 1 -- 172.21.15.6:0/1011767395 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac01e070 con 0x7fbbb006a090 2023-07-21T07:36:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.247+0000 7fbbb7896700 1 -- 172.21.15.6:0/1011767395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb00bdf80 con 0x7fbbb006a090 2023-07-21T07:36:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.247+0000 7fbba5ffb700 1 -- 172.21.15.6:0/1011767395 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac003a40 con 0x7fbbb006a090 2023-07-21T07:36:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.247+0000 7fbbb7896700 1 -- 172.21.15.6:0/1011767395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb00be260 con 0x7fbbb006a090 2023-07-21T07:36:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.248+0000 7fbbb7896700 1 -- 172.21.15.6:0/1011767395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb01579e0 con 0x7fbbb006a090 2023-07-21T07:36:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.248+0000 7fbba5ffb700 1 -- 172.21.15.6:0/1011767395 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbbac003ba0 con 0x7fbbb006a090 2023-07-21T07:36:51.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.249+0000 7fbba5ffb700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbb9406ad10 0x7fbb9406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:51.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.249+0000 7fbba5ffb700 1 -- 172.21.15.6:0/1011767395 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fbbac020070 con 0x7fbbb006a090 2023-07-21T07:36:51.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.249+0000 7fbbb4e31700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbb9406ad10 0x7fbb9406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:51.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.249+0000 7fbbb4e31700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbb9406ad10 0x7fbb9406d1d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbbb01ed650 tx=0x7fbba0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:51.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.253+0000 7fbba5ffb700 1 -- 172.21.15.6:0/1011767395 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbbac055a20 con 0x7fbbb006a090 2023-07-21T07:36:51.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.445+0000 7fbbb7896700 1 -- 172.21.15.6:0/1011767395 --> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbb01554d0 con 0x7fbb9406ad10 2023-07-21T07:36:51.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.460+0000 7fbba5ffb700 1 -- 172.21.15.6:0/1011767395 <== mgr.4099 v2:172.21.15.86:6832/462616725 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+550400 (secure 0 0 0) 0x7fbba0015440 con 0x7fbb9406ad10 2023-07-21T07:36:51.519 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.464+0000 7fbbb7896700 1 -- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbb9406ad10 msgr2=0x7fbb9406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.464+0000 7fbbb7896700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbb9406ad10 0x7fbb9406d1d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbbb01ed650 tx=0x7fbba0008040 comp rx=0 tx=0).stop 2023-07-21T07:36:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.464+0000 7fbbb7896700 1 -- 172.21.15.6:0/1011767395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb006a090 msgr2=0x7fbbb01eb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.464+0000 7fbbb7896700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb006a090 0x7fbbb01eb5f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fbbac014040 tx=0x7fbbac004750 comp rx=0 tx=0).stop 2023-07-21T07:36:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.464+0000 7fbbb7896700 1 -- 172.21.15.6:0/1011767395 shutdown_connections 2023-07-21T07:36:51.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.464+0000 7fbbb7896700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fbb9406ad10 0x7fbb9406d1d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.464+0000 7fbbb7896700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb0151b10 0x7fbbb0150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.464+0000 7fbbb7896700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb006a090 0x7fbbb01eb5f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.464+0000 7fbbb7896700 1 --2- 172.21.15.6:0/1011767395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbb00c5660 0x7fbbb0157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.464+0000 7fbbb7896700 1 -- 172.21.15.6:0/1011767395 >> 172.21.15.6:0/1011767395 conn(0x7fbbb00a8660 msgr2=0x7fbbb01538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:51.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.464+0000 7fbbb7896700 1 -- 172.21.15.6:0/1011767395 shutdown_connections 2023-07-21T07:36:51.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.464+0000 7fbbb7896700 1 -- 172.21.15.6:0/1011767395 wait complete. 2023-07-21T07:36:51.523 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T07:36:51.530 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2023-07-21T07:36:50.725314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596599,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":312,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222808,"kb_used_data":6632,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754751912,"statfs":{"total":773094113280,"available":772865957888,"internally_reserved":0,"allocated":6791168,"data_stored":3667230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.835894"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938663+0000","last_change":"2023-07-21T07:36:46.929149+0000","last_active":"2023-07-21T07:36:46.938663+0000","last_peered":"2023-07-21T07:36:46.938663+0000","last_clean":"2023-07-21T07:36:46.938663+0000","last_became_active":"2023-07-21T07:36:46.928624+0000","last_became_peered":"2023-07-21T07:36:46.928624+0000","last_unstale":"2023-07-21T07:36:46.938663+0000","last_undegraded":"2023-07-21T07:36:46.938663+0000","last_fullsized":"2023-07-21T07:36:46.938663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:59:25.823663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907893+0000","last_change":"2023-07-21T07:36:28.546426+0000","last_active":"2023-07-21T07:36:46.907893+0000","last_peered":"2023-07-21T07:36:46.907893+0000","last_clean":"2023-07-21T07:36:46.907893+0000","last_became_active":"2023-07-21T07:36:28.546106+0000","last_became_peered":"2023-07-21T07:36:28.546106+0000","last_unstale":"2023-07-21T07:36:46.907893+0000","last_undegraded":"2023-07-21T07:36:46.907893+0000","last_fullsized":"2023-07-21T07:36:46.907893+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:54:48.032678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.924393+0000","last_change":"2023-07-21T07:36:46.919847+0000","last_active":"2023-07-21T07:36:46.924393+0000","last_peered":"2023-07-21T07:36:46.924393+0000","last_clean":"2023-07-21T07:36:46.924393+0000","last_became_active":"2023-07-21T07:36:46.919552+0000","last_became_peered":"2023-07-21T07:36:46.919552+0000","last_unstale":"2023-07-21T07:36:46.924393+0000","last_undegraded":"2023-07-21T07:36:46.924393+0000","last_fullsized":"2023-07-21T07:36:46.924393+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:03:14.366312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907496+0000","last_change":"2023-07-21T07:36:28.553546+0000","last_active":"2023-07-21T07:36:46.907496+0000","last_peered":"2023-07-21T07:36:46.907496+0000","last_clean":"2023-07-21T07:36:46.907496+0000","last_became_active":"2023-07-21T07:36:28.553260+0000","last_became_peered":"2023-07-21T07:36:28.553260+0000","last_unstale":"2023-07-21T07:36:46.907496+0000","last_undegraded":"2023-07-21T07:36:46.907496+0000","last_fullsized":"2023-07-21T07:36:46.907496+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:52:36.692277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.929183+0000","last_change":"2023-07-21T07:36:46.919212+0000","last_active":"2023-07-21T07:36:46.929183+0000","last_peered":"2023-07-21T07:36:46.929183+0000","last_clean":"2023-07-21T07:36:46.929183+0000","last_became_active":"2023-07-21T07:36:46.918812+0000","last_became_peered":"2023-07-21T07:36:46.918812+0000","last_unstale":"2023-07-21T07:36:46.929183+0000","last_undegraded":"2023-07-21T07:36:46.929183+0000","last_fullsized":"2023-07-21T07:36:46.929183+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:01:54.936247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914190+0000","last_change":"2023-07-21T07:36:28.554364+0000","last_active":"2023-07-21T07:36:46.914190+0000","last_peered":"2023-07-21T07:36:46.914190+0000","last_clean":"2023-07-21T07:36:46.914190+0000","last_became_active":"2023-07-21T07:36:28.554095+0000","last_became_peered":"2023-07-21T07:36:28.554095+0000","last_unstale":"2023-07-21T07:36:46.914190+0000","last_undegraded":"2023-07-21T07:36:46.914190+0000","last_fullsized":"2023-07-21T07:36:46.914190+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:21:55.516958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.922830+0000","last_change":"2023-07-21T07:36:46.916502+0000","last_active":"2023-07-21T07:36:46.922830+0000","last_peered":"2023-07-21T07:36:46.922830+0000","last_clean":"2023-07-21T07:36:46.922830+0000","last_became_active":"2023-07-21T07:36:46.916137+0000","last_became_peered":"2023-07-21T07:36:46.916137+0000","last_unstale":"2023-07-21T07:36:46.922830+0000","last_undegraded":"2023-07-21T07:36:46.922830+0000","last_fullsized":"2023-07-21T07:36:46.922830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:04:18.558921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905703+0000","last_change":"2023-07-21T07:36:28.553233+0000","last_active":"2023-07-21T07:36:46.905703+0000","last_peered":"2023-07-21T07:36:46.905703+0000","last_clean":"2023-07-21T07:36:46.905703+0000","last_became_active":"2023-07-21T07:36:28.552984+0000","last_became_peered":"2023-07-21T07:36:28.552984+0000","last_unstale":"2023-07-21T07:36:46.905703+0000","last_undegraded":"2023-07-21T07:36:46.905703+0000","last_fullsized":"2023-07-21T07:36:46.905703+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:41:31.754173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.944282+0000","last_change":"2023-07-21T07:36:46.943362+0000","last_active":"2023-07-21T07:36:46.944282+0000","last_peered":"2023-07-21T07:36:46.944282+0000","last_clean":"2023-07-21T07:36:46.944282+0000","last_became_active":"2023-07-21T07:36:46.943065+0000","last_became_peered":"2023-07-21T07:36:46.943065+0000","last_unstale":"2023-07-21T07:36:46.944282+0000","last_undegraded":"2023-07-21T07:36:46.944282+0000","last_fullsized":"2023-07-21T07:36:46.944282+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:14:07.210742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913715+0000","last_change":"2023-07-21T07:36:28.555196+0000","last_active":"2023-07-21T07:36:46.913715+0000","last_peered":"2023-07-21T07:36:46.913715+0000","last_clean":"2023-07-21T07:36:46.913715+0000","last_became_active":"2023-07-21T07:36:28.554805+0000","last_became_peered":"2023-07-21T07:36:28.554805+0000","last_unstale":"2023-07-21T07:36:46.913715+0000","last_undegraded":"2023-07-21T07:36:46.913715+0000","last_fullsized":"2023-07-21T07:36:46.913715+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:51:09.771177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.924772+0000","last_change":"2023-07-21T07:36:46.918562+0000","last_active":"2023-07-21T07:36:46.924772+0000","last_peered":"2023-07-21T07:36:46.924772+0000","last_clean":"2023-07-21T07:36:46.924772+0000","last_became_active":"2023-07-21T07:36:46.918291+0000","last_became_peered":"2023-07-21T07:36:46.918291+0000","last_unstale":"2023-07-21T07:36:46.924772+0000","last_undegraded":"2023-07-21T07:36:46.924772+0000","last_fullsized":"2023-07-21T07:36:46.924772+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:38:56.965556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911631+0000","last_change":"2023-07-21T07:36:28.557651+0000","last_active":"2023-07-21T07:36:46.911631+0000","last_peered":"2023-07-21T07:36:46.911631+0000","last_clean":"2023-07-21T07:36:46.911631+0000","last_became_active":"2023-07-21T07:36:28.557396+0000","last_became_peered":"2023-07-21T07:36:28.557396+0000","last_unstale":"2023-07-21T07:36:46.911631+0000","last_undegraded":"2023-07-21T07:36:46.911631+0000","last_fullsized":"2023-07-21T07:36:46.911631+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:23:24.859339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.927768+0000","last_change":"2023-07-21T07:36:46.924168+0000","last_active":"2023-07-21T07:36:46.927768+0000","last_peered":"2023-07-21T07:36:46.927768+0000","last_clean":"2023-07-21T07:36:46.927768+0000","last_became_active":"2023-07-21T07:36:46.923821+0000","last_became_peered":"2023-07-21T07:36:46.923821+0000","last_unstale":"2023-07-21T07:36:46.927768+0000","last_undegraded":"2023-07-21T07:36:46.927768+0000","last_fullsized":"2023-07-21T07:36:46.927768+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:02:43.605562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.909166+0000","last_change":"2023-07-21T07:36:28.557367+0000","last_active":"2023-07-21T07:36:46.909166+0000","last_peered":"2023-07-21T07:36:46.909166+0000","last_clean":"2023-07-21T07:36:46.909166+0000","last_became_active":"2023-07-21T07:36:28.557060+0000","last_became_peered":"2023-07-21T07:36:28.557060+0000","last_unstale":"2023-07-21T07:36:46.909166+0000","last_undegraded":"2023-07-21T07:36:46.909166+0000","last_fullsized":"2023-07-21T07:36:46.909166+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:07:09.045197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.941322+0000","last_change":"2023-07-21T07:36:46.938931+0000","last_active":"2023-07-21T07:36:46.941322+0000","last_peered":"2023-07-21T07:36:46.941322+0000","last_clean":"2023-07-21T07:36:46.941322+0000","last_became_active":"2023-07-21T07:36:46.938595+0000","last_became_peered":"2023-07-21T07:36:46.938595+0000","last_unstale":"2023-07-21T07:36:46.941322+0000","last_undegraded":"2023-07-21T07:36:46.941322+0000","last_fullsized":"2023-07-21T07:36:46.941322+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:54:20.782814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911378+0000","last_change":"2023-07-21T07:36:28.550020+0000","last_active":"2023-07-21T07:36:46.911378+0000","last_peered":"2023-07-21T07:36:46.911378+0000","last_clean":"2023-07-21T07:36:46.911378+0000","last_became_active":"2023-07-21T07:36:28.549706+0000","last_became_peered":"2023-07-21T07:36:28.549706+0000","last_unstale":"2023-07-21T07:36:46.911378+0000","last_undegraded":"2023-07-21T07:36:46.911378+0000","last_fullsized":"2023-07-21T07:36:46.911378+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:39:18.998942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.937924+0000","last_change":"2023-07-21T07:36:46.927194+0000","last_active":"2023-07-21T07:36:46.937924+0000","last_peered":"2023-07-21T07:36:46.937924+0000","last_clean":"2023-07-21T07:36:46.937924+0000","last_became_active":"2023-07-21T07:36:46.921059+0000","last_became_peered":"2023-07-21T07:36:46.921059+0000","last_unstale":"2023-07-21T07:36:46.937924+0000","last_undegraded":"2023-07-21T07:36:46.937924+0000","last_fullsized":"2023-07-21T07:36:46.937924+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:41:57.632713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914507+0000","last_change":"2023-07-21T07:36:28.553926+0000","last_active":"2023-07-21T07:36:46.914507+0000","last_peered":"2023-07-21T07:36:46.914507+0000","last_clean":"2023-07-21T07:36:46.914507+0000","last_became_active":"2023-07-21T07:36:28.552424+0000","last_became_peered":"2023-07-21T07:36:28.552424+0000","last_unstale":"2023-07-21T07:36:46.914507+0000","last_undegraded":"2023-07-21T07:36:46.914507+0000","last_fullsized":"2023-07-21T07:36:46.914507+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:56:02.291385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932447+0000","last_change":"2023-07-21T07:36:46.925625+0000","last_active":"2023-07-21T07:36:46.932447+0000","last_peered":"2023-07-21T07:36:46.932447+0000","last_clean":"2023-07-21T07:36:46.932447+0000","last_became_active":"2023-07-21T07:36:46.925156+0000","last_became_peered":"2023-07-21T07:36:46.925156+0000","last_unstale":"2023-07-21T07:36:46.932447+0000","last_undegraded":"2023-07-21T07:36:46.932447+0000","last_fullsized":"2023-07-21T07:36:46.932447+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:25:23.390482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912089+0000","last_change":"2023-07-21T07:36:28.551408+0000","last_active":"2023-07-21T07:36:46.912089+0000","last_peered":"2023-07-21T07:36:46.912089+0000","last_clean":"2023-07-21T07:36:46.912089+0000","last_became_active":"2023-07-21T07:36:28.551138+0000","last_became_peered":"2023-07-21T07:36:28.551138+0000","last_unstale":"2023-07-21T07:36:46.912089+0000","last_undegraded":"2023-07-21T07:36:46.912089+0000","last_fullsized":"2023-07-21T07:36:46.912089+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:19.298788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938138+0000","last_change":"2023-07-21T07:36:46.924927+0000","last_active":"2023-07-21T07:36:46.938138+0000","last_peered":"2023-07-21T07:36:46.938138+0000","last_clean":"2023-07-21T07:36:46.938138+0000","last_became_active":"2023-07-21T07:36:46.924422+0000","last_became_peered":"2023-07-21T07:36:46.924422+0000","last_unstale":"2023-07-21T07:36:46.938138+0000","last_undegraded":"2023-07-21T07:36:46.938138+0000","last_fullsized":"2023-07-21T07:36:46.938138+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:14:49.090853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905924+0000","last_change":"2023-07-21T07:36:28.550836+0000","last_active":"2023-07-21T07:36:46.905924+0000","last_peered":"2023-07-21T07:36:46.905924+0000","last_clean":"2023-07-21T07:36:46.905924+0000","last_became_active":"2023-07-21T07:36:28.550559+0000","last_became_peered":"2023-07-21T07:36:28.550559+0000","last_unstale":"2023-07-21T07:36:46.905924+0000","last_undegraded":"2023-07-21T07:36:46.905924+0000","last_fullsized":"2023-07-21T07:36:46.905924+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:47:50.154203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.922784+0000","last_change":"2023-07-21T07:36:46.910662+0000","last_active":"2023-07-21T07:36:46.922784+0000","last_peered":"2023-07-21T07:36:46.922784+0000","last_clean":"2023-07-21T07:36:46.922784+0000","last_became_active":"2023-07-21T07:36:46.910263+0000","last_became_peered":"2023-07-21T07:36:46.910263+0000","last_unstale":"2023-07-21T07:36:46.922784+0000","last_undegraded":"2023-07-21T07:36:46.922784+0000","last_fullsized":"2023-07-21T07:36:46.922784+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:48:52.254857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914041+0000","last_change":"2023-07-21T07:36:28.550059+0000","last_active":"2023-07-21T07:36:46.914041+0000","last_peered":"2023-07-21T07:36:46.914041+0000","last_clean":"2023-07-21T07:36:46.914041+0000","last_became_active":"2023-07-21T07:36:28.549772+0000","last_became_peered":"2023-07-21T07:36:28.549772+0000","last_unstale":"2023-07-21T07:36:46.914041+0000","last_undegraded":"2023-07-21T07:36:46.914041+0000","last_fullsized":"2023-07-21T07:36:46.914041+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:14:37.136009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.944222+0000","last_change":"2023-07-21T07:36:46.942968+0000","last_active":"2023-07-21T07:36:46.944222+0000","last_peered":"2023-07-21T07:36:46.944222+0000","last_clean":"2023-07-21T07:36:46.944222+0000","last_became_active":"2023-07-21T07:36:46.942662+0000","last_became_peered":"2023-07-21T07:36:46.942662+0000","last_unstale":"2023-07-21T07:36:46.944222+0000","last_undegraded":"2023-07-21T07:36:46.944222+0000","last_fullsized":"2023-07-21T07:36:46.944222+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:21:58.590181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911515+0000","last_change":"2023-07-21T07:36:28.548999+0000","last_active":"2023-07-21T07:36:46.911515+0000","last_peered":"2023-07-21T07:36:46.911515+0000","last_clean":"2023-07-21T07:36:46.911515+0000","last_became_active":"2023-07-21T07:36:28.548721+0000","last_became_peered":"2023-07-21T07:36:28.548721+0000","last_unstale":"2023-07-21T07:36:46.911515+0000","last_undegraded":"2023-07-21T07:36:46.911515+0000","last_fullsized":"2023-07-21T07:36:46.911515+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:24:02.750880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.939011+0000","last_change":"2023-07-21T07:36:46.934546+0000","last_active":"2023-07-21T07:36:46.939011+0000","last_peered":"2023-07-21T07:36:46.939011+0000","last_clean":"2023-07-21T07:36:46.939011+0000","last_became_active":"2023-07-21T07:36:46.934287+0000","last_became_peered":"2023-07-21T07:36:46.934287+0000","last_unstale":"2023-07-21T07:36:46.939011+0000","last_undegraded":"2023-07-21T07:36:46.939011+0000","last_fullsized":"2023-07-21T07:36:46.939011+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:58:22.838750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911876+0000","last_change":"2023-07-21T07:36:28.551943+0000","last_active":"2023-07-21T07:36:46.911876+0000","last_peered":"2023-07-21T07:36:46.911876+0000","last_clean":"2023-07-21T07:36:46.911876+0000","last_became_active":"2023-07-21T07:36:28.551690+0000","last_became_peered":"2023-07-21T07:36:28.551690+0000","last_unstale":"2023-07-21T07:36:46.911876+0000","last_undegraded":"2023-07-21T07:36:46.911876+0000","last_fullsized":"2023-07-21T07:36:46.911876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:07:33.542398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914895+0000","last_change":"2023-07-21T07:36:46.910906+0000","last_active":"2023-07-21T07:36:46.914895+0000","last_peered":"2023-07-21T07:36:46.914895+0000","last_clean":"2023-07-21T07:36:46.914895+0000","last_became_active":"2023-07-21T07:36:46.910639+0000","last_became_peered":"2023-07-21T07:36:46.910639+0000","last_unstale":"2023-07-21T07:36:46.914895+0000","last_undegraded":"2023-07-21T07:36:46.914895+0000","last_fullsized":"2023-07-21T07:36:46.914895+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:59:09.641133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911273+0000","last_change":"2023-07-21T07:36:28.551052+0000","last_active":"2023-07-21T07:36:46.911273+0000","last_peered":"2023-07-21T07:36:46.911273+0000","last_clean":"2023-07-21T07:36:46.911273+0000","last_became_active":"2023-07-21T07:36:28.550737+0000","last_became_peered":"2023-07-21T07:36:28.550737+0000","last_unstale":"2023-07-21T07:36:46.911273+0000","last_undegraded":"2023-07-21T07:36:46.911273+0000","last_fullsized":"2023-07-21T07:36:46.911273+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:58:04.474332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932791+0000","last_change":"2023-07-21T07:36:46.927236+0000","last_active":"2023-07-21T07:36:46.932791+0000","last_peered":"2023-07-21T07:36:46.932791+0000","last_clean":"2023-07-21T07:36:46.932791+0000","last_became_active":"2023-07-21T07:36:46.926976+0000","last_became_peered":"2023-07-21T07:36:46.926976+0000","last_unstale":"2023-07-21T07:36:46.932791+0000","last_undegraded":"2023-07-21T07:36:46.932791+0000","last_fullsized":"2023-07-21T07:36:46.932791+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:15:56.867282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911055+0000","last_change":"2023-07-21T07:36:28.561905+0000","last_active":"2023-07-21T07:36:46.911055+0000","last_peered":"2023-07-21T07:36:46.911055+0000","last_clean":"2023-07-21T07:36:46.911055+0000","last_became_active":"2023-07-21T07:36:28.561351+0000","last_became_peered":"2023-07-21T07:36:28.561351+0000","last_unstale":"2023-07-21T07:36:46.911055+0000","last_undegraded":"2023-07-21T07:36:46.911055+0000","last_fullsized":"2023-07-21T07:36:46.911055+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:59:11.060456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.924873+0000","last_change":"2023-07-21T07:36:46.918054+0000","last_active":"2023-07-21T07:36:46.924873+0000","last_peered":"2023-07-21T07:36:46.924873+0000","last_clean":"2023-07-21T07:36:46.924873+0000","last_became_active":"2023-07-21T07:36:46.917793+0000","last_became_peered":"2023-07-21T07:36:46.917793+0000","last_unstale":"2023-07-21T07:36:46.924873+0000","last_undegraded":"2023-07-21T07:36:46.924873+0000","last_fullsized":"2023-07-21T07:36:46.924873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:15:37.959979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907557+0000","last_change":"2023-07-21T07:36:28.550124+0000","last_active":"2023-07-21T07:36:46.907557+0000","last_peered":"2023-07-21T07:36:46.907557+0000","last_clean":"2023-07-21T07:36:46.907557+0000","last_became_active":"2023-07-21T07:36:28.549862+0000","last_became_peered":"2023-07-21T07:36:28.549862+0000","last_unstale":"2023-07-21T07:36:46.907557+0000","last_undegraded":"2023-07-21T07:36:46.907557+0000","last_fullsized":"2023-07-21T07:36:46.907557+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:41:42.818636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938043+0000","last_change":"2023-07-21T07:36:46.926809+0000","last_active":"2023-07-21T07:36:46.938043+0000","last_peered":"2023-07-21T07:36:46.938043+0000","last_clean":"2023-07-21T07:36:46.938043+0000","last_became_active":"2023-07-21T07:36:46.926500+0000","last_became_peered":"2023-07-21T07:36:46.926500+0000","last_unstale":"2023-07-21T07:36:46.938043+0000","last_undegraded":"2023-07-21T07:36:46.938043+0000","last_fullsized":"2023-07-21T07:36:46.938043+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:41:30.594611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906108+0000","last_change":"2023-07-21T07:36:28.552922+0000","last_active":"2023-07-21T07:36:46.906108+0000","last_peered":"2023-07-21T07:36:46.906108+0000","last_clean":"2023-07-21T07:36:46.906108+0000","last_became_active":"2023-07-21T07:36:28.552646+0000","last_became_peered":"2023-07-21T07:36:28.552646+0000","last_unstale":"2023-07-21T07:36:46.906108+0000","last_undegraded":"2023-07-21T07:36:46.906108+0000","last_fullsized":"2023-07-21T07:36:46.906108+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:14:45.455549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.922497+0000","last_change":"2023-07-21T07:36:46.914534+0000","last_active":"2023-07-21T07:36:46.922497+0000","last_peered":"2023-07-21T07:36:46.922497+0000","last_clean":"2023-07-21T07:36:46.922497+0000","last_became_active":"2023-07-21T07:36:46.914133+0000","last_became_peered":"2023-07-21T07:36:46.914133+0000","last_unstale":"2023-07-21T07:36:46.922497+0000","last_undegraded":"2023-07-21T07:36:46.922497+0000","last_fullsized":"2023-07-21T07:36:46.922497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:55:37.466273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.918138+0000","last_change":"2023-07-21T07:36:28.554910+0000","last_active":"2023-07-21T07:36:46.918138+0000","last_peered":"2023-07-21T07:36:46.918138+0000","last_clean":"2023-07-21T07:36:46.918138+0000","last_became_active":"2023-07-21T07:36:28.554628+0000","last_became_peered":"2023-07-21T07:36:28.554628+0000","last_unstale":"2023-07-21T07:36:46.918138+0000","last_undegraded":"2023-07-21T07:36:46.918138+0000","last_fullsized":"2023-07-21T07:36:46.918138+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:36:43.040440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.939808+0000","last_change":"2023-07-21T07:36:46.929954+0000","last_active":"2023-07-21T07:36:46.939808+0000","last_peered":"2023-07-21T07:36:46.939808+0000","last_clean":"2023-07-21T07:36:46.939808+0000","last_became_active":"2023-07-21T07:36:46.929659+0000","last_became_peered":"2023-07-21T07:36:46.929659+0000","last_unstale":"2023-07-21T07:36:46.939808+0000","last_undegraded":"2023-07-21T07:36:46.939808+0000","last_fullsized":"2023-07-21T07:36:46.939808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:27:35.901936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904803+0000","last_change":"2023-07-21T07:36:28.547134+0000","last_active":"2023-07-21T07:36:46.904803+0000","last_peered":"2023-07-21T07:36:46.904803+0000","last_clean":"2023-07-21T07:36:46.904803+0000","last_became_active":"2023-07-21T07:36:28.546821+0000","last_became_peered":"2023-07-21T07:36:28.546821+0000","last_unstale":"2023-07-21T07:36:46.904803+0000","last_undegraded":"2023-07-21T07:36:46.904803+0000","last_fullsized":"2023-07-21T07:36:46.904803+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:23:24.859339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.934430+0000","last_change":"2023-07-21T07:36:46.926697+0000","last_active":"2023-07-21T07:36:46.934430+0000","last_peered":"2023-07-21T07:36:46.934430+0000","last_clean":"2023-07-21T07:36:46.934430+0000","last_became_active":"2023-07-21T07:36:46.926338+0000","last_became_peered":"2023-07-21T07:36:46.926338+0000","last_unstale":"2023-07-21T07:36:46.934430+0000","last_undegraded":"2023-07-21T07:36:46.934430+0000","last_fullsized":"2023-07-21T07:36:46.934430+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:30:42.278569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911498+0000","last_change":"2023-07-21T07:36:28.546888+0000","last_active":"2023-07-21T07:36:46.911498+0000","last_peered":"2023-07-21T07:36:46.911498+0000","last_clean":"2023-07-21T07:36:46.911498+0000","last_became_active":"2023-07-21T07:36:28.546615+0000","last_became_peered":"2023-07-21T07:36:28.546615+0000","last_unstale":"2023-07-21T07:36:46.911498+0000","last_undegraded":"2023-07-21T07:36:46.911498+0000","last_fullsized":"2023-07-21T07:36:46.911498+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:26:49.024923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.939772+0000","last_change":"2023-07-21T07:36:46.929045+0000","last_active":"2023-07-21T07:36:46.939772+0000","last_peered":"2023-07-21T07:36:46.939772+0000","last_clean":"2023-07-21T07:36:46.939772+0000","last_became_active":"2023-07-21T07:36:46.928729+0000","last_became_peered":"2023-07-21T07:36:46.928729+0000","last_unstale":"2023-07-21T07:36:46.939772+0000","last_undegraded":"2023-07-21T07:36:46.939772+0000","last_fullsized":"2023-07-21T07:36:46.939772+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:36:40.339739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905874+0000","last_change":"2023-07-21T07:36:28.551413+0000","last_active":"2023-07-21T07:36:46.905874+0000","last_peered":"2023-07-21T07:36:46.905874+0000","last_clean":"2023-07-21T07:36:46.905874+0000","last_became_active":"2023-07-21T07:36:28.551080+0000","last_became_peered":"2023-07-21T07:36:28.551080+0000","last_unstale":"2023-07-21T07:36:46.905874+0000","last_undegraded":"2023-07-21T07:36:46.905874+0000","last_fullsized":"2023-07-21T07:36:46.905874+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:40:31.805910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.940211+0000","last_change":"2023-07-21T07:36:46.935202+0000","last_active":"2023-07-21T07:36:46.940211+0000","last_peered":"2023-07-21T07:36:46.940211+0000","last_clean":"2023-07-21T07:36:46.940211+0000","last_became_active":"2023-07-21T07:36:46.934903+0000","last_became_peered":"2023-07-21T07:36:46.934903+0000","last_unstale":"2023-07-21T07:36:46.940211+0000","last_undegraded":"2023-07-21T07:36:46.940211+0000","last_fullsized":"2023-07-21T07:36:46.940211+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:24:52.408043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906974+0000","last_change":"2023-07-21T07:36:28.551886+0000","last_active":"2023-07-21T07:36:46.906974+0000","last_peered":"2023-07-21T07:36:46.906974+0000","last_clean":"2023-07-21T07:36:46.906974+0000","last_became_active":"2023-07-21T07:36:28.551565+0000","last_became_peered":"2023-07-21T07:36:28.551565+0000","last_unstale":"2023-07-21T07:36:46.906974+0000","last_undegraded":"2023-07-21T07:36:46.906974+0000","last_fullsized":"2023-07-21T07:36:46.906974+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:56:59.066697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.920264+0000","last_change":"2023-07-21T07:36:46.917418+0000","last_active":"2023-07-21T07:36:46.920264+0000","last_peered":"2023-07-21T07:36:46.920264+0000","last_clean":"2023-07-21T07:36:46.920264+0000","last_became_active":"2023-07-21T07:36:46.917210+0000","last_became_peered":"2023-07-21T07:36:46.917210+0000","last_unstale":"2023-07-21T07:36:46.920264+0000","last_undegraded":"2023-07-21T07:36:46.920264+0000","last_fullsized":"2023-07-21T07:36:46.920264+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:30:55.049913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911551+0000","last_change":"2023-07-21T07:36:28.558221+0000","last_active":"2023-07-21T07:36:46.911551+0000","last_peered":"2023-07-21T07:36:46.911551+0000","last_clean":"2023-07-21T07:36:46.911551+0000","last_became_active":"2023-07-21T07:36:28.557198+0000","last_became_peered":"2023-07-21T07:36:28.557198+0000","last_unstale":"2023-07-21T07:36:46.911551+0000","last_undegraded":"2023-07-21T07:36:46.911551+0000","last_fullsized":"2023-07-21T07:36:46.911551+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:13:24.378572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.934517+0000","last_change":"2023-07-21T07:36:46.930279+0000","last_active":"2023-07-21T07:36:46.934517+0000","last_peered":"2023-07-21T07:36:46.934517+0000","last_clean":"2023-07-21T07:36:46.934517+0000","last_became_active":"2023-07-21T07:36:46.929957+0000","last_became_peered":"2023-07-21T07:36:46.929957+0000","last_unstale":"2023-07-21T07:36:46.934517+0000","last_undegraded":"2023-07-21T07:36:46.934517+0000","last_fullsized":"2023-07-21T07:36:46.934517+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:04:11.675967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911635+0000","last_change":"2023-07-21T07:36:28.557669+0000","last_active":"2023-07-21T07:36:46.911635+0000","last_peered":"2023-07-21T07:36:46.911635+0000","last_clean":"2023-07-21T07:36:46.911635+0000","last_became_active":"2023-07-21T07:36:28.557198+0000","last_became_peered":"2023-07-21T07:36:28.557198+0000","last_unstale":"2023-07-21T07:36:46.911635+0000","last_undegraded":"2023-07-21T07:36:46.911635+0000","last_fullsized":"2023-07-21T07:36:46.911635+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:42:03.223977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.922779+0000","last_change":"2023-07-21T07:36:46.920006+0000","last_active":"2023-07-21T07:36:46.922779+0000","last_peered":"2023-07-21T07:36:46.922779+0000","last_clean":"2023-07-21T07:36:46.922779+0000","last_became_active":"2023-07-21T07:36:46.919741+0000","last_became_peered":"2023-07-21T07:36:46.919741+0000","last_unstale":"2023-07-21T07:36:46.922779+0000","last_undegraded":"2023-07-21T07:36:46.922779+0000","last_fullsized":"2023-07-21T07:36:46.922779+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:24:01.077385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912318+0000","last_change":"2023-07-21T07:36:28.556248+0000","last_active":"2023-07-21T07:36:46.912318+0000","last_peered":"2023-07-21T07:36:46.912318+0000","last_clean":"2023-07-21T07:36:46.912318+0000","last_became_active":"2023-07-21T07:36:28.556010+0000","last_became_peered":"2023-07-21T07:36:28.556010+0000","last_unstale":"2023-07-21T07:36:46.912318+0000","last_undegraded":"2023-07-21T07:36:46.912318+0000","last_fullsized":"2023-07-21T07:36:46.912318+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:01:35.593787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938142+0000","last_change":"2023-07-21T07:36:46.931353+0000","last_active":"2023-07-21T07:36:46.938142+0000","last_peered":"2023-07-21T07:36:46.938142+0000","last_clean":"2023-07-21T07:36:46.938142+0000","last_became_active":"2023-07-21T07:36:46.931042+0000","last_became_peered":"2023-07-21T07:36:46.931042+0000","last_unstale":"2023-07-21T07:36:46.938142+0000","last_undegraded":"2023-07-21T07:36:46.938142+0000","last_fullsized":"2023-07-21T07:36:46.938142+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:45:36.090178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906039+0000","last_change":"2023-07-21T07:36:28.554107+0000","last_active":"2023-07-21T07:36:46.906039+0000","last_peered":"2023-07-21T07:36:46.906039+0000","last_clean":"2023-07-21T07:36:46.906039+0000","last_became_active":"2023-07-21T07:36:28.553824+0000","last_became_peered":"2023-07-21T07:36:28.553824+0000","last_unstale":"2023-07-21T07:36:46.906039+0000","last_undegraded":"2023-07-21T07:36:46.906039+0000","last_fullsized":"2023-07-21T07:36:46.906039+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:10:58.291575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.925652+0000","last_change":"2023-07-21T07:36:46.922000+0000","last_active":"2023-07-21T07:36:46.925652+0000","last_peered":"2023-07-21T07:36:46.925652+0000","last_clean":"2023-07-21T07:36:46.925652+0000","last_became_active":"2023-07-21T07:36:46.921752+0000","last_became_peered":"2023-07-21T07:36:46.921752+0000","last_unstale":"2023-07-21T07:36:46.925652+0000","last_undegraded":"2023-07-21T07:36:46.925652+0000","last_fullsized":"2023-07-21T07:36:46.925652+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:33:39.431098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907394+0000","last_change":"2023-07-21T07:36:28.544714+0000","last_active":"2023-07-21T07:36:46.907394+0000","last_peered":"2023-07-21T07:36:46.907394+0000","last_clean":"2023-07-21T07:36:46.907394+0000","last_became_active":"2023-07-21T07:36:28.544330+0000","last_became_peered":"2023-07-21T07:36:28.544330+0000","last_unstale":"2023-07-21T07:36:46.907394+0000","last_undegraded":"2023-07-21T07:36:46.907394+0000","last_fullsized":"2023-07-21T07:36:46.907394+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:21:11.273627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932510+0000","last_change":"2023-07-21T07:36:46.925505+0000","last_active":"2023-07-21T07:36:46.932510+0000","last_peered":"2023-07-21T07:36:46.932510+0000","last_clean":"2023-07-21T07:36:46.932510+0000","last_became_active":"2023-07-21T07:36:46.925207+0000","last_became_peered":"2023-07-21T07:36:46.925207+0000","last_unstale":"2023-07-21T07:36:46.932510+0000","last_undegraded":"2023-07-21T07:36:46.932510+0000","last_fullsized":"2023-07-21T07:36:46.932510+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:49:48.657150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912006+0000","last_change":"2023-07-21T07:36:28.553757+0000","last_active":"2023-07-21T07:36:46.912006+0000","last_peered":"2023-07-21T07:36:46.912006+0000","last_clean":"2023-07-21T07:36:46.912006+0000","last_became_active":"2023-07-21T07:36:28.553520+0000","last_became_peered":"2023-07-21T07:36:28.553520+0000","last_unstale":"2023-07-21T07:36:46.912006+0000","last_undegraded":"2023-07-21T07:36:46.912006+0000","last_fullsized":"2023-07-21T07:36:46.912006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:24:02.750880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.925675+0000","last_change":"2023-07-21T07:36:46.921847+0000","last_active":"2023-07-21T07:36:46.925675+0000","last_peered":"2023-07-21T07:36:46.925675+0000","last_clean":"2023-07-21T07:36:46.925675+0000","last_became_active":"2023-07-21T07:36:46.921538+0000","last_became_peered":"2023-07-21T07:36:46.921538+0000","last_unstale":"2023-07-21T07:36:46.925675+0000","last_undegraded":"2023-07-21T07:36:46.925675+0000","last_fullsized":"2023-07-21T07:36:46.925675+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:44:35.066491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911101+0000","last_change":"2023-07-21T07:36:28.546337+0000","last_active":"2023-07-21T07:36:46.911101+0000","last_peered":"2023-07-21T07:36:46.911101+0000","last_clean":"2023-07-21T07:36:46.911101+0000","last_became_active":"2023-07-21T07:36:28.546061+0000","last_became_peered":"2023-07-21T07:36:28.546061+0000","last_unstale":"2023-07-21T07:36:46.911101+0000","last_undegraded":"2023-07-21T07:36:46.911101+0000","last_fullsized":"2023-07-21T07:36:46.911101+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:54:09.794907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.944497+0000","last_change":"2023-07-21T07:36:46.926794+0000","last_active":"2023-07-21T07:36:46.944497+0000","last_peered":"2023-07-21T07:36:46.944497+0000","last_clean":"2023-07-21T07:36:46.944497+0000","last_became_active":"2023-07-21T07:36:46.926408+0000","last_became_peered":"2023-07-21T07:36:46.926408+0000","last_unstale":"2023-07-21T07:36:46.944497+0000","last_undegraded":"2023-07-21T07:36:46.944497+0000","last_fullsized":"2023-07-21T07:36:46.944497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:27:02.660082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905321+0000","last_change":"2023-07-21T07:36:28.553711+0000","last_active":"2023-07-21T07:36:46.905321+0000","last_peered":"2023-07-21T07:36:46.905321+0000","last_clean":"2023-07-21T07:36:46.905321+0000","last_became_active":"2023-07-21T07:36:28.553426+0000","last_became_peered":"2023-07-21T07:36:28.553426+0000","last_unstale":"2023-07-21T07:36:46.905321+0000","last_undegraded":"2023-07-21T07:36:46.905321+0000","last_fullsized":"2023-07-21T07:36:46.905321+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:40:24.687597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932812+0000","last_change":"2023-07-21T07:36:46.927835+0000","last_active":"2023-07-21T07:36:46.932812+0000","last_peered":"2023-07-21T07:36:46.932812+0000","last_clean":"2023-07-21T07:36:46.932812+0000","last_became_active":"2023-07-21T07:36:46.927574+0000","last_became_peered":"2023-07-21T07:36:46.927574+0000","last_unstale":"2023-07-21T07:36:46.932812+0000","last_undegraded":"2023-07-21T07:36:46.932812+0000","last_fullsized":"2023-07-21T07:36:46.932812+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:01:03.330143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913970+0000","last_change":"2023-07-21T07:36:28.557219+0000","last_active":"2023-07-21T07:36:46.913970+0000","last_peered":"2023-07-21T07:36:46.913970+0000","last_clean":"2023-07-21T07:36:46.913970+0000","last_became_active":"2023-07-21T07:36:28.556584+0000","last_became_peered":"2023-07-21T07:36:28.556584+0000","last_unstale":"2023-07-21T07:36:46.913970+0000","last_undegraded":"2023-07-21T07:36:46.913970+0000","last_fullsized":"2023-07-21T07:36:46.913970+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:45:36.038414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.917944+0000","last_change":"2023-07-21T07:36:46.914172+0000","last_active":"2023-07-21T07:36:46.917944+0000","last_peered":"2023-07-21T07:36:46.917944+0000","last_clean":"2023-07-21T07:36:46.917944+0000","last_became_active":"2023-07-21T07:36:46.913040+0000","last_became_peered":"2023-07-21T07:36:46.913040+0000","last_unstale":"2023-07-21T07:36:46.917944+0000","last_undegraded":"2023-07-21T07:36:46.917944+0000","last_fullsized":"2023-07-21T07:36:46.917944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:17:13.881677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.943112+0000","last_change":"2023-07-21T07:36:45.913909+0000","last_active":"2023-07-21T07:36:46.943112+0000","last_peered":"2023-07-21T07:36:46.943112+0000","last_clean":"2023-07-21T07:36:46.943112+0000","last_became_active":"2023-07-21T07:36:45.913622+0000","last_became_peered":"2023-07-21T07:36:45.913622+0000","last_unstale":"2023-07-21T07:36:46.943112+0000","last_undegraded":"2023-07-21T07:36:46.943112+0000","last_fullsized":"2023-07-21T07:36:46.943112+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:37:19.528849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.920596+0000","last_change":"2023-07-21T07:36:28.554012+0000","last_active":"2023-07-21T07:36:46.920596+0000","last_peered":"2023-07-21T07:36:46.920596+0000","last_clean":"2023-07-21T07:36:46.920596+0000","last_became_active":"2023-07-21T07:36:28.553737+0000","last_became_peered":"2023-07-21T07:36:28.553737+0000","last_unstale":"2023-07-21T07:36:46.920596+0000","last_undegraded":"2023-07-21T07:36:46.920596+0000","last_fullsized":"2023-07-21T07:36:46.920596+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:22:40.174027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"53'4","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907363+0000","last_change":"2023-07-21T07:36:27.542913+0000","last_active":"2023-07-21T07:36:46.907363+0000","last_peered":"2023-07-21T07:36:46.907363+0000","last_clean":"2023-07-21T07:36:46.907363+0000","last_became_active":"2023-07-21T07:36:27.542352+0000","last_became_peered":"2023-07-21T07:36:27.542352+0000","last_unstale":"2023-07-21T07:36:46.907363+0000","last_undegraded":"2023-07-21T07:36:46.907363+0000","last_fullsized":"2023-07-21T07:36:46.907363+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:54:48.273335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.917897+0000","last_change":"2023-07-21T07:36:46.914406+0000","last_active":"2023-07-21T07:36:46.917897+0000","last_peered":"2023-07-21T07:36:46.917897+0000","last_clean":"2023-07-21T07:36:46.917897+0000","last_became_active":"2023-07-21T07:36:46.913766+0000","last_became_peered":"2023-07-21T07:36:46.913766+0000","last_unstale":"2023-07-21T07:36:46.917897+0000","last_undegraded":"2023-07-21T07:36:46.917897+0000","last_fullsized":"2023-07-21T07:36:46.917897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:10:37.483435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.933020+0000","last_change":"2023-07-21T07:36:45.909492+0000","last_active":"2023-07-21T07:36:46.933020+0000","last_peered":"2023-07-21T07:36:46.933020+0000","last_clean":"2023-07-21T07:36:46.933020+0000","last_became_active":"2023-07-21T07:36:45.909234+0000","last_became_peered":"2023-07-21T07:36:45.909234+0000","last_unstale":"2023-07-21T07:36:46.933020+0000","last_undegraded":"2023-07-21T07:36:46.933020+0000","last_fullsized":"2023-07-21T07:36:46.933020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:44:10.346087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906082+0000","last_change":"2023-07-21T07:36:28.549909+0000","last_active":"2023-07-21T07:36:46.906082+0000","last_peered":"2023-07-21T07:36:46.906082+0000","last_clean":"2023-07-21T07:36:46.906082+0000","last_became_active":"2023-07-21T07:36:28.549643+0000","last_became_peered":"2023-07-21T07:36:28.549643+0000","last_unstale":"2023-07-21T07:36:46.906082+0000","last_undegraded":"2023-07-21T07:36:46.906082+0000","last_fullsized":"2023-07-21T07:36:46.906082+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:48:02.004368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"53'1","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915763+0000","last_change":"2023-07-21T07:36:27.544173+0000","last_active":"2023-07-21T07:36:46.915763+0000","last_peered":"2023-07-21T07:36:46.915763+0000","last_clean":"2023-07-21T07:36:46.915763+0000","last_became_active":"2023-07-21T07:36:27.543806+0000","last_became_peered":"2023-07-21T07:36:27.543806+0000","last_unstale":"2023-07-21T07:36:46.915763+0000","last_undegraded":"2023-07-21T07:36:46.915763+0000","last_fullsized":"2023-07-21T07:36:46.915763+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:54:31.837115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.920234+0000","last_change":"2023-07-21T07:36:46.915860+0000","last_active":"2023-07-21T07:36:46.920234+0000","last_peered":"2023-07-21T07:36:46.920234+0000","last_clean":"2023-07-21T07:36:46.920234+0000","last_became_active":"2023-07-21T07:36:46.915579+0000","last_became_peered":"2023-07-21T07:36:46.915579+0000","last_unstale":"2023-07-21T07:36:46.920234+0000","last_undegraded":"2023-07-21T07:36:46.920234+0000","last_fullsized":"2023-07-21T07:36:46.920234+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:56:08.681349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"57'4","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.941616+0000","last_change":"2023-07-21T07:36:45.912403+0000","last_active":"2023-07-21T07:36:46.941616+0000","last_peered":"2023-07-21T07:36:46.941616+0000","last_clean":"2023-07-21T07:36:46.941616+0000","last_became_active":"2023-07-21T07:36:45.912058+0000","last_became_peered":"2023-07-21T07:36:45.912058+0000","last_unstale":"2023-07-21T07:36:46.941616+0000","last_undegraded":"2023-07-21T07:36:46.941616+0000","last_fullsized":"2023-07-21T07:36:46.941616+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:46:08.990070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915914+0000","last_change":"2023-07-21T07:36:28.553914+0000","last_active":"2023-07-21T07:36:46.915914+0000","last_peered":"2023-07-21T07:36:46.915914+0000","last_clean":"2023-07-21T07:36:46.915914+0000","last_became_active":"2023-07-21T07:36:28.553610+0000","last_became_peered":"2023-07-21T07:36:28.553610+0000","last_unstale":"2023-07-21T07:36:46.915914+0000","last_undegraded":"2023-07-21T07:36:46.915914+0000","last_fullsized":"2023-07-21T07:36:46.915914+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:24:31.633925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"53'2","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913248+0000","last_change":"2023-07-21T07:36:27.548717+0000","last_active":"2023-07-21T07:36:46.913248+0000","last_peered":"2023-07-21T07:36:46.913248+0000","last_clean":"2023-07-21T07:36:46.913248+0000","last_became_active":"2023-07-21T07:36:27.548229+0000","last_became_peered":"2023-07-21T07:36:27.548229+0000","last_unstale":"2023-07-21T07:36:46.913248+0000","last_undegraded":"2023-07-21T07:36:46.913248+0000","last_fullsized":"2023-07-21T07:36:46.913248+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:15:15.775784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932224+0000","last_change":"2023-07-21T07:36:46.920123+0000","last_active":"2023-07-21T07:36:46.932224+0000","last_peered":"2023-07-21T07:36:46.932224+0000","last_clean":"2023-07-21T07:36:46.932224+0000","last_became_active":"2023-07-21T07:36:46.919800+0000","last_became_peered":"2023-07-21T07:36:46.919800+0000","last_unstale":"2023-07-21T07:36:46.932224+0000","last_undegraded":"2023-07-21T07:36:46.932224+0000","last_fullsized":"2023-07-21T07:36:46.932224+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:11:41.659131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938816+0000","last_change":"2023-07-21T07:36:45.914046+0000","last_active":"2023-07-21T07:36:46.938816+0000","last_peered":"2023-07-21T07:36:46.938816+0000","last_clean":"2023-07-21T07:36:46.938816+0000","last_became_active":"2023-07-21T07:36:45.913746+0000","last_became_peered":"2023-07-21T07:36:45.913746+0000","last_unstale":"2023-07-21T07:36:46.938816+0000","last_undegraded":"2023-07-21T07:36:46.938816+0000","last_fullsized":"2023-07-21T07:36:46.938816+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:39:36.356734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914914+0000","last_change":"2023-07-21T07:36:28.551204+0000","last_active":"2023-07-21T07:36:46.914914+0000","last_peered":"2023-07-21T07:36:46.914914+0000","last_clean":"2023-07-21T07:36:46.914914+0000","last_became_active":"2023-07-21T07:36:28.550896+0000","last_became_peered":"2023-07-21T07:36:28.550896+0000","last_unstale":"2023-07-21T07:36:46.914914+0000","last_undegraded":"2023-07-21T07:36:46.914914+0000","last_fullsized":"2023-07-21T07:36:46.914914+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:04:08.888934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"53'2","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914550+0000","last_change":"2023-07-21T07:36:27.550565+0000","last_active":"2023-07-21T07:36:46.914550+0000","last_peered":"2023-07-21T07:36:46.914550+0000","last_clean":"2023-07-21T07:36:46.914550+0000","last_became_active":"2023-07-21T07:36:27.550235+0000","last_became_peered":"2023-07-21T07:36:27.550235+0000","last_unstale":"2023-07-21T07:36:46.914550+0000","last_undegraded":"2023-07-21T07:36:46.914550+0000","last_fullsized":"2023-07-21T07:36:46.914550+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:16:55.790478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915134+0000","last_change":"2023-07-21T07:36:46.911104+0000","last_active":"2023-07-21T07:36:46.915134+0000","last_peered":"2023-07-21T07:36:46.915134+0000","last_clean":"2023-07-21T07:36:46.915134+0000","last_became_active":"2023-07-21T07:36:46.910615+0000","last_became_peered":"2023-07-21T07:36:46.910615+0000","last_unstale":"2023-07-21T07:36:46.915134+0000","last_undegraded":"2023-07-21T07:36:46.915134+0000","last_fullsized":"2023-07-21T07:36:46.915134+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:45:42.579561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914115+0000","last_change":"2023-07-21T07:36:45.908037+0000","last_active":"2023-07-21T07:36:46.914115+0000","last_peered":"2023-07-21T07:36:46.914115+0000","last_clean":"2023-07-21T07:36:46.914115+0000","last_became_active":"2023-07-21T07:36:45.907753+0000","last_became_peered":"2023-07-21T07:36:45.907753+0000","last_unstale":"2023-07-21T07:36:46.914115+0000","last_undegraded":"2023-07-21T07:36:46.914115+0000","last_fullsized":"2023-07-21T07:36:46.914115+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:57:16.424489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911209+0000","last_change":"2023-07-21T07:36:28.564622+0000","last_active":"2023-07-21T07:36:46.911209+0000","last_peered":"2023-07-21T07:36:46.911209+0000","last_clean":"2023-07-21T07:36:46.911209+0000","last_became_active":"2023-07-21T07:36:28.564322+0000","last_became_peered":"2023-07-21T07:36:28.564322+0000","last_unstale":"2023-07-21T07:36:46.911209+0000","last_undegraded":"2023-07-21T07:36:46.911209+0000","last_fullsized":"2023-07-21T07:36:46.911209+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:23:55.153453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"53'1","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905173+0000","last_change":"2023-07-21T07:36:27.548030+0000","last_active":"2023-07-21T07:36:46.905173+0000","last_peered":"2023-07-21T07:36:46.905173+0000","last_clean":"2023-07-21T07:36:46.905173+0000","last_became_active":"2023-07-21T07:36:27.547734+0000","last_became_peered":"2023-07-21T07:36:27.547734+0000","last_unstale":"2023-07-21T07:36:46.905173+0000","last_undegraded":"2023-07-21T07:36:46.905173+0000","last_fullsized":"2023-07-21T07:36:46.905173+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:32:20.547301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.939921+0000","last_change":"2023-07-21T07:36:46.938741+0000","last_active":"2023-07-21T07:36:46.939921+0000","last_peered":"2023-07-21T07:36:46.939921+0000","last_clean":"2023-07-21T07:36:46.939921+0000","last_became_active":"2023-07-21T07:36:46.938457+0000","last_became_peered":"2023-07-21T07:36:46.938457+0000","last_unstale":"2023-07-21T07:36:46.939921+0000","last_undegraded":"2023-07-21T07:36:46.939921+0000","last_fullsized":"2023-07-21T07:36:46.939921+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:10:44.421155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.910892+0000","last_change":"2023-07-21T07:36:45.901685+0000","last_active":"2023-07-21T07:36:46.910892+0000","last_peered":"2023-07-21T07:36:46.910892+0000","last_clean":"2023-07-21T07:36:46.910892+0000","last_became_active":"2023-07-21T07:36:45.901385+0000","last_became_peered":"2023-07-21T07:36:45.901385+0000","last_unstale":"2023-07-21T07:36:46.910892+0000","last_undegraded":"2023-07-21T07:36:46.910892+0000","last_fullsized":"2023-07-21T07:36:46.910892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:20:30.015376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904853+0000","last_change":"2023-07-21T07:36:28.561529+0000","last_active":"2023-07-21T07:36:46.904853+0000","last_peered":"2023-07-21T07:36:46.904853+0000","last_clean":"2023-07-21T07:36:46.904853+0000","last_became_active":"2023-07-21T07:36:28.561238+0000","last_became_peered":"2023-07-21T07:36:28.561238+0000","last_unstale":"2023-07-21T07:36:46.904853+0000","last_undegraded":"2023-07-21T07:36:46.904853+0000","last_fullsized":"2023-07-21T07:36:46.904853+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:08:56.057233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"53'1","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905528+0000","last_change":"2023-07-21T07:36:27.543128+0000","last_active":"2023-07-21T07:36:46.905528+0000","last_peered":"2023-07-21T07:36:46.905528+0000","last_clean":"2023-07-21T07:36:46.905528+0000","last_became_active":"2023-07-21T07:36:27.542777+0000","last_became_peered":"2023-07-21T07:36:27.542777+0000","last_unstale":"2023-07-21T07:36:46.905528+0000","last_undegraded":"2023-07-21T07:36:46.905528+0000","last_fullsized":"2023-07-21T07:36:46.905528+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:41:38.262822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.941319+0000","last_change":"2023-07-21T07:36:46.938955+0000","last_active":"2023-07-21T07:36:46.941319+0000","last_peered":"2023-07-21T07:36:46.941319+0000","last_clean":"2023-07-21T07:36:46.941319+0000","last_became_active":"2023-07-21T07:36:46.938688+0000","last_became_peered":"2023-07-21T07:36:46.938688+0000","last_unstale":"2023-07-21T07:36:46.941319+0000","last_undegraded":"2023-07-21T07:36:46.941319+0000","last_fullsized":"2023-07-21T07:36:46.941319+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:50:05.920137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.935496+0000","last_change":"2023-07-21T07:36:45.912305+0000","last_active":"2023-07-21T07:36:46.935496+0000","last_peered":"2023-07-21T07:36:46.935496+0000","last_clean":"2023-07-21T07:36:46.935496+0000","last_became_active":"2023-07-21T07:36:45.912005+0000","last_became_peered":"2023-07-21T07:36:45.912005+0000","last_unstale":"2023-07-21T07:36:46.935496+0000","last_undegraded":"2023-07-21T07:36:46.935496+0000","last_fullsized":"2023-07-21T07:36:46.935496+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:13:29.344323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915602+0000","last_change":"2023-07-21T07:36:28.552687+0000","last_active":"2023-07-21T07:36:46.915602+0000","last_peered":"2023-07-21T07:36:46.915602+0000","last_clean":"2023-07-21T07:36:46.915602+0000","last_became_active":"2023-07-21T07:36:28.552238+0000","last_became_peered":"2023-07-21T07:36:28.552238+0000","last_unstale":"2023-07-21T07:36:46.915602+0000","last_undegraded":"2023-07-21T07:36:46.915602+0000","last_fullsized":"2023-07-21T07:36:46.915602+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:31:51.872997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906653+0000","last_change":"2023-07-21T07:36:27.545649+0000","last_active":"2023-07-21T07:36:46.906653+0000","last_peered":"2023-07-21T07:36:46.906653+0000","last_clean":"2023-07-21T07:36:46.906653+0000","last_became_active":"2023-07-21T07:36:27.545358+0000","last_became_peered":"2023-07-21T07:36:27.545358+0000","last_unstale":"2023-07-21T07:36:46.906653+0000","last_undegraded":"2023-07-21T07:36:46.906653+0000","last_fullsized":"2023-07-21T07:36:46.906653+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:58:26.522998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.944243+0000","last_change":"2023-07-21T07:36:46.943327+0000","last_active":"2023-07-21T07:36:46.944243+0000","last_peered":"2023-07-21T07:36:46.944243+0000","last_clean":"2023-07-21T07:36:46.944243+0000","last_became_active":"2023-07-21T07:36:46.942960+0000","last_became_peered":"2023-07-21T07:36:46.942960+0000","last_unstale":"2023-07-21T07:36:46.944243+0000","last_undegraded":"2023-07-21T07:36:46.944243+0000","last_fullsized":"2023-07-21T07:36:46.944243+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:49:26.415109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938384+0000","last_change":"2023-07-21T07:36:45.913557+0000","last_active":"2023-07-21T07:36:46.938384+0000","last_peered":"2023-07-21T07:36:46.938384+0000","last_clean":"2023-07-21T07:36:46.938384+0000","last_became_active":"2023-07-21T07:36:45.913101+0000","last_became_peered":"2023-07-21T07:36:45.913101+0000","last_unstale":"2023-07-21T07:36:46.938384+0000","last_undegraded":"2023-07-21T07:36:46.938384+0000","last_fullsized":"2023-07-21T07:36:46.938384+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:13:41.736364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905002+0000","last_change":"2023-07-21T07:36:28.551678+0000","last_active":"2023-07-21T07:36:46.905002+0000","last_peered":"2023-07-21T07:36:46.905002+0000","last_clean":"2023-07-21T07:36:46.905002+0000","last_became_active":"2023-07-21T07:36:28.551150+0000","last_became_peered":"2023-07-21T07:36:28.551150+0000","last_unstale":"2023-07-21T07:36:46.905002+0000","last_undegraded":"2023-07-21T07:36:46.905002+0000","last_fullsized":"2023-07-21T07:36:46.905002+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:49:08.050691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.916414+0000","last_change":"2023-07-21T07:36:27.549188+0000","last_active":"2023-07-21T07:36:46.916414+0000","last_peered":"2023-07-21T07:36:46.916414+0000","last_clean":"2023-07-21T07:36:46.916414+0000","last_became_active":"2023-07-21T07:36:27.548866+0000","last_became_peered":"2023-07-21T07:36:27.548866+0000","last_unstale":"2023-07-21T07:36:46.916414+0000","last_undegraded":"2023-07-21T07:36:46.916414+0000","last_fullsized":"2023-07-21T07:36:46.916414+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:47:05.576287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.922808+0000","last_change":"2023-07-21T07:36:46.911238+0000","last_active":"2023-07-21T07:36:46.922808+0000","last_peered":"2023-07-21T07:36:46.922808+0000","last_clean":"2023-07-21T07:36:46.922808+0000","last_became_active":"2023-07-21T07:36:46.910958+0000","last_became_peered":"2023-07-21T07:36:46.910958+0000","last_unstale":"2023-07-21T07:36:46.922808+0000","last_undegraded":"2023-07-21T07:36:46.922808+0000","last_fullsized":"2023-07-21T07:36:46.922808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:40:32.179748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"57'3","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.942214+0000","last_change":"2023-07-21T07:36:45.908665+0000","last_active":"2023-07-21T07:36:46.942214+0000","last_peered":"2023-07-21T07:36:46.942214+0000","last_clean":"2023-07-21T07:36:46.942214+0000","last_became_active":"2023-07-21T07:36:45.908321+0000","last_became_peered":"2023-07-21T07:36:45.908321+0000","last_unstale":"2023-07-21T07:36:46.942214+0000","last_undegraded":"2023-07-21T07:36:46.942214+0000","last_fullsized":"2023-07-21T07:36:46.942214+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:16:16.179184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907038+0000","last_change":"2023-07-21T07:36:28.561022+0000","last_active":"2023-07-21T07:36:46.907038+0000","last_peered":"2023-07-21T07:36:46.907038+0000","last_clean":"2023-07-21T07:36:46.907038+0000","last_became_active":"2023-07-21T07:36:28.560541+0000","last_became_peered":"2023-07-21T07:36:28.560541+0000","last_unstale":"2023-07-21T07:36:46.907038+0000","last_undegraded":"2023-07-21T07:36:46.907038+0000","last_fullsized":"2023-07-21T07:36:46.907038+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:51:47.425948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914646+0000","last_change":"2023-07-21T07:36:27.541612+0000","last_active":"2023-07-21T07:36:46.914646+0000","last_peered":"2023-07-21T07:36:46.914646+0000","last_clean":"2023-07-21T07:36:46.914646+0000","last_became_active":"2023-07-21T07:36:27.541373+0000","last_became_peered":"2023-07-21T07:36:27.541373+0000","last_unstale":"2023-07-21T07:36:46.914646+0000","last_undegraded":"2023-07-21T07:36:46.914646+0000","last_fullsized":"2023-07-21T07:36:46.914646+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:01:56.804032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.940960+0000","last_change":"2023-07-21T07:36:46.938540+0000","last_active":"2023-07-21T07:36:46.940960+0000","last_peered":"2023-07-21T07:36:46.940960+0000","last_clean":"2023-07-21T07:36:46.940960+0000","last_became_active":"2023-07-21T07:36:46.938198+0000","last_became_peered":"2023-07-21T07:36:46.938198+0000","last_unstale":"2023-07-21T07:36:46.940960+0000","last_undegraded":"2023-07-21T07:36:46.940960+0000","last_fullsized":"2023-07-21T07:36:46.940960+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:35:35.671358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"57'6","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.939933+0000","last_change":"2023-07-21T07:36:45.900626+0000","last_active":"2023-07-21T07:36:46.939933+0000","last_peered":"2023-07-21T07:36:46.939933+0000","last_clean":"2023-07-21T07:36:46.939933+0000","last_became_active":"2023-07-21T07:36:45.900367+0000","last_became_peered":"2023-07-21T07:36:45.900367+0000","last_unstale":"2023-07-21T07:36:46.939933+0000","last_undegraded":"2023-07-21T07:36:46.939933+0000","last_fullsized":"2023-07-21T07:36:46.939933+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:33:45.465886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904426+0000","last_change":"2023-07-21T07:36:28.547366+0000","last_active":"2023-07-21T07:36:46.904426+0000","last_peered":"2023-07-21T07:36:46.904426+0000","last_clean":"2023-07-21T07:36:46.904426+0000","last_became_active":"2023-07-21T07:36:28.547029+0000","last_became_peered":"2023-07-21T07:36:28.547029+0000","last_unstale":"2023-07-21T07:36:46.904426+0000","last_undegraded":"2023-07-21T07:36:46.904426+0000","last_fullsized":"2023-07-21T07:36:46.904426+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:49:33.261990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906459+0000","last_change":"2023-07-21T07:36:27.547744+0000","last_active":"2023-07-21T07:36:46.906459+0000","last_peered":"2023-07-21T07:36:46.906459+0000","last_clean":"2023-07-21T07:36:46.906459+0000","last_became_active":"2023-07-21T07:36:27.547463+0000","last_became_peered":"2023-07-21T07:36:27.547463+0000","last_unstale":"2023-07-21T07:36:46.906459+0000","last_undegraded":"2023-07-21T07:36:46.906459+0000","last_fullsized":"2023-07-21T07:36:46.906459+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:04:47.446026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.936711+0000","last_change":"2023-07-21T07:36:46.921997+0000","last_active":"2023-07-21T07:36:46.936711+0000","last_peered":"2023-07-21T07:36:46.936711+0000","last_clean":"2023-07-21T07:36:46.936711+0000","last_became_active":"2023-07-21T07:36:46.921703+0000","last_became_peered":"2023-07-21T07:36:46.921703+0000","last_unstale":"2023-07-21T07:36:46.936711+0000","last_undegraded":"2023-07-21T07:36:46.936711+0000","last_fullsized":"2023-07-21T07:36:46.936711+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:32:39.917192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914405+0000","last_change":"2023-07-21T07:36:45.915581+0000","last_active":"2023-07-21T07:36:46.914405+0000","last_peered":"2023-07-21T07:36:46.914405+0000","last_clean":"2023-07-21T07:36:46.914405+0000","last_became_active":"2023-07-21T07:36:45.915296+0000","last_became_peered":"2023-07-21T07:36:45.915296+0000","last_unstale":"2023-07-21T07:36:46.914405+0000","last_undegraded":"2023-07-21T07:36:46.914405+0000","last_fullsized":"2023-07-21T07:36:46.914405+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:34.457862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.920489+0000","last_change":"2023-07-21T07:36:28.542046+0000","last_active":"2023-07-21T07:36:46.920489+0000","last_peered":"2023-07-21T07:36:46.920489+0000","last_clean":"2023-07-21T07:36:46.920489+0000","last_became_active":"2023-07-21T07:36:28.541690+0000","last_became_peered":"2023-07-21T07:36:28.541690+0000","last_unstale":"2023-07-21T07:36:46.920489+0000","last_undegraded":"2023-07-21T07:36:46.920489+0000","last_fullsized":"2023-07-21T07:36:46.920489+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:14:51.106285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"53'3","reported_seq":22,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914129+0000","last_change":"2023-07-21T07:36:27.542236+0000","last_active":"2023-07-21T07:36:46.914129+0000","last_peered":"2023-07-21T07:36:46.914129+0000","last_clean":"2023-07-21T07:36:46.914129+0000","last_became_active":"2023-07-21T07:36:27.541799+0000","last_became_peered":"2023-07-21T07:36:27.541799+0000","last_unstale":"2023-07-21T07:36:46.914129+0000","last_undegraded":"2023-07-21T07:36:46.914129+0000","last_fullsized":"2023-07-21T07:36:46.914129+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:48:31.993058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.922601+0000","last_change":"2023-07-21T07:36:46.917096+0000","last_active":"2023-07-21T07:36:46.922601+0000","last_peered":"2023-07-21T07:36:46.922601+0000","last_clean":"2023-07-21T07:36:46.922601+0000","last_became_active":"2023-07-21T07:36:46.916811+0000","last_became_peered":"2023-07-21T07:36:46.916811+0000","last_unstale":"2023-07-21T07:36:46.922601+0000","last_undegraded":"2023-07-21T07:36:46.922601+0000","last_fullsized":"2023-07-21T07:36:46.922601+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:33:39.431098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915205+0000","last_change":"2023-07-21T07:36:45.908177+0000","last_active":"2023-07-21T07:36:46.915205+0000","last_peered":"2023-07-21T07:36:46.915205+0000","last_clean":"2023-07-21T07:36:46.915205+0000","last_became_active":"2023-07-21T07:36:45.907636+0000","last_became_peered":"2023-07-21T07:36:45.907636+0000","last_unstale":"2023-07-21T07:36:46.915205+0000","last_undegraded":"2023-07-21T07:36:46.915205+0000","last_fullsized":"2023-07-21T07:36:46.915205+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:34.457862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906547+0000","last_change":"2023-07-21T07:36:28.555407+0000","last_active":"2023-07-21T07:36:46.906547+0000","last_peered":"2023-07-21T07:36:46.906547+0000","last_clean":"2023-07-21T07:36:46.906547+0000","last_became_active":"2023-07-21T07:36:28.552229+0000","last_became_peered":"2023-07-21T07:36:28.552229+0000","last_unstale":"2023-07-21T07:36:46.906547+0000","last_undegraded":"2023-07-21T07:36:46.906547+0000","last_fullsized":"2023-07-21T07:36:46.906547+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:29:23.804284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"54'8","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907229+0000","last_change":"2023-07-21T07:36:27.546185+0000","last_active":"2023-07-21T07:36:46.907229+0000","last_peered":"2023-07-21T07:36:46.907229+0000","last_clean":"2023-07-21T07:36:46.907229+0000","last_became_active":"2023-07-21T07:36:27.545925+0000","last_became_peered":"2023-07-21T07:36:27.545925+0000","last_unstale":"2023-07-21T07:36:46.907229+0000","last_undegraded":"2023-07-21T07:36:46.907229+0000","last_fullsized":"2023-07-21T07:36:46.907229+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:12:01.355660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938655+0000","last_change":"2023-07-21T07:36:46.929136+0000","last_active":"2023-07-21T07:36:46.938655+0000","last_peered":"2023-07-21T07:36:46.938655+0000","last_clean":"2023-07-21T07:36:46.938655+0000","last_became_active":"2023-07-21T07:36:46.928864+0000","last_became_peered":"2023-07-21T07:36:46.928864+0000","last_unstale":"2023-07-21T07:36:46.938655+0000","last_undegraded":"2023-07-21T07:36:46.938655+0000","last_fullsized":"2023-07-21T07:36:46.938655+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:57:35.868513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.909034+0000","last_change":"2023-07-21T07:36:45.912368+0000","last_active":"2023-07-21T07:36:46.909034+0000","last_peered":"2023-07-21T07:36:46.909034+0000","last_clean":"2023-07-21T07:36:46.909034+0000","last_became_active":"2023-07-21T07:36:45.912044+0000","last_became_peered":"2023-07-21T07:36:45.912044+0000","last_unstale":"2023-07-21T07:36:46.909034+0000","last_undegraded":"2023-07-21T07:36:46.909034+0000","last_fullsized":"2023-07-21T07:36:46.909034+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:36:27.392107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904968+0000","last_change":"2023-07-21T07:36:28.549175+0000","last_active":"2023-07-21T07:36:46.904968+0000","last_peered":"2023-07-21T07:36:46.904968+0000","last_clean":"2023-07-21T07:36:46.904968+0000","last_became_active":"2023-07-21T07:36:28.548904+0000","last_became_peered":"2023-07-21T07:36:28.548904+0000","last_unstale":"2023-07-21T07:36:46.904968+0000","last_undegraded":"2023-07-21T07:36:46.904968+0000","last_fullsized":"2023-07-21T07:36:46.904968+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:28:58.739292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"53'2","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913664+0000","last_change":"2023-07-21T07:36:27.544775+0000","last_active":"2023-07-21T07:36:46.913664+0000","last_peered":"2023-07-21T07:36:46.913664+0000","last_clean":"2023-07-21T07:36:46.913664+0000","last_became_active":"2023-07-21T07:36:27.544495+0000","last_became_peered":"2023-07-21T07:36:27.544495+0000","last_unstale":"2023-07-21T07:36:46.913664+0000","last_undegraded":"2023-07-21T07:36:46.913664+0000","last_fullsized":"2023-07-21T07:36:46.913664+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:05:27.853733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938955+0000","last_change":"2023-07-21T07:36:46.929448+0000","last_active":"2023-07-21T07:36:46.938955+0000","last_peered":"2023-07-21T07:36:46.938955+0000","last_clean":"2023-07-21T07:36:46.938955+0000","last_became_active":"2023-07-21T07:36:46.929148+0000","last_became_peered":"2023-07-21T07:36:46.929148+0000","last_unstale":"2023-07-21T07:36:46.938955+0000","last_undegraded":"2023-07-21T07:36:46.938955+0000","last_fullsized":"2023-07-21T07:36:46.938955+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:53.348683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"57'8","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.941039+0000","last_change":"2023-07-21T07:36:45.905226+0000","last_active":"2023-07-21T07:36:46.941039+0000","last_peered":"2023-07-21T07:36:46.941039+0000","last_clean":"2023-07-21T07:36:46.941039+0000","last_became_active":"2023-07-21T07:36:45.904788+0000","last_became_peered":"2023-07-21T07:36:45.904788+0000","last_unstale":"2023-07-21T07:36:46.941039+0000","last_undegraded":"2023-07-21T07:36:46.941039+0000","last_fullsized":"2023-07-21T07:36:46.941039+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:45:53.791995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911814+0000","last_change":"2023-07-21T07:36:28.553926+0000","last_active":"2023-07-21T07:36:46.911814+0000","last_peered":"2023-07-21T07:36:46.911814+0000","last_clean":"2023-07-21T07:36:46.911814+0000","last_became_active":"2023-07-21T07:36:28.551968+0000","last_became_peered":"2023-07-21T07:36:28.551968+0000","last_unstale":"2023-07-21T07:36:46.911814+0000","last_undegraded":"2023-07-21T07:36:46.911814+0000","last_fullsized":"2023-07-21T07:36:46.911814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:29:18.047828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911198+0000","last_change":"2023-07-21T07:36:27.550743+0000","last_active":"2023-07-21T07:36:46.911198+0000","last_peered":"2023-07-21T07:36:46.911198+0000","last_clean":"2023-07-21T07:36:46.911198+0000","last_became_active":"2023-07-21T07:36:27.550521+0000","last_became_peered":"2023-07-21T07:36:27.550521+0000","last_unstale":"2023-07-21T07:36:46.911198+0000","last_undegraded":"2023-07-21T07:36:46.911198+0000","last_fullsized":"2023-07-21T07:36:46.911198+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:03:43.154046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.928081+0000","last_change":"2023-07-21T07:36:46.924125+0000","last_active":"2023-07-21T07:36:46.928081+0000","last_peered":"2023-07-21T07:36:46.928081+0000","last_clean":"2023-07-21T07:36:46.928081+0000","last_became_active":"2023-07-21T07:36:46.923846+0000","last_became_peered":"2023-07-21T07:36:46.923846+0000","last_unstale":"2023-07-21T07:36:46.928081+0000","last_undegraded":"2023-07-21T07:36:46.928081+0000","last_fullsized":"2023-07-21T07:36:46.928081+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:25:23.390482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938850+0000","last_change":"2023-07-21T07:36:45.906228+0000","last_active":"2023-07-21T07:36:46.938850+0000","last_peered":"2023-07-21T07:36:46.938850+0000","last_clean":"2023-07-21T07:36:46.938850+0000","last_became_active":"2023-07-21T07:36:45.905786+0000","last_became_peered":"2023-07-21T07:36:45.905786+0000","last_unstale":"2023-07-21T07:36:46.938850+0000","last_undegraded":"2023-07-21T07:36:46.938850+0000","last_fullsized":"2023-07-21T07:36:46.938850+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:08:44.625597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915416+0000","last_change":"2023-07-21T07:36:28.555482+0000","last_active":"2023-07-21T07:36:46.915416+0000","last_peered":"2023-07-21T07:36:46.915416+0000","last_clean":"2023-07-21T07:36:46.915416+0000","last_became_active":"2023-07-21T07:36:28.554468+0000","last_became_peered":"2023-07-21T07:36:28.554468+0000","last_unstale":"2023-07-21T07:36:46.915416+0000","last_undegraded":"2023-07-21T07:36:46.915416+0000","last_fullsized":"2023-07-21T07:36:46.915416+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:13:46.845837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911396+0000","last_change":"2023-07-21T07:36:27.542687+0000","last_active":"2023-07-21T07:36:46.911396+0000","last_peered":"2023-07-21T07:36:46.911396+0000","last_clean":"2023-07-21T07:36:46.911396+0000","last_became_active":"2023-07-21T07:36:27.542483+0000","last_became_peered":"2023-07-21T07:36:27.542483+0000","last_unstale":"2023-07-21T07:36:46.911396+0000","last_undegraded":"2023-07-21T07:36:46.911396+0000","last_fullsized":"2023-07-21T07:36:46.911396+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:54:08.789435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932382+0000","last_change":"2023-07-21T07:36:46.926213+0000","last_active":"2023-07-21T07:36:46.932382+0000","last_peered":"2023-07-21T07:36:46.932382+0000","last_clean":"2023-07-21T07:36:46.932382+0000","last_became_active":"2023-07-21T07:36:46.925900+0000","last_became_peered":"2023-07-21T07:36:46.925900+0000","last_unstale":"2023-07-21T07:36:46.932382+0000","last_undegraded":"2023-07-21T07:36:46.932382+0000","last_fullsized":"2023-07-21T07:36:46.932382+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:14:35.977107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911671+0000","last_change":"2023-07-21T07:36:45.912078+0000","last_active":"2023-07-21T07:36:46.911671+0000","last_peered":"2023-07-21T07:36:46.911671+0000","last_clean":"2023-07-21T07:36:46.911671+0000","last_became_active":"2023-07-21T07:36:45.911771+0000","last_became_peered":"2023-07-21T07:36:45.911771+0000","last_unstale":"2023-07-21T07:36:46.911671+0000","last_undegraded":"2023-07-21T07:36:46.911671+0000","last_fullsized":"2023-07-21T07:36:46.911671+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:04:01.517310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906824+0000","last_change":"2023-07-21T07:36:28.546081+0000","last_active":"2023-07-21T07:36:46.906824+0000","last_peered":"2023-07-21T07:36:46.906824+0000","last_clean":"2023-07-21T07:36:46.906824+0000","last_became_active":"2023-07-21T07:36:28.545781+0000","last_became_peered":"2023-07-21T07:36:28.545781+0000","last_unstale":"2023-07-21T07:36:46.906824+0000","last_undegraded":"2023-07-21T07:36:46.906824+0000","last_fullsized":"2023-07-21T07:36:46.906824+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:05:32.290531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'8","reported_seq":27,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905041+0000","last_change":"2023-07-21T07:36:27.549363+0000","last_active":"2023-07-21T07:36:46.905041+0000","last_peered":"2023-07-21T07:36:46.905041+0000","last_clean":"2023-07-21T07:36:46.905041+0000","last_became_active":"2023-07-21T07:36:27.548945+0000","last_became_peered":"2023-07-21T07:36:27.548945+0000","last_unstale":"2023-07-21T07:36:46.905041+0000","last_undegraded":"2023-07-21T07:36:46.905041+0000","last_fullsized":"2023-07-21T07:36:46.905041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:19:21.744719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.917925+0000","last_change":"2023-07-21T07:36:46.913112+0000","last_active":"2023-07-21T07:36:46.917925+0000","last_peered":"2023-07-21T07:36:46.917925+0000","last_clean":"2023-07-21T07:36:46.917925+0000","last_became_active":"2023-07-21T07:36:46.912683+0000","last_became_peered":"2023-07-21T07:36:46.912683+0000","last_unstale":"2023-07-21T07:36:46.917925+0000","last_undegraded":"2023-07-21T07:36:46.917925+0000","last_fullsized":"2023-07-21T07:36:46.917925+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:34.821586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914094+0000","last_change":"2023-07-21T07:36:45.915569+0000","last_active":"2023-07-21T07:36:46.914094+0000","last_peered":"2023-07-21T07:36:46.914094+0000","last_clean":"2023-07-21T07:36:46.914094+0000","last_became_active":"2023-07-21T07:36:45.915252+0000","last_became_peered":"2023-07-21T07:36:45.915252+0000","last_unstale":"2023-07-21T07:36:46.914094+0000","last_undegraded":"2023-07-21T07:36:46.914094+0000","last_fullsized":"2023-07-21T07:36:46.914094+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:01:52.951579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914743+0000","last_change":"2023-07-21T07:36:28.551178+0000","last_active":"2023-07-21T07:36:46.914743+0000","last_peered":"2023-07-21T07:36:46.914743+0000","last_clean":"2023-07-21T07:36:46.914743+0000","last_became_active":"2023-07-21T07:36:28.550868+0000","last_became_peered":"2023-07-21T07:36:28.550868+0000","last_unstale":"2023-07-21T07:36:46.914743+0000","last_undegraded":"2023-07-21T07:36:46.914743+0000","last_fullsized":"2023-07-21T07:36:46.914743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:56:51.273123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"53'2","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912159+0000","last_change":"2023-07-21T07:36:27.550087+0000","last_active":"2023-07-21T07:36:46.912159+0000","last_peered":"2023-07-21T07:36:46.912159+0000","last_clean":"2023-07-21T07:36:46.912159+0000","last_became_active":"2023-07-21T07:36:27.549834+0000","last_became_peered":"2023-07-21T07:36:27.549834+0000","last_unstale":"2023-07-21T07:36:46.912159+0000","last_undegraded":"2023-07-21T07:36:46.912159+0000","last_fullsized":"2023-07-21T07:36:46.912159+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:37:01.165584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.937812+0000","last_change":"2023-07-21T07:36:46.926262+0000","last_active":"2023-07-21T07:36:46.937812+0000","last_peered":"2023-07-21T07:36:46.937812+0000","last_clean":"2023-07-21T07:36:46.937812+0000","last_became_active":"2023-07-21T07:36:46.925980+0000","last_became_peered":"2023-07-21T07:36:46.925980+0000","last_unstale":"2023-07-21T07:36:46.937812+0000","last_undegraded":"2023-07-21T07:36:46.937812+0000","last_fullsized":"2023-07-21T07:36:46.937812+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:58:37.500627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911962+0000","last_change":"2023-07-21T07:36:45.912625+0000","last_active":"2023-07-21T07:36:46.911962+0000","last_peered":"2023-07-21T07:36:46.911962+0000","last_clean":"2023-07-21T07:36:46.911962+0000","last_became_active":"2023-07-21T07:36:45.912346+0000","last_became_peered":"2023-07-21T07:36:45.912346+0000","last_unstale":"2023-07-21T07:36:46.911962+0000","last_undegraded":"2023-07-21T07:36:46.911962+0000","last_fullsized":"2023-07-21T07:36:46.911962+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:27:06.382716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915995+0000","last_change":"2023-07-21T07:36:28.554479+0000","last_active":"2023-07-21T07:36:46.915995+0000","last_peered":"2023-07-21T07:36:46.915995+0000","last_clean":"2023-07-21T07:36:46.915995+0000","last_became_active":"2023-07-21T07:36:28.554145+0000","last_became_peered":"2023-07-21T07:36:28.554145+0000","last_unstale":"2023-07-21T07:36:46.915995+0000","last_undegraded":"2023-07-21T07:36:46.915995+0000","last_fullsized":"2023-07-21T07:36:46.915995+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:34:55.973265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"54'1","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912580+0000","last_change":"2023-07-21T07:36:27.545216+0000","last_active":"2023-07-21T07:36:46.912580+0000","last_peered":"2023-07-21T07:36:46.912580+0000","last_clean":"2023-07-21T07:36:46.912580+0000","last_became_active":"2023-07-21T07:36:27.544952+0000","last_became_peered":"2023-07-21T07:36:27.544952+0000","last_unstale":"2023-07-21T07:36:46.912580+0000","last_undegraded":"2023-07-21T07:36:46.912580+0000","last_fullsized":"2023-07-21T07:36:46.912580+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:21:54.511486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932809+0000","last_change":"2023-07-21T07:36:46.926727+0000","last_active":"2023-07-21T07:36:46.932809+0000","last_peered":"2023-07-21T07:36:46.932809+0000","last_clean":"2023-07-21T07:36:46.932809+0000","last_became_active":"2023-07-21T07:36:46.926439+0000","last_became_peered":"2023-07-21T07:36:46.926439+0000","last_unstale":"2023-07-21T07:36:46.932809+0000","last_undegraded":"2023-07-21T07:36:46.932809+0000","last_fullsized":"2023-07-21T07:36:46.932809+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:44:08.986337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938415+0000","last_change":"2023-07-21T07:36:45.908888+0000","last_active":"2023-07-21T07:36:46.938415+0000","last_peered":"2023-07-21T07:36:46.938415+0000","last_clean":"2023-07-21T07:36:46.938415+0000","last_became_active":"2023-07-21T07:36:45.908578+0000","last_became_peered":"2023-07-21T07:36:45.908578+0000","last_unstale":"2023-07-21T07:36:46.938415+0000","last_undegraded":"2023-07-21T07:36:46.938415+0000","last_fullsized":"2023-07-21T07:36:46.938415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:54:36.656580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912441+0000","last_change":"2023-07-21T07:36:28.554762+0000","last_active":"2023-07-21T07:36:46.912441+0000","last_peered":"2023-07-21T07:36:46.912441+0000","last_clean":"2023-07-21T07:36:46.912441+0000","last_became_active":"2023-07-21T07:36:28.554473+0000","last_became_peered":"2023-07-21T07:36:28.554473+0000","last_unstale":"2023-07-21T07:36:46.912441+0000","last_undegraded":"2023-07-21T07:36:46.912441+0000","last_fullsized":"2023-07-21T07:36:46.912441+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:48:32.998531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913808+0000","last_change":"2023-07-21T07:36:27.548955+0000","last_active":"2023-07-21T07:36:46.913808+0000","last_peered":"2023-07-21T07:36:46.913808+0000","last_clean":"2023-07-21T07:36:46.913808+0000","last_became_active":"2023-07-21T07:36:27.548615+0000","last_became_peered":"2023-07-21T07:36:27.548615+0000","last_unstale":"2023-07-21T07:36:46.913808+0000","last_undegraded":"2023-07-21T07:36:46.913808+0000","last_fullsized":"2023-07-21T07:36:46.913808+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T07:58:26.522998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938689+0000","last_change":"2023-07-21T07:36:46.929176+0000","last_active":"2023-07-21T07:36:46.938689+0000","last_peered":"2023-07-21T07:36:46.938689+0000","last_clean":"2023-07-21T07:36:46.938689+0000","last_became_active":"2023-07-21T07:36:46.928843+0000","last_became_peered":"2023-07-21T07:36:46.928843+0000","last_unstale":"2023-07-21T07:36:46.938689+0000","last_undegraded":"2023-07-21T07:36:46.938689+0000","last_fullsized":"2023-07-21T07:36:46.938689+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:59:11.721376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.916104+0000","last_change":"2023-07-21T07:36:45.905106+0000","last_active":"2023-07-21T07:36:46.916104+0000","last_peered":"2023-07-21T07:36:46.916104+0000","last_clean":"2023-07-21T07:36:46.916104+0000","last_became_active":"2023-07-21T07:36:45.904792+0000","last_became_peered":"2023-07-21T07:36:45.904792+0000","last_unstale":"2023-07-21T07:36:46.916104+0000","last_undegraded":"2023-07-21T07:36:46.916104+0000","last_fullsized":"2023-07-21T07:36:46.916104+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:02:11.282261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.921513+0000","last_change":"2023-07-21T07:36:28.553270+0000","last_active":"2023-07-21T07:36:46.921513+0000","last_peered":"2023-07-21T07:36:46.921513+0000","last_clean":"2023-07-21T07:36:46.921513+0000","last_became_active":"2023-07-21T07:36:28.552988+0000","last_became_peered":"2023-07-21T07:36:28.552988+0000","last_unstale":"2023-07-21T07:36:46.921513+0000","last_undegraded":"2023-07-21T07:36:46.921513+0000","last_fullsized":"2023-07-21T07:36:46.921513+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:34:34.121910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906887+0000","last_change":"2023-07-21T07:36:27.546128+0000","last_active":"2023-07-21T07:36:46.906887+0000","last_peered":"2023-07-21T07:36:46.906887+0000","last_clean":"2023-07-21T07:36:46.906887+0000","last_became_active":"2023-07-21T07:36:27.545829+0000","last_became_peered":"2023-07-21T07:36:27.545829+0000","last_unstale":"2023-07-21T07:36:46.906887+0000","last_undegraded":"2023-07-21T07:36:46.906887+0000","last_fullsized":"2023-07-21T07:36:46.906887+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:06:49.609054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.941610+0000","last_change":"2023-07-21T07:36:46.938815+0000","last_active":"2023-07-21T07:36:46.941610+0000","last_peered":"2023-07-21T07:36:46.941610+0000","last_clean":"2023-07-21T07:36:46.941610+0000","last_became_active":"2023-07-21T07:36:46.938526+0000","last_became_peered":"2023-07-21T07:36:46.938526+0000","last_unstale":"2023-07-21T07:36:46.941610+0000","last_undegraded":"2023-07-21T07:36:46.941610+0000","last_fullsized":"2023-07-21T07:36:46.941610+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:47:55.446543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.921860+0000","last_change":"2023-07-21T07:36:45.912513+0000","last_active":"2023-07-21T07:36:46.921860+0000","last_peered":"2023-07-21T07:36:46.921860+0000","last_clean":"2023-07-21T07:36:46.921860+0000","last_became_active":"2023-07-21T07:36:45.912233+0000","last_became_peered":"2023-07-21T07:36:45.912233+0000","last_unstale":"2023-07-21T07:36:46.921860+0000","last_undegraded":"2023-07-21T07:36:46.921860+0000","last_fullsized":"2023-07-21T07:36:46.921860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:38:58.574437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.916315+0000","last_change":"2023-07-21T07:36:28.550679+0000","last_active":"2023-07-21T07:36:46.916315+0000","last_peered":"2023-07-21T07:36:46.916315+0000","last_clean":"2023-07-21T07:36:46.916315+0000","last_became_active":"2023-07-21T07:36:28.550320+0000","last_became_peered":"2023-07-21T07:36:28.550320+0000","last_unstale":"2023-07-21T07:36:46.916315+0000","last_undegraded":"2023-07-21T07:36:46.916315+0000","last_fullsized":"2023-07-21T07:36:46.916315+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:11:32.617795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913796+0000","last_change":"2023-07-21T07:36:27.542890+0000","last_active":"2023-07-21T07:36:46.913796+0000","last_peered":"2023-07-21T07:36:46.913796+0000","last_clean":"2023-07-21T07:36:46.913796+0000","last_became_active":"2023-07-21T07:36:27.542614+0000","last_became_peered":"2023-07-21T07:36:27.542614+0000","last_unstale":"2023-07-21T07:36:46.913796+0000","last_undegraded":"2023-07-21T07:36:46.913796+0000","last_fullsized":"2023-07-21T07:36:46.913796+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:06:38.366991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.920742+0000","last_change":"2023-07-21T07:36:46.919077+0000","last_active":"2023-07-21T07:36:46.920742+0000","last_peered":"2023-07-21T07:36:46.920742+0000","last_clean":"2023-07-21T07:36:46.920742+0000","last_became_active":"2023-07-21T07:36:46.918716+0000","last_became_peered":"2023-07-21T07:36:46.918716+0000","last_unstale":"2023-07-21T07:36:46.920742+0000","last_undegraded":"2023-07-21T07:36:46.920742+0000","last_fullsized":"2023-07-21T07:36:46.920742+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:04:16.159951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.903719+0000","last_change":"2023-07-21T07:36:45.910989+0000","last_active":"2023-07-21T07:36:46.903719+0000","last_peered":"2023-07-21T07:36:46.903719+0000","last_clean":"2023-07-21T07:36:46.903719+0000","last_became_active":"2023-07-21T07:36:45.910672+0000","last_became_peered":"2023-07-21T07:36:45.910672+0000","last_unstale":"2023-07-21T07:36:46.903719+0000","last_undegraded":"2023-07-21T07:36:46.903719+0000","last_fullsized":"2023-07-21T07:36:46.903719+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:45.969257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905368+0000","last_change":"2023-07-21T07:36:28.549203+0000","last_active":"2023-07-21T07:36:46.905368+0000","last_peered":"2023-07-21T07:36:46.905368+0000","last_clean":"2023-07-21T07:36:46.905368+0000","last_became_active":"2023-07-21T07:36:28.548933+0000","last_became_peered":"2023-07-21T07:36:28.548933+0000","last_unstale":"2023-07-21T07:36:46.905368+0000","last_undegraded":"2023-07-21T07:36:46.905368+0000","last_fullsized":"2023-07-21T07:36:46.905368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:19:38.268923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905713+0000","last_change":"2023-07-21T07:36:27.535134+0000","last_active":"2023-07-21T07:36:46.905713+0000","last_peered":"2023-07-21T07:36:46.905713+0000","last_clean":"2023-07-21T07:36:46.905713+0000","last_became_active":"2023-07-21T07:36:27.534830+0000","last_became_peered":"2023-07-21T07:36:27.534830+0000","last_unstale":"2023-07-21T07:36:46.905713+0000","last_undegraded":"2023-07-21T07:36:46.905713+0000","last_fullsized":"2023-07-21T07:36:46.905713+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:15:15.775784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938705+0000","last_change":"2023-07-21T07:36:46.929815+0000","last_active":"2023-07-21T07:36:46.938705+0000","last_peered":"2023-07-21T07:36:46.938705+0000","last_clean":"2023-07-21T07:36:46.938705+0000","last_became_active":"2023-07-21T07:36:46.929571+0000","last_became_peered":"2023-07-21T07:36:46.929571+0000","last_unstale":"2023-07-21T07:36:46.938705+0000","last_undegraded":"2023-07-21T07:36:46.938705+0000","last_fullsized":"2023-07-21T07:36:46.938705+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:20:17.567282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915086+0000","last_change":"2023-07-21T07:36:45.910749+0000","last_active":"2023-07-21T07:36:46.915086+0000","last_peered":"2023-07-21T07:36:46.915086+0000","last_clean":"2023-07-21T07:36:46.915086+0000","last_became_active":"2023-07-21T07:36:45.910493+0000","last_became_peered":"2023-07-21T07:36:45.910493+0000","last_unstale":"2023-07-21T07:36:46.915086+0000","last_undegraded":"2023-07-21T07:36:46.915086+0000","last_fullsized":"2023-07-21T07:36:46.915086+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:57:15.389224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904308+0000","last_change":"2023-07-21T07:36:28.549213+0000","last_active":"2023-07-21T07:36:46.904308+0000","last_peered":"2023-07-21T07:36:46.904308+0000","last_clean":"2023-07-21T07:36:46.904308+0000","last_became_active":"2023-07-21T07:36:28.548890+0000","last_became_peered":"2023-07-21T07:36:28.548890+0000","last_unstale":"2023-07-21T07:36:46.904308+0000","last_undegraded":"2023-07-21T07:36:46.904308+0000","last_fullsized":"2023-07-21T07:36:46.904308+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:25:51.809023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.905285+0000","last_change":"2023-07-21T07:36:27.545372+0000","last_active":"2023-07-21T07:36:46.905285+0000","last_peered":"2023-07-21T07:36:46.905285+0000","last_clean":"2023-07-21T07:36:46.905285+0000","last_became_active":"2023-07-21T07:36:27.544933+0000","last_became_peered":"2023-07-21T07:36:27.544933+0000","last_unstale":"2023-07-21T07:36:46.905285+0000","last_undegraded":"2023-07-21T07:36:46.905285+0000","last_fullsized":"2023-07-21T07:36:46.905285+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:21:39.220291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938632+0000","last_change":"2023-07-21T07:36:46.929374+0000","last_active":"2023-07-21T07:36:46.938632+0000","last_peered":"2023-07-21T07:36:46.938632+0000","last_clean":"2023-07-21T07:36:46.938632+0000","last_became_active":"2023-07-21T07:36:46.928599+0000","last_became_peered":"2023-07-21T07:36:46.928599+0000","last_unstale":"2023-07-21T07:36:46.938632+0000","last_undegraded":"2023-07-21T07:36:46.938632+0000","last_fullsized":"2023-07-21T07:36:46.938632+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:25:00.200344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911111+0000","last_change":"2023-07-21T07:36:45.913121+0000","last_active":"2023-07-21T07:36:46.911111+0000","last_peered":"2023-07-21T07:36:46.911111+0000","last_clean":"2023-07-21T07:36:46.911111+0000","last_became_active":"2023-07-21T07:36:45.912788+0000","last_became_peered":"2023-07-21T07:36:45.912788+0000","last_unstale":"2023-07-21T07:36:46.911111+0000","last_undegraded":"2023-07-21T07:36:46.911111+0000","last_fullsized":"2023-07-21T07:36:46.911111+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:52:27.782378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911920+0000","last_change":"2023-07-21T07:36:28.561703+0000","last_active":"2023-07-21T07:36:46.911920+0000","last_peered":"2023-07-21T07:36:46.911920+0000","last_clean":"2023-07-21T07:36:46.911920+0000","last_became_active":"2023-07-21T07:36:28.561400+0000","last_became_peered":"2023-07-21T07:36:28.561400+0000","last_unstale":"2023-07-21T07:36:46.911920+0000","last_undegraded":"2023-07-21T07:36:46.911920+0000","last_fullsized":"2023-07-21T07:36:46.911920+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:19:27.442967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904752+0000","last_change":"2023-07-21T07:36:27.542037+0000","last_active":"2023-07-21T07:36:46.904752+0000","last_peered":"2023-07-21T07:36:46.904752+0000","last_clean":"2023-07-21T07:36:46.904752+0000","last_became_active":"2023-07-21T07:36:27.541783+0000","last_became_peered":"2023-07-21T07:36:27.541783+0000","last_unstale":"2023-07-21T07:36:46.904752+0000","last_undegraded":"2023-07-21T07:36:46.904752+0000","last_fullsized":"2023-07-21T07:36:46.904752+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:00:46.576555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.939897+0000","last_change":"2023-07-21T07:36:46.936155+0000","last_active":"2023-07-21T07:36:46.939897+0000","last_peered":"2023-07-21T07:36:46.939897+0000","last_clean":"2023-07-21T07:36:46.939897+0000","last_became_active":"2023-07-21T07:36:46.930622+0000","last_became_peered":"2023-07-21T07:36:46.930622+0000","last_unstale":"2023-07-21T07:36:46.939897+0000","last_undegraded":"2023-07-21T07:36:46.939897+0000","last_fullsized":"2023-07-21T07:36:46.939897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:28:23.578836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.934748+0000","last_change":"2023-07-21T07:36:45.903139+0000","last_active":"2023-07-21T07:36:46.934748+0000","last_peered":"2023-07-21T07:36:46.934748+0000","last_clean":"2023-07-21T07:36:46.934748+0000","last_became_active":"2023-07-21T07:36:45.902866+0000","last_became_peered":"2023-07-21T07:36:45.902866+0000","last_unstale":"2023-07-21T07:36:46.934748+0000","last_undegraded":"2023-07-21T07:36:46.934748+0000","last_fullsized":"2023-07-21T07:36:46.934748+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:16:56.213120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.921386+0000","last_change":"2023-07-21T07:36:28.553251+0000","last_active":"2023-07-21T07:36:46.921386+0000","last_peered":"2023-07-21T07:36:46.921386+0000","last_clean":"2023-07-21T07:36:46.921386+0000","last_became_active":"2023-07-21T07:36:28.552971+0000","last_became_peered":"2023-07-21T07:36:28.552971+0000","last_unstale":"2023-07-21T07:36:46.921386+0000","last_undegraded":"2023-07-21T07:36:46.921386+0000","last_fullsized":"2023-07-21T07:36:46.921386+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:36:39.371874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904769+0000","last_change":"2023-07-21T07:36:27.548492+0000","last_active":"2023-07-21T07:36:46.904769+0000","last_peered":"2023-07-21T07:36:46.904769+0000","last_clean":"2023-07-21T07:36:46.904769+0000","last_became_active":"2023-07-21T07:36:27.548083+0000","last_became_peered":"2023-07-21T07:36:27.548083+0000","last_unstale":"2023-07-21T07:36:46.904769+0000","last_undegraded":"2023-07-21T07:36:46.904769+0000","last_fullsized":"2023-07-21T07:36:46.904769+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:26:43.290192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.921406+0000","last_change":"2023-07-21T07:34:34.852368+0000","last_active":"2023-07-21T07:36:46.921406+0000","last_peered":"2023-07-21T07:36:46.921406+0000","last_clean":"2023-07-21T07:36:46.921406+0000","last_became_active":"2023-07-21T07:34:34.852094+0000","last_became_peered":"2023-07-21T07:34:34.852094+0000","last_unstale":"2023-07-21T07:36:46.921406+0000","last_undegraded":"2023-07-21T07:36:46.921406+0000","last_fullsized":"2023-07-21T07:36:46.921406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:04:00.375284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.934479+0000","last_change":"2023-07-21T07:36:46.926559+0000","last_active":"2023-07-21T07:36:46.934479+0000","last_peered":"2023-07-21T07:36:46.934479+0000","last_clean":"2023-07-21T07:36:46.934479+0000","last_became_active":"2023-07-21T07:36:46.926261+0000","last_became_peered":"2023-07-21T07:36:46.926261+0000","last_unstale":"2023-07-21T07:36:46.934479+0000","last_undegraded":"2023-07-21T07:36:46.934479+0000","last_fullsized":"2023-07-21T07:36:46.934479+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:04:42.863647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.932477+0000","last_change":"2023-07-21T07:36:45.914430+0000","last_active":"2023-07-21T07:36:46.932477+0000","last_peered":"2023-07-21T07:36:46.932477+0000","last_clean":"2023-07-21T07:36:46.932477+0000","last_became_active":"2023-07-21T07:36:45.914164+0000","last_became_peered":"2023-07-21T07:36:45.914164+0000","last_unstale":"2023-07-21T07:36:46.932477+0000","last_undegraded":"2023-07-21T07:36:46.932477+0000","last_fullsized":"2023-07-21T07:36:46.932477+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:35:30.630333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906355+0000","last_change":"2023-07-21T07:36:28.550245+0000","last_active":"2023-07-21T07:36:46.906355+0000","last_peered":"2023-07-21T07:36:46.906355+0000","last_clean":"2023-07-21T07:36:46.906355+0000","last_became_active":"2023-07-21T07:36:28.548746+0000","last_became_peered":"2023-07-21T07:36:28.548746+0000","last_unstale":"2023-07-21T07:36:46.906355+0000","last_undegraded":"2023-07-21T07:36:46.906355+0000","last_fullsized":"2023-07-21T07:36:46.906355+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:21:56.390688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"53'1","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914277+0000","last_change":"2023-07-21T07:36:27.542066+0000","last_active":"2023-07-21T07:36:46.914277+0000","last_peered":"2023-07-21T07:36:46.914277+0000","last_clean":"2023-07-21T07:36:46.914277+0000","last_became_active":"2023-07-21T07:36:27.541789+0000","last_became_peered":"2023-07-21T07:36:27.541789+0000","last_unstale":"2023-07-21T07:36:46.914277+0000","last_undegraded":"2023-07-21T07:36:46.914277+0000","last_fullsized":"2023-07-21T07:36:46.914277+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:14:36.130537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.907246+0000","last_change":"2023-07-21T07:34:34.851431+0000","last_active":"2023-07-21T07:36:46.907246+0000","last_peered":"2023-07-21T07:36:46.907246+0000","last_clean":"2023-07-21T07:36:46.907246+0000","last_became_active":"2023-07-21T07:34:34.851083+0000","last_became_peered":"2023-07-21T07:34:34.851083+0000","last_unstale":"2023-07-21T07:36:46.907246+0000","last_undegraded":"2023-07-21T07:36:46.907246+0000","last_fullsized":"2023-07-21T07:36:46.907246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:48:51.310800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.934652+0000","last_change":"2023-07-21T07:36:46.927246+0000","last_active":"2023-07-21T07:36:46.934652+0000","last_peered":"2023-07-21T07:36:46.934652+0000","last_clean":"2023-07-21T07:36:46.934652+0000","last_became_active":"2023-07-21T07:36:46.927005+0000","last_became_peered":"2023-07-21T07:36:46.927005+0000","last_unstale":"2023-07-21T07:36:46.934652+0000","last_undegraded":"2023-07-21T07:36:46.934652+0000","last_fullsized":"2023-07-21T07:36:46.934652+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:15:59.794291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906779+0000","last_change":"2023-07-21T07:36:45.906637+0000","last_active":"2023-07-21T07:36:46.906779+0000","last_peered":"2023-07-21T07:36:46.906779+0000","last_clean":"2023-07-21T07:36:46.906779+0000","last_became_active":"2023-07-21T07:36:45.906341+0000","last_became_peered":"2023-07-21T07:36:45.906341+0000","last_unstale":"2023-07-21T07:36:46.906779+0000","last_undegraded":"2023-07-21T07:36:46.906779+0000","last_fullsized":"2023-07-21T07:36:46.906779+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:54:27.443317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.920649+0000","last_change":"2023-07-21T07:36:28.555257+0000","last_active":"2023-07-21T07:36:46.920649+0000","last_peered":"2023-07-21T07:36:46.920649+0000","last_clean":"2023-07-21T07:36:46.920649+0000","last_became_active":"2023-07-21T07:36:28.554356+0000","last_became_peered":"2023-07-21T07:36:28.554356+0000","last_unstale":"2023-07-21T07:36:46.920649+0000","last_undegraded":"2023-07-21T07:36:46.920649+0000","last_fullsized":"2023-07-21T07:36:46.920649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:47:53.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"53'2","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913838+0000","last_change":"2023-07-21T07:36:27.547064+0000","last_active":"2023-07-21T07:36:46.913838+0000","last_peered":"2023-07-21T07:36:46.913838+0000","last_clean":"2023-07-21T07:36:46.913838+0000","last_became_active":"2023-07-21T07:36:27.546817+0000","last_became_peered":"2023-07-21T07:36:27.546817+0000","last_unstale":"2023-07-21T07:36:46.913838+0000","last_undegraded":"2023-07-21T07:36:46.913838+0000","last_fullsized":"2023-07-21T07:36:46.913838+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:40:52.003756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914710+0000","last_change":"2023-07-21T07:34:34.967200+0000","last_active":"2023-07-21T07:36:46.914710+0000","last_peered":"2023-07-21T07:36:46.914710+0000","last_clean":"2023-07-21T07:36:46.914710+0000","last_became_active":"2023-07-21T07:34:34.966895+0000","last_became_peered":"2023-07-21T07:34:34.966895+0000","last_unstale":"2023-07-21T07:36:46.914710+0000","last_undegraded":"2023-07-21T07:36:46.914710+0000","last_fullsized":"2023-07-21T07:36:46.914710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:11:54.052982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.937877+0000","last_change":"2023-07-21T07:36:46.927118+0000","last_active":"2023-07-21T07:36:46.937877+0000","last_peered":"2023-07-21T07:36:46.937877+0000","last_clean":"2023-07-21T07:36:46.937877+0000","last_became_active":"2023-07-21T07:36:46.926381+0000","last_became_peered":"2023-07-21T07:36:46.926381+0000","last_unstale":"2023-07-21T07:36:46.937877+0000","last_undegraded":"2023-07-21T07:36:46.937877+0000","last_fullsized":"2023-07-21T07:36:46.937877+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:08:51.913795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906869+0000","last_change":"2023-07-21T07:36:45.912075+0000","last_active":"2023-07-21T07:36:46.906869+0000","last_peered":"2023-07-21T07:36:46.906869+0000","last_clean":"2023-07-21T07:36:46.906869+0000","last_became_active":"2023-07-21T07:36:45.911775+0000","last_became_peered":"2023-07-21T07:36:45.911775+0000","last_unstale":"2023-07-21T07:36:46.906869+0000","last_undegraded":"2023-07-21T07:36:46.906869+0000","last_fullsized":"2023-07-21T07:36:46.906869+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:45:53.396207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914120+0000","last_change":"2023-07-21T07:36:28.556796+0000","last_active":"2023-07-21T07:36:46.914120+0000","last_peered":"2023-07-21T07:36:46.914120+0000","last_clean":"2023-07-21T07:36:46.914120+0000","last_became_active":"2023-07-21T07:36:28.556511+0000","last_became_peered":"2023-07-21T07:36:28.556511+0000","last_unstale":"2023-07-21T07:36:46.914120+0000","last_undegraded":"2023-07-21T07:36:46.914120+0000","last_fullsized":"2023-07-21T07:36:46.914120+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:38:38.862110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"53'2","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.919754+0000","last_change":"2023-07-21T07:36:27.546993+0000","last_active":"2023-07-21T07:36:46.919754+0000","last_peered":"2023-07-21T07:36:46.919754+0000","last_clean":"2023-07-21T07:36:46.919754+0000","last_became_active":"2023-07-21T07:36:27.546675+0000","last_became_peered":"2023-07-21T07:36:27.546675+0000","last_unstale":"2023-07-21T07:36:46.919754+0000","last_undegraded":"2023-07-21T07:36:46.919754+0000","last_fullsized":"2023-07-21T07:36:46.919754+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:52:27.605993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911729+0000","last_change":"2023-07-21T07:34:34.851177+0000","last_active":"2023-07-21T07:36:46.911729+0000","last_peered":"2023-07-21T07:36:46.911729+0000","last_clean":"2023-07-21T07:36:46.911729+0000","last_became_active":"2023-07-21T07:34:34.850985+0000","last_became_peered":"2023-07-21T07:34:34.850985+0000","last_unstale":"2023-07-21T07:36:46.911729+0000","last_undegraded":"2023-07-21T07:36:46.911729+0000","last_fullsized":"2023-07-21T07:36:46.911729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T08:06:33.583998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.925576+0000","last_change":"2023-07-21T07:36:46.922129+0000","last_active":"2023-07-21T07:36:46.925576+0000","last_peered":"2023-07-21T07:36:46.925576+0000","last_clean":"2023-07-21T07:36:46.925576+0000","last_became_active":"2023-07-21T07:36:46.921833+0000","last_became_peered":"2023-07-21T07:36:46.921833+0000","last_unstale":"2023-07-21T07:36:46.925576+0000","last_undegraded":"2023-07-21T07:36:46.925576+0000","last_fullsized":"2023-07-21T07:36:46.925576+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:42:21.588395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906087+0000","last_change":"2023-07-21T07:36:45.914841+0000","last_active":"2023-07-21T07:36:46.906087+0000","last_peered":"2023-07-21T07:36:46.906087+0000","last_clean":"2023-07-21T07:36:46.906087+0000","last_became_active":"2023-07-21T07:36:45.914515+0000","last_became_peered":"2023-07-21T07:36:45.914515+0000","last_unstale":"2023-07-21T07:36:46.906087+0000","last_undegraded":"2023-07-21T07:36:46.906087+0000","last_fullsized":"2023-07-21T07:36:46.906087+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:45:53.791995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915176+0000","last_change":"2023-07-21T07:36:28.550594+0000","last_active":"2023-07-21T07:36:46.915176+0000","last_peered":"2023-07-21T07:36:46.915176+0000","last_clean":"2023-07-21T07:36:46.915176+0000","last_became_active":"2023-07-21T07:36:28.550307+0000","last_became_peered":"2023-07-21T07:36:28.550307+0000","last_unstale":"2023-07-21T07:36:46.915176+0000","last_undegraded":"2023-07-21T07:36:46.915176+0000","last_fullsized":"2023-07-21T07:36:46.915176+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:31:12.174896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904734+0000","last_change":"2023-07-21T07:36:27.545082+0000","last_active":"2023-07-21T07:36:46.904734+0000","last_peered":"2023-07-21T07:36:46.904734+0000","last_clean":"2023-07-21T07:36:46.904734+0000","last_became_active":"2023-07-21T07:36:27.544787+0000","last_became_peered":"2023-07-21T07:36:27.544787+0000","last_unstale":"2023-07-21T07:36:46.904734+0000","last_undegraded":"2023-07-21T07:36:46.904734+0000","last_fullsized":"2023-07-21T07:36:46.904734+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:11:22.289241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":230,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.914379+0000","last_change":"2023-07-21T07:34:29.935077+0000","last_active":"2023-07-21T07:36:46.914379+0000","last_peered":"2023-07-21T07:36:46.914379+0000","last_clean":"2023-07-21T07:36:46.914379+0000","last_became_active":"2023-07-21T07:34:29.933996+0000","last_became_peered":"2023-07-21T07:34:29.933996+0000","last_unstale":"2023-07-21T07:36:46.914379+0000","last_undegraded":"2023-07-21T07:36:46.914379+0000","last_fullsized":"2023-07-21T07:36:46.914379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:28.798979+0000","last_clean_scrub_stamp":"2023-07-21T07:34:28.798979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:30:16.542890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":76,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911617+0000","last_change":"2023-07-21T07:34:34.850739+0000","last_active":"2023-07-21T07:36:46.911617+0000","last_peered":"2023-07-21T07:36:46.911617+0000","last_clean":"2023-07-21T07:36:46.911617+0000","last_became_active":"2023-07-21T07:34:34.850423+0000","last_became_peered":"2023-07-21T07:34:34.850423+0000","last_unstale":"2023-07-21T07:36:46.911617+0000","last_undegraded":"2023-07-21T07:36:46.911617+0000","last_fullsized":"2023-07-21T07:36:46.911617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T10:21:49.029160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.938656+0000","last_change":"2023-07-21T07:36:46.928849+0000","last_active":"2023-07-21T07:36:46.938656+0000","last_peered":"2023-07-21T07:36:46.938656+0000","last_clean":"2023-07-21T07:36:46.938656+0000","last_became_active":"2023-07-21T07:36:46.928501+0000","last_became_peered":"2023-07-21T07:36:46.928501+0000","last_unstale":"2023-07-21T07:36:46.938656+0000","last_undegraded":"2023-07-21T07:36:46.938656+0000","last_fullsized":"2023-07-21T07:36:46.938656+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:39:44.154529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.904611+0000","last_change":"2023-07-21T07:36:45.911915+0000","last_active":"2023-07-21T07:36:46.904611+0000","last_peered":"2023-07-21T07:36:46.904611+0000","last_clean":"2023-07-21T07:36:46.904611+0000","last_became_active":"2023-07-21T07:36:45.911608+0000","last_became_peered":"2023-07-21T07:36:45.911608+0000","last_unstale":"2023-07-21T07:36:46.904611+0000","last_undegraded":"2023-07-21T07:36:46.904611+0000","last_fullsized":"2023-07-21T07:36:46.904611+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:48:09.579584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911955+0000","last_change":"2023-07-21T07:36:28.555760+0000","last_active":"2023-07-21T07:36:46.911955+0000","last_peered":"2023-07-21T07:36:46.911955+0000","last_clean":"2023-07-21T07:36:46.911955+0000","last_became_active":"2023-07-21T07:36:28.555505+0000","last_became_peered":"2023-07-21T07:36:28.555505+0000","last_unstale":"2023-07-21T07:36:46.911955+0000","last_undegraded":"2023-07-21T07:36:46.911955+0000","last_fullsized":"2023-07-21T07:36:46.911955+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:05:28.859205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911321+0000","last_change":"2023-07-21T07:36:27.550572+0000","last_active":"2023-07-21T07:36:46.911321+0000","last_peered":"2023-07-21T07:36:46.911321+0000","last_clean":"2023-07-21T07:36:46.911321+0000","last_became_active":"2023-07-21T07:36:27.550195+0000","last_became_peered":"2023-07-21T07:36:27.550195+0000","last_unstale":"2023-07-21T07:36:46.911321+0000","last_undegraded":"2023-07-21T07:36:46.911321+0000","last_fullsized":"2023-07-21T07:36:46.911321+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T14:06:38.366991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.909291+0000","last_change":"2023-07-21T07:34:34.849204+0000","last_active":"2023-07-21T07:36:46.909291+0000","last_peered":"2023-07-21T07:36:46.909291+0000","last_clean":"2023-07-21T07:36:46.909291+0000","last_became_active":"2023-07-21T07:34:34.848874+0000","last_became_peered":"2023-07-21T07:34:34.848874+0000","last_unstale":"2023-07-21T07:36:46.909291+0000","last_undegraded":"2023-07-21T07:36:46.909291+0000","last_fullsized":"2023-07-21T07:36:46.909291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:29:16.542188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.936768+0000","last_change":"2023-07-21T07:36:46.924427+0000","last_active":"2023-07-21T07:36:46.936768+0000","last_peered":"2023-07-21T07:36:46.936768+0000","last_clean":"2023-07-21T07:36:46.936768+0000","last_became_active":"2023-07-21T07:36:46.924193+0000","last_became_peered":"2023-07-21T07:36:46.924193+0000","last_unstale":"2023-07-21T07:36:46.936768+0000","last_undegraded":"2023-07-21T07:36:46.936768+0000","last_fullsized":"2023-07-21T07:36:46.936768+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T12:20:25.172699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.937104+0000","last_change":"2023-07-21T07:36:45.911172+0000","last_active":"2023-07-21T07:36:46.937104+0000","last_peered":"2023-07-21T07:36:46.937104+0000","last_clean":"2023-07-21T07:36:46.937104+0000","last_became_active":"2023-07-21T07:36:45.910442+0000","last_became_peered":"2023-07-21T07:36:45.910442+0000","last_unstale":"2023-07-21T07:36:46.937104+0000","last_undegraded":"2023-07-21T07:36:46.937104+0000","last_fullsized":"2023-07-21T07:36:46.937104+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:41:29.587985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.915561+0000","last_change":"2023-07-21T07:36:28.552513+0000","last_active":"2023-07-21T07:36:46.915561+0000","last_peered":"2023-07-21T07:36:46.915561+0000","last_clean":"2023-07-21T07:36:46.915561+0000","last_became_active":"2023-07-21T07:36:28.551895+0000","last_became_peered":"2023-07-21T07:36:28.551895+0000","last_unstale":"2023-07-21T07:36:46.915561+0000","last_undegraded":"2023-07-21T07:36:46.915561+0000","last_fullsized":"2023-07-21T07:36:46.915561+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T11:20:04.242746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913256+0000","last_change":"2023-07-21T07:36:27.544373+0000","last_active":"2023-07-21T07:36:46.913256+0000","last_peered":"2023-07-21T07:36:46.913256+0000","last_clean":"2023-07-21T07:36:46.913256+0000","last_became_active":"2023-07-21T07:36:27.544074+0000","last_became_peered":"2023-07-21T07:36:27.544074+0000","last_unstale":"2023-07-21T07:36:46.913256+0000","last_undegraded":"2023-07-21T07:36:46.913256+0000","last_fullsized":"2023-07-21T07:36:46.913256+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T13:40:30.800437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":76,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.911392+0000","last_change":"2023-07-21T07:34:34.849279+0000","last_active":"2023-07-21T07:36:46.911392+0000","last_peered":"2023-07-21T07:36:46.911392+0000","last_clean":"2023-07-21T07:36:46.911392+0000","last_became_active":"2023-07-21T07:34:34.848961+0000","last_became_peered":"2023-07-21T07:34:34.848961+0000","last_unstale":"2023-07-21T07:36:46.911392+0000","last_undegraded":"2023-07-21T07:36:46.911392+0000","last_fullsized":"2023-07-21T07:36:46.911392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T19:05:39.858592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.942129+0000","last_change":"2023-07-21T07:36:46.937977+0000","last_active":"2023-07-21T07:36:46.942129+0000","last_peered":"2023-07-21T07:36:46.942129+0000","last_clean":"2023-07-21T07:36:46.942129+0000","last_became_active":"2023-07-21T07:36:46.937507+0000","last_became_peered":"2023-07-21T07:36:46.937507+0000","last_unstale":"2023-07-21T07:36:46.942129+0000","last_undegraded":"2023-07-21T07:36:46.942129+0000","last_fullsized":"2023-07-21T07:36:46.942129+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:45.886107+0000","last_clean_scrub_stamp":"2023-07-21T07:36:45.886107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T15:31:43.603585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.942317+0000","last_change":"2023-07-21T07:36:45.901611+0000","last_active":"2023-07-21T07:36:46.942317+0000","last_peered":"2023-07-21T07:36:46.942317+0000","last_clean":"2023-07-21T07:36:46.942317+0000","last_became_active":"2023-07-21T07:36:45.901298+0000","last_became_peered":"2023-07-21T07:36:45.901298+0000","last_unstale":"2023-07-21T07:36:46.942317+0000","last_undegraded":"2023-07-21T07:36:46.942317+0000","last_fullsized":"2023-07-21T07:36:46.942317+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:44.879481+0000","last_clean_scrub_stamp":"2023-07-21T07:36:44.879481+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T16:15:15.471784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.913488+0000","last_change":"2023-07-21T07:36:28.553427+0000","last_active":"2023-07-21T07:36:46.913488+0000","last_peered":"2023-07-21T07:36:46.913488+0000","last_clean":"2023-07-21T07:36:46.913488+0000","last_became_active":"2023-07-21T07:36:28.553096+0000","last_became_peered":"2023-07-21T07:36:28.553096+0000","last_unstale":"2023-07-21T07:36:46.913488+0000","last_undegraded":"2023-07-21T07:36:46.913488+0000","last_fullsized":"2023-07-21T07:36:46.913488+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:27.521688+0000","last_clean_scrub_stamp":"2023-07-21T07:36:27.521688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T18:29:18.047828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"53'1","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.912104+0000","last_change":"2023-07-21T07:36:27.550570+0000","last_active":"2023-07-21T07:36:46.912104+0000","last_peered":"2023-07-21T07:36:46.912104+0000","last_clean":"2023-07-21T07:36:46.912104+0000","last_became_active":"2023-07-21T07:36:27.550296+0000","last_became_peered":"2023-07-21T07:36:27.550296+0000","last_unstale":"2023-07-21T07:36:46.912104+0000","last_undegraded":"2023-07-21T07:36:46.912104+0000","last_fullsized":"2023-07-21T07:36:46.912104+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:36:26.516216+0000","last_clean_scrub_stamp":"2023-07-21T07:36:26.516216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T17:40:52.003756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-21T07:36:46.906803+0000","last_change":"2023-07-21T07:34:34.967067+0000","last_active":"2023-07-21T07:36:46.906803+0000","last_peered":"2023-07-21T07:36:46.906803+0000","last_clean":"2023-07-21T07:36:46.906803+0000","last_became_active":"2023-07-21T07:34:34.966759+0000","last_became_peered":"2023-07-21T07:34:34.966759+0000","last_unstale":"2023-07-21T07:36:46.906803+0000","last_undegraded":"2023-07-21T07:36:46.906803+0000","last_fullsized":"2023-07-21T07:36:46.906803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T07:34:33.837882+0000","last_clean_scrub_stamp":"2023-07-21T07:34:33.837882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T09:53:59.711057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3869,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1298432,"data_stored":900420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.71999999999999997,"5min":0.876,"15min":0.876},"last":0.371}]},{"osd":1,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.75,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.67800000000000005,"5min":0.871,"15min":0.871},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.44400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72899999999999998,"5min":0.878,"15min":0.878},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.64600000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60199999999999998,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71499999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.56299999999999994}]},{"osd":4,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71399999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57899999999999996}]},{"osd":5,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.622}]},{"osd":6,"last update":"Fri Jul 21 07:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86799999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":310852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.84399999999999997,"15min":0.89400000000000002},"min":{"1min":0.34000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69599999999999995,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.65400000000000003,"15min":0.67400000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70799999999999996,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.34599999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48699999999999999,"15min":0.47699999999999998},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.746,"15min":0.77500000000000002},"min":{"1min":0.39400000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.71299999999999997,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.64100000000000001}]},{"osd":3,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.40500000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73699999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.46500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85799999999999998,"5min":1.319,"15min":1.319},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79600000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40100000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81799999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.376},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73099999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56200000000000006}]},{"osd":7,"last update":"Fri Jul 21 07:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.622,"15min":0.626},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76200000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":313201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34699999999999998,"15min":0.35099999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.502,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.249,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.49399999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.32100000000000001}]},{"osd":2,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.34699999999999998,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.44700000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.436,"15min":0.436},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.34100000000000003}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.57499999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.40600000000000003,"15min":0.41199999999999998},"min":{"1min":0.27000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56299999999999994,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.372}]},{"osd":4,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59699999999999998,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89300000000000002,"5min":1.006,"15min":1.006},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73599999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48299999999999998}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63400000000000001,"15min":0.64600000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80500000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.504},{"interface":"front","average":{"1min":0.62,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82699999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.64000000000000001,"15min":0.65500000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68600000000000005,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.69099999999999995,"15min":0.70899999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85299999999999998,"5min":1.339,"15min":1.339},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.747,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1277952,"data_stored":899622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.373,"15min":0.378},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52000000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.36199999999999999,"15min":0.36399999999999999},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.497,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.377,"15min":0.376},"min":{"1min":0.26800000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.60599999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.371}]},{"osd":3,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.37,"15min":0.372},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51500000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66100000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69699999999999995,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83999999999999997,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81299999999999994,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.76400000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.77600000000000002,"15min":0.80800000000000005},"min":{"1min":0.47499999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.751,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79400000000000004,"5min":1.002,"15min":1.002},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85999999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.504,"5min":0.433,"15min":0.433},"max":{"1min":0.72899999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":696320,"data_stored":309996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.35399999999999998},"min":{"1min":0.23599999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45900000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34899999999999998,"15min":0.34999999999999998},"min":{"1min":0.249,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.33000000000000002}]},{"osd":1,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38700000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.29499999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.49199999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.51900000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41899999999999998,"15min":0.42199999999999999},"min":{"1min":0.32800000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60099999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.38500000000000001}]},{"osd":4,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.434,"5min":0.379,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.40500000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82199999999999995,"5min":1.127,"15min":1.127},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76000000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.46000000000000002}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84199999999999997,"5min":1.109,"15min":1.109},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.622,"15min":0.61299999999999999},"min":{"1min":0.501,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88400000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.60299999999999998},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84699999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":688128,"data_stored":309836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35399999999999998,"15min":0.35599999999999998},"min":{"1min":0.248,"5min":0.224,"15min":0.224},"max":{"1min":0.56999999999999995,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.41299999999999998},"min":{"1min":0.29599999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60799999999999998,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.378,"15min":0.378},"min":{"1min":0.27700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.47899999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64600000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.38500000000000001}]},{"osd":4,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59799999999999998,"15min":0.59499999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.47899999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.49399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82399999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.627}]},{"osd":6,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81499999999999995,"5min":1.05,"15min":1.05},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85499999999999998,"5min":1.008,"15min":1.008},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Jul 21 07:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.44600000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.89800000000000002,"5min":1.222,"15min":1.222},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90800000000000003,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.76300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":313993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":1.008,"15min":1.0920000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66700000000000004,"5min":10.18,"15min":10.18},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.98099999999999998,"15min":1.0549999999999999},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.71299999999999997,"5min":10.207000000000001,"15min":10.207000000000001},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66900000000000004,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.58599999999999997,"15min":0.59999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64600000000000002,"5min":1.198,"15min":1.198},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.64500000000000002,"15min":0.66200000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70999999999999996,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.69299999999999995,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":0.80700000000000005}]},{"osd":3,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.68899999999999995,"15min":0.71099999999999997},"min":{"1min":0.36199999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":3.3380000000000001,"15min":3.3380000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72899999999999998,"5min":1.179,"15min":1.179},"last":0.754}]},{"osd":5,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.42199999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.505},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.624}]},{"osd":7,"last update":"Fri Jul 21 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.497,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77500000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.64600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":309310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64400000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.38700000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70399999999999996,"5min":0.751,"15min":0.751},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53900000000000003,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.68700000000000006,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.67300000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.70399999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.42199999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.623,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.47199999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.62,"15min":0.624},"min":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.67300000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.501}]},{"osd":4,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.72599999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.42599999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69299999999999995,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.70999999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Jul 21 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.72499999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.75,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T07:36:51.542 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T07:36:51.543 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-07-21T07:36:51.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.649+0000 7ffb3fed7700 1 Processor -- start 2023-07-21T07:36:51.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.649+0000 7ffb3fed7700 1 -- start start 2023-07-21T07:36:51.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.650+0000 7ffb3fed7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb380ba140 0x7ffb380c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:51.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.650+0000 7ffb3fed7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3806d8a0 0x7ffb380c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:51.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.650+0000 7ffb3fed7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb38155530 con 0x7ffb3806a300 2023-07-21T07:36:51.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.650+0000 7ffb3fed7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb380c1a30 con 0x7ffb380ba140 2023-07-21T07:36:51.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.650+0000 7ffb3fed7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb38154920 con 0x7ffb3806d8a0 2023-07-21T07:36:51.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.650+0000 7ffb3d472700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb380ba140 0x7ffb380c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:51.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.650+0000 7ffb3dc73700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffb3806a300 0x7ffb381519b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44522/0 (socket says 172.21.15.6:44522) 2023-07-21T07:36:51.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.650+0000 7ffb3dc73700 1 -- 172.21.15.6:0/3815739427 learned_addr learned my addr 172.21.15.6:0/3815739427 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:51.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.650+0000 7ffb3e474700 1 --2- 172.21.15.6:0/3815739427 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3806d8a0 0x7ffb380c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:51.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3d472700 1 -- 172.21.15.6:0/3815739427 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3806d8a0 msgr2=0x7ffb380c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:51.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3d472700 1 --2- 172.21.15.6:0/3815739427 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3806d8a0 0x7ffb380c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3d472700 1 -- 172.21.15.6:0/3815739427 >> v1:172.21.15.6:6789/0 conn(0x7ffb3806a300 legacy=0x7ffb381519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:51.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3d472700 1 -- 172.21.15.6:0/3815739427 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb38154c00 con 0x7ffb380ba140 2023-07-21T07:36:51.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3e474700 1 --2- 172.21.15.6:0/3815739427 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3806d8a0 0x7ffb380c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:51.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3d472700 1 --2- 172.21.15.6:0/3815739427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb380ba140 0x7ffb380c4a40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009840 tx=0x7ffb34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b029c87250063c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:51.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3cc71700 1 -- 172.21.15.6:0/3815739427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34011830 con 0x7ffb380ba140 2023-07-21T07:36:51.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3cc71700 1 -- 172.21.15.6:0/3815739427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb34011990 con 0x7ffb380ba140 2023-07-21T07:36:51.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3cc71700 1 -- 172.21.15.6:0/3815739427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34011d20 con 0x7ffb380ba140 2023-07-21T07:36:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3815739427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb380ba140 msgr2=0x7ffb380c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3fed7700 1 --2- 172.21.15.6:0/3815739427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb380ba140 0x7ffb380c4a40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009840 tx=0x7ffb34009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3815739427 shutdown_connections 2023-07-21T07:36:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3fed7700 1 --2- 172.21.15.6:0/3815739427 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3806d8a0 0x7ffb380c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3fed7700 1 --2- 172.21.15.6:0/3815739427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb380ba140 0x7ffb380c4a40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.651+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3815739427 >> 172.21.15.6:0/3815739427 conn(0x7ffb380a8660 msgr2=0x7ffb380a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.652+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3815739427 shutdown_connections 2023-07-21T07:36:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.652+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3815739427 wait complete. 2023-07-21T07:36:51.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.653+0000 7ffb3fed7700 1 Processor -- start 2023-07-21T07:36:51.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.653+0000 7ffb3fed7700 1 -- start start 2023-07-21T07:36:51.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.653+0000 7ffb3fed7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb3806a300 0x7ffb38152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:51.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.653+0000 7ffb3fed7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3806d8a0 0x7ffb381ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:51.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.653+0000 7ffb3fed7700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb380ba140 0x7ffb380be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:51.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.653+0000 7ffb3fed7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380c24d0 con 0x7ffb3806a300 2023-07-21T07:36:51.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.653+0000 7ffb3fed7700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380c0a50 con 0x7ffb380ba140 2023-07-21T07:36:51.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.653+0000 7ffb3fed7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb381ee010 con 0x7ffb3806d8a0 2023-07-21T07:36:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.653+0000 7ffb3dc73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb3806a300 0x7ffb38152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb3dc73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb3806a300 0x7ffb38152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36508/0 (socket says 172.21.15.6:36508) 2023-07-21T07:36:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb3dc73700 1 -- 172.21.15.6:0/3997302912 learned_addr learned my addr 172.21.15.6:0/3997302912 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb3d472700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3806d8a0 0x7ffb381ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb3e474700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb380ba140 0x7ffb380be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb3dc73700 1 -- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3806d8a0 msgr2=0x7ffb381ed740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb3dc73700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3806d8a0 0x7ffb381ed740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb3dc73700 1 -- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb380ba140 msgr2=0x7ffb380be7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb3dc73700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb380ba140 0x7ffb380be7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb3dc73700 1 -- 172.21.15.6:0/3997302912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340094a0 con 0x7ffb3806a300 2023-07-21T07:36:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb3e474700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb380ba140 0x7ffb380be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb3dc73700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb3806a300 0x7ffb38152680 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800c480 tx=0x7ffb2800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb2e7fc700 1 -- 172.21.15.6:0/3997302912 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28005d70 con 0x7ffb3806a300 2023-07-21T07:36:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb2e7fc700 1 -- 172.21.15.6:0/3997302912 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb280070d0 con 0x7ffb3806a300 2023-07-21T07:36:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3997302912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb381ee2f0 con 0x7ffb3806a300 2023-07-21T07:36:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb2e7fc700 1 -- 172.21.15.6:0/3997302912 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28007440 con 0x7ffb3806a300 2023-07-21T07:36:51.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.654+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3997302912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb380c06e0 con 0x7ffb3806a300 2023-07-21T07:36:51.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.655+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3997302912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb381ee480 con 0x7ffb3806a300 2023-07-21T07:36:51.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.656+0000 7ffb2e7fc700 1 -- 172.21.15.6:0/3997302912 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffb280075a0 con 0x7ffb3806a300 2023-07-21T07:36:51.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.656+0000 7ffb2e7fc700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ffb1c06ace0 0x7ffb1c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:51.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.656+0000 7ffb2e7fc700 1 -- 172.21.15.6:0/3997302912 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7ffb28088c40 con 0x7ffb3806a300 2023-07-21T07:36:51.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.657+0000 7ffb3d472700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ffb1c06ace0 0x7ffb1c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:51.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.657+0000 7ffb3d472700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ffb1c06ace0 0x7ffb1c06d1a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffb380ba5b0 tx=0x7ffb34008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:51.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.661+0000 7ffb2e7fc700 1 -- 172.21.15.6:0/3997302912 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffb28053a40 con 0x7ffb3806a300 2023-07-21T07:36:51.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.942+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3997302912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7ffb38074500 con 0x7ffb3806a300 2023-07-21T07:36:52.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.946+0000 7ffb2e7fc700 1 -- 172.21.15.6:0/3997302912 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v14) v1 ==== 185+0+142 (secure 0 0 0) 0x7ffb280170a0 con 0x7ffb3806a300 2023-07-21T07:36:52.000 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2023-07-21T07:36:52.000 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDVNLpkvOxjOhAA2c1WuwU8rO+o7NzkpQOe0w== 2023-07-21T07:36:52.000 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T07:36:52.001 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T07:36:52.001 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-07-21T07:36:52.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.948+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ffb1c06ace0 msgr2=0x7ffb1c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.948+0000 7ffb3fed7700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ffb1c06ace0 0x7ffb1c06d1a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffb380ba5b0 tx=0x7ffb34008030 comp rx=0 tx=0).stop 2023-07-21T07:36:52.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.948+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3997302912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb3806a300 msgr2=0x7ffb38152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.948+0000 7ffb3fed7700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb3806a300 0x7ffb38152680 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800c480 tx=0x7ffb2800c840 comp rx=0 tx=0).stop 2023-07-21T07:36:52.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.948+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3997302912 shutdown_connections 2023-07-21T07:36:52.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.948+0000 7ffb3fed7700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ffb1c06ace0 0x7ffb1c06d1a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.948+0000 7ffb3fed7700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb380ba140 0x7ffb380be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.948+0000 7ffb3fed7700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb3806a300 0x7ffb38152680 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.948+0000 7ffb3fed7700 1 --2- 172.21.15.6:0/3997302912 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3806d8a0 0x7ffb381ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.948+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3997302912 >> 172.21.15.6:0/3997302912 conn(0x7ffb380a8660 msgr2=0x7ffb380c31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:52.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.948+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3997302912 shutdown_connections 2023-07-21T07:36:52.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:51.948+0000 7ffb3fed7700 1 -- 172.21.15.6:0/3997302912 wait complete. 2023-07-21T07:36:52.004 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.1 2023-07-21T07:36:52.015 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:36:52.015 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:36:52.034 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:36:52.035 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:36:52.094 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T07:36:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.166+0000 7f9b82854700 1 Processor -- start 2023-07-21T07:36:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.166+0000 7f9b82854700 1 -- start start 2023-07-21T07:36:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b82854700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c14e870 0x7f9b7c14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b82854700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b7c0c4930 0x7f9b7c151330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b82854700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7c0c4ef0 con 0x7f9b7c0a5f00 2023-07-21T07:36:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b82854700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7c0c1df0 con 0x7f9b7c0c4930 2023-07-21T07:36:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b82854700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c0c1450 con 0x7f9b7c14e870 2023-07-21T07:36:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b7bfff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c14e870 0x7f9b7c14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b80df1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b7c0c4930 0x7f9b7c151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b7b7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9b7c0a5f00 0x7f9b7c0c3440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.6:47780/0 (socket says 172.21.15.6:47780) 2023-07-21T07:36:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b80df1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b7c0c4930 0x7f9b7c151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.6:58324/0 (socket says 172.21.15.6:58324) 2023-07-21T07:36:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b7b7fe700 1 -- 172.21.15.6:0/1143890391 learned_addr learned my addr 172.21.15.6:0/1143890391 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b80df1700 1 -- 172.21.15.6:0/1143890391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c14e870 msgr2=0x7f9b7c14ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b80df1700 1 --2- 172.21.15.6:0/1143890391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c14e870 0x7f9b7c14ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b80df1700 1 -- 172.21.15.6:0/1143890391 >> v1:172.21.15.86:6789/0 conn(0x7f9b7c0a5f00 legacy=0x7f9b7c0c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b80df1700 1 -- 172.21.15.6:0/1143890391 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c0c1730 con 0x7f9b7c0c4930 2023-07-21T07:36:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b7bfff700 1 --2- 172.21.15.6:0/1143890391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c14e870 0x7f9b7c14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.167+0000 7f9b80df1700 1 --2- 172.21.15.6:0/1143890391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0c4930 0x7f9b7c151330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009d90 tx=0x7f9b7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17845c88879cf2bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.168+0000 7f9b7affd700 1 -- 172.21.15.6:0/1143890391 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7400e070 con 0x7f9b7c0c4930 2023-07-21T07:36:52.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.168+0000 7f9b7affd700 1 -- 172.21.15.6:0/1143890391 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7400bb20 con 0x7f9b7c0c4930 2023-07-21T07:36:52.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.168+0000 7f9b7affd700 1 -- 172.21.15.6:0/1143890391 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74012430 con 0x7f9b7c0c4930 2023-07-21T07:36:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.168+0000 7f9b82854700 1 -- 172.21.15.6:0/1143890391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0c4930 msgr2=0x7f9b7c151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.168+0000 7f9b82854700 1 --2- 172.21.15.6:0/1143890391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0c4930 0x7f9b7c151330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009d90 tx=0x7f9b7400b330 comp rx=0 tx=0).stop 2023-07-21T07:36:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.168+0000 7f9b82854700 1 -- 172.21.15.6:0/1143890391 shutdown_connections 2023-07-21T07:36:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.168+0000 7f9b82854700 1 --2- 172.21.15.6:0/1143890391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0c4930 0x7f9b7c151330 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.168+0000 7f9b82854700 1 --2- 172.21.15.6:0/1143890391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c14e870 0x7f9b7c14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.168+0000 7f9b82854700 1 -- 172.21.15.6:0/1143890391 >> 172.21.15.6:0/1143890391 conn(0x7f9b7c0a8660 msgr2=0x7f9b7c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.168+0000 7f9b82854700 1 -- 172.21.15.6:0/1143890391 shutdown_connections 2023-07-21T07:36:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.168+0000 7f9b82854700 1 -- 172.21.15.6:0/1143890391 wait complete. 2023-07-21T07:36:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.169+0000 7f9b82854700 1 Processor -- start 2023-07-21T07:36:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.170+0000 7f9b82854700 1 -- start start 2023-07-21T07:36:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.170+0000 7f9b82854700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0a5f00 0x7f9b7c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.170+0000 7f9b82854700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b7c0c4930 0x7f9b7c0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.170+0000 7f9b82854700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c14e870 0x7f9b7c1e9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.170+0000 7f9b82854700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c0715e0 con 0x7f9b7c0c4930 2023-07-21T07:36:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.170+0000 7f9b82854700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c0722e0 con 0x7f9b7c0a5f00 2023-07-21T07:36:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.170+0000 7f9b82854700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c0717c0 con 0x7f9b7c14e870 2023-07-21T07:36:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.170+0000 7f9b7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b7c0c4930 0x7f9b7c0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.170+0000 7f9b7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b7c0c4930 0x7f9b7c0a52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36524/0 (socket says 172.21.15.6:36524) 2023-07-21T07:36:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.170+0000 7f9b7b7fe700 1 -- 172.21.15.6:0/684602019 learned_addr learned my addr 172.21.15.6:0/684602019 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.170+0000 7f9b7bfff700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0a5f00 0x7f9b7c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b80df1700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c14e870 0x7f9b7c1e9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b7b7fe700 1 -- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c14e870 msgr2=0x7f9b7c1e9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b7b7fe700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c14e870 0x7f9b7c1e9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b7b7fe700 1 -- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0a5f00 msgr2=0x7f9b7c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b7b7fe700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0a5f00 0x7f9b7c070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b7b7fe700 1 -- 172.21.15.6:0/684602019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c0094a0 con 0x7f9b7c0c4930 2023-07-21T07:36:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b7bfff700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0a5f00 0x7f9b7c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b80df1700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c14e870 0x7f9b7c1e9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T07:36:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b7b7fe700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b7c0c4930 0x7f9b7c0a52b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000c480 tx=0x7f9b7000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b78ff9700 1 -- 172.21.15.6:0/684602019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70005d70 con 0x7f9b7c0c4930 2023-07-21T07:36:52.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b78ff9700 1 -- 172.21.15.6:0/684602019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7000ce90 con 0x7f9b7c0c4930 2023-07-21T07:36:52.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b82854700 1 -- 172.21.15.6:0/684602019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b74009a70 con 0x7f9b7c0c4930 2023-07-21T07:36:52.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b78ff9700 1 -- 172.21.15.6:0/684602019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b700072d0 con 0x7f9b7c0c4930 2023-07-21T07:36:52.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.171+0000 7f9b82854700 1 -- 172.21.15.6:0/684602019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7c1e9aa0 con 0x7f9b7c0c4930 2023-07-21T07:36:52.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.172+0000 7f9b82854700 1 -- 172.21.15.6:0/684602019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7c074500 con 0x7f9b7c0c4930 2023-07-21T07:36:52.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.173+0000 7f9b78ff9700 1 -- 172.21.15.6:0/684602019 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b70007430 con 0x7f9b7c0c4930 2023-07-21T07:36:52.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.173+0000 7f9b78ff9700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9b6806ace0 0x7f9b6806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.173+0000 7f9b78ff9700 1 -- 172.21.15.6:0/684602019 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f9b700889f0 con 0x7f9b7c0c4930 2023-07-21T07:36:52.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.173+0000 7f9b7bfff700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9b6806ace0 0x7f9b6806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.174+0000 7f9b7bfff700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9b6806ace0 0x7f9b6806d1a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0114b0 tx=0x7f9b6c009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.177+0000 7f9b78ff9700 1 -- 172.21.15.6:0/684602019 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9b700537f0 con 0x7f9b7c0c4930 2023-07-21T07:36:52.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.376+0000 7f9b82854700 1 -- 172.21.15.6:0/684602019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b7c0a8c90 con 0x7f9b7c0c4930 2023-07-21T07:36:52.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.377+0000 7f9b78ff9700 1 -- 172.21.15.6:0/684602019 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+21903 (secure 0 0 0) 0x7f9b70056e10 con 0x7f9b7c0c4930 2023-07-21T07:36:52.432 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T07:36:52.432 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":58,"fsid":"8c602ac0-17b3-4df5-8928-640a7524b3b3","created":"2023-07-21T07:34:15.066383+0000","modified":"2023-07-21T07:36:47.910087+0000","last_up_change":"2023-07-21T07:34:26.738810+0000","last_in_change":"2023-07-21T07:34:17.557774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T07:34:28.748776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T07:34:33.572759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T07:36:26.204826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T07:36:26.916497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-07-21T07:36:44.559566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-07-21T07:36:45.284485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5ceae1ca-30ae-426d-92bb-ae9cb464a5ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6817","nonce":3132105263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6819","nonce":3132105263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6823","nonce":3132105263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3132105263},{"type":"v1","addr":"172.21.15.6:6821","nonce":3132105263}]},"public_addr":"172.21.15.6:6817/3132105263","cluster_addr":"172.21.15.6:6819/3132105263","heartbeat_back_addr":"172.21.15.6:6823/3132105263","heartbeat_front_addr":"172.21.15.6:6821/3132105263","state":["exists","up"]},{"osd":1,"uuid":"b02b714f-db39-498d-8132-8eb25620599f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6804","nonce":3429574632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6808","nonce":3429574632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6815","nonce":3429574632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3429574632},{"type":"v1","addr":"172.21.15.6:6812","nonce":3429574632}]},"public_addr":"172.21.15.6:6804/3429574632","cluster_addr":"172.21.15.6:6808/3429574632","heartbeat_back_addr":"172.21.15.6:6815/3429574632","heartbeat_front_addr":"172.21.15.6:6812/3429574632","state":["exists","up"]},{"osd":2,"uuid":"cfd9db11-934c-47d5-9455-ab05f8ee9849","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6801","nonce":4035793919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6803","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6805","nonce":4035793919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6811","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6813","nonce":4035793919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6807","nonce":4035793919},{"type":"v1","addr":"172.21.15.6:6809","nonce":4035793919}]},"public_addr":"172.21.15.6:6801/4035793919","cluster_addr":"172.21.15.6:6805/4035793919","heartbeat_back_addr":"172.21.15.6:6813/4035793919","heartbeat_front_addr":"172.21.15.6:6809/4035793919","state":["exists","up"]},{"osd":3,"uuid":"793561e2-f037-4898-9161-405770446e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6825","nonce":3597608045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6827","nonce":3597608045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6831","nonce":3597608045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3597608045},{"type":"v1","addr":"172.21.15.6:6829","nonce":3597608045}]},"public_addr":"172.21.15.6:6825/3597608045","cluster_addr":"172.21.15.6:6827/3597608045","heartbeat_back_addr":"172.21.15.6:6831/3597608045","heartbeat_front_addr":"172.21.15.6:6829/3597608045","state":["exists","up"]},{"osd":4,"uuid":"1f861df6-be24-4dd7-8ba9-d6bc55c83ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6819","nonce":3071121321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6826","nonce":3071121321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6831","nonce":3071121321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3071121321},{"type":"v1","addr":"172.21.15.86:6829","nonce":3071121321}]},"public_addr":"172.21.15.86:6819/3071121321","cluster_addr":"172.21.15.86:6826/3071121321","heartbeat_back_addr":"172.21.15.86:6831/3071121321","heartbeat_front_addr":"172.21.15.86:6829/3071121321","state":["exists","up"]},{"osd":5,"uuid":"264a393b-14c1-4bb1-a174-f2ff3353229f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6801","nonce":141737948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6803","nonce":141737948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6807","nonce":141737948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":141737948},{"type":"v1","addr":"172.21.15.86:6805","nonce":141737948}]},"public_addr":"172.21.15.86:6801/141737948","cluster_addr":"172.21.15.86:6803/141737948","heartbeat_back_addr":"172.21.15.86:6807/141737948","heartbeat_front_addr":"172.21.15.86:6805/141737948","state":["exists","up"]},{"osd":6,"uuid":"bef4ee26-5dd9-403a-8774-deb095924ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6809","nonce":236253683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6811","nonce":236253683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6821","nonce":236253683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":236253683},{"type":"v1","addr":"172.21.15.86:6814","nonce":236253683}]},"public_addr":"172.21.15.86:6809/236253683","cluster_addr":"172.21.15.86:6811/236253683","heartbeat_back_addr":"172.21.15.86:6821/236253683","heartbeat_front_addr":"172.21.15.86:6814/236253683","state":["exists","up"]},{"osd":7,"uuid":"7277270a-bbb3-4dfc-ae70-4aecf3a708e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6813","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6815","nonce":3554109165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6820","nonce":3554109165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6825","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6827","nonce":3554109165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3554109165},{"type":"v1","addr":"172.21.15.86:6824","nonce":3554109165}]},"public_addr":"172.21.15.86:6815/3554109165","cluster_addr":"172.21.15.86:6820/3554109165","heartbeat_back_addr":"172.21.15.86:6827/3554109165","heartbeat_front_addr":"172.21.15.86:6824/3554109165","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.772178+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.790263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.712555+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.792481+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.768558+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.713983+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.779343+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T07:34:22.706132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T07:36:52.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.380+0000 7f9b82854700 1 -- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9b6806ace0 msgr2=0x7f9b6806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.380+0000 7f9b82854700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9b6806ace0 0x7f9b6806d1a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0114b0 tx=0x7f9b6c009210 comp rx=0 tx=0).stop 2023-07-21T07:36:52.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.380+0000 7f9b82854700 1 -- 172.21.15.6:0/684602019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b7c0c4930 msgr2=0x7f9b7c0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.380+0000 7f9b82854700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b7c0c4930 0x7f9b7c0a52b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000c480 tx=0x7f9b7000c790 comp rx=0 tx=0).stop 2023-07-21T07:36:52.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.380+0000 7f9b82854700 1 -- 172.21.15.6:0/684602019 shutdown_connections 2023-07-21T07:36:52.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.380+0000 7f9b82854700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f9b6806ace0 0x7f9b6806d1a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.380+0000 7f9b82854700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c14e870 0x7f9b7c1e9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.380+0000 7f9b82854700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0a5f00 0x7f9b7c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.380+0000 7f9b82854700 1 --2- 172.21.15.6:0/684602019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b7c0c4930 0x7f9b7c0a52b0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.380+0000 7f9b82854700 1 -- 172.21.15.6:0/684602019 >> 172.21.15.6:0/684602019 conn(0x7f9b7c0a8660 msgr2=0x7f9b7c0c3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:52.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.380+0000 7f9b82854700 1 -- 172.21.15.6:0/684602019 shutdown_connections 2023-07-21T07:36:52.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.380+0000 7f9b82854700 1 -- 172.21.15.6:0/684602019 wait complete. 2023-07-21T07:36:52.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T07:34:28.748776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T07:34:33.572759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T07:36:26.204826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T07:36:26.916497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-21T07:36:44.559566+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-21T07:36:45.284485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T07:36:52.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T07:36:52.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.521+0000 7fa8b1c92700 1 Processor -- start 2023-07-21T07:36:52.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.521+0000 7fa8b1c92700 1 -- start start 2023-07-21T07:36:52.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.522+0000 7fa8b1c92700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8ac06a300 0x7fa8ac1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.522+0000 7fa8b1c92700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa8ac0ba140 0x7fa8ac151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.522+0000 7fa8b1c92700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8ac06d8a0 0x7fa8ac0c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.522+0000 7fa8b1c92700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac0c1a30 con 0x7fa8ac06d8a0 2023-07-21T07:36:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.522+0000 7fa8b1c92700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac155530 con 0x7fa8ac0ba140 2023-07-21T07:36:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.522+0000 7fa8b1c92700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac154920 con 0x7fa8ac06a300 2023-07-21T07:36:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.522+0000 7fa8abfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8ac06d8a0 0x7fa8ac0c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.522+0000 7fa8abfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8ac06d8a0 0x7fa8ac0c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36534/0 (socket says 172.21.15.6:36534) 2023-07-21T07:36:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.522+0000 7fa8abfff700 1 -- 172.21.15.6:0/1765158164 learned_addr learned my addr 172.21.15.6:0/1765158164 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.523+0000 7fa8ab7fe700 1 --2- 172.21.15.6:0/1765158164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8ac06a300 0x7fa8ac1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.523+0000 7fa8aaffd700 1 --2- 172.21.15.6:0/1765158164 >> v2:172.21.15.86:3300/0 conn(0x7fa8ac0ba140 0x7fa8ac151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.523+0000 7fa8abfff700 1 -- 172.21.15.6:0/1765158164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8ac06a300 msgr2=0x7fa8ac1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.523+0000 7fa8abfff700 1 --2- 172.21.15.6:0/1765158164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8ac06a300 0x7fa8ac1519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.523+0000 7fa8abfff700 1 -- 172.21.15.6:0/1765158164 >> v2:172.21.15.86:3300/0 conn(0x7fa8ac0ba140 msgr2=0x7fa8ac151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.523+0000 7fa8abfff700 1 --2- 172.21.15.6:0/1765158164 >> v2:172.21.15.86:3300/0 conn(0x7fa8ac0ba140 0x7fa8ac151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.523+0000 7fa8abfff700 1 -- 172.21.15.6:0/1765158164 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac154c00 con 0x7fa8ac06d8a0 2023-07-21T07:36:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.523+0000 7fa8abfff700 1 --2- 172.21.15.6:0/1765158164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ac06d8a0 0x7fa8ac0c4a40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0c4630 tx=0x7fa8a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1026e97094b7f56 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.523+0000 7fa8aa7fc700 1 -- 172.21.15.6:0/1765158164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400e070 con 0x7fa8ac06d8a0 2023-07-21T07:36:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.523+0000 7fa8aa7fc700 1 -- 172.21.15.6:0/1765158164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a400b9c0 con 0x7fa8ac06d8a0 2023-07-21T07:36:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.523+0000 7fa8aa7fc700 1 -- 172.21.15.6:0/1765158164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400bd70 con 0x7fa8ac06d8a0 2023-07-21T07:36:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.523+0000 7fa8b1c92700 1 -- 172.21.15.6:0/1765158164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ac06d8a0 msgr2=0x7fa8ac0c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.524+0000 7fa8b1c92700 1 --2- 172.21.15.6:0/1765158164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ac06d8a0 0x7fa8ac0c4a40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0c4630 tx=0x7fa8a400b330 comp rx=0 tx=0).stop 2023-07-21T07:36:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.524+0000 7fa8b1c92700 1 -- 172.21.15.6:0/1765158164 shutdown_connections 2023-07-21T07:36:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.524+0000 7fa8b1c92700 1 --2- 172.21.15.6:0/1765158164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ac06d8a0 0x7fa8ac0c4a40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.524+0000 7fa8b1c92700 1 --2- 172.21.15.6:0/1765158164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8ac06a300 0x7fa8ac1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.524+0000 7fa8b1c92700 1 --2- 172.21.15.6:0/1765158164 >> v2:172.21.15.86:3300/0 conn(0x7fa8ac0ba140 0x7fa8ac151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.524+0000 7fa8b1c92700 1 -- 172.21.15.6:0/1765158164 >> 172.21.15.6:0/1765158164 conn(0x7fa8ac0a8660 msgr2=0x7fa8ac0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.524+0000 7fa8b1c92700 1 -- 172.21.15.6:0/1765158164 shutdown_connections 2023-07-21T07:36:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.524+0000 7fa8b1c92700 1 -- 172.21.15.6:0/1765158164 wait complete. 2023-07-21T07:36:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.525+0000 7fa8b1c92700 1 Processor -- start 2023-07-21T07:36:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.525+0000 7fa8b1c92700 1 -- start start 2023-07-21T07:36:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8b1c92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ac06a300 0x7fa8ac072130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8b1c92700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8ac06d8a0 0x7fa8ac1ed940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8b1c92700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8ac0ba140 0x7fa8ac1df620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8b1c92700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac155be0 con 0x7fa8ac06a300 2023-07-21T07:36:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8b1c92700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac1ede80 con 0x7fa8ac0ba140 2023-07-21T07:36:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8b1c92700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac070680 con 0x7fa8ac06d8a0 2023-07-21T07:36:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8ab7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ac06a300 0x7fa8ac072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8ab7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ac06a300 0x7fa8ac072130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36536/0 (socket says 172.21.15.6:36536) 2023-07-21T07:36:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8ab7fe700 1 -- 172.21.15.6:0/4080935063 learned_addr learned my addr 172.21.15.6:0/4080935063 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8aaffd700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8ac06d8a0 0x7fa8ac1ed940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8abfff700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8ac0ba140 0x7fa8ac1df620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8ab7fe700 1 -- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8ac06d8a0 msgr2=0x7fa8ac1ed940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8ab7fe700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8ac06d8a0 0x7fa8ac1ed940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8ab7fe700 1 -- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8ac0ba140 msgr2=0x7fa8ac1df620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8ab7fe700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8ac0ba140 0x7fa8ac1df620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8ab7fe700 1 -- 172.21.15.6:0/4080935063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a4009b30 con 0x7fa8ac06a300 2023-07-21T07:36:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8ab7fe700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ac06a300 0x7fa8ac072130 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00c7f0 tx=0x7fa89c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa893fff700 1 -- 172.21.15.6:0/4080935063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c011800 con 0x7fa8ac06a300 2023-07-21T07:36:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa893fff700 1 -- 172.21.15.6:0/4080935063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c011960 con 0x7fa8ac06a300 2023-07-21T07:36:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.526+0000 7fa8b1c92700 1 -- 172.21.15.6:0/4080935063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac0bfe70 con 0x7fa8ac06a300 2023-07-21T07:36:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.527+0000 7fa893fff700 1 -- 172.21.15.6:0/4080935063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c011d10 con 0x7fa8ac06a300 2023-07-21T07:36:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.527+0000 7fa8b1c92700 1 -- 172.21.15.6:0/4080935063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac0c0430 con 0x7fa8ac06a300 2023-07-21T07:36:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.527+0000 7fa8b1c92700 1 -- 172.21.15.6:0/4080935063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac0c0620 con 0x7fa8ac06a300 2023-07-21T07:36:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.528+0000 7fa893fff700 1 -- 172.21.15.6:0/4080935063 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa89c018360 con 0x7fa8ac06a300 2023-07-21T07:36:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.528+0000 7fa893fff700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa89806ace0 0x7fa89806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.528+0000 7fa893fff700 1 -- 172.21.15.6:0/4080935063 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fa89c089320 con 0x7fa8ac06a300 2023-07-21T07:36:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.529+0000 7fa8aaffd700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa89806ace0 0x7fa89806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.529+0000 7fa8aaffd700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa89806ace0 0x7fa89806d1a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0bfda0 tx=0x7fa8a0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:52.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.533+0000 7fa893fff700 1 -- 172.21.15.6:0/4080935063 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa89c054060 con 0x7fa8ac06a300 2023-07-21T07:36:52.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.731+0000 7fa8b1c92700 1 -- 172.21.15.6:0/4080935063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8ac074500 con 0x7fa8ac06a300 2023-07-21T07:36:52.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.732+0000 7fa893fff700 1 -- 172.21.15.6:0/4080935063 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa89c057680 con 0x7fa8ac06a300 2023-07-21T07:36:52.787 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T07:36:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.734+0000 7fa8b1c92700 1 -- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa89806ace0 msgr2=0x7fa89806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.734+0000 7fa8b1c92700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa89806ace0 0x7fa89806d1a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0bfda0 tx=0x7fa8a0008040 comp rx=0 tx=0).stop 2023-07-21T07:36:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.734+0000 7fa8b1c92700 1 -- 172.21.15.6:0/4080935063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ac06a300 msgr2=0x7fa8ac072130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.734+0000 7fa8b1c92700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ac06a300 0x7fa8ac072130 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00c7f0 tx=0x7fa89c00cbb0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.734+0000 7fa8b1c92700 1 -- 172.21.15.6:0/4080935063 shutdown_connections 2023-07-21T07:36:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.734+0000 7fa8b1c92700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fa89806ace0 0x7fa89806d1a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.734+0000 7fa8b1c92700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8ac0ba140 0x7fa8ac1df620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.734+0000 7fa8b1c92700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8ac06a300 0x7fa8ac072130 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.734+0000 7fa8b1c92700 1 --2- 172.21.15.6:0/4080935063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8ac06d8a0 0x7fa8ac1ed940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.734+0000 7fa8b1c92700 1 -- 172.21.15.6:0/4080935063 >> 172.21.15.6:0/4080935063 conn(0x7fa8ac0a8660 msgr2=0x7fa8ac154050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:52.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.734+0000 7fa8b1c92700 1 -- 172.21.15.6:0/4080935063 shutdown_connections 2023-07-21T07:36:52.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.734+0000 7fa8b1c92700 1 -- 172.21.15.6:0/4080935063 wait complete. 2023-07-21T07:36:52.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T07:36:52.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.874+0000 7fc9804b9700 1 Processor -- start 2023-07-21T07:36:52.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.874+0000 7fc9804b9700 1 -- start start 2023-07-21T07:36:52.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc9804b9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806a300 0x7fc9781519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc9804b9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc97806d8a0 0x7fc978151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc9804b9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc978155530 con 0x7fc9780ba140 2023-07-21T07:36:52.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc9804b9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9780c1a30 con 0x7fc97806d8a0 2023-07-21T07:36:52.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc9804b9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc978154920 con 0x7fc97806a300 2023-07-21T07:36:52.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc97ea56700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc97806d8a0 0x7fc978151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc97da54700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc9780ba140 0x7fc9780c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44566/0 (socket says 172.21.15.6:44566) 2023-07-21T07:36:52.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc97da54700 1 -- 172.21.15.6:0/4053557162 learned_addr learned my addr 172.21.15.6:0/4053557162 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:52.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc97e255700 1 --2- 172.21.15.6:0/4053557162 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806a300 0x7fc9781519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc97ea56700 1 -- 172.21.15.6:0/4053557162 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806a300 msgr2=0x7fc9781519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:52.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc97ea56700 1 --2- 172.21.15.6:0/4053557162 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806a300 0x7fc9781519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc97ea56700 1 -- 172.21.15.6:0/4053557162 >> v1:172.21.15.6:6789/0 conn(0x7fc9780ba140 legacy=0x7fc9780c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc97ea56700 1 -- 172.21.15.6:0/4053557162 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc978154c00 con 0x7fc97806d8a0 2023-07-21T07:36:52.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc97d253700 1 -- 172.21.15.6:0/4053557162 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530243791 0 0) 0x7fc978155530 con 0x7fc9780ba140 2023-07-21T07:36:52.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.875+0000 7fc97e255700 1 --2- 172.21.15.6:0/4053557162 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806a300 0x7fc9781519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:52.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.876+0000 7fc97ea56700 1 --2- 172.21.15.6:0/4053557162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc97806d8a0 0x7fc978151ef0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc970009d90 tx=0x7fc97000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31788df27d7cd5a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:52.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.876+0000 7fc97d253700 1 -- 172.21.15.6:0/4053557162 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000e070 con 0x7fc97806d8a0 2023-07-21T07:36:52.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.876+0000 7fc97d253700 1 -- 172.21.15.6:0/4053557162 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97000bbd0 con 0x7fc97806d8a0 2023-07-21T07:36:52.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.876+0000 7fc97d253700 1 -- 172.21.15.6:0/4053557162 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970012430 con 0x7fc97806d8a0 2023-07-21T07:36:52.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.876+0000 7fc9804b9700 1 -- 172.21.15.6:0/4053557162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc97806d8a0 msgr2=0x7fc978151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.876+0000 7fc9804b9700 1 --2- 172.21.15.6:0/4053557162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc97806d8a0 0x7fc978151ef0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc970009d90 tx=0x7fc97000b330 comp rx=0 tx=0).stop 2023-07-21T07:36:52.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.876+0000 7fc9804b9700 1 -- 172.21.15.6:0/4053557162 shutdown_connections 2023-07-21T07:36:52.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.876+0000 7fc9804b9700 1 --2- 172.21.15.6:0/4053557162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc97806d8a0 0x7fc978151ef0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.876+0000 7fc9804b9700 1 --2- 172.21.15.6:0/4053557162 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806a300 0x7fc9781519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.876+0000 7fc9804b9700 1 -- 172.21.15.6:0/4053557162 >> 172.21.15.6:0/4053557162 conn(0x7fc9780a8660 msgr2=0x7fc9780a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.876+0000 7fc9804b9700 1 -- 172.21.15.6:0/4053557162 shutdown_connections 2023-07-21T07:36:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.876+0000 7fc9804b9700 1 -- 172.21.15.6:0/4053557162 wait complete. 2023-07-21T07:36:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.878+0000 7fc9804b9700 1 Processor -- start 2023-07-21T07:36:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.878+0000 7fc9804b9700 1 -- start start 2023-07-21T07:36:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.878+0000 7fc9804b9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806a300 0x7fc9781ea4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.878+0000 7fc9804b9700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc97806d8a0 0x7fc9780c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.878+0000 7fc9804b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9780ba140 0x7fc978071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.878+0000 7fc9804b9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781eaa20 con 0x7fc9780ba140 2023-07-21T07:36:52.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.878+0000 7fc9804b9700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780c0ae0 con 0x7fc97806d8a0 2023-07-21T07:36:52.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.878+0000 7fc9804b9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97814c280 con 0x7fc97806a300 2023-07-21T07:36:52.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.878+0000 7fc97ea56700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9780ba140 0x7fc978071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.878+0000 7fc97ea56700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9780ba140 0x7fc978071550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36554/0 (socket says 172.21.15.6:36554) 2023-07-21T07:36:52.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.878+0000 7fc97ea56700 1 -- 172.21.15.6:0/3020592978 learned_addr learned my addr 172.21.15.6:0/3020592978 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:52.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.879+0000 7fc97e255700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806a300 0x7fc9781ea4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.879+0000 7fc97da54700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc97806d8a0 0x7fc9780c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.879+0000 7fc97ea56700 1 -- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806a300 msgr2=0x7fc9781ea4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.879+0000 7fc97ea56700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806a300 0x7fc9781ea4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.879+0000 7fc97ea56700 1 -- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc97806d8a0 msgr2=0x7fc9780c05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:52.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.879+0000 7fc97ea56700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc97806d8a0 0x7fc9780c05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:52.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.879+0000 7fc97ea56700 1 -- 172.21.15.6:0/3020592978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc970009a70 con 0x7fc9780ba140 2023-07-21T07:36:52.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.879+0000 7fc97ea56700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9780ba140 0x7fc978071550 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc97806d570 tx=0x7fc970004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:52.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.879+0000 7fc96effd700 1 -- 172.21.15.6:0/3020592978 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970012430 con 0x7fc9780ba140 2023-07-21T07:36:52.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.879+0000 7fc96effd700 1 -- 172.21.15.6:0/3020592978 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc970020070 con 0x7fc9780ba140 2023-07-21T07:36:52.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.879+0000 7fc96effd700 1 -- 172.21.15.6:0/3020592978 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970004280 con 0x7fc9780ba140 2023-07-21T07:36:52.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.879+0000 7fc9804b9700 1 -- 172.21.15.6:0/3020592978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97814b270 con 0x7fc9780ba140 2023-07-21T07:36:52.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.879+0000 7fc9804b9700 1 -- 172.21.15.6:0/3020592978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97814c4d0 con 0x7fc9780ba140 2023-07-21T07:36:52.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.880+0000 7fc9804b9700 1 -- 172.21.15.6:0/3020592978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97814b400 con 0x7fc9780ba140 2023-07-21T07:36:52.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.881+0000 7fc96effd700 1 -- 172.21.15.6:0/3020592978 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc9700043e0 con 0x7fc9780ba140 2023-07-21T07:36:52.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.881+0000 7fc96effd700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc95c06ace0 0x7fc95c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:52.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.881+0000 7fc96effd700 1 -- 172.21.15.6:0/3020592978 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fc970022070 con 0x7fc9780ba140 2023-07-21T07:36:52.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.882+0000 7fc97e255700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc95c06ace0 0x7fc95c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:52.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.882+0000 7fc97e255700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc95c06ace0 0x7fc95c06d1a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc96800c940 tx=0x7fc968008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:52.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:52.886+0000 7fc96effd700 1 -- 172.21.15.6:0/3020592978 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc970056270 con 0x7fc9780ba140 2023-07-21T07:36:53.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.086+0000 7fc9804b9700 1 -- 172.21.15.6:0/3020592978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc978074500 con 0x7fc9780ba140 2023-07-21T07:36:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.086+0000 7fc96effd700 1 -- 172.21.15.6:0/3020592978 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc970059890 con 0x7fc9780ba140 2023-07-21T07:36:53.141 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T07:36:53.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.088+0000 7fc9804b9700 1 -- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc95c06ace0 msgr2=0x7fc95c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.088+0000 7fc9804b9700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc95c06ace0 0x7fc95c06d1a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc96800c940 tx=0x7fc968008040 comp rx=0 tx=0).stop 2023-07-21T07:36:53.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.088+0000 7fc9804b9700 1 -- 172.21.15.6:0/3020592978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9780ba140 msgr2=0x7fc978071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.088+0000 7fc9804b9700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9780ba140 0x7fc978071550 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc97806d570 tx=0x7fc970004ad0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.088+0000 7fc9804b9700 1 -- 172.21.15.6:0/3020592978 shutdown_connections 2023-07-21T07:36:53.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.088+0000 7fc9804b9700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fc95c06ace0 0x7fc95c06d1a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.088+0000 7fc9804b9700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9780ba140 0x7fc978071550 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.088+0000 7fc9804b9700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806a300 0x7fc9781ea4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.088+0000 7fc9804b9700 1 --2- 172.21.15.6:0/3020592978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc97806d8a0 0x7fc9780c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.088+0000 7fc9804b9700 1 -- 172.21.15.6:0/3020592978 >> 172.21.15.6:0/3020592978 conn(0x7fc9780a8660 msgr2=0x7fc9780c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.088+0000 7fc9804b9700 1 -- 172.21.15.6:0/3020592978 shutdown_connections 2023-07-21T07:36:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.088+0000 7fc9804b9700 1 -- 172.21.15.6:0/3020592978 wait complete. 2023-07-21T07:36:53.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T07:36:53.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.229+0000 7fe1d6d9f700 1 Processor -- start 2023-07-21T07:36:53.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.229+0000 7fe1d6d9f700 1 -- start start 2023-07-21T07:36:53.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.230+0000 7fe1d6d9f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe1d00c58e0 0x7fe1d006e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.230+0000 7fe1d6d9f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d00c5450 con 0x7fe1d006dca0 2023-07-21T07:36:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.230+0000 7fe1d6d9f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d01519a0 con 0x7fe1d0072090 2023-07-21T07:36:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.230+0000 7fe1d6d9f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d00c4ed0 con 0x7fe1d00c58e0 2023-07-21T07:36:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.230+0000 7fe1d5d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe1d006dca0 0x7fe1d006fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44578/0 (socket says 172.21.15.6:44578) 2023-07-21T07:36:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.230+0000 7fe1d5d9d700 1 -- 172.21.15.6:0/4147026780 learned_addr learned my addr 172.21.15.6:0/4147026780 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d659e700 1 --2- 172.21.15.6:0/4147026780 >> v2:172.21.15.86:3300/0 conn(0x7fe1d00c58e0 0x7fe1d006e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568892851 0 0) 0x7fe1d00c5450 con 0x7fe1d006dca0 2023-07-21T07:36:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1bc0035b0 con 0x7fe1d006dca0 2023-07-21T07:36:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1105072230 0 0) 0x7fe1bc0035b0 con 0x7fe1d006dca0 2023-07-21T07:36:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 >> v2:172.21.15.86:3300/0 conn(0x7fe1d00c58e0 msgr2=0x7fe1d006e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 --2- 172.21.15.6:0/4147026780 >> v2:172.21.15.86:3300/0 conn(0x7fe1d00c58e0 0x7fe1d006e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 >> v1:172.21.15.86:6789/0 conn(0x7fe1d0072090 legacy=0x7fe1d0159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0151c80 con 0x7fe1d006dca0 2023-07-21T07:36:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7fe1c0001670 con 0x7fe1d006dca0 2023-07-21T07:36:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 >> v1:172.21.15.6:6789/0 conn(0x7fe1d006dca0 legacy=0x7fe1d006fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 --2- 172.21.15.6:0/4147026780 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1bc003a00 0x7fe1bc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 --2- 172.21.15.6:0/4147026780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc004850 0x7fe1bc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 --2- 172.21.15.6:0/4147026780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1bc005210 0x7fe1bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d00c4ed0 con 0x7fe1bc004850 2023-07-21T07:36:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc00c0b0 con 0x7fe1bc005210 2023-07-21T07:36:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc00c270 con 0x7fe1bc003a00 2023-07-21T07:36:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d559c700 1 --2- 172.21.15.6:0/4147026780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc004850 0x7fe1bc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d659e700 1 --2- 172.21.15.6:0/4147026780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1bc005210 0x7fe1bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d5d9d700 1 --2- 172.21.15.6:0/4147026780 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1bc003a00 0x7fe1bc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d559c700 1 -- 172.21.15.6:0/4147026780 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1bc003a00 msgr2=0x7fe1bc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d559c700 1 --2- 172.21.15.6:0/4147026780 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1bc003a00 0x7fe1bc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d559c700 1 -- 172.21.15.6:0/4147026780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1bc005210 msgr2=0x7fe1bc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d559c700 1 --2- 172.21.15.6:0/4147026780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1bc005210 0x7fe1bc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d559c700 1 -- 172.21.15.6:0/4147026780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc0035b0 con 0x7fe1bc004850 2023-07-21T07:36:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.231+0000 7fe1d659e700 1 -- 172.21.15.6:0/4147026780 reap_dead start 2023-07-21T07:36:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.232+0000 7fe1d559c700 1 --2- 172.21.15.6:0/4147026780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc004850 0x7fe1bc004cd0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0072470 tx=0x7fe1bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c0ef92e260e851 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.232+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0052d0 con 0x7fe1bc004850 2023-07-21T07:36:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.232+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc005450 con 0x7fe1bc004850 2023-07-21T07:36:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.232+0000 7fe1d4d9b700 1 -- 172.21.15.6:0/4147026780 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0038c0 con 0x7fe1bc004850 2023-07-21T07:36:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.232+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/4147026780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc004850 msgr2=0x7fe1bc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.232+0000 7fe1d6d9f700 1 --2- 172.21.15.6:0/4147026780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc004850 0x7fe1bc004cd0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0072470 tx=0x7fe1bc005880 comp rx=0 tx=0).stop 2023-07-21T07:36:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.232+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/4147026780 shutdown_connections 2023-07-21T07:36:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.232+0000 7fe1d6d9f700 1 --2- 172.21.15.6:0/4147026780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc004850 0x7fe1bc004cd0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.232+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/4147026780 >> 172.21.15.6:0/4147026780 conn(0x7fe1d006a090 msgr2=0x7fe1d006a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.232+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/4147026780 shutdown_connections 2023-07-21T07:36:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.232+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/4147026780 wait complete. 2023-07-21T07:36:53.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.234+0000 7fe1d6d9f700 1 Processor -- start 2023-07-21T07:36:53.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.234+0000 7fe1d6d9f700 1 -- start start 2023-07-21T07:36:53.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.234+0000 7fe1d6d9f700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1bc004850 0x7fe1d00c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.234+0000 7fe1d6d9f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1d014b8a0 0x7fe1d00c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.234+0000 7fe1d6d9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d00c4300 0x7fe1d0149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.234+0000 7fe1d6d9f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d014b170 con 0x7fe1d00c4300 2023-07-21T07:36:53.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.234+0000 7fe1d6d9f700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d00bf910 con 0x7fe1bc004850 2023-07-21T07:36:53.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.234+0000 7fe1d6d9f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d00bfcf0 con 0x7fe1d014b8a0 2023-07-21T07:36:53.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1d659e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d00c4300 0x7fe1d0149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1d659e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d00c4300 0x7fe1d0149570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36572/0 (socket says 172.21.15.6:36572) 2023-07-21T07:36:53.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1d659e700 1 -- 172.21.15.6:0/1139471701 learned_addr learned my addr 172.21.15.6:0/1139471701 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:53.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1d559c700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1d014b8a0 0x7fe1d00c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1d5d9d700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1bc004850 0x7fe1d00c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1d659e700 1 -- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1d014b8a0 msgr2=0x7fe1d00c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1d659e700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1d014b8a0 0x7fe1d00c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1d659e700 1 -- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1bc004850 msgr2=0x7fe1d00c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1d659e700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1bc004850 0x7fe1d00c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1d659e700 1 -- 172.21.15.6:0/1139471701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d00bffd0 con 0x7fe1d00c4300 2023-07-21T07:36:53.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1d659e700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d00c4300 0x7fe1d0149570 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0074080 tx=0x7fe1c8011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:53.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1c67fc700 1 -- 172.21.15.6:0/1139471701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800e040 con 0x7fe1d00c4300 2023-07-21T07:36:53.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1c67fc700 1 -- 172.21.15.6:0/1139471701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c800f040 con 0x7fe1d00c4300 2023-07-21T07:36:53.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/1139471701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d00c02b0 con 0x7fe1d00c4300 2023-07-21T07:36:53.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1c67fc700 1 -- 172.21.15.6:0/1139471701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800fc40 con 0x7fe1d00c4300 2023-07-21T07:36:53.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.235+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/1139471701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d00c20d0 con 0x7fe1d00c4300 2023-07-21T07:36:53.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.236+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/1139471701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d00c04a0 con 0x7fe1d00c4300 2023-07-21T07:36:53.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.237+0000 7fe1c67fc700 1 -- 172.21.15.6:0/1139471701 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1c8022460 con 0x7fe1d00c4300 2023-07-21T07:36:53.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.237+0000 7fe1c67fc700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe1b406ace0 0x7fe1b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.237+0000 7fe1c67fc700 1 -- 172.21.15.6:0/1139471701 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fe1c8089cc0 con 0x7fe1d00c4300 2023-07-21T07:36:53.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.237+0000 7fe1d5d9d700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe1b406ace0 0x7fe1b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.238+0000 7fe1d5d9d700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe1b406ace0 0x7fe1b406d1a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0000f60 tx=0x7fe1c0000ef0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:53.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.241+0000 7fe1c67fc700 1 -- 172.21.15.6:0/1139471701 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe1d00c04a0 con 0x7fe1d00c4300 2023-07-21T07:36:53.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.440+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/1139471701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1d00c04a0 con 0x7fe1d00c4300 2023-07-21T07:36:53.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.441+0000 7fe1c67fc700 1 -- 172.21.15.6:0/1139471701 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1d00c04a0 con 0x7fe1d00c4300 2023-07-21T07:36:53.495 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:36:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.443+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe1b406ace0 msgr2=0x7fe1b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.443+0000 7fe1d6d9f700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe1b406ace0 0x7fe1b406d1a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0000f60 tx=0x7fe1c0000ef0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.443+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/1139471701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d00c4300 msgr2=0x7fe1d0149570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.443+0000 7fe1d6d9f700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d00c4300 0x7fe1d0149570 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0074080 tx=0x7fe1c8011e20 comp rx=0 tx=0).stop 2023-07-21T07:36:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.443+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/1139471701 shutdown_connections 2023-07-21T07:36:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.443+0000 7fe1d6d9f700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fe1b406ace0 0x7fe1b406d1a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.443+0000 7fe1d6d9f700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d00c4300 0x7fe1d0149570 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.443+0000 7fe1d6d9f700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1bc004850 0x7fe1d00c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.443+0000 7fe1d6d9f700 1 --2- 172.21.15.6:0/1139471701 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1d014b8a0 0x7fe1d00c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.443+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/1139471701 >> 172.21.15.6:0/1139471701 conn(0x7fe1d006a090 msgr2=0x7fe1d00aab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.443+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/1139471701 shutdown_connections 2023-07-21T07:36:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.443+0000 7fe1d6d9f700 1 -- 172.21.15.6:0/1139471701 wait complete. 2023-07-21T07:36:53.509 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T07:36:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.583+0000 7f008670d700 1 Processor -- start 2023-07-21T07:36:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.583+0000 7f008670d700 1 -- start start 2023-07-21T07:36:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.583+0000 7f008670d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00800703f0 0x7f00800c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.583+0000 7f008670d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f00800c18c0 0x7f008014dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.583+0000 7f008670d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00800c0b20 con 0x7f0080072130 2023-07-21T07:36:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.583+0000 7f008670d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0080151820 con 0x7f00800703f0 2023-07-21T07:36:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.583+0000 7f008670d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00800c0de0 con 0x7f00800c18c0 2023-07-21T07:36:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.584+0000 7f007ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00800703f0 0x7f00800c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.584+0000 7f007ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00800703f0 0x7f00800c25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36576/0 (socket says 172.21.15.6:36576) 2023-07-21T07:36:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.584+0000 7f007ffff700 1 -- 172.21.15.6:0/3275874850 learned_addr learned my addr 172.21.15.6:0/3275874850 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.584+0000 7f007f7fe700 1 --2- 172.21.15.6:0/3275874850 >> v2:172.21.15.86:3300/0 conn(0x7f00800c18c0 0x7f008014dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.584+0000 7f007ffff700 1 -- 172.21.15.6:0/3275874850 >> v2:172.21.15.86:3300/0 conn(0x7f00800c18c0 msgr2=0x7f008014dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.584+0000 7f007ffff700 1 --2- 172.21.15.6:0/3275874850 >> v2:172.21.15.86:3300/0 conn(0x7f00800c18c0 0x7f008014dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.584+0000 7f007ffff700 1 -- 172.21.15.6:0/3275874850 >> v1:172.21.15.86:6789/0 conn(0x7f0080072130 legacy=0x7f008006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.584+0000 7f007ffff700 1 -- 172.21.15.6:0/3275874850 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00800c10c0 con 0x7f00800703f0 2023-07-21T07:36:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.584+0000 7f007f7fe700 1 --2- 172.21.15.6:0/3275874850 >> v2:172.21.15.86:3300/0 conn(0x7f00800c18c0 0x7f008014dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.584+0000 7f007ffff700 1 --2- 172.21.15.6:0/3275874850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00800703f0 0x7f00800c25f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f008006ba80 tx=0x7f0070009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307c0d89feca3cec server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.584+0000 7f007effd700 1 -- 172.21.15.6:0/3275874850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007000b870 con 0x7f00800703f0 2023-07-21T07:36:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.584+0000 7f007effd700 1 -- 172.21.15.6:0/3275874850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007000b9d0 con 0x7f00800703f0 2023-07-21T07:36:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.584+0000 7f007effd700 1 -- 172.21.15.6:0/3275874850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007000bd60 con 0x7f00800703f0 2023-07-21T07:36:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.585+0000 7f008670d700 1 -- 172.21.15.6:0/3275874850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00800703f0 msgr2=0x7f00800c25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.585+0000 7f008670d700 1 --2- 172.21.15.6:0/3275874850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00800703f0 0x7f00800c25f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f008006ba80 tx=0x7f0070009bd0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.585+0000 7f008670d700 1 -- 172.21.15.6:0/3275874850 shutdown_connections 2023-07-21T07:36:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.585+0000 7f008670d700 1 --2- 172.21.15.6:0/3275874850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00800703f0 0x7f00800c25f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.585+0000 7f008670d700 1 --2- 172.21.15.6:0/3275874850 >> v2:172.21.15.86:3300/0 conn(0x7f00800c18c0 0x7f008014dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.585+0000 7f008670d700 1 -- 172.21.15.6:0/3275874850 >> 172.21.15.6:0/3275874850 conn(0x7f00800c2c20 msgr2=0x7f00800c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.585+0000 7f008670d700 1 -- 172.21.15.6:0/3275874850 shutdown_connections 2023-07-21T07:36:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.585+0000 7f008670d700 1 -- 172.21.15.6:0/3275874850 wait complete. 2023-07-21T07:36:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.586+0000 7f008670d700 1 Processor -- start 2023-07-21T07:36:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.586+0000 7f008670d700 1 -- start start 2023-07-21T07:36:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f008670d700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00800703f0 0x7f00800c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f008670d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0080072130 0x7f008014a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f008670d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00800c18c0 0x7f00801eb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f008670d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0080143130 con 0x7f0080072130 2023-07-21T07:36:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f008670d700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008014b450 con 0x7f00800703f0 2023-07-21T07:36:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f008670d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00801eaf90 con 0x7f00800c18c0 2023-07-21T07:36:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f007f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0080072130 0x7f008014a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f007f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0080072130 0x7f008014a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36584/0 (socket says 172.21.15.6:36584) 2023-07-21T07:36:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f007f7fe700 1 -- 172.21.15.6:0/2562372343 learned_addr learned my addr 172.21.15.6:0/2562372343 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f007ffff700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00800703f0 0x7f00800c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f0084caa700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00800c18c0 0x7f00801eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f007f7fe700 1 -- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00800c18c0 msgr2=0x7f00801eb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f007f7fe700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00800c18c0 0x7f00801eb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f007f7fe700 1 -- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00800703f0 msgr2=0x7f00800c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f007f7fe700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00800703f0 0x7f00800c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f007f7fe700 1 -- 172.21.15.6:0/2562372343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070009550 con 0x7f0080072130 2023-07-21T07:36:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f007ffff700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00800703f0 0x7f00800c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.587+0000 7f007f7fe700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0080072130 0x7f008014a880 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f007400d700 tx=0x7f007400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.588+0000 7f007cff9700 1 -- 172.21.15.6:0/2562372343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074011870 con 0x7f0080072130 2023-07-21T07:36:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.588+0000 7f007cff9700 1 -- 172.21.15.6:0/2562372343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00740119d0 con 0x7f0080072130 2023-07-21T07:36:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.588+0000 7f008670d700 1 -- 172.21.15.6:0/2562372343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00800c46f0 con 0x7f0080072130 2023-07-21T07:36:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.588+0000 7f007cff9700 1 -- 172.21.15.6:0/2562372343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074011d60 con 0x7f0080072130 2023-07-21T07:36:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.588+0000 7f008670d700 1 -- 172.21.15.6:0/2562372343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00801eac60 con 0x7f0080072130 2023-07-21T07:36:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.589+0000 7f008670d700 1 -- 172.21.15.6:0/2562372343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00801eb100 con 0x7f0080072130 2023-07-21T07:36:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.589+0000 7f007cff9700 1 -- 172.21.15.6:0/2562372343 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f007400f400 con 0x7f0080072130 2023-07-21T07:36:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.589+0000 7f007cff9700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f006c06ad10 0x7f006c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.590+0000 7f007cff9700 1 -- 172.21.15.6:0/2562372343 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f0074089770 con 0x7f0080072130 2023-07-21T07:36:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.590+0000 7f007ffff700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f006c06ad10 0x7f006c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.590+0000 7f007ffff700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f006c06ad10 0x7f006c06d1d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0070000c00 tx=0x7f0070008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.594+0000 7f007cff9700 1 -- 172.21.15.6:0/2562372343 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0074057f60 con 0x7f0080072130 2023-07-21T07:36:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.790+0000 7f008670d700 1 -- 172.21.15.6:0/2562372343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0080074500 con 0x7f0080072130 2023-07-21T07:36:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.790+0000 7f007cff9700 1 -- 172.21.15.6:0/2562372343 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f007400b040 con 0x7f0080072130 2023-07-21T07:36:53.845 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:36:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.792+0000 7f008670d700 1 -- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f006c06ad10 msgr2=0x7f006c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.792+0000 7f008670d700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f006c06ad10 0x7f006c06d1d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0070000c00 tx=0x7f0070008030 comp rx=0 tx=0).stop 2023-07-21T07:36:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.792+0000 7f008670d700 1 -- 172.21.15.6:0/2562372343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0080072130 msgr2=0x7f008014a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.792+0000 7f008670d700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0080072130 0x7f008014a880 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f007400d700 tx=0x7f007400dac0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.792+0000 7f008670d700 1 -- 172.21.15.6:0/2562372343 shutdown_connections 2023-07-21T07:36:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.792+0000 7f008670d700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f006c06ad10 0x7f006c06d1d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.792+0000 7f008670d700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00800c18c0 0x7f00801eb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.792+0000 7f008670d700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00800703f0 0x7f00800c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.792+0000 7f008670d700 1 --2- 172.21.15.6:0/2562372343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0080072130 0x7f008014a880 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.792+0000 7f008670d700 1 -- 172.21.15.6:0/2562372343 >> 172.21.15.6:0/2562372343 conn(0x7f00800c2c20 msgr2=0x7f008014ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.792+0000 7f008670d700 1 -- 172.21.15.6:0/2562372343 shutdown_connections 2023-07-21T07:36:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.792+0000 7f008670d700 1 -- 172.21.15.6:0/2562372343 wait complete. 2023-07-21T07:36:53.859 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-21T07:36:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.934+0000 7f0717cd5700 1 Processor -- start 2023-07-21T07:36:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.934+0000 7f0717cd5700 1 -- start start 2023-07-21T07:36:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.934+0000 7f0717cd5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f071014c580 0x7f07100abd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.934+0000 7f0717cd5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07100aafe0 0x7f071015cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.934+0000 7f0717cd5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07100ac280 con 0x7f07100c2260 2023-07-21T07:36:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.934+0000 7f0717cd5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0710066580 con 0x7f07100aafe0 2023-07-21T07:36:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.934+0000 7f0717cd5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0710152f50 con 0x7f071014c580 2023-07-21T07:36:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.935+0000 7f0716272700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07100aafe0 0x7f071015cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.935+0000 7f0715270700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f07100c2260 0x7f07100aa8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44610/0 (socket says 172.21.15.6:44610) 2023-07-21T07:36:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.935+0000 7f0715270700 1 -- 172.21.15.6:0/276971122 learned_addr learned my addr 172.21.15.6:0/276971122 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:53.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.935+0000 7f0715a71700 1 --2- 172.21.15.6:0/276971122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f071014c580 0x7f07100abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.935+0000 7f0716272700 1 -- 172.21.15.6:0/276971122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f071014c580 msgr2=0x7f07100abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.935+0000 7f0716272700 1 --2- 172.21.15.6:0/276971122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f071014c580 0x7f07100abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.935+0000 7f0716272700 1 -- 172.21.15.6:0/276971122 >> v1:172.21.15.6:6789/0 conn(0x7f07100c2260 legacy=0x7f07100aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.935+0000 7f0716272700 1 -- 172.21.15.6:0/276971122 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0710066050 con 0x7f07100aafe0 2023-07-21T07:36:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.935+0000 7f0714a6f700 1 -- 172.21.15.6:0/276971122 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980103971 0 0) 0x7f070c001110 con 0x7f07100c2260 2023-07-21T07:36:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.935+0000 7f0716272700 1 --2- 172.21.15.6:0/276971122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07100aafe0 0x7f071015cbb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0708009d90 tx=0x7f070800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc19346b651f8b6b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.935+0000 7f0714a6f700 1 -- 172.21.15.6:0/276971122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070800e070 con 0x7f07100aafe0 2023-07-21T07:36:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.935+0000 7f0714a6f700 1 -- 172.21.15.6:0/276971122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070800bbd0 con 0x7f07100aafe0 2023-07-21T07:36:53.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.935+0000 7f0714a6f700 1 -- 172.21.15.6:0/276971122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708012430 con 0x7f07100aafe0 2023-07-21T07:36:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.936+0000 7f0717cd5700 1 -- 172.21.15.6:0/276971122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07100aafe0 msgr2=0x7f071015cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.936+0000 7f0717cd5700 1 --2- 172.21.15.6:0/276971122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07100aafe0 0x7f071015cbb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0708009d90 tx=0x7f070800b330 comp rx=0 tx=0).stop 2023-07-21T07:36:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.936+0000 7f0717cd5700 1 -- 172.21.15.6:0/276971122 shutdown_connections 2023-07-21T07:36:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.936+0000 7f0717cd5700 1 --2- 172.21.15.6:0/276971122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07100aafe0 0x7f071015cbb0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.936+0000 7f0717cd5700 1 --2- 172.21.15.6:0/276971122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f071014c580 0x7f07100abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.936+0000 7f0717cd5700 1 -- 172.21.15.6:0/276971122 >> 172.21.15.6:0/276971122 conn(0x7f07100c2c20 msgr2=0x7f07100c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.936+0000 7f0717cd5700 1 -- 172.21.15.6:0/276971122 shutdown_connections 2023-07-21T07:36:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.936+0000 7f0717cd5700 1 -- 172.21.15.6:0/276971122 wait complete. 2023-07-21T07:36:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.938+0000 7f0717cd5700 1 Processor -- start 2023-07-21T07:36:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.938+0000 7f0717cd5700 1 -- start start 2023-07-21T07:36:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.938+0000 7f0717cd5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07100aafe0 0x7f07101e76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.938+0000 7f0717cd5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07100c2260 0x7f0710148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.938+0000 7f0717cd5700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f071014c580 0x7f071014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.938+0000 7f0717cd5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0710152670 con 0x7f07100aafe0 2023-07-21T07:36:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0717cd5700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071014eea0 con 0x7f071014c580 2023-07-21T07:36:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0717cd5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071014d150 con 0x7f07100c2260 2023-07-21T07:36:53.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0715a71700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07100aafe0 0x7f07101e76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0715a71700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07100aafe0 0x7f07101e76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36596/0 (socket says 172.21.15.6:36596) 2023-07-21T07:36:53.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0715a71700 1 -- 172.21.15.6:0/2837849464 learned_addr learned my addr 172.21.15.6:0/2837849464 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:53.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0715270700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07100c2260 0x7f0710148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0716272700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f071014c580 0x7f071014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:53.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0715a71700 1 -- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07100c2260 msgr2=0x7f0710148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0715a71700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07100c2260 0x7f0710148380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0715a71700 1 -- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f071014c580 msgr2=0x7f071014f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:53.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0715a71700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f071014c580 0x7f071014f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:53.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0715a71700 1 -- 172.21.15.6:0/2837849464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0708009a70 con 0x7f07100aafe0 2023-07-21T07:36:53.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0715270700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07100c2260 0x7f0710148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:53.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0716272700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f071014c580 0x7f071014f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:53.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0715a71700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07100aafe0 0x7f07101e76d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f070400e810 tx=0x7f070400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:53.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f07027fc700 1 -- 172.21.15.6:0/2837849464 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704013610 con 0x7f07100aafe0 2023-07-21T07:36:53.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f07027fc700 1 -- 172.21.15.6:0/2837849464 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0704013770 con 0x7f07100aafe0 2023-07-21T07:36:53.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0717cd5700 1 -- 172.21.15.6:0/2837849464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07101496a0 con 0x7f07100aafe0 2023-07-21T07:36:53.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f07027fc700 1 -- 172.21.15.6:0/2837849464 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704013b20 con 0x7f07100aafe0 2023-07-21T07:36:53.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.939+0000 7f0717cd5700 1 -- 172.21.15.6:0/2837849464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071014d6d0 con 0x7f07100aafe0 2023-07-21T07:36:53.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.940+0000 7f0717cd5700 1 -- 172.21.15.6:0/2837849464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071014d8c0 con 0x7f07100aafe0 2023-07-21T07:36:53.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.941+0000 7f07027fc700 1 -- 172.21.15.6:0/2837849464 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0704013c80 con 0x7f07100aafe0 2023-07-21T07:36:53.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.941+0000 7f07027fc700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f06f406ace0 0x7f06f406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:53.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.941+0000 7f07027fc700 1 -- 172.21.15.6:0/2837849464 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f07040894f0 con 0x7f07100aafe0 2023-07-21T07:36:53.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.941+0000 7f0715270700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f06f406ace0 0x7f06f406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.942+0000 7f0715270700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f06f406ace0 0x7f06f406d1a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f070c007fd0 tx=0x7f070c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:54.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:53.946+0000 7f07027fc700 1 -- 172.21.15.6:0/2837849464 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f07040541b0 con 0x7f07100aafe0 2023-07-21T07:36:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.144+0000 7f0717cd5700 1 -- 172.21.15.6:0/2837849464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0710074500 con 0x7f07100aafe0 2023-07-21T07:36:54.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.144+0000 7f07027fc700 1 -- 172.21.15.6:0/2837849464 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v58) v1 ==== 105+0+11 (secure 0 0 0) 0x7f07040577d0 con 0x7f07100aafe0 2023-07-21T07:36:54.200 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T07:36:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.147+0000 7f0717cd5700 1 -- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f06f406ace0 msgr2=0x7f06f406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.147+0000 7f0717cd5700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f06f406ace0 0x7f06f406d1a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f070c007fd0 tx=0x7f070c009040 comp rx=0 tx=0).stop 2023-07-21T07:36:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.147+0000 7f0717cd5700 1 -- 172.21.15.6:0/2837849464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07100aafe0 msgr2=0x7f07101e76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.147+0000 7f0717cd5700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07100aafe0 0x7f07101e76d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f070400e810 tx=0x7f070400ebd0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.147+0000 7f0717cd5700 1 -- 172.21.15.6:0/2837849464 shutdown_connections 2023-07-21T07:36:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.147+0000 7f0717cd5700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f06f406ace0 0x7f06f406d1a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.147+0000 7f0717cd5700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f071014c580 0x7f071014f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.147+0000 7f0717cd5700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07100aafe0 0x7f07101e76d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.147+0000 7f0717cd5700 1 --2- 172.21.15.6:0/2837849464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07100c2260 0x7f0710148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.147+0000 7f0717cd5700 1 -- 172.21.15.6:0/2837849464 >> 172.21.15.6:0/2837849464 conn(0x7f07100c2c20 msgr2=0x7f071006b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.147+0000 7f0717cd5700 1 -- 172.21.15.6:0/2837849464 shutdown_connections 2023-07-21T07:36:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.147+0000 7f0717cd5700 1 -- 172.21.15.6:0/2837849464 wait complete. 2023-07-21T07:36:54.213 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-21T07:36:54.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.288+0000 7ffb983c6700 1 Processor -- start 2023-07-21T07:36:54.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.288+0000 7ffb983c6700 1 -- start start 2023-07-21T07:36:54.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb983c6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffb9006d8a0 0x7ffb900c5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:54.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb983c6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb90155530 con 0x7ffb900ba140 2023-07-21T07:36:54.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb983c6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb900c5690 con 0x7ffb9006a300 2023-07-21T07:36:54.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb983c6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb900c1a30 con 0x7ffb9006d8a0 2023-07-21T07:36:54.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95961700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffb900ba140 0x7ffb900c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44626/0 (socket says 172.21.15.6:44626) 2023-07-21T07:36:54.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95961700 1 -- 172.21.15.6:0/4207405499 learned_addr learned my addr 172.21.15.6:0/4207405499 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:54.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb96963700 1 --2- 172.21.15.6:0/4207405499 >> v2:172.21.15.86:3300/0 conn(0x7ffb9006d8a0 0x7ffb900c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178219216 0 0) 0x7ffb90155530 con 0x7ffb900ba140 2023-07-21T07:36:54.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb7c0035b0 con 0x7ffb900ba140 2023-07-21T07:36:54.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2110626871 0 0) 0x7ffb7c0035b0 con 0x7ffb900ba140 2023-07-21T07:36:54.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 >> v2:172.21.15.86:3300/0 conn(0x7ffb9006d8a0 msgr2=0x7ffb900c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:54.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 --2- 172.21.15.6:0/4207405499 >> v2:172.21.15.86:3300/0 conn(0x7ffb9006d8a0 0x7ffb900c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 >> v1:172.21.15.86:6789/0 conn(0x7ffb9006a300 legacy=0x7ffb901519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb90154920 con 0x7ffb900ba140 2023-07-21T07:36:54.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4106776467 0 0) 0x7ffb8c001670 con 0x7ffb900ba140 2023-07-21T07:36:54.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 >> v1:172.21.15.6:6789/0 conn(0x7ffb900ba140 legacy=0x7ffb900c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 --2- 172.21.15.6:0/4207405499 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb7c003a00 0x7ffb7c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:54.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 --2- 172.21.15.6:0/4207405499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb7c004850 0x7ffb7c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:54.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 --2- 172.21.15.6:0/4207405499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb7c005210 0x7ffb7c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:54.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900c1a30 con 0x7ffb7c004850 2023-07-21T07:36:54.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c00c1b0 con 0x7ffb7c005210 2023-07-21T07:36:54.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.289+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c00c370 con 0x7ffb7c003a00 2023-07-21T07:36:54.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.290+0000 7ffb95961700 1 --2- 172.21.15.6:0/4207405499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb7c004850 0x7ffb7c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.290+0000 7ffb96162700 1 --2- 172.21.15.6:0/4207405499 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb7c003a00 0x7ffb7c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.290+0000 7ffb96963700 1 --2- 172.21.15.6:0/4207405499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb7c005210 0x7ffb7c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.290+0000 7ffb95961700 1 -- 172.21.15.6:0/4207405499 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb7c003a00 msgr2=0x7ffb7c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:54.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.290+0000 7ffb95961700 1 --2- 172.21.15.6:0/4207405499 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb7c003a00 0x7ffb7c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.290+0000 7ffb95961700 1 -- 172.21.15.6:0/4207405499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb7c005210 msgr2=0x7ffb7c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:54.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.290+0000 7ffb95961700 1 --2- 172.21.15.6:0/4207405499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb7c005210 0x7ffb7c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.290+0000 7ffb96963700 1 -- 172.21.15.6:0/4207405499 reap_dead start 2023-07-21T07:36:54.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.290+0000 7ffb95961700 1 -- 172.21.15.6:0/4207405499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c0035b0 con 0x7ffb7c004850 2023-07-21T07:36:54.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.290+0000 7ffb95961700 1 --2- 172.21.15.6:0/4207405499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb7c004850 0x7ffb7c004cd0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00c210 tx=0x7ffb7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f97e72dbd377a7c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:54.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.290+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c007c10 con 0x7ffb7c004850 2023-07-21T07:36:54.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.290+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c00cd30 con 0x7ffb7c004850 2023-07-21T07:36:54.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.290+0000 7ffb95160700 1 -- 172.21.15.6:0/4207405499 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c00cea0 con 0x7ffb7c004850 2023-07-21T07:36:54.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.291+0000 7ffb983c6700 1 -- 172.21.15.6:0/4207405499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb7c004850 msgr2=0x7ffb7c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.291+0000 7ffb983c6700 1 --2- 172.21.15.6:0/4207405499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb7c004850 0x7ffb7c004cd0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00c210 tx=0x7ffb7c005880 comp rx=0 tx=0).stop 2023-07-21T07:36:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.291+0000 7ffb983c6700 1 -- 172.21.15.6:0/4207405499 shutdown_connections 2023-07-21T07:36:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.291+0000 7ffb983c6700 1 --2- 172.21.15.6:0/4207405499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb7c004850 0x7ffb7c004cd0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.291+0000 7ffb983c6700 1 -- 172.21.15.6:0/4207405499 >> 172.21.15.6:0/4207405499 conn(0x7ffb900a8660 msgr2=0x7ffb900a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.291+0000 7ffb983c6700 1 -- 172.21.15.6:0/4207405499 shutdown_connections 2023-07-21T07:36:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.291+0000 7ffb983c6700 1 -- 172.21.15.6:0/4207405499 wait complete. 2023-07-21T07:36:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.292+0000 7ffb983c6700 1 Processor -- start 2023-07-21T07:36:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.292+0000 7ffb983c6700 1 -- start start 2023-07-21T07:36:54.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb983c6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb7c004850 0x7ffb9014f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:54.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb983c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb9014f4b0 0x7ffb900b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:54.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb983c6700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9014d920 0x7ffb900b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:54.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb983c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb90152810 con 0x7ffb9014f4b0 2023-07-21T07:36:54.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb983c6700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900a8050 con 0x7ffb9014d920 2023-07-21T07:36:54.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb983c6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900a8330 con 0x7ffb7c004850 2023-07-21T07:36:54.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb95961700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb9014f4b0 0x7ffb900b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb95961700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb9014f4b0 0x7ffb900b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36618/0 (socket says 172.21.15.6:36618) 2023-07-21T07:36:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb95961700 1 -- 172.21.15.6:0/2932154864 learned_addr learned my addr 172.21.15.6:0/2932154864 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb96162700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb7c004850 0x7ffb9014f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb96963700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9014d920 0x7ffb900b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb95961700 1 -- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb7c004850 msgr2=0x7ffb9014f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb95961700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb7c004850 0x7ffb9014f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb95961700 1 -- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9014d920 msgr2=0x7ffb900b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb95961700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9014d920 0x7ffb900b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb95961700 1 -- 172.21.15.6:0/2932154864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9014fec0 con 0x7ffb9014f4b0 2023-07-21T07:36:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb95961700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb9014f4b0 0x7ffb900b6cd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00c800 tx=0x7ffb8c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb86ffd700 1 -- 172.21.15.6:0/2932154864 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c000ed0 con 0x7ffb9014f4b0 2023-07-21T07:36:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb86ffd700 1 -- 172.21.15.6:0/2932154864 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c0070d0 con 0x7ffb9014f4b0 2023-07-21T07:36:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb983c6700 1 -- 172.21.15.6:0/2932154864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb901501a0 con 0x7ffb9014f4b0 2023-07-21T07:36:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb86ffd700 1 -- 172.21.15.6:0/2932154864 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c007480 con 0x7ffb9014f4b0 2023-07-21T07:36:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.293+0000 7ffb983c6700 1 -- 172.21.15.6:0/2932154864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9014d400 con 0x7ffb9014f4b0 2023-07-21T07:36:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.294+0000 7ffb983c6700 1 -- 172.21.15.6:0/2932154864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb90074500 con 0x7ffb9014f4b0 2023-07-21T07:36:54.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.295+0000 7ffb86ffd700 1 -- 172.21.15.6:0/2932154864 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffb8c0075e0 con 0x7ffb9014f4b0 2023-07-21T07:36:54.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.295+0000 7ffb86ffd700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ffb7406ace0 0x7ffb7406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:54.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.295+0000 7ffb86ffd700 1 -- 172.21.15.6:0/2932154864 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7ffb8c08aad0 con 0x7ffb9014f4b0 2023-07-21T07:36:54.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.296+0000 7ffb96162700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ffb7406ace0 0x7ffb7406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.296+0000 7ffb96162700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ffb7406ace0 0x7ffb7406d1a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffb90154800 tx=0x7ffb80009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:54.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.300+0000 7ffb86ffd700 1 -- 172.21.15.6:0/2932154864 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffb8c0559d0 con 0x7ffb9014f4b0 2023-07-21T07:36:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.495+0000 7ffb983c6700 1 -- 172.21.15.6:0/2932154864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7ffb90151420 con 0x7ffb9014f4b0 2023-07-21T07:36:54.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.495+0000 7ffb86ffd700 1 -- 172.21.15.6:0/2932154864 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v58) v1 ==== 101+0+11 (secure 0 0 0) 0x7ffb8c058ff0 con 0x7ffb9014f4b0 2023-07-21T07:36:54.550 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T07:36:54.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.497+0000 7ffb983c6700 1 -- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ffb7406ace0 msgr2=0x7ffb7406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.497+0000 7ffb983c6700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ffb7406ace0 0x7ffb7406d1a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffb90154800 tx=0x7ffb80009040 comp rx=0 tx=0).stop 2023-07-21T07:36:54.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.497+0000 7ffb983c6700 1 -- 172.21.15.6:0/2932154864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb9014f4b0 msgr2=0x7ffb900b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.497+0000 7ffb983c6700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb9014f4b0 0x7ffb900b6cd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00c800 tx=0x7ffb8c001a00 comp rx=0 tx=0).stop 2023-07-21T07:36:54.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.498+0000 7ffb983c6700 1 -- 172.21.15.6:0/2932154864 shutdown_connections 2023-07-21T07:36:54.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.498+0000 7ffb983c6700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7ffb7406ace0 0x7ffb7406d1a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.498+0000 7ffb983c6700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9014d920 0x7ffb900b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.498+0000 7ffb983c6700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb7c004850 0x7ffb9014f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.498+0000 7ffb983c6700 1 --2- 172.21.15.6:0/2932154864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb9014f4b0 0x7ffb900b6cd0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.498+0000 7ffb983c6700 1 -- 172.21.15.6:0/2932154864 >> 172.21.15.6:0/2932154864 conn(0x7ffb900a8660 msgr2=0x7ffb900c31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:54.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.498+0000 7ffb983c6700 1 -- 172.21.15.6:0/2932154864 shutdown_connections 2023-07-21T07:36:54.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.498+0000 7ffb983c6700 1 -- 172.21.15.6:0/2932154864 wait complete. 2023-07-21T07:36:54.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T07:36:54.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.635+0000 7fb0d0359700 1 Processor -- start 2023-07-21T07:36:54.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.635+0000 7fb0d0359700 1 -- start start 2023-07-21T07:36:54.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.636+0000 7fb0d0359700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb0c80bf440 0x7fb0c81513d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:54.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.636+0000 7fb0d0359700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c80c0510 con 0x7fb0c8071010 2023-07-21T07:36:54.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.636+0000 7fb0d0359700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c806dc40 con 0x7fb0c806d860 2023-07-21T07:36:54.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.636+0000 7fb0d0359700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c80be640 con 0x7fb0c80bf440 2023-07-21T07:36:54.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.636+0000 7fb0ce8f6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb0c8071010 0x7fb0c80714a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44648/0 (socket says 172.21.15.6:44648) 2023-07-21T07:36:54.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.636+0000 7fb0ce8f6700 1 -- 172.21.15.6:0/2255308138 learned_addr learned my addr 172.21.15.6:0/2255308138 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:54.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.637+0000 7fb0cd8f4700 1 --2- 172.21.15.6:0/2255308138 >> v2:172.21.15.86:3300/0 conn(0x7fb0c80bf440 0x7fb0c81513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.637+0000 7fb0cd0f3700 1 -- 172.21.15.6:0/2255308138 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129609567 0 0) 0x7fb0c80c0510 con 0x7fb0c8071010 2023-07-21T07:36:54.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.637+0000 7fb0cd0f3700 1 -- 172.21.15.6:0/2255308138 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b40035b0 con 0x7fb0c8071010 2023-07-21T07:36:54.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.637+0000 7fb0cd8f4700 1 -- 172.21.15.6:0/2255308138 >> v1:172.21.15.86:6789/0 conn(0x7fb0c806d860 legacy=0x7fb0c80bd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.637+0000 7fb0cd8f4700 1 -- 172.21.15.6:0/2255308138 >> v1:172.21.15.6:6789/0 conn(0x7fb0c8071010 legacy=0x7fb0c80714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.637+0000 7fb0cd0f3700 1 -- 172.21.15.6:0/2255308138 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278472179 0 0) 0x7fb0c806dc40 con 0x7fb0c806d860 2023-07-21T07:36:54.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.637+0000 7fb0cd8f4700 1 -- 172.21.15.6:0/2255308138 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c80bf900 con 0x7fb0c80bf440 2023-07-21T07:36:54.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.637+0000 7fb0cd8f4700 1 --2- 172.21.15.6:0/2255308138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0c80bf440 0x7fb0c81513d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8009820 tx=0x7fb0b8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdf21158c6dd6559 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:54.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.637+0000 7fb0cd0f3700 1 -- 172.21.15.6:0/2255308138 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8005e30 con 0x7fb0c80bf440 2023-07-21T07:36:54.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.637+0000 7fb0cd0f3700 1 -- 172.21.15.6:0/2255308138 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b8006030 con 0x7fb0c80bf440 2023-07-21T07:36:54.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.637+0000 7fb0cd0f3700 1 -- 172.21.15.6:0/2255308138 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80063c0 con 0x7fb0c80bf440 2023-07-21T07:36:54.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.638+0000 7fb0d0359700 1 -- 172.21.15.6:0/2255308138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0c80bf440 msgr2=0x7fb0c81513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.638+0000 7fb0d0359700 1 --2- 172.21.15.6:0/2255308138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0c80bf440 0x7fb0c81513d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8009820 tx=0x7fb0b8009b30 comp rx=0 tx=0).stop 2023-07-21T07:36:54.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.638+0000 7fb0d0359700 1 -- 172.21.15.6:0/2255308138 shutdown_connections 2023-07-21T07:36:54.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.638+0000 7fb0d0359700 1 --2- 172.21.15.6:0/2255308138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0c80bf440 0x7fb0c81513d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.638+0000 7fb0d0359700 1 -- 172.21.15.6:0/2255308138 >> 172.21.15.6:0/2255308138 conn(0x7fb0c80c09f0 msgr2=0x7fb0c80c0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:54.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.638+0000 7fb0d0359700 1 -- 172.21.15.6:0/2255308138 shutdown_connections 2023-07-21T07:36:54.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.638+0000 7fb0d0359700 1 -- 172.21.15.6:0/2255308138 wait complete. 2023-07-21T07:36:54.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.640+0000 7fb0d0359700 1 Processor -- start 2023-07-21T07:36:54.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.640+0000 7fb0d0359700 1 -- start start 2023-07-21T07:36:54.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0d0359700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d860 0x7fb0c80c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:54.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0d0359700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0c8071010 0x7fb0c8145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:54.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0d0359700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0c80bf440 0x7fb0c815d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:54.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0d0359700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c815c3e0 con 0x7fb0c806d860 2023-07-21T07:36:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0d0359700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c815d0c0 con 0x7fb0c80bf440 2023-07-21T07:36:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0d0359700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80c5d40 con 0x7fb0c8071010 2023-07-21T07:36:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0ce0f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d860 0x7fb0c80c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0ce0f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d860 0x7fb0c80c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36630/0 (socket says 172.21.15.6:36630) 2023-07-21T07:36:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0ce0f5700 1 -- 172.21.15.6:0/3429835461 learned_addr learned my addr 172.21.15.6:0/3429835461 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0ce0f5700 1 -- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0c8071010 msgr2=0x7fb0c8145870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0cd8f4700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0c8071010 0x7fb0c8145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0ce0f5700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0c8071010 0x7fb0c8145870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0ce8f6700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0c80bf440 0x7fb0c815d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0ce0f5700 1 -- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0c80bf440 msgr2=0x7fb0c815d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0ce0f5700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0c80bf440 0x7fb0c815d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0ce0f5700 1 -- 172.21.15.6:0/3429835461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b8009430 con 0x7fb0c806d860 2023-07-21T07:36:54.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0ce8f6700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0c80bf440 0x7fb0c815d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:54.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0ce0f5700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d860 0x7fb0c80c5800 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4001eb0 tx=0x7fb0c400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:54.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0beffd700 1 -- 172.21.15.6:0/3429835461 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c40054e0 con 0x7fb0c806d860 2023-07-21T07:36:54.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0beffd700 1 -- 172.21.15.6:0/3429835461 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c4003680 con 0x7fb0c806d860 2023-07-21T07:36:54.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0d0359700 1 -- 172.21.15.6:0/3429835461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c81e9b80 con 0x7fb0c806d860 2023-07-21T07:36:54.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0beffd700 1 -- 172.21.15.6:0/3429835461 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c40039f0 con 0x7fb0c806d860 2023-07-21T07:36:54.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.641+0000 7fb0d0359700 1 -- 172.21.15.6:0/3429835461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c8145070 con 0x7fb0c806d860 2023-07-21T07:36:54.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.642+0000 7fb0d0359700 1 -- 172.21.15.6:0/3429835461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c804ecc0 con 0x7fb0c806d860 2023-07-21T07:36:54.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.642+0000 7fb0beffd700 1 -- 172.21.15.6:0/3429835461 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb0c4003b50 con 0x7fb0c806d860 2023-07-21T07:36:54.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.642+0000 7fb0beffd700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb0ac06ace0 0x7fb0ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:54.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.642+0000 7fb0beffd700 1 -- 172.21.15.6:0/3429835461 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fb0c4088b90 con 0x7fb0c806d860 2023-07-21T07:36:54.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.643+0000 7fb0cd8f4700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb0ac06ace0 0x7fb0ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:54.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.643+0000 7fb0cd8f4700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb0ac06ace0 0x7fb0ac06d1a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8154cb0 tx=0x7fb0b8008070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:54.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.647+0000 7fb0beffd700 1 -- 172.21.15.6:0/3429835461 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb0c4053990 con 0x7fb0c806d860 2023-07-21T07:36:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.862+0000 7fb0d0359700 1 -- 172.21.15.6:0/3429835461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb0c80c3e50 con 0x7fb0c806d860 2023-07-21T07:36:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.862+0000 7fb0beffd700 1 -- 172.21.15.6:0/3429835461 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb0c4017080 con 0x7fb0c806d860 2023-07-21T07:36:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.864+0000 7fb0d0359700 1 -- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb0ac06ace0 msgr2=0x7fb0ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.864+0000 7fb0d0359700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb0ac06ace0 0x7fb0ac06d1a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8154cb0 tx=0x7fb0b8008070 comp rx=0 tx=0).stop 2023-07-21T07:36:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.864+0000 7fb0d0359700 1 -- 172.21.15.6:0/3429835461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d860 msgr2=0x7fb0c80c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.864+0000 7fb0d0359700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d860 0x7fb0c80c5800 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4001eb0 tx=0x7fb0c400c8b0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.864+0000 7fb0d0359700 1 -- 172.21.15.6:0/3429835461 shutdown_connections 2023-07-21T07:36:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.864+0000 7fb0d0359700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fb0ac06ace0 0x7fb0ac06d1a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.864+0000 7fb0d0359700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0c80bf440 0x7fb0c815d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.864+0000 7fb0d0359700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d860 0x7fb0c80c5800 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.864+0000 7fb0d0359700 1 --2- 172.21.15.6:0/3429835461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0c8071010 0x7fb0c8145870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.864+0000 7fb0d0359700 1 -- 172.21.15.6:0/3429835461 >> 172.21.15.6:0/3429835461 conn(0x7fb0c80c09f0 msgr2=0x7fb0c814f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.864+0000 7fb0d0359700 1 -- 172.21.15.6:0/3429835461 shutdown_connections 2023-07-21T07:36:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:54.864+0000 7fb0d0359700 1 -- 172.21.15.6:0/3429835461 wait complete. 2023-07-21T07:36:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-21T07:36:54.931 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-21T07:36:54.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:54.931 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-21T07:36:54.971 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2023-07-21T07:36:54.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:54.971 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-21T07:36:55.028 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:36:55.029 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:36:55.085 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15810 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-07-21T07:36:55.086 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T07:36:55.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.157+0000 7f001106c700 1 Processor -- start 2023-07-21T07:36:55.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.157+0000 7f001106c700 1 -- start start 2023-07-21T07:36:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.158+0000 7f001106c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f000c0c6170 0x7f000c14ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.158+0000 7f001106c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f000c0c53e0 0x7f000c154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.158+0000 7f001106c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c0ba440 con 0x7f000c0c3750 2023-07-21T07:36:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.158+0000 7f001106c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000c0c15d0 con 0x7f000c0c53e0 2023-07-21T07:36:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.158+0000 7f001106c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0c18b0 con 0x7f000c0c6170 2023-07-21T07:36:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.158+0000 7f000b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f000c0c53e0 0x7f000c154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.159+0000 7f000b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f000c0c53e0 0x7f000c154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36642/0 (socket says 172.21.15.6:36642) 2023-07-21T07:36:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.159+0000 7f000b59e700 1 -- 172.21.15.6:0/3227612655 learned_addr learned my addr 172.21.15.6:0/3227612655 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.159+0000 7f000a59c700 1 --2- 172.21.15.6:0/3227612655 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f000c0c6170 0x7f000c14ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.159+0000 7f000b59e700 1 -- 172.21.15.6:0/3227612655 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f000c0c6170 msgr2=0x7f000c14ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.159+0000 7f000b59e700 1 --2- 172.21.15.6:0/3227612655 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f000c0c6170 0x7f000c14ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.159+0000 7f000b59e700 1 -- 172.21.15.6:0/3227612655 >> v1:172.21.15.86:6789/0 conn(0x7f000c0c3750 legacy=0x7f000c14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T07:36:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.159+0000 7f000b59e700 1 -- 172.21.15.6:0/3227612655 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c0c1b90 con 0x7f000c0c53e0 2023-07-21T07:36:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.159+0000 7f000b59e700 1 --2- 172.21.15.6:0/3227612655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f000c0c53e0 0x7f000c154c80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0004009e50 tx=0x7f000400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdea673a58ae278 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.159+0000 7f0009d9b700 1 -- 172.21.15.6:0/3227612655 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000400e070 con 0x7f000c0c53e0 2023-07-21T07:36:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.159+0000 7f0009d9b700 1 -- 172.21.15.6:0/3227612655 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0004003a20 con 0x7f000c0c53e0 2023-07-21T07:36:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.159+0000 7f0009d9b700 1 -- 172.21.15.6:0/3227612655 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004003dd0 con 0x7f000c0c53e0 2023-07-21T07:36:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.160+0000 7f001106c700 1 -- 172.21.15.6:0/3227612655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f000c0c53e0 msgr2=0x7f000c154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.160+0000 7f001106c700 1 --2- 172.21.15.6:0/3227612655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f000c0c53e0 0x7f000c154c80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0004009e50 tx=0x7f000400b330 comp rx=0 tx=0).stop 2023-07-21T07:36:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.160+0000 7f001106c700 1 -- 172.21.15.6:0/3227612655 shutdown_connections 2023-07-21T07:36:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.160+0000 7f001106c700 1 --2- 172.21.15.6:0/3227612655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f000c0c53e0 0x7f000c154c80 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.160+0000 7f001106c700 1 --2- 172.21.15.6:0/3227612655 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f000c0c6170 0x7f000c14ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.160+0000 7f001106c700 1 -- 172.21.15.6:0/3227612655 >> 172.21.15.6:0/3227612655 conn(0x7f000c0a8c90 msgr2=0x7f000c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.160+0000 7f001106c700 1 -- 172.21.15.6:0/3227612655 shutdown_connections 2023-07-21T07:36:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.160+0000 7f001106c700 1 -- 172.21.15.6:0/3227612655 wait complete. 2023-07-21T07:36:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.161+0000 7f001106c700 1 Processor -- start 2023-07-21T07:36:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.161+0000 7f001106c700 1 -- start start 2023-07-21T07:36:55.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f001106c700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f000c0c3750 0x7f000c153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f001106c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f000c0c53e0 0x7f000c1d9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f001106c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f000c0c6170 0x7f000c154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f001106c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c150ae0 con 0x7f000c0c6170 2023-07-21T07:36:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f001106c700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c150780 con 0x7f000c0c3750 2023-07-21T07:36:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f001106c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c152c20 con 0x7f000c0c53e0 2023-07-21T07:36:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f000b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f000c0c6170 0x7f000c154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f000b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f000c0c6170 0x7f000c154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36648/0 (socket says 172.21.15.6:36648) 2023-07-21T07:36:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f000b59e700 1 -- 172.21.15.6:0/531931658 learned_addr learned my addr 172.21.15.6:0/531931658 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f000a59c700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f000c0c53e0 0x7f000c1d9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f000ad9d700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f000c0c3750 0x7f000c153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f000b59e700 1 -- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f000c0c53e0 msgr2=0x7f000c1d9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f000b59e700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f000c0c53e0 0x7f000c1d9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f000b59e700 1 -- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f000c0c3750 msgr2=0x7f000c153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f000b59e700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f000c0c3750 0x7f000c153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f000b59e700 1 -- 172.21.15.6:0/531931658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0004009b30 con 0x7f000c0c6170 2023-07-21T07:36:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.162+0000 7f000ad9d700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f000c0c3750 0x7f000c153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T07:36:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.163+0000 7f000b59e700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f000c0c6170 0x7f000c154120 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f000400b730 tx=0x7f0004004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.163+0000 7efff37fe700 1 -- 172.21.15.6:0/531931658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004004440 con 0x7f000c0c6170 2023-07-21T07:36:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.163+0000 7efff37fe700 1 -- 172.21.15.6:0/531931658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00040045a0 con 0x7f000c0c6170 2023-07-21T07:36:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.163+0000 7efff37fe700 1 -- 172.21.15.6:0/531931658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004004950 con 0x7f000c0c6170 2023-07-21T07:36:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.163+0000 7f001106c700 1 -- 172.21.15.6:0/531931658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000c1538d0 con 0x7f000c0c6170 2023-07-21T07:36:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.163+0000 7f001106c700 1 -- 172.21.15.6:0/531931658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000c14fee0 con 0x7f000c0c6170 2023-07-21T07:36:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.164+0000 7f001106c700 1 -- 172.21.15.6:0/531931658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000c1530b0 con 0x7f000c0c6170 2023-07-21T07:36:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.164+0000 7efff37fe700 1 -- 172.21.15.6:0/531931658 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f000401c440 con 0x7f000c0c6170 2023-07-21T07:36:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.165+0000 7efff37fe700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7efff806ace0 0x7efff806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.165+0000 7efff37fe700 1 -- 172.21.15.6:0/531931658 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f000408ab60 con 0x7f000c0c6170 2023-07-21T07:36:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.165+0000 7f000ad9d700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7efff806ace0 0x7efff806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.165+0000 7f000ad9d700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7efff806ace0 0x7efff806d1a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0000003f40 tx=0x7f0000009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.169+0000 7efff37fe700 1 -- 172.21.15.6:0/531931658 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f000c1530b0 con 0x7f000c0c6170 2023-07-21T07:36:55.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.414+0000 7f001106c700 1 -- 172.21.15.6:0/531931658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f000c1530b0 con 0x7f000c0c6170 2023-07-21T07:36:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.414+0000 7efff37fe700 1 -- 172.21.15.6:0/531931658 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+149 (secure 0 0 0) 0x7f000c1530b0 con 0x7f000c0c6170 2023-07-21T07:36:55.468 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T07:36:55.468 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-07-21T07:36:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.416+0000 7f001106c700 1 -- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7efff806ace0 msgr2=0x7efff806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.416+0000 7f001106c700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7efff806ace0 0x7efff806d1a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0000003f40 tx=0x7f0000009040 comp rx=0 tx=0).stop 2023-07-21T07:36:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.416+0000 7f001106c700 1 -- 172.21.15.6:0/531931658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f000c0c6170 msgr2=0x7f000c154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.416+0000 7f001106c700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f000c0c6170 0x7f000c154120 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f000400b730 tx=0x7f0004004ad0 comp rx=0 tx=0).stop 2023-07-21T07:36:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.416+0000 7f001106c700 1 -- 172.21.15.6:0/531931658 shutdown_connections 2023-07-21T07:36:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.416+0000 7f001106c700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7efff806ace0 0x7efff806d1a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.416+0000 7f001106c700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f000c0c6170 0x7f000c154120 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.416+0000 7f001106c700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f000c0c3750 0x7f000c153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.416+0000 7f001106c700 1 --2- 172.21.15.6:0/531931658 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f000c0c53e0 0x7f000c1d9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.416+0000 7f001106c700 1 -- 172.21.15.6:0/531931658 >> 172.21.15.6:0/531931658 conn(0x7f000c0a8c90 msgr2=0x7f000c0c6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.417+0000 7f001106c700 1 -- 172.21.15.6:0/531931658 shutdown_connections 2023-07-21T07:36:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:55.417+0000 7f001106c700 1 -- 172.21.15.6:0/531931658 wait complete. 2023-07-21T07:36:55.482 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-07-21T07:36:55.483 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T07:36:55.483 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2023-07-21T07:36:55.484 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-21T07:36:55.484 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-21T07:36:55.485 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-07-21T07:36:55.485 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T07:36:55.486 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T07:36:55.486 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:36:55.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:55.487 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2023-07-21T07:36:55.509 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T07:36:55.509 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T07:36:55.509 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T07:36:55.509 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:55.509 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2023-07-21T07:36:55.510 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:55.510 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:36:55.510 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:55.510 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:36:55.510 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:55.510 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T07:36:55.510 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:55.511 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T07:36:55.511 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:55.511 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-21T07:36:55.511 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41852sec preferred_lft 41852sec 2023-07-21T07:36:55.511 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::c182:1cf2:777e:c99f/64 scope link noprefixroute 2023-07-21T07:36:55.511 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:55.511 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T07:36:55.511 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 6e:29:3e:ed:f1:91 brd ff:ff:ff:ff:ff:ff 2023-07-21T07:36:55.512 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T07:36:55.512 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:55.512 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::88c2:92ff:fec4:e7d6/64 scope link 2023-07-21T07:36:55.512 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:55.512 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T07:36:55.513 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 6e:29:3e:ed:f1:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-21T07:36:55.513 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::6c29:3eff:feed:f191/64 scope link 2023-07-21T07:36:55.513 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2023-07-21T07:36:55.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:55.514 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T07:36:55.578 INFO:teuthology.orchestra.run.smithi086.stdout:1 2023-07-21T07:36:55.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:55.580 DEBUG:teuthology.orchestra.run.smithi086:> route 2023-07-21T07:36:55.641 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2023-07-21T07:36:55.641 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T07:36:55.642 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T07:36:55.642 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-21T07:36:55.642 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T07:36:55.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:55.643 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec bash -c ' 2023-07-21T07:36:55.643 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2023-07-21T07:36:55.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T07:36:55.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T07:36:55.644 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T07:36:55.644 DEBUG:teuthology.orchestra.run.smithi086:> ') 2023-07-21T07:36:55.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:55.751 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2023-07-21T07:36:55.768 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-21T07:36:55.768 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:36:55.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:55.769 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2023-07-21T07:36:55.835 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:36:55.836 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-21T07:36:55.892 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-21T07:36:55.892 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T07:36:55.892 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-21T07:36:55.949 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-07-21T07:36:55.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:55.951 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:56.034 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:56.034 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:36:56.059 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:56.059 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:36:56.059 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:36:56.060 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 1@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs2=/ 2023-07-21T07:36:56.060 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:36:56.061 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:36:56.061 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:36:56.061 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:36:56.089 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-21T07:36:56.089 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-21T07:36:56.089 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.86:3300,172.21.15.86:3301" 2023-07-21T07:36:56.089 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with new device syntax: 1@8c602ac0-17b3-4df5-8928-640a7524b3b3.cephfs2=/ 2023-07-21T07:36:56.090 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.86:3300/172.21.15.86:3301" will pass to kernel 2023-07-21T07:36:56.090 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: v2 mount support check returned 2 2023-07-21T07:36:56.090 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: kernel does not support v2 syntax 2023-07-21T07:36:56.090 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T07:36:56.090 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790" 2023-07-21T07:36:56.090 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2023-07-21T07:36:56.091 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs2,fsid=8c602ac0-17b3-4df5-8928-640a7524b3b3" will pass to kernel 2023-07-21T07:36:56.092 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T07:36:56.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:56.093 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-21T07:36:56.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T07:36:56.127 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T07:36:56.221 INFO:teuthology.orchestra.run.smithi086.stdout:client5435 2023-07-21T07:36:56.221 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-07-21T07:36:56.222 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T07:36:56.238 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-07-21T07:36:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.327+0000 7f8e673ad700 1 Processor -- start 2023-07-21T07:36:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.327+0000 7f8e673ad700 1 -- start start 2023-07-21T07:36:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.328+0000 7f8e673ad700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e6006ff90 0x7f8e60151e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.328+0000 7f8e673ad700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e600664e0 con 0x7f8e600abc30 2023-07-21T07:36:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.328+0000 7f8e673ad700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e6006b760 con 0x7f8e6014ed60 2023-07-21T07:36:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.328+0000 7f8e673ad700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e60071ba0 con 0x7f8e6006ff90 2023-07-21T07:36:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.328+0000 7f8e65149700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8e600abc30 0x7f8e6014e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44672/0 (socket says 172.21.15.6:44672) 2023-07-21T07:36:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.328+0000 7f8e65149700 1 -- 172.21.15.6:0/1677799630 learned_addr learned my addr 172.21.15.6:0/1677799630 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.328+0000 7f8e6594a700 1 --2- 172.21.15.6:0/1677799630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e6006ff90 0x7f8e60151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.329+0000 7f8e57fff700 1 -- 172.21.15.6:0/1677799630 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251939112 0 0) 0x7f8e600664e0 con 0x7f8e600abc30 2023-07-21T07:36:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.329+0000 7f8e57fff700 1 -- 172.21.15.6:0/1677799630 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e4c0035b0 con 0x7f8e600abc30 2023-07-21T07:36:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.329+0000 7f8e57fff700 1 -- 172.21.15.6:0/1677799630 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659326496 0 0) 0x7f8e6006b760 con 0x7f8e6014ed60 2023-07-21T07:36:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.329+0000 7f8e6594a700 1 -- 172.21.15.6:0/1677799630 >> v1:172.21.15.86:6789/0 conn(0x7f8e6014ed60 legacy=0x7f8e60151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.329+0000 7f8e6594a700 1 -- 172.21.15.6:0/1677799630 >> v1:172.21.15.6:6789/0 conn(0x7f8e600abc30 legacy=0x7f8e6014e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.329+0000 7f8e6594a700 1 -- 172.21.15.6:0/1677799630 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e60065f60 con 0x7f8e6006ff90 2023-07-21T07:36:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.329+0000 7f8e6594a700 1 --2- 172.21.15.6:0/1677799630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e6006ff90 0x7f8e60151e30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009dc0 tx=0x7f8e5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b948df91d992b92 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.329+0000 7f8e57fff700 1 -- 172.21.15.6:0/1677799630 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5800e070 con 0x7f8e6006ff90 2023-07-21T07:36:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.329+0000 7f8e57fff700 1 -- 172.21.15.6:0/1677799630 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5800bb20 con 0x7f8e6006ff90 2023-07-21T07:36:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.329+0000 7f8e57fff700 1 -- 172.21.15.6:0/1677799630 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5800bed0 con 0x7f8e6006ff90 2023-07-21T07:36:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.330+0000 7f8e673ad700 1 -- 172.21.15.6:0/1677799630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e6006ff90 msgr2=0x7f8e60151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.330+0000 7f8e673ad700 1 --2- 172.21.15.6:0/1677799630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e6006ff90 0x7f8e60151e30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009dc0 tx=0x7f8e5800b330 comp rx=0 tx=0).stop 2023-07-21T07:36:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.330+0000 7f8e673ad700 1 -- 172.21.15.6:0/1677799630 shutdown_connections 2023-07-21T07:36:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.330+0000 7f8e673ad700 1 --2- 172.21.15.6:0/1677799630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e6006ff90 0x7f8e60151e30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.330+0000 7f8e673ad700 1 -- 172.21.15.6:0/1677799630 >> 172.21.15.6:0/1677799630 conn(0x7f8e600c2c20 msgr2=0x7f8e600c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.330+0000 7f8e673ad700 1 -- 172.21.15.6:0/1677799630 shutdown_connections 2023-07-21T07:36:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.330+0000 7f8e673ad700 1 -- 172.21.15.6:0/1677799630 wait complete. 2023-07-21T07:36:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.331+0000 7f8e673ad700 1 Processor -- start 2023-07-21T07:36:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.331+0000 7f8e673ad700 1 -- start start 2023-07-21T07:36:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e673ad700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e6006ff90 0x7f8e600c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e673ad700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e600abc30 0x7f8e6013fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e673ad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e6014ed60 0x7f8e600c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:56.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e673ad700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e601eb010 con 0x7f8e6014ed60 2023-07-21T07:36:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e673ad700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e60143d10 con 0x7f8e6006ff90 2023-07-21T07:36:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e673ad700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e600c0d90 con 0x7f8e600abc30 2023-07-21T07:36:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e6594a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e6014ed60 0x7f8e600c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e6594a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e6014ed60 0x7f8e600c19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36662/0 (socket says 172.21.15.6:36662) 2023-07-21T07:36:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e6594a700 1 -- 172.21.15.6:0/1011949290 learned_addr learned my addr 172.21.15.6:0/1011949290 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e64948700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e600abc30 0x7f8e6013fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e65149700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e6006ff90 0x7f8e600c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e6594a700 1 -- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e600abc30 msgr2=0x7f8e6013fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e6594a700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e600abc30 0x7f8e6013fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e6594a700 1 -- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e6006ff90 msgr2=0x7f8e600c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e6594a700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e6006ff90 0x7f8e600c11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e6594a700 1 -- 172.21.15.6:0/1011949290 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58009a70 con 0x7f8e6014ed60 2023-07-21T07:36:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.332+0000 7f8e6594a700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e6014ed60 0x7f8e600c19d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009f30 tx=0x7f8e58004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.333+0000 7f8e55ffb700 1 -- 172.21.15.6:0/1011949290 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5801b810 con 0x7f8e6014ed60 2023-07-21T07:36:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.333+0000 7f8e55ffb700 1 -- 172.21.15.6:0/1011949290 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e58020070 con 0x7f8e6014ed60 2023-07-21T07:36:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.333+0000 7f8e673ad700 1 -- 172.21.15.6:0/1011949290 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e601ea9c0 con 0x7f8e6014ed60 2023-07-21T07:36:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.333+0000 7f8e55ffb700 1 -- 172.21.15.6:0/1011949290 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5801bbb0 con 0x7f8e6014ed60 2023-07-21T07:36:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.333+0000 7f8e673ad700 1 -- 172.21.15.6:0/1011949290 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e60140420 con 0x7f8e6014ed60 2023-07-21T07:36:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.334+0000 7f8e673ad700 1 -- 172.21.15.6:0/1011949290 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e601ea820 con 0x7f8e6014ed60 2023-07-21T07:36:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.334+0000 7f8e55ffb700 1 -- 172.21.15.6:0/1011949290 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e5801bd10 con 0x7f8e6014ed60 2023-07-21T07:36:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.335+0000 7f8e55ffb700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8e4406ace0 0x7f8e4406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.335+0000 7f8e55ffb700 1 -- 172.21.15.6:0/1011949290 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f8e58022070 con 0x7f8e6014ed60 2023-07-21T07:36:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.335+0000 7f8e65149700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8e4406ace0 0x7f8e4406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.335+0000 7f8e65149700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8e4406ace0 0x7f8e4406d1a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8e50005910 tx=0x7f8e50009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:56.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.339+0000 7f8e55ffb700 1 -- 172.21.15.6:0/1011949290 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8e601ea820 con 0x7f8e6014ed60 2023-07-21T07:36:56.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.620+0000 7f8e673ad700 1 -- 172.21.15.6:0/1011949290 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7f8e601ea820 con 0x7f8e6014ed60 2023-07-21T07:36:56.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.623+0000 7f8e55ffb700 1 -- 172.21.15.6:0/1011949290 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v15) v1 ==== 291+0+0 (secure 0 0 0) 0x7f8e601ea820 con 0x7f8e6014ed60 2023-07-21T07:36:56.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.626+0000 7f8e673ad700 1 -- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8e4406ace0 msgr2=0x7f8e4406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:56.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.626+0000 7f8e673ad700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8e4406ace0 0x7f8e4406d1a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8e50005910 tx=0x7f8e50009040 comp rx=0 tx=0).stop 2023-07-21T07:36:56.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.626+0000 7f8e673ad700 1 -- 172.21.15.6:0/1011949290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e6014ed60 msgr2=0x7f8e600c19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.626+0000 7f8e673ad700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e6014ed60 0x7f8e600c19d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009f30 tx=0x7f8e58004ad0 comp rx=0 tx=0).stop 2023-07-21T07:36:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.626+0000 7f8e673ad700 1 -- 172.21.15.6:0/1011949290 shutdown_connections 2023-07-21T07:36:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.626+0000 7f8e673ad700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7f8e4406ace0 0x7f8e4406d1a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.626+0000 7f8e673ad700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e6014ed60 0x7f8e600c19d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.626+0000 7f8e673ad700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e6006ff90 0x7f8e600c11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.626+0000 7f8e673ad700 1 --2- 172.21.15.6:0/1011949290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e600abc30 0x7f8e6013fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.626+0000 7f8e673ad700 1 -- 172.21.15.6:0/1011949290 >> 172.21.15.6:0/1011949290 conn(0x7f8e600c2c20 msgr2=0x7f8e600a99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.626+0000 7f8e673ad700 1 -- 172.21.15.6:0/1011949290 shutdown_connections 2023-07-21T07:36:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.626+0000 7f8e673ad700 1 -- 172.21.15.6:0/1011949290 wait complete. 2023-07-21T07:36:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:added key for client.testuser 2023-07-21T07:36:56.691 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-07-21T07:36:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.763+0000 7fef70660700 1 Processor -- start 2023-07-21T07:36:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.764+0000 7fef70660700 1 -- start start 2023-07-21T07:36:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.764+0000 7fef70660700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fef680c7260 0x7fef680c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.764+0000 7fef70660700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef681581d0 con 0x7fef68158660 2023-07-21T07:36:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.764+0000 7fef70660700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef680c98e0 con 0x7fef68151b70 2023-07-21T07:36:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.764+0000 7fef70660700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef68155360 con 0x7fef680c7260 2023-07-21T07:36:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.765+0000 7fef6ebfd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fef68158660 0x7fef6815ede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44690/0 (socket says 172.21.15.6:44690) 2023-07-21T07:36:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.765+0000 7fef6ebfd700 1 -- 172.21.15.6:0/991782647 learned_addr learned my addr 172.21.15.6:0/991782647 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T07:36:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.765+0000 7fef6dbfb700 1 --2- 172.21.15.6:0/991782647 >> v2:172.21.15.86:3300/0 conn(0x7fef680c7260 0x7fef680c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.765+0000 7fef6d3fa700 1 -- 172.21.15.6:0/991782647 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781295223 0 0) 0x7fef681581d0 con 0x7fef68158660 2023-07-21T07:36:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.765+0000 7fef6d3fa700 1 -- 172.21.15.6:0/991782647 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef540035b0 con 0x7fef68158660 2023-07-21T07:36:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.765+0000 7fef6d3fa700 1 -- 172.21.15.6:0/991782647 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311118035 0 0) 0x7fef680c98e0 con 0x7fef68151b70 2023-07-21T07:36:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.765+0000 7fef6d3fa700 1 -- 172.21.15.6:0/991782647 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef681581d0 con 0x7fef68151b70 2023-07-21T07:36:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.765+0000 7fef6dbfb700 1 -- 172.21.15.6:0/991782647 >> v1:172.21.15.86:6789/0 conn(0x7fef68151b70 legacy=0x7fef680bea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.765+0000 7fef6dbfb700 1 -- 172.21.15.6:0/991782647 >> v1:172.21.15.6:6789/0 conn(0x7fef68158660 legacy=0x7fef6815ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.765+0000 7fef6d3fa700 1 -- 172.21.15.6:0/991782647 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2494583945 0 0) 0x7fef540035b0 con 0x7fef68158660 2023-07-21T07:36:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.765+0000 7fef6dbfb700 1 -- 172.21.15.6:0/991782647 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef68155080 con 0x7fef680c7260 2023-07-21T07:36:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.765+0000 7fef6dbfb700 1 --2- 172.21.15.6:0/991782647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef680c7260 0x7fef680c8ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fef58009840 tx=0x7fef58009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973849d4840f7b95 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.766+0000 7fef6d3fa700 1 -- 172.21.15.6:0/991782647 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef600019f0 con 0x7fef680c7260 2023-07-21T07:36:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.766+0000 7fef6d3fa700 1 -- 172.21.15.6:0/991782647 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef58004030 con 0x7fef680c7260 2023-07-21T07:36:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.766+0000 7fef6d3fa700 1 -- 172.21.15.6:0/991782647 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef580043c0 con 0x7fef680c7260 2023-07-21T07:36:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.766+0000 7fef70660700 1 -- 172.21.15.6:0/991782647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef680c7260 msgr2=0x7fef680c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.766+0000 7fef70660700 1 --2- 172.21.15.6:0/991782647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef680c7260 0x7fef680c8ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fef58009840 tx=0x7fef58009b50 comp rx=0 tx=0).stop 2023-07-21T07:36:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.766+0000 7fef70660700 1 -- 172.21.15.6:0/991782647 shutdown_connections 2023-07-21T07:36:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.766+0000 7fef70660700 1 --2- 172.21.15.6:0/991782647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef680c7260 0x7fef680c8ab0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.766+0000 7fef70660700 1 -- 172.21.15.6:0/991782647 >> 172.21.15.6:0/991782647 conn(0x7fef680c6620 msgr2=0x7fef680c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.766+0000 7fef70660700 1 -- 172.21.15.6:0/991782647 shutdown_connections 2023-07-21T07:36:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.766+0000 7fef70660700 1 -- 172.21.15.6:0/991782647 wait complete. 2023-07-21T07:36:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.767+0000 7fef70660700 1 Processor -- start 2023-07-21T07:36:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.767+0000 7fef70660700 1 -- start start 2023-07-21T07:36:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.768+0000 7fef70660700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef680c7260 0x7fef68153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.768+0000 7fef70660700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef68151b70 0x7fef681e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.768+0000 7fef70660700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef68158660 0x7fef681ea530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.768+0000 7fef70660700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef680c3ee0 con 0x7fef680c7260 2023-07-21T07:36:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.768+0000 7fef70660700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef681ede00 con 0x7fef68151b70 2023-07-21T07:36:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.768+0000 7fef70660700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef681ee0a0 con 0x7fef68158660 2023-07-21T07:36:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.768+0000 7fef6e3fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef680c7260 0x7fef68153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.768+0000 7fef6e3fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef680c7260 0x7fef68153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36672/0 (socket says 172.21.15.6:36672) 2023-07-21T07:36:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.768+0000 7fef6e3fc700 1 -- 172.21.15.6:0/573511158 learned_addr learned my addr 172.21.15.6:0/573511158 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T07:36:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.768+0000 7fef6ebfd700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef68158660 0x7fef681ea530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.768+0000 7fef6dbfb700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef68151b70 0x7fef681e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.768+0000 7fef6e3fc700 1 -- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef68158660 msgr2=0x7fef681ea530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.768+0000 7fef6e3fc700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef68158660 0x7fef681ea530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.769+0000 7fef6e3fc700 1 -- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef68151b70 msgr2=0x7fef681e9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.769+0000 7fef6e3fc700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef68151b70 0x7fef681e9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.769+0000 7fef6e3fc700 1 -- 172.21.15.6:0/573511158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580094a0 con 0x7fef680c7260 2023-07-21T07:36:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.769+0000 7fef6dbfb700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef68151b70 0x7fef681e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T07:36:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.769+0000 7fef6e3fc700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef680c7260 0x7fef68153590 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fef6400c520 tx=0x7fef6400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.769+0000 7fef5effd700 1 -- 172.21.15.6:0/573511158 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef640052d0 con 0x7fef680c7260 2023-07-21T07:36:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.769+0000 7fef5effd700 1 -- 172.21.15.6:0/573511158 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef64005430 con 0x7fef680c7260 2023-07-21T07:36:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.769+0000 7fef70660700 1 -- 172.21.15.6:0/573511158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef680c3b70 con 0x7fef680c7260 2023-07-21T07:36:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.769+0000 7fef5effd700 1 -- 172.21.15.6:0/573511158 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef640038c0 con 0x7fef680c7260 2023-07-21T07:36:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.769+0000 7fef70660700 1 -- 172.21.15.6:0/573511158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef68153ea0 con 0x7fef680c7260 2023-07-21T07:36:56.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.770+0000 7fef70660700 1 -- 172.21.15.6:0/573511158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6804ecc0 con 0x7fef680c7260 2023-07-21T07:36:56.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.770+0000 7fef5effd700 1 -- 172.21.15.6:0/573511158 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef64003a20 con 0x7fef680c7260 2023-07-21T07:36:56.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.771+0000 7fef5effd700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fef4c06ace0 0x7fef4c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T07:36:56.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.771+0000 7fef5effd700 1 -- 172.21.15.6:0/573511158 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fef64088d60 con 0x7fef680c7260 2023-07-21T07:36:56.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.771+0000 7fef6dbfb700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fef4c06ace0 0x7fef4c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T07:36:56.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.771+0000 7fef6dbfb700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fef4c06ace0 0x7fef4c06d1a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fef5800a010 tx=0x7fef58013040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T07:36:56.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:56.775+0000 7fef5effd700 1 -- 172.21.15.6:0/573511158 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fef64053b40 con 0x7fef680c7260 2023-07-21T07:36:57.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.055+0000 7fef70660700 1 -- 172.21.15.6:0/573511158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7fef680ab5f0 con 0x7fef680c7260 2023-07-21T07:36:57.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.056+0000 7fef5effd700 1 -- 172.21.15.6:0/573511158 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v15) v1 ==== 85+0+245 (secure 0 0 0) 0x7fef64017110 con 0x7fef680c7260 2023-07-21T07:36:57.110 INFO:teuthology.orchestra.run.smithi006.stdout:[client.testuser] 2023-07-21T07:36:57.110 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCYNbpki0EIJRAAWmuD+wQcBYZ5zyNBHM3FTw== 2023-07-21T07:36:57.110 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow rw fsname=cephfs" 2023-07-21T07:36:57.110 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-07-21T07:36:57.111 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-07-21T07:36:57.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.058+0000 7fef70660700 1 -- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fef4c06ace0 msgr2=0x7fef4c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:57.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.058+0000 7fef70660700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fef4c06ace0 0x7fef4c06d1a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fef5800a010 tx=0x7fef58013040 comp rx=0 tx=0).stop 2023-07-21T07:36:57.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.058+0000 7fef70660700 1 -- 172.21.15.6:0/573511158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef680c7260 msgr2=0x7fef68153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T07:36:57.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.058+0000 7fef70660700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef680c7260 0x7fef68153590 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fef6400c520 tx=0x7fef6400c8e0 comp rx=0 tx=0).stop 2023-07-21T07:36:57.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.058+0000 7fef70660700 1 -- 172.21.15.6:0/573511158 shutdown_connections 2023-07-21T07:36:57.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.058+0000 7fef70660700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:6832/462616725,v1:172.21.15.86:6833/462616725] conn(0x7fef4c06ace0 0x7fef4c06d1a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:57.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.058+0000 7fef70660700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef68158660 0x7fef681ea530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:57.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.058+0000 7fef70660700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef680c7260 0x7fef68153590 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:57.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.058+0000 7fef70660700 1 --2- 172.21.15.6:0/573511158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef68151b70 0x7fef681e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T07:36:57.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.058+0000 7fef70660700 1 -- 172.21.15.6:0/573511158 >> 172.21.15.6:0/573511158 conn(0x7fef680c6620 msgr2=0x7fef68150a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T07:36:57.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.058+0000 7fef70660700 1 -- 172.21.15.6:0/573511158 shutdown_connections 2023-07-21T07:36:57.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T07:36:57.058+0000 7fef70660700 1 -- 172.21.15.6:0/573511158 wait complete. 2023-07-21T07:36:57.123 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2023-07-21T07:36:57.140 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.mLVhOnCtKq 2023-07-21T07:36:57.140 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T07:36:57.141 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/tmp/tmp.mLVhOnCtKq 2023-07-21T07:36:57.187 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 309, in copy_and_close shutil.copyfileobj(src, fdst) File "/usr/lib/python3.8/shutil.py", line 199, in copyfileobj fsrc_read = fsrc.read AttributeError: 'RemoteProcess' object has no attribute 'read' 2023-07-21T07:37:09.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:37:09.304 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:37:39.392 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:37:39.395 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:38:09.470 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:38:09.473 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:38:39.561 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:38:39.564 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:39:09.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:39:09.656 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:39:39.718 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:39:39.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:40:09.783 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:40:09.786 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:40:39.888 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:40:39.891 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:41:09.952 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:41:09.955 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:41:40.019 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:41:40.022 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:42:10.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:42:10.086 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:42:40.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:42:40.151 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:43:10.213 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:43:10.216 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:43:40.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:43:40.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:44:10.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:44:10.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:44:40.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:44:40.471 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:45:10.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:45:10.534 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:45:40.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:45:40.606 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:46:10.669 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:46:10.672 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:46:40.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:46:40.744 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:47:10.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:47:10.810 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:47:40.879 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:47:40.882 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:48:10.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:48:10.954 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:48:41.011 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:48:41.014 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:49:11.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:49:11.085 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:49:41.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:49:41.179 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:50:11.238 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:50:11.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:50:41.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:50:41.307 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:51:11.370 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:51:11.372 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:51:41.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:51:41.439 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:52:11.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:52:11.509 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:52:41.576 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:52:41.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:53:11.642 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:53:11.646 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:53:41.708 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:53:41.711 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:54:11.798 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:54:11.801 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:54:41.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:54:41.898 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:55:11.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:55:11.991 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:55:42.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:55:42.058 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:56:12.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:56:12.150 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:56:42.217 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:56:42.220 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:57:12.294 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:57:12.297 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:57:42.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:57:42.371 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:58:12.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:58:12.448 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:58:42.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:58:42.513 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:59:12.599 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:59:12.602 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:59:42.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T07:59:42.673 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:00:12.783 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:00:12.786 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:00:42.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:00:42.876 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:01:12.944 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:01:12.947 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:01:43.011 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:01:43.014 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:02:13.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:02:13.083 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:02:43.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:02:43.153 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:03:13.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:03:13.235 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:03:43.305 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:03:43.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:04:13.372 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:04:13.375 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:04:43.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:04:43.441 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:05:13.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:05:13.522 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:05:43.591 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:05:43.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:06:13.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:06:13.656 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:06:43.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:06:43.723 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:07:13.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:07:13.795 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:07:43.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:07:43.867 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:08:14.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:08:14.071 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:08:44.142 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:08:44.145 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:09:14.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:09:14.217 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:09:44.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:09:44.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:10:14.367 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:10:14.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:10:44.439 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:10:44.442 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:11:14.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:11:14.565 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:11:44.642 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:11:44.645 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:12:14.714 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:12:14.717 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:12:44.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:12:44.789 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:13:14.859 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:13:14.861 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:13:44.932 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:13:44.934 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:14:15.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:14:15.015 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:14:45.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:14:45.112 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:15:15.192 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:15:15.195 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:15:45.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:15:45.271 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:16:15.343 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:16:15.346 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:16:45.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:16:45.530 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:17:15.591 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:17:15.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:17:45.676 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:17:45.679 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:18:15.748 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:18:15.752 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:18:45.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:18:45.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:19:15.885 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:19:15.888 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:19:45.968 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:19:45.971 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:20:16.038 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:20:16.041 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:20:46.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:20:46.163 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:21:16.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:21:16.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:21:46.325 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:21:46.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:22:16.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:22:16.392 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:22:46.464 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:22:46.467 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:23:16.533 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:23:16.536 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:23:46.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:23:46.610 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:24:16.687 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:24:16.690 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:24:46.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:24:46.774 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:25:16.859 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:25:16.862 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:25:46.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:25:46.952 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:26:17.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:26:17.057 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:26:47.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:26:47.150 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:27:17.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:27:17.231 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:27:47.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:27:47.306 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:28:17.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:28:17.386 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:28:47.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:28:47.451 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:29:17.525 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:29:17.528 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:29:47.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:29:47.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:30:17.713 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:30:17.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:30:47.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:30:47.806 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:31:17.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:31:17.879 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:31:47.974 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:31:47.978 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:32:18.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:32:18.058 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:32:48.128 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:32:48.131 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:33:18.201 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:33:18.204 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:33:48.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:33:48.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:34:18.346 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:34:18.349 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:34:48.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:34:48.418 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:35:18.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:35:18.491 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:35:48.574 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:35:48.578 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:36:18.663 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:36:18.666 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:36:48.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:36:48.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:37:18.833 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:37:18.835 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:37:48.914 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:37:48.917 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:38:18.994 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:38:18.997 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:38:49.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:38:49.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:39:19.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:39:19.144 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:39:49.213 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:39:49.216 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:40:19.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:40:19.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:40:49.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:40:49.366 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:41:19.466 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:41:19.469 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:41:49.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:41:49.561 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:42:19.689 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:42:19.692 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:42:49.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:42:49.822 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:43:19.909 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:43:19.912 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:43:50.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:43:50.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:44:20.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:44:20.248 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:44:50.317 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:44:50.320 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:45:20.458 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:45:20.462 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:45:50.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:45:50.609 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:46:20.777 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:46:20.781 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:46:50.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:46:50.931 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:47:21.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:47:21.067 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:47:51.137 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:47:51.141 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:48:21.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:48:21.264 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:48:51.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:48:51.410 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:49:21.546 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:49:21.549 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:49:51.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:49:51.696 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:50:21.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:50:21.770 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:50:51.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:50:51.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:51:22.062 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:51:22.065 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:51:52.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:51:52.196 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:52:22.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:52:22.352 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:52:52.471 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:52:52.474 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:53:22.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:53:22.597 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:53:52.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:53:52.783 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:54:22.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:54:22.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:54:53.019 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:54:53.023 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:55:23.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:55:23.086 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:55:53.222 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:55:53.225 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:56:23.377 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:56:23.380 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:56:53.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:56:53.525 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:57:23.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:57:23.680 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:57:53.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:57:53.745 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:58:23.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:58:23.914 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:58:54.074 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:58:54.078 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:59:24.186 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:59:24.190 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:59:54.332 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T08:59:54.335 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:00:24.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:00:24.482 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:00:54.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:00:54.628 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:01:24.709 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:01:24.711 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:01:55.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:01:55.063 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:02:25.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:02:25.143 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:02:55.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:02:55.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:03:25.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:03:25.427 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:03:55.494 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:03:55.497 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:04:25.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:04:25.637 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:04:55.715 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:04:55.718 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:05:25.870 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:05:25.873 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:05:56.000 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:05:56.003 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:06:26.156 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:06:26.159 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:06:56.269 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:06:56.272 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:07:26.408 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:07:26.411 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:07:56.546 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:07:56.548 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:08:26.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:08:26.687 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:08:56.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:08:56.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:09:26.961 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:09:26.964 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:09:57.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:09:57.139 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:10:27.289 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:10:27.292 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:10:57.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:10:57.476 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:11:27.626 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:11:27.628 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:11:57.764 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:11:57.766 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:12:27.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:12:27.827 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:12:57.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:12:57.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:13:28.039 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:13:28.042 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:13:58.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:13:58.172 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:14:28.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:14:28.285 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:14:58.405 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:14:58.408 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:15:28.492 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:15:28.496 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:15:58.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:15:58.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:16:28.788 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:16:28.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:16:58.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:16:58.922 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:17:29.099 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:17:29.102 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:17:59.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:17:59.232 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:18:29.394 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:18:29.400 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:18:59.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:18:59.553 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:19:29.713 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:19:29.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:19:59.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:19:59.856 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:20:29.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:20:29.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:21:00.088 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:21:00.092 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:21:30.251 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:21:30.254 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:22:00.391 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:22:00.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:22:30.504 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:22:30.507 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:23:00.619 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:23:00.622 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:23:30.766 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:23:30.770 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:24:00.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:24:00.924 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:24:31.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:24:31.054 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:25:01.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:25:01.119 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:25:31.238 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:25:31.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:26:01.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:26:01.312 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:26:31.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:26:31.386 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:27:01.453 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:27:01.456 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:27:31.619 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:27:31.622 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:28:01.774 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:28:01.777 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:28:31.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:28:31.856 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:29:01.993 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:29:01.997 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:29:32.124 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:29:32.127 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:30:02.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:30:02.258 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:30:32.386 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:30:32.389 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:31:02.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:31:02.511 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:31:32.614 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:31:32.618 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:32:02.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:32:02.907 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:32:32.969 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:32:32.973 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:33:03.032 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:33:03.035 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:33:33.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:33:33.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:34:03.180 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:34:03.184 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:34:33.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:34:33.256 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:35:03.326 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:35:03.329 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:35:33.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:35:33.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:36:03.470 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:36:03.473 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:36:33.544 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:36:33.547 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:37:03.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:37:03.612 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:37:33.673 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:37:33.676 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:38:03.747 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:38:03.749 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:38:33.882 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:38:33.885 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:39:04.030 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:39:04.033 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:39:34.178 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:39:34.181 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:40:04.241 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:40:04.244 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:40:34.408 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:40:34.411 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:41:04.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:41:04.557 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:41:34.668 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:41:34.671 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:42:04.848 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:42:04.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:42:34.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:42:34.958 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:43:05.095 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:43:05.098 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:43:35.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:43:35.227 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:44:05.422 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:44:05.425 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:44:35.494 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:44:35.497 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:45:05.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:45:05.569 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:45:35.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:45:35.701 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:46:05.787 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:46:05.790 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:46:35.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:46:35.989 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:47:06.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:47:06.118 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:47:36.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:47:36.198 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:48:06.326 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:48:06.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:48:36.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:48:36.443 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:49:06.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:49:06.573 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:49:36.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:49:36.705 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:50:06.866 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:50:06.869 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:50:37.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:50:37.017 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:51:07.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:51:07.105 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:51:37.241 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:51:37.243 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:52:07.388 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:52:07.391 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:52:37.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:52:37.522 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:53:07.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:53:07.655 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:53:37.724 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:53:37.727 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:54:07.797 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:54:07.801 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:54:37.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:54:37.870 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:55:07.932 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:55:07.935 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:55:38.015 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:55:38.019 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:56:08.088 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:56:08.091 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:56:38.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:56:38.172 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:57:08.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:57:08.244 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:57:38.319 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:57:38.322 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:58:08.449 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:58:08.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:58:38.580 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:58:38.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:59:08.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:59:08.731 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:59:38.875 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T09:59:38.879 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:00:09.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:00:09.017 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:00:39.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:00:39.155 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:01:09.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:01:09.301 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:01:39.388 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:01:39.391 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:02:09.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:02:09.540 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:02:39.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:02:39.688 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:03:09.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:03:09.760 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:03:39.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:03:39.883 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:04:10.019 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:04:10.022 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:04:40.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:04:40.160 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:05:10.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:05:10.349 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:05:40.419 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:05:40.422 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:06:10.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:06:10.495 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:06:40.580 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:06:40.583 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:07:10.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:07:10.657 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:07:40.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:07:40.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:08:10.816 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:08:10.820 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:08:40.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:08:40.960 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:09:11.046 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:09:11.050 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:09:41.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:09:41.196 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:10:11.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:10:11.444 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:10:41.504 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:10:41.507 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:11:11.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:11:11.630 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:11:41.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:11:41.784 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:12:11.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:12:11.854 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:12:41.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:12:41.995 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:13:12.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:13:12.067 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:13:42.203 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:13:42.206 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:14:12.291 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:14:12.294 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:14:42.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:14:42.409 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:15:12.561 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:15:12.564 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:15:42.708 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:15:42.711 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:16:12.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:16:12.867 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:16:43.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:16:43.006 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:17:13.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:17:13.071 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:17:43.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:17:43.208 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:18:13.370 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:18:13.373 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:18:43.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:18:43.519 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:19:13.638 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:19:13.641 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:19:43.760 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:19:43.763 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:20:13.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:20:13.894 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:20:44.046 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:20:44.049 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:21:14.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:21:14.171 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:21:44.316 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:21:44.319 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:22:14.472 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:22:14.475 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:22:44.604 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:22:44.608 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:23:14.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:23:14.680 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:23:44.813 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:23:44.817 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:24:14.952 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:24:14.955 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:24:45.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:24:45.078 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:25:15.223 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:25:15.226 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:25:45.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:25:45.355 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:26:15.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:26:15.511 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:26:45.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:26:45.843 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:27:15.916 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:27:15.919 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:27:46.112 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:27:46.117 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:28:16.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:28:16.267 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:28:46.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:28:46.407 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:29:16.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:29:16.537 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:29:46.631 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:29:46.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:30:16.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:30:16.766 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:30:46.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:30:46.854 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:31:17.133 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:31:17.136 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:31:47.230 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:31:47.233 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:32:17.353 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:32:17.356 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:32:47.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:32:47.501 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:33:17.596 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:33:17.599 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:33:47.718 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:33:47.721 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:34:17.850 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:34:17.852 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:34:47.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:34:47.924 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:35:18.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:35:18.290 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:35:48.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:35:48.360 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:36:18.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:36:18.533 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:36:48.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:36:48.697 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:37:18.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:37:18.770 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:37:48.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:37:48.925 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:38:19.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:38:19.056 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:38:49.200 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:38:49.203 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:39:19.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:39:19.343 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:39:49.405 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:39:49.408 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:40:19.472 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:40:19.475 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:40:49.638 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:40:49.640 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:41:19.784 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:41:19.786 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:41:49.932 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:41:49.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:42:20.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:42:20.059 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:42:50.196 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:42:50.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:43:20.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:43:20.347 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:43:50.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:43:50.478 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:44:20.546 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:44:20.550 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:44:50.644 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:44:50.647 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:45:20.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:45:20.773 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:45:50.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:45:50.921 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:46:20.981 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:46:20.984 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:46:51.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:46:51.143 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:47:21.305 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:47:21.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:47:51.453 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:47:51.455 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:48:21.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:48:21.686 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:48:51.830 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:48:51.834 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:49:21.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:49:21.899 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:49:52.044 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:49:52.047 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:50:22.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:50:22.186 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:50:52.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:50:52.336 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:51:22.421 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:51:22.424 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:51:52.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:51:52.562 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:52:22.623 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:52:22.626 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:52:52.688 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:52:52.692 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:53:22.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:53:22.856 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:53:53.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:53:53.012 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:54:23.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:54:23.160 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:54:53.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:54:53.292 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:55:23.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:55:23.438 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:55:53.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:55:53.569 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:56:23.681 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:56:23.683 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:56:53.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:56:53.856 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:57:23.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:57:23.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:57:54.074 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:57:54.077 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:58:24.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:58:24.224 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:58:54.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:58:54.363 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:59:24.500 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:59:24.503 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:59:54.615 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T10:59:54.618 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:00:24.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:00:24.731 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:00:54.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:00:54.854 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:01:24.981 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:01:24.985 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:01:55.062 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:01:55.065 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:02:25.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:02:25.213 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:02:55.341 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:02:55.344 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:03:25.498 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:03:25.502 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:03:55.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:03:55.674 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:04:25.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:04:25.797 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:04:55.866 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:04:55.870 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:05:26.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:05:26.067 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:05:56.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:05:56.149 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:06:26.284 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:06:26.287 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:06:56.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:06:56.444 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:07:26.571 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:07:26.574 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:07:56.719 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:07:56.722 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:08:26.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:08:26.803 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:08:56.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:08:56.960 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:09:27.031 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:09:27.034 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:09:57.095 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:09:57.098 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:10:27.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:10:27.172 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:10:57.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:10:57.235 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:11:27.346 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:11:27.349 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:11:57.461 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:11:57.464 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:12:27.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:12:27.619 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:12:57.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:12:57.758 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:13:27.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:13:27.856 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:13:57.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:13:57.994 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:14:28.050 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:14:28.053 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:14:58.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:14:58.196 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:15:28.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:15:28.343 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:15:58.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:15:58.499 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:16:28.573 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:16:28.576 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:16:58.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:16:58.648 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:17:28.779 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:17:28.783 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:17:58.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:17:58.921 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:18:29.065 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:18:29.068 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:18:59.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:18:59.207 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:19:29.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:19:29.354 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:19:59.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:19:59.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:20:29.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:20:29.715 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:20:59.877 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:20:59.880 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:21:29.956 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:21:29.959 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:22:00.097 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:22:00.100 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:22:30.244 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:22:30.247 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:23:00.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:23:00.393 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:23:30.521 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:23:30.524 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:24:00.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:24:00.667 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:24:30.750 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:24:30.753 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:25:00.814 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:25:00.817 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:25:30.961 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:25:30.964 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:26:01.066 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:26:01.069 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:26:31.188 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:26:31.191 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:27:01.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:27:01.323 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:27:31.492 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:27:31.495 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:28:01.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:28:01.637 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:28:31.745 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:28:31.748 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:29:01.892 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:29:01.895 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:29:32.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:29:32.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:30:02.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:30:02.167 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:30:32.252 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:30:32.255 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:31:02.391 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:31:02.399 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:31:32.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:31:32.516 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:32:02.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:32:02.680 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:32:32.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:32:32.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:33:02.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:33:02.924 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:33:33.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:33:33.056 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:34:03.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:34:03.179 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:34:33.306 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:34:33.310 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:35:03.454 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:35:03.457 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:35:33.576 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:35:33.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:36:03.724 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:36:03.727 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:36:33.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:36:33.802 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:37:03.935 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:37:03.938 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:37:34.091 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:37:34.094 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:38:04.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:38:04.163 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:38:34.269 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:38:34.272 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:39:04.408 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:39:04.411 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:39:34.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:39:34.525 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:40:04.687 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:40:04.690 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:40:34.834 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:40:34.837 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:41:04.974 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:41:04.977 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:41:35.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:41:35.158 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:42:05.294 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:42:05.297 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:42:35.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:42:35.376 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:43:05.471 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:43:05.474 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:43:35.636 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:43:35.639 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:44:05.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:44:05.778 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:44:35.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:44:35.909 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:45:05.978 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:45:05.981 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:45:36.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:45:36.120 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:46:06.189 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:46:06.193 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:46:36.370 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:46:36.373 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:47:06.451 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:47:06.454 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:47:36.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:47:36.609 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:48:06.745 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:48:06.749 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:48:36.810 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:48:36.812 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:49:06.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:49:06.924 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:49:37.069 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:49:37.072 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:50:07.217 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:50:07.219 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:50:37.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:50:37.285 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:51:07.419 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:51:07.422 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:51:37.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:51:37.552 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:52:07.722 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:52:07.724 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:52:37.860 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:52:37.864 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:53:08.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:53:08.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:53:38.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:53:38.158 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:54:08.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:54:08.279 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:54:38.466 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:54:38.469 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:55:08.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:55:08.532 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:55:38.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:55:38.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:56:08.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:56:08.876 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:56:38.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:56:38.998 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:57:09.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:57:09.136 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:57:39.274 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:57:39.277 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:58:09.337 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:58:09.340 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:58:39.493 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:58:39.496 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:59:09.791 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:59:09.795 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:59:39.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T11:59:39.908 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:00:10.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:00:10.030 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:00:40.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:00:40.154 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:01:10.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:01:10.291 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:01:40.370 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:01:40.373 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:02:10.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:02:10.520 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:02:40.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:02:40.592 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:03:10.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:03:10.714 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:03:40.859 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:03:40.862 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:04:11.056 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:04:11.059 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:04:41.211 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:04:41.214 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:05:11.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:05:11.279 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:05:41.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:05:41.386 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:06:11.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:06:11.532 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:06:41.619 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:06:41.622 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:07:11.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:07:11.737 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:07:41.889 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:07:41.892 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:08:12.019 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:08:12.023 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:08:42.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:08:42.112 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:09:12.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:09:12.176 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:09:42.246 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:09:42.249 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:10:12.311 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:10:12.314 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:10:42.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:10:42.378 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:11:12.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:11:12.441 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:11:42.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:11:42.514 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:12:12.592 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:12:12.595 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:12:42.681 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:12:42.684 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:13:12.788 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:13:12.791 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:13:42.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:13:42.904 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:14:13.039 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:14:13.042 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:14:43.161 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:14:43.164 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:15:13.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:15:13.296 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:15:43.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:15:43.368 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:16:13.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:16:13.516 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:16:43.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:16:43.656 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:17:13.750 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:17:13.752 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:17:43.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:17:43.874 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:18:14.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:18:14.005 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:18:44.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:18:44.135 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:19:14.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:19:14.291 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:19:44.418 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:19:44.421 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:20:14.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:20:14.586 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:20:44.722 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:20:44.725 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:21:14.852 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:21:14.855 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:21:44.983 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:21:44.986 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:22:15.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:22:15.151 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:22:45.305 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:22:45.310 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:23:15.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:23:15.482 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:23:45.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:23:45.614 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:24:15.742 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:24:15.745 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:24:45.856 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:24:45.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:25:15.939 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:25:15.942 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:25:46.019 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:25:46.022 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:26:16.085 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:26:16.088 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:26:46.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:26:46.161 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:27:16.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:27:16.235 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:27:46.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:27:46.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:28:16.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:28:16.379 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:28:46.451 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:28:46.454 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:29:16.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:29:16.510 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:29:46.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:29:46.583 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:30:16.637 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:30:16.646 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:30:46.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:30:46.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:31:16.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:31:16.803 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:31:46.890 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:31:46.894 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:32:16.955 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:32:16.958 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:32:47.037 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:32:47.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:33:17.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:33:17.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:33:47.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:33:47.216 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:34:17.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:34:17.355 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:34:47.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:34:47.483 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:35:17.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:35:17.611 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:35:47.713 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:35:47.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:36:17.861 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:36:17.864 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:36:47.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:36:47.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:37:18.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:37:18.039 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:37:48.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:37:48.144 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:38:18.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:38:18.205 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:38:48.279 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:38:48.282 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:39:18.343 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:39:18.346 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:39:48.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:39:48.428 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:40:18.489 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:40:18.492 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:40:48.596 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:40:48.598 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:41:18.668 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:41:18.671 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:41:48.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:41:48.744 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:42:18.808 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:42:18.811 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:42:48.882 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:42:48.885 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:43:19.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:43:19.015 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:43:49.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:43:49.138 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:44:19.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:44:19.211 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:44:49.321 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:44:49.324 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:45:19.470 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:45:19.474 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:45:49.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:45:49.606 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:46:19.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:46:19.728 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:46:49.848 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:46:49.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:47:19.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:47:19.906 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:47:50.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:47:50.030 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:48:20.199 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:48:20.202 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:48:50.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:48:50.342 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:49:20.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:49:20.481 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:49:50.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:49:50.570 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:50:20.715 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:50:20.718 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:50:50.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:50:50.848 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:51:20.968 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:51:20.971 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:51:51.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:51:51.127 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:52:21.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:52:21.223 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:52:51.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:52:51.295 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:53:21.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:53:21.419 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:53:51.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:53:51.542 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:54:21.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:54:21.597 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:54:51.717 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:54:51.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:55:21.856 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:55:21.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:55:52.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:55:52.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:56:22.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:56:22.154 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:56:52.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:56:52.234 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:57:22.386 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:57:22.389 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:57:52.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:57:52.450 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:58:22.577 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:58:22.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:58:52.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:58:52.719 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:59:22.837 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:59:22.840 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:59:52.984 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T12:59:52.987 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:00:23.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:00:23.051 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:00:53.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:00:53.198 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:01:23.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:01:23.353 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:01:53.497 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:01:53.500 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:02:23.619 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:02:23.622 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:02:53.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:02:53.760 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:03:23.832 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:03:23.835 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:03:53.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:03:53.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:04:24.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:04:24.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:04:54.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:04:54.177 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:05:24.238 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:05:24.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:05:54.311 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:05:54.314 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:06:24.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:06:24.378 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:06:54.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:06:54.444 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:07:24.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:07:24.567 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:07:54.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:07:54.705 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:08:24.859 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:08:24.862 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:08:55.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:08:55.025 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:09:25.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:09:25.114 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:09:55.191 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:09:55.194 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:10:25.330 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:10:25.333 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:10:55.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:10:55.490 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:11:25.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:11:25.620 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:11:55.756 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:11:55.758 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:12:25.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:12:25.905 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:12:56.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:12:56.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:13:26.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:13:26.184 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:13:56.361 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:13:56.364 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:14:26.509 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:14:26.512 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:14:56.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:14:56.635 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:15:26.780 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:15:26.783 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:15:56.866 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:15:56.868 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:16:26.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:16:26.932 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:16:57.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:16:57.121 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:17:27.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:17:27.231 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:17:57.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:17:57.378 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:18:27.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:18:27.509 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:18:57.662 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:18:57.694 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:19:27.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:19:27.868 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:19:57.981 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:19:57.984 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:20:28.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:20:28.163 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:20:58.241 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:20:58.244 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:21:28.389 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:21:28.392 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:21:58.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:21:58.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:22:28.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:22:28.655 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:22:58.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:22:58.719 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:23:28.879 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:23:28.882 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:23:59.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:23:59.171 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:24:29.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:24:29.234 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:24:59.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:24:59.307 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:25:29.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:25:29.361 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:25:59.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:25:59.440 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:26:29.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:26:29.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:26:59.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:26:59.611 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:27:29.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:27:29.673 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:27:59.751 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:27:59.754 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:28:29.835 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:28:29.838 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:28:59.913 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:28:59.918 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:29:29.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:29:29.992 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:30:00.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:30:00.086 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:30:30.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:30:30.167 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:31:00.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:31:00.240 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:31:30.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:31:30.304 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:32:00.498 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:32:00.501 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:32:30.571 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:32:30.574 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:33:00.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:33:00.646 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:33:30.732 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:33:30.735 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:34:00.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:34:00.808 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:34:30.919 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:34:30.922 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:35:00.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:35:00.994 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:35:31.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:35:31.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:36:01.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:36:01.290 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:36:31.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:36:31.379 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:37:01.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:37:01.509 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:37:31.662 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:37:31.665 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:38:01.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:38:01.793 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:38:31.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:38:31.868 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:39:01.940 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:39:01.943 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:39:32.001 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:39:32.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:40:02.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:40:02.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:40:32.124 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:40:32.127 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:41:02.197 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:41:02.199 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:41:32.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:41:32.263 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:42:02.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:42:02.336 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:42:32.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:42:32.396 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:43:02.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:43:02.465 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:43:32.544 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:43:32.547 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:44:02.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:44:02.620 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:44:32.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:44:32.685 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:45:02.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:45:02.758 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:45:32.827 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:45:32.830 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:46:02.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:46:02.902 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:46:32.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:46:32.967 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:47:03.028 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:47:03.031 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:47:33.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:47:33.095 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:48:03.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:48:03.166 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:48:33.239 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:48:33.242 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:49:03.337 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:49:03.340 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:49:33.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:49:33.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:50:03.489 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:50:03.493 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:50:33.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:50:33.554 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:51:03.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:51:03.642 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:51:33.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:51:33.703 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:52:03.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:52:03.784 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:52:33.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:52:33.848 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:53:03.909 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:53:03.912 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:53:33.966 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:53:33.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:54:04.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:54:04.042 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:54:34.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:54:34.115 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:55:04.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:55:04.187 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:55:34.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:55:34.252 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:56:04.321 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:56:04.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:56:34.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:56:34.387 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:57:04.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:57:04.443 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:57:34.505 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:57:34.508 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:58:04.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:58:04.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:58:34.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:58:34.637 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:59:04.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:59:04.699 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:59:34.769 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T13:59:34.772 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:00:04.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:00:04.905 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:00:34.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:00:34.993 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:01:05.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:01:05.143 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:01:35.444 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:01:35.446 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:02:05.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:02:05.511 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:02:35.648 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:02:35.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:03:05.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:03:05.723 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:03:35.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:03:35.887 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:04:05.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:04:05.994 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:04:36.137 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:04:36.140 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:05:06.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:05:06.339 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:05:36.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:05:36.586 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:06:06.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:06:06.727 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:06:36.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:06:36.868 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:07:07.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:07:07.013 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:07:37.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:07:37.135 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:08:07.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:08:07.225 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:08:37.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:08:37.355 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:09:07.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:09:07.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:09:37.568 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:09:37.571 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:10:07.636 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:10:07.639 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:10:37.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:10:37.762 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:11:07.857 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:11:07.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:11:38.004 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:11:38.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:12:08.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:12:08.071 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:12:38.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:12:38.219 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:13:08.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:13:08.376 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:13:38.505 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:13:38.508 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:14:08.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:14:08.590 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:14:38.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:14:38.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:15:08.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:15:08.861 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:15:38.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:15:38.999 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:16:09.142 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:16:09.145 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:16:39.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:16:39.268 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:17:09.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:17:09.366 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:17:39.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:17:39.499 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:18:09.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:18:09.646 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:18:39.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:18:39.710 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:19:09.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:19:09.875 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:19:40.036 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:19:40.039 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:20:10.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:20:10.178 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:20:40.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:20:40.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:21:10.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:21:10.388 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:21:40.517 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:21:40.519 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:22:10.698 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:22:10.702 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:22:40.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:22:40.773 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:23:10.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:23:10.847 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:23:40.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:23:40.977 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:24:11.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:24:11.107 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:24:41.234 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:24:41.237 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:25:11.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:25:11.586 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:25:41.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:25:41.724 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:26:11.860 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:26:11.863 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:26:41.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:26:42.002 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:27:12.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:27:12.066 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:27:42.194 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:27:42.197 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:28:12.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:28:12.261 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:28:42.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:28:42.427 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:29:12.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:29:12.511 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:29:42.609 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:29:42.612 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:30:12.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:30:12.735 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:30:42.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:30:42.879 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:31:12.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:31:12.939 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:31:43.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:31:43.154 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:32:13.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:32:13.268 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:32:43.337 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:32:43.340 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:33:13.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:33:13.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:33:43.464 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:33:43.467 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:34:13.528 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:34:13.531 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:34:43.601 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:34:43.604 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:35:13.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:35:13.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:35:43.739 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:35:43.742 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:36:13.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:36:13.808 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:36:43.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:36:43.870 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:37:13.931 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:37:13.934 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:37:44.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:37:44.008 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:38:14.069 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:38:14.072 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:38:44.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:38:44.137 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:39:14.197 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:39:14.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:39:44.271 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:39:44.274 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:40:14.328 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:40:14.331 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:40:44.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:40:44.481 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:41:14.626 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:41:14.629 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:41:44.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:41:44.702 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:42:14.839 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:42:14.842 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:42:44.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:42:44.999 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:43:15.144 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:43:15.147 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:43:45.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:43:45.227 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:44:15.372 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:44:15.374 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:44:45.520 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:44:45.523 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:45:15.578 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:45:15.581 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:45:45.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:45:45.646 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:46:15.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:46:15.707 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:46:45.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:46:45.771 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:47:15.833 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:47:15.836 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:47:45.912 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:47:45.915 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:48:15.978 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:48:15.982 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:48:46.042 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:48:46.044 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:49:16.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:49:16.110 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:49:46.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:49:46.182 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:50:16.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:50:16.239 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:50:46.317 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:50:46.321 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:51:16.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:51:16.383 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:51:46.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:51:46.451 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:52:16.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:52:16.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:52:46.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:52:46.588 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:53:16.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:53:16.658 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:53:46.713 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:53:46.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:54:16.774 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:54:16.777 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:54:46.835 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:54:46.841 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:55:16.920 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:55:16.923 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:55:46.984 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:55:46.987 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:56:17.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:56:17.067 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:56:47.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:56:47.123 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:57:17.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:57:17.198 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:57:47.272 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:57:47.274 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:58:17.355 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:58:17.368 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:58:47.426 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:58:47.429 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:59:17.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:59:17.519 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:59:47.580 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T14:59:47.719 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:00:17.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:00:17.814 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:00:47.942 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:00:47.945 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:01:18.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:01:18.083 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:01:48.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:01:48.159 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:02:18.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:02:18.238 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:02:48.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:02:48.295 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:03:18.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:03:18.368 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:03:48.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:03:48.430 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:04:18.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:04:18.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:04:48.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:04:48.553 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:05:18.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:05:18.630 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:05:48.692 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:05:48.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:06:18.769 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:06:18.772 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:06:48.829 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:06:48.832 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:07:18.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:07:18.905 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:07:48.966 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:07:48.969 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:08:19.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:08:19.025 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:08:49.086 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:08:49.089 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:09:19.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:09:19.178 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:09:49.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:09:49.240 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:10:19.321 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:10:19.323 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:10:49.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:10:49.386 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:11:19.449 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:11:19.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:11:49.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:11:49.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:12:19.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:12:19.589 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:12:49.648 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:12:49.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:13:19.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:13:19.707 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:13:49.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:13:49.770 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:14:19.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:14:19.887 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:14:49.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:14:49.957 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:15:20.018 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:15:20.021 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:15:50.091 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:15:50.095 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:16:20.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:16:20.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:16:50.208 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:16:50.211 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:17:20.266 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:17:20.269 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:17:50.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:17:50.356 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:18:20.419 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:18:20.422 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:18:50.500 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:18:50.503 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:19:20.560 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:19:20.563 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:19:50.624 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:19:50.627 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:20:20.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:20:20.704 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:20:50.776 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:20:50.779 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:21:20.857 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:21:20.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:21:50.935 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:21:50.937 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:22:21.001 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:22:21.005 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:22:51.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:22:51.066 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:23:21.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:23:21.131 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:23:51.192 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:23:51.196 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:24:21.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:24:21.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:24:51.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:24:51.332 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:25:21.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:25:21.397 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:25:51.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:25:51.462 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:26:21.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:26:21.541 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:26:51.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:26:51.597 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:27:21.657 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:27:21.659 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:27:51.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:27:51.724 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:28:21.793 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:28:21.797 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:28:51.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:28:51.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:29:21.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:29:21.933 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:29:51.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:29:51.991 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:30:22.066 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:30:22.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:30:52.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:30:52.133 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:31:22.211 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:31:22.214 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:31:52.278 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:31:52.281 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:32:22.348 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:32:22.351 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:32:52.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:32:52.411 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:33:22.492 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:33:22.495 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:33:52.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:33:52.558 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:34:22.620 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:34:22.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:34:52.693 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:34:52.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:35:22.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:35:22.757 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:35:52.810 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:35:52.813 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:36:22.886 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:36:22.889 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:36:52.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:36:52.967 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:37:23.036 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:37:23.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:37:53.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:37:53.114 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:38:23.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:38:23.176 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:38:53.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:38:53.240 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:39:23.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:39:23.290 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:39:53.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:39:53.362 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:40:23.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:40:23.434 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:40:53.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:40:53.516 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:41:23.577 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:41:23.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:41:53.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:41:53.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:42:23.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:42:23.757 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:42:53.827 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:42:53.829 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:43:23.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:43:23.904 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:43:53.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:43:53.965 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:44:24.034 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:44:24.037 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:44:54.110 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:44:54.114 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:45:24.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:45:24.178 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:45:54.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:45:54.238 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:46:24.299 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:46:24.302 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:46:54.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:46:54.380 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:47:24.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:47:24.440 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:47:54.494 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:47:54.497 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:48:24.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:48:24.562 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:48:54.631 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:48:54.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:49:24.690 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:49:24.692 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:49:54.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:49:54.757 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:50:24.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:50:24.821 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:50:54.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:50:54.887 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:51:24.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:51:24.954 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:51:55.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:51:55.035 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:52:25.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:52:25.102 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:52:55.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:52:55.167 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:53:25.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:53:25.239 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:53:55.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:53:55.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:54:25.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:54:25.369 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:54:55.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:54:55.451 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:55:25.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:55:25.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:55:55.591 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:55:55.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:56:25.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:56:25.677 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:56:55.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:56:55.825 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:57:25.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:57:25.950 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:57:56.019 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:57:56.021 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:58:26.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:58:26.161 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:58:56.298 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:58:56.301 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:59:26.429 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:59:26.433 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:59:56.568 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T15:59:56.571 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:00:26.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:00:26.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:00:56.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:00:56.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:01:26.928 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:01:26.931 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:01:57.085 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:01:57.088 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:02:27.225 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:02:27.227 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:02:57.342 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:02:57.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:03:27.471 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:03:27.474 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:03:57.577 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:03:57.580 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:04:27.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:04:27.652 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:04:57.764 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:04:57.767 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:05:27.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:05:27.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:05:57.960 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:05:57.963 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:06:28.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:06:28.026 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:06:58.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:06:58.158 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:07:28.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:07:28.330 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:07:58.483 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:07:58.486 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:08:28.614 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:08:28.616 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:08:58.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:08:58.778 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:09:28.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:09:28.846 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:09:58.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:09:58.985 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:10:29.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:10:29.143 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:10:59.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:10:59.293 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:11:29.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:11:29.430 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:11:59.573 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:11:59.578 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:12:29.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:12:29.734 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:12:59.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:12:59.896 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:13:29.974 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:13:29.977 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:14:00.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:14:00.076 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:14:30.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:14:30.198 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:15:00.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:15:00.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:15:30.400 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:15:30.402 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:16:00.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:16:00.542 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:16:30.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:16:30.674 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:17:00.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:17:00.846 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:17:30.975 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:17:30.979 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:18:01.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:18:01.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:18:31.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:18:31.290 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:19:01.426 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:19:01.429 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:19:31.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:19:31.492 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:20:01.638 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:20:01.641 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:20:31.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:20:31.789 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:21:01.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:21:01.867 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:21:32.011 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:21:32.209 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:22:02.266 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:22:02.269 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:22:32.395 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:22:32.398 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:23:02.541 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:23:02.545 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:23:32.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:23:32.609 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:24:02.663 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:24:02.666 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:24:32.727 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:24:32.730 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:25:02.787 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:25:02.790 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:25:32.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:25:32.848 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:26:02.931 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:26:02.933 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:26:32.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:26:32.988 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:27:03.049 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:27:03.052 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:27:33.112 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:27:33.115 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:28:03.243 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:28:03.246 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:28:33.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:28:33.448 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:29:03.520 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:29:03.523 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:29:33.660 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:29:33.663 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:30:03.815 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:30:03.818 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:30:33.971 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:30:33.974 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:31:04.128 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:31:04.131 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:31:34.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:31:34.208 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:32:04.345 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:32:04.349 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:32:34.413 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:32:34.417 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:33:04.589 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:33:04.593 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:33:34.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:33:34.757 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:34:04.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:34:04.944 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:34:35.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:34:35.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:35:05.162 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:35:05.165 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:35:35.294 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:35:35.298 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:36:05.449 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:36:05.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:36:35.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:36:35.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:37:05.652 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:37:05.656 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:37:35.732 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:37:35.735 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:38:05.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:38:05.883 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:38:36.019 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:38:36.022 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:39:06.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:39:06.177 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:39:36.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:39:36.291 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:40:06.353 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:40:06.356 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:40:36.426 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:40:36.429 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:41:06.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:41:06.493 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:41:36.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:41:36.556 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:42:06.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:42:06.620 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:42:36.691 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:42:36.694 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:43:06.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:43:06.773 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:43:36.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:43:36.906 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:44:07.032 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:44:07.035 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:44:37.170 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:44:37.174 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:45:07.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:45:07.306 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:45:37.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:45:37.385 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:46:07.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:46:07.516 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:46:37.576 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:46:37.579 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:47:07.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:47:07.719 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:47:37.780 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:47:37.783 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:48:07.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:48:07.956 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:48:38.110 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:48:38.113 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:49:08.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:49:08.218 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:49:38.372 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:49:38.375 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:50:08.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:50:08.514 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:50:38.641 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:50:38.644 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:51:08.747 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:51:08.751 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:51:38.827 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:51:38.830 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:52:08.892 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:52:08.894 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:52:38.956 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:52:38.959 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:53:09.045 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:53:09.048 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:53:39.110 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:53:39.113 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:54:09.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:54:09.175 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:54:39.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:54:39.240 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:55:09.296 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:55:09.299 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:55:39.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:55:39.379 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:56:09.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:56:09.443 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:56:39.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:56:39.504 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:57:09.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:57:09.571 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:57:39.630 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:57:39.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:58:09.696 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:58:09.701 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:58:39.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:58:39.781 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:59:09.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:59:09.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:59:39.919 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T16:59:39.922 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:00:09.981 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:00:09.984 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:00:40.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:00:40.052 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:01:10.113 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:01:10.117 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:01:40.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:01:40.264 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:02:10.342 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:02:10.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:02:40.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:02:40.418 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:03:10.471 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:03:10.474 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:03:40.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:03:40.557 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:04:10.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:04:10.637 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:04:40.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:04:40.702 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:05:10.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:05:10.769 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:05:40.856 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:05:40.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:06:10.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:06:10.920 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:06:40.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:06:40.986 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:07:11.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:07:11.065 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:07:41.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:07:41.136 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:08:11.198 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:08:11.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:08:41.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:08:41.303 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:09:11.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:09:11.368 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:09:41.429 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:09:41.433 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:10:11.503 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:10:11.506 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:10:41.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:10:41.573 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:11:11.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:11:11.652 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:11:41.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:11:41.724 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:12:11.795 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:12:11.798 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:12:41.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:12:41.853 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:13:11.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:13:11.928 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:13:41.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:13:41.993 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:14:12.078 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:14:12.081 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:14:42.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:14:42.155 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:15:12.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:15:12.279 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:15:42.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:15:42.418 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:16:12.604 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:16:12.607 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:16:42.669 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:16:42.672 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:17:12.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:17:12.803 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:17:42.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:17:42.884 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:18:12.961 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:18:12.964 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:18:43.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:18:43.104 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:19:13.191 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:19:13.194 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:19:43.371 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:19:43.374 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:20:13.502 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:20:13.506 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:20:43.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:20:43.637 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:21:13.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:21:13.793 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:21:43.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:21:43.907 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:22:14.018 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:22:14.020 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:22:44.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:22:44.178 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:23:14.540 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:23:14.543 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:23:44.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:23:44.606 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:24:14.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:24:14.737 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:24:44.798 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:24:44.800 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:25:14.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:25:14.950 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:25:45.052 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:25:45.056 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:26:15.194 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:26:15.205 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:26:45.283 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:26:45.285 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:27:15.405 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:27:15.408 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:27:45.553 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:27:45.556 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:28:15.684 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:28:15.687 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:28:45.839 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:28:45.842 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:29:15.961 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:29:15.964 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:29:46.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:29:46.110 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:30:16.345 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:30:16.348 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:30:46.412 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:30:46.416 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:31:16.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:31:16.559 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:31:46.703 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:31:46.705 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:32:16.857 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:32:16.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:32:46.920 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:32:46.925 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:33:17.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:33:17.063 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:33:47.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:33:47.139 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:34:17.208 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:34:17.211 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:34:47.272 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:34:47.275 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:35:17.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:35:17.347 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:35:47.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:35:47.411 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:36:17.497 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:36:17.501 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:36:47.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:36:47.565 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:37:17.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:37:17.635 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:37:47.689 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:37:47.692 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:38:17.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:38:17.765 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:38:47.826 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:38:47.829 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:39:17.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:39:17.902 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:39:48.004 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:39:48.007 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:40:18.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:40:18.121 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:40:48.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:40:48.219 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:41:18.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:41:18.307 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:41:48.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:41:48.413 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:42:18.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:42:18.535 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:42:48.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:42:48.682 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:43:18.793 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:43:18.796 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:43:48.882 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:43:48.885 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:44:19.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:44:19.058 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:44:49.226 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:44:49.229 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:45:19.291 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:45:19.294 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:45:49.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:45:49.433 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:46:19.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:46:19.509 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:46:49.631 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:46:49.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:47:19.737 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:47:19.740 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:47:49.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:47:49.880 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:48:20.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:48:20.010 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:48:50.138 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:48:50.141 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:49:20.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:49:20.213 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:49:50.283 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:49:50.286 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:50:20.421 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:50:20.424 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:50:50.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:50:50.522 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:51:20.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:51:20.677 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:51:50.830 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:51:50.833 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:52:20.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:52:20.980 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:52:51.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:52:51.239 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:53:21.355 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:53:21.358 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:53:51.419 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:53:51.422 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:54:21.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:54:21.519 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:54:51.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:54:51.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:55:21.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:55:21.775 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:55:51.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:55:51.854 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:56:22.006 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:56:22.009 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:56:52.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:56:52.149 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:57:22.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:57:22.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:57:52.361 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:57:52.365 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:58:22.460 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:58:22.464 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:58:52.524 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:58:52.527 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:59:22.597 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:59:22.600 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:59:52.696 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T17:59:52.700 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:00:22.852 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:00:22.855 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:00:52.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:00:52.929 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:01:23.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:01:23.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:01:53.212 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:01:53.215 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:02:23.309 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:02:23.312 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:02:53.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:02:53.393 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:03:23.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:03:23.542 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:03:53.681 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:03:53.684 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:04:23.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:04:23.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:04:53.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:04:53.964 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:05:24.052 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:05:24.055 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:05:54.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:05:54.196 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:06:24.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:06:24.336 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:06:54.466 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:06:54.469 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:07:24.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:07:24.600 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:07:54.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:07:54.683 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:08:24.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:08:24.807 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:08:54.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:08:54.956 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:09:25.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:09:25.054 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:09:55.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:09:55.139 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:10:25.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:10:25.259 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:10:55.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:10:55.393 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:11:25.553 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:11:25.556 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:11:55.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:11:55.621 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:12:25.750 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:12:25.753 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:12:55.814 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:12:55.817 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:13:25.893 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:13:25.896 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:13:55.952 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:13:55.955 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:14:26.032 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:14:26.036 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:14:56.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:14:56.110 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:15:26.189 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:15:26.192 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:15:56.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:15:56.247 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:16:26.368 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:16:26.371 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:16:56.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:16:56.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:17:26.630 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:17:26.633 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:17:56.695 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:17:56.698 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:18:26.776 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:18:26.779 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:18:56.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:18:56.902 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:19:26.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:19:26.976 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:19:57.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:19:57.066 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:20:27.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:20:27.157 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:20:57.283 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:20:57.286 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:21:27.456 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:21:27.459 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:21:57.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:21:57.708 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:22:27.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:22:27.789 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:22:57.883 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:22:57.886 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:23:28.006 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:23:28.009 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:23:58.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:23:58.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:24:28.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:24:28.263 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:24:58.399 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:24:58.402 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:25:28.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:25:28.530 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:25:58.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:25:58.724 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:26:28.835 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:26:28.838 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:26:58.907 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:26:58.910 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:27:29.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:27:29.058 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:27:59.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:27:59.172 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:28:29.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:28:29.303 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:28:59.456 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:28:59.459 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:29:29.579 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:29:29.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:29:59.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:29:59.739 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:30:29.841 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:30:29.844 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:30:59.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:30:59.975 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:31:30.087 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:31:30.090 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:32:00.218 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:32:00.221 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:32:30.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:32:30.362 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:33:00.489 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:33:00.492 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:33:30.662 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:33:30.665 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:34:00.802 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:34:00.804 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:34:30.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:34:30.868 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:35:00.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:35:00.921 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:35:31.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:35:31.029 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:36:01.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:36:01.100 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:36:31.240 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:36:31.243 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:37:01.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:37:01.383 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:37:31.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:37:31.511 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:38:01.630 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:38:01.633 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:38:31.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:38:31.746 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:39:01.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:39:01.808 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:39:31.959 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:39:31.963 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:40:02.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:40:02.110 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:40:32.269 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:40:32.272 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:41:02.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:41:02.410 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:41:32.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:41:32.565 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:42:02.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:42:02.686 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:42:32.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:42:32.760 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:43:02.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:43:02.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:43:32.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:43:32.887 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:44:02.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:44:02.960 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:44:33.037 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:44:33.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:45:03.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:45:03.103 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:45:33.190 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:45:33.193 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:46:03.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:46:03.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:46:33.325 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:46:33.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:47:03.397 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:47:03.400 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:47:33.460 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:47:33.463 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:48:03.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:48:03.591 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:48:33.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:48:33.684 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:49:03.745 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:49:03.748 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:49:33.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:49:33.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:50:03.960 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:50:03.963 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:50:34.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:50:34.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:51:04.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:51:04.134 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:51:34.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:51:34.262 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:52:04.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:52:04.393 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:52:34.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:52:34.558 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:53:04.719 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:53:04.722 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:53:34.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:53:34.852 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:54:04.979 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:54:04.982 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:54:35.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:54:35.155 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:55:05.217 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:55:05.220 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:55:35.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:55:35.384 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:56:05.451 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:56:05.454 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:56:35.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:56:35.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:57:05.600 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:57:05.603 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:57:35.673 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:57:35.675 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:58:05.774 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:58:05.777 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:58:35.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:58:35.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:59:06.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:59:06.057 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:59:36.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T18:59:36.196 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:00:06.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:00:06.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:00:36.326 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:00:36.329 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:01:06.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:01:06.401 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:01:36.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:01:36.491 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:02:06.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:02:06.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:02:36.620 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:02:36.622 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:03:06.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:03:06.686 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:03:36.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:03:36.765 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:04:06.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:04:06.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:04:36.907 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:04:36.910 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:05:06.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:05:06.969 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:05:37.036 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:05:37.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:06:07.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:06:07.112 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:06:37.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:06:37.179 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:07:07.238 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:07:07.240 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:07:37.377 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:07:37.380 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:08:07.541 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:08:07.544 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:08:37.706 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:08:37.709 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:09:07.935 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:09:07.939 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:09:38.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:09:38.023 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:10:08.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:10:08.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:10:38.270 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:10:38.272 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:11:08.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:11:08.396 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:11:38.547 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:11:38.551 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:12:08.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:12:08.697 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:12:38.847 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:12:38.851 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:13:08.908 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:13:08.911 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:13:38.979 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:13:38.981 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:14:09.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:14:09.124 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:14:39.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:14:39.263 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:15:09.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:15:09.384 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:15:39.458 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:15:39.461 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T19:15:42.053 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-07-21T19:15:42.054 DEBUG:teuthology.task.console_log:Killing console logger for smithi006 2023-07-21T19:15:42.054 DEBUG:teuthology.task.console_log:Killing console logger for smithi086 2023-07-21T19:15:42.055 DEBUG:teuthology.exit:Finished running handlers